Out of Resource Handling of FIB Resources
The main function of the FIB within routers/line-cards is to map destination IP prefixes/labels to potential egress interfaces. In order to achieve this, the FIB maintains multiple databases or hardware tables, such as:
-
Forward Equivalence Class (FEC) and the Equal Cost Multi-Path Forward Equivalence Class (ECMP FEC): This database mainly stores information related to the IPv4 and IPv6 prefixes that the router has learnt. When a traffic packet reaches the router, it performs a FIB lookup on the destination prefix of the incoming packet. This lookup results in the FEC or ECMP FEC object for that particular prefix and it provides information about the egress interface on the router through which the packet can reach its destination.
OOR Protection Mode
When the FIB resource usage exceeds the red threshold, the system enters OOR protection mode.
In FEC OOR protection mode, the router doesn’t allocate any FEC objects when it learns a new prefix, but assigns a pre-created drop FEC instead. The router drops incoming packets with destination IP addresses that were assigned the drop FEC.
In ECMP FEC OOR protection mode, the router chooses only the first path among multiple paths to forward traffic. When FEC or ECMP FEC usage drops below yellow threshold, the router reprograms the affected prefixes to normal FEC or ECMP FEC. Thereafter, the router resumes traffic flow.
Configuration Steps to Change OOR Threshold Levels
The following section shows how to change the default threshold levels for OOR handling.
Router# conf t
Router(config)# oor hw threshold red 90
Router(config)# oor hw threshold yellow 75
Router(config)# commitRelease Stale FEC Resources
To release the stale FEC resources, execute the following command:
Router# clear cefVerification of FEC Resources
Use show controllers npu resources the command to verify FIB resources.
The OOR State in the output of the show controllers npu resources command changes when the router reaches an OOR situation. The OOR State changes from Green to Yellow, and finally to Red depending on the utilization of FEC or ECMP FEC resources.
The router processes several entries and often stores these entries in the form of tables. These tables are further divided into smaller tables. These smaller tables are called as banks. The banks are often named as bank_0, bank_1, bank_2, and so on. Router segregates the entries through these banks.
Router# show controllers npu resources fec location 1/0/CPU0
HW Resource Information For Location: 0/1/CPU0
HW Resource Information
Name : encap
Asic Type : Jericho
NPU-0
OOR Summary
Red Threshold : 95 %
Yellow Threshold : 80 %
OFA Table Information
(May not match HW usage)
ipnh : 9
ip6nh : 0
mplsnh : 10984
llnh : 0
srv6nh : 0
ipvrf : 1
mplsmdtbud : 0
iptunnelencap : 0
tep : 0
Current Hardware Usage
Name: encap
Name: bank_0
Estimated Max Entries : 4096
Total In-Use : 2394 (58 %)
OOR State : Green
OOR State Change Time : 2021.Apr.16 00:22:36 WIB
Bank Info : phase=2 extended=no
--More--
Name: bank_1
Estimated Max Entries : 4096
Total In-Use : 12 (0 %)
OOR State : Green
Bank Info : phase=8 extended=no
Name: bank_2
Estimated Max Entries : 4096
Total In-Use : 9 (0 %)
OOR State : Green
Bank Info : phase=4 extended=no
Name: bank_3
Estimated Max Entries : 4096
Total In-Use : 2 (0 %)
OOR State : Green
OOR State Change Time : 2021.May.02 11:37:03 WIB
Bank Info : phase=2 extended=no
Name: bank_4
Estimated Max Entries : 4096
Total In-Use : 0 (0 %)
OOR State : Green
Bank Info : phase=0 extended=no
Name: bank_5
Estimated Max Entries : 4096
Total In-Use : 0 (0 %)
OOR State : Green
Bank Info : phase=0 extended=no
Name: bank_6
Estimated Max Entries : 4096
Total In-Use : 4096 (100 %)
OOR State : Red
OOR State Change Time : 2021.Apr.24 19:39:09 WIB
Bank Info : phase=1 extended=no
Name: bank_7
Estimated Max Entries : 4096
Total In-Use : 3 (0 %)
OOR State : Green
Bank Info : phase=4 extended=no
Name: bank_8
Estimated Max Entries : 4096
Total In-Use : 4096 (100 %)
OOR State : Red
OOR State Change Time : 2021.Apr.28 02:56:28 WIB
Bank Info : phase=1 extended=no
Name: bank_9
Estimated Max Entries : 4096
Total In-Use : 2477 (60 %)
OOR State : GreenVerification of EEDB Resources
Use show controllers npu resources encap command to verify the usage of EEDB resources.
The OOR State in the output of the show controllers npu resources encap command changes when the router reaches an OOR situation. The OOR State changes from Green to Yellow, and finally to Red depending on the utilization of the EEDB resources.
Router# show controllers npu resources encap location 1/0/CPU0
HW Resource Information
Name : encap
Asic Type : Jericho
NPU-0
OOR Summary
Red Threshold : 95 %
Yellow Threshold : 80 %
OFA Table Information
(May not match HW usage)
ipnh : 13
ip6nh : 0
mplsnh : 0
llnh : 0
srv6nh : 0
ipvrf : 0
mplsmdtbud : 0
iptunnelencap : 0
tep : 0
Current Hardware Usage
Name: encap
Name: bank_0
Estimated Max Entries : 4096
Total In-Use : 4096 (100 %)
OOR State : Red
OOR State Change Time : 2022.Mar.15 05:33:14 UTC
Bank Info : phase=2 extended=no
Name: bank_1
Estimated Max Entries : 4096
Total In-Use : 4 (0 %)
OOR State : Green
Bank Info : phase=8 extended=no
Name: bank_2
Estimated Max Entries : 4096
Total In-Use : 0 (0 %)
OOR State : Green
Bank Info : phase=0 extended=no
Name: bank_3
Estimated Max Entries : 4096
Total In-Use : 0 (0 %)
OOR State : Green
Bank Info : phase=0 extended=no
Feedback