Feature History for Configuring Link Bundles
Release | Modification |
---|---|
Release 5.2.1 | This feature was introduced. |
The documentation set for this product strives to use bias-free language. For the purposes of this documentation set, bias-free is defined as language that does not imply discrimination based on age, disability, gender, racial identity, ethnic identity, sexual orientation, socioeconomic status, and intersectionality. Exceptions may be present in the documentation due to language that is hardcoded in the user interfaces of the product software, language used based on RFP documentation, or language that is used by a referenced third-party product. Learn more about how Cisco is using Inclusive Language.
A bundle is a group of one or more ports that are aggregated together and treated as a single link. The different links within a single bundle can have varying speeds, where the fastest link can be a maximum of ten times greater than the slowest link. Each bundle has a single MAC, a single IP address, and a single configuration set (such as ACLs or QoS).
The router supports bundling for these types of interfaces:
Ethernet interfaces
Note |
Bundles do not have a one-to-one modular services card association. |
Release | Modification |
---|---|
Release 5.2.1 | This feature was introduced. |
Before configuring Link Bundling, be sure that these tasks and conditions are met:
You must be in a user group associated with a task group that includes the proper task IDs. The command reference guides include the task IDs required for each command.
If you suspect user group assignment is preventing you from using a command, contact your AAA administrator for assistance.
You know the interface IP address.
You know which links should be included in the bundle you are configuring.
If you are configuring an Ethernet link bundle, you have at least one of these Ethernet line cards installed in the router:
NCS 6000 10x100G Multi-Service CXPv
NCS 6000 10x100G Multi-Service CPAK
Cisco PANINI 60-ports 10GE SFP Optics LC
Note |
For more information about physical interfaces, PLIMs, and modular services cards, refer to the Cisco Network Convergence System 6000 Series Routers Hardware Installation Guide . |
To implement the Link Bundling feature, you must understand these concepts:
A link bundle is simply a group of ports that are bundled together and act as a single link. The advantages of link bundles are these:
Multiple links can span several line cards to form a single interface. Thus, the failure of a single link does not cause a loss of connectivity.
Bundled interfaces increase bandwidth availability, because traffic is forwarded over all available members of the bundle. Therefore, traffic can flow on the available links if one of the links within a bundle fails. Bandwidth can be added without interrupting packet flow.
Although the individual links within a single bundle can have varying speeds, all links within a bundle must be of the same type.
Cisco IOS XR software supports these methods of forming bundles of Ethernet interfaces:
IEEE 802.3ad—Standard technology that employs a Link Aggregation Control Protocol (LACP) to ensure that all the member links in a bundle are compatible. Links that are incompatible or have failed are automatically removed from a bundle.
EtherChannel—Cisco proprietary technology that allows the user to configure links to join a bundle, but has no mechanisms to check whether the links in a bundle are compatible.
This list describes the properties and limitations of link bundles:
Any type of Ethernet interfaces can be bundled, with or without the use of LACP (Link Aggregation Control Protocol).
Bundle membership can span across several line cards that are installed in a single router.
The Cisco NCS 6000 Series Router supports a maximum of 256 ethernet link bundles. Each link bundle can have a maximum of 64 member links.
A single bundle supports maximum of 64 physical links.
Different link speeds are allowed within a single bundle, with a maximum of ten times the speed difference between the members of the bundle.
Physical layer and link layer configuration are performed on individual member links of a bundle.
Configuration of network layer protocols and higher layer applications is performed on the bundle itself.
A bundle can be administratively enabled or disabled.
Each individual link within a bundle can be administratively enabled or disabled.
Ethernet link bundles are created in the same way as Ethernet channels, where the user enters the same configuration on both end systems.
The MAC address that is set on the bundle becomes the MAC address of the links within that bundle.
When LACP configured, each link within a bundle can be configured to allow different keepalive periods on different members.
Load balancing (the distribution of data between member links) is done by flow instead of by packet. Data is distributed to a link in proportion to the bandwidth of the link in relation to its bundle.
QoS is supported and is applied proportionally on each bundle member.
Link layer protocols, such as CDP and HDLC keepalives, work independently on each link within a bundle.
Upper layer protocols, such as routing updates and hellos, are sent over any member link of an interface bundle.
Bundled interfaces are point to point.
A link must be in the up state before it can be in distributing state in a bundle.
All links within a single bundle must be configured either to run 802.3ad (LACP) or Etherchannel (non-LACP). Mixed links within a single bundle are not supported.
A bundle interface can contain physical links only.
Access Control List (ACL) configuration on link bundles is identical to ACL configuration on regular interfaces.
Multicast traffic is load balanced over the members of a bundle. For a given flow, internal processes select the member link and all traffic for that flow is sent over that member.
The IEEE 802.3ad standard typically defines a method of forming Ethernet link bundles.
For each link configured as bundle member, this information is exchanged between the systems that host each end of the link bundle:
A globally unique local system identifier
An identifier (operational key) for the bundle of which the link is a member
An identifier (port ID) for the link
The current aggregation status of the link
This information is used to form the link aggregation group identifier (LAG ID). Links that share a common LAG ID can be aggregated. Individual links have unique LAG IDs.
The system identifier distinguishes one router from another, and its uniqueness is guaranteed through the use of a MAC address from the system. The bundle and link identifiers have significance only to the router assigning them, which must guarantee that no two links have the same identifier, and that no two bundles have the same identifier.
The information from the peer system is combined with the information from the local system to determine the compatibility of the links configured to be members of a bundle.
Bundle MAC addresses in the routers come from a set of reserved MAC addresses in the backplane. This MAC address stays with the bundle as long as the bundle interface exists. The bundle uses this MAC address until the user configures a different MAC address. The bundle MAC address is used by all member links when passing bundle traffic. Any unicast or multicast addresses set on the bundle are also set on all the member links.
Note |
We recommend that you avoid modifying the MAC address, because changes in the MAC address can affect packet forwarding. |
802.1Q VLAN subinterfaces can be configured on 802.3ad Ethernet link bundles. Keep this information in mind when adding VLANs on an Ethernet link bundle:
The maximum number of VLANs allowed per bundle is 4000.
The maximum number of bundled VLANs allowed per router is 128000.
Note |
The memory requirement for bundle VLANs is slightly higher than standard physical interfaces. |
To create a VLAN subinterface on a bundle, include the VLAN subinterface instance with the interface Bundle-Ether command:
interface Bundle-Ether instance.subinterface
After you create a VLAN on an Ethernet link bundle, all physical VLAN subinterface configuration is supported on that link bundle.
These steps provide a general overview of the link bundle configuration process. Keep in mind that a link must be cleared of all previous network layer configuration before it can be added to a bundle:
In global configuration mode, create a link bundle. To create an Ethernet link bundle, enter the interface Bundle-Ether command.
Assign an IP address and subnet mask to the virtual interface using the ipv4 address command.
Add interfaces to the bundle you created in Step 1 with the bundle id command in the interface configuration submode. You can add up to 32 links to a single bundle.
Note |
A link is configured to be a member of a bundle from the interface configuration submode for that link. |
The Cisco IOS XR software supports nonstop forwarding during failover between active and standby paired RSP cards. Nonstop forwarding ensures that there is no change in the state of the link bundles when a failover occurs.
For example, if an active RSP fails, the standby RSP becomes operational. The configuration, node state, and checkpoint data of the failed RSP are replicated to the standby RSP. The bundled interfaces will all be present when the standby RSP becomes the active RSP.
Note |
Failover is always onto the standby RSP. |
Note |
You do not need to configure anything to guarantee that the standby interface configurations are maintained. |
When one member link in a bundle fails, traffic is redirected to the remaining operational member links and traffic flow remains uninterrupted.
A bundle is a group of one or more ports that are aggregated together and treated as a single link. The different links within a single bundle can have varying speeds, where the fastest link can be a maximum of four times greater than the slowest link. Each bundle has a single MAC, a single IP address, and a single configuration set (such as ACLs or QoS).
The router supports bundling for these types of interfaces:
Ethernet interfaces
VLAN subinterfaces
This section describes how to configure a Ethernet link bundle.
Note |
MAC accounting is not supported on Ethernet link bundles. |
Note |
In order for an Ethernet bundle to be active, you must perform the same configuration on both connection endpoints of the bundle. |
The creation of an Ethernet link bundle involves creating a bundle and adding member interfaces to that bundle, as shown in the steps that follow.
Step 1 |
configure Example:
Enters the XR Config mode. |
||
Step 2 |
interface Bundle-Ether bundle-id Example:
Creates and names a new Ethernet link bundle. This interface Bundle-Ether command enters you into the interface configuration submode, where you can enter interface specific configuration commands are entered. Use the exit command to exit from the interface configuration submode back to the normal XR Config mode. |
||
Step 3 |
ipv4 address ipv4-address-address mask Example:
Assigns an IP address and subnet mask to the virtual interface using the ipv4 address configuration subcommand. |
||
Step 4 |
bundle minimum-active bandwidth kbps (optional) Example:
Sets the minimum amount of bandwidth required before a user can bring up a bundle. |
||
Step 5 |
bundle minimum-active links links (optional) Example:
Sets the number of active links required before you can bring up a specific bundle. |
||
Step 6 |
bundle maximum-active links links (optional) Example:
Designates one active link and one link in standby mode that can take over immediately for a bundle if the active link fails (1:1 protection). The default number of active links allowed in a single bundle is 8.
|
||
Step 7 |
bundle maximum-active links links hot-standby Example:
The hot-standby keyword helps to avoid bundle flaps on a switchover or switchback event during which the bundle temporarily falls below the minimum links or bandwidth threshold. It sets default values for the wait-while timer and suppress-flaps timer to achieve this. |
||
Step 8 |
exit Example:
Exits interface configuration submode for the Ethernet link bundle. |
||
Step 9 |
interface TenGigE instance Example:
Enters the interface configuration mode for the specified interface. Enter the TenGigE keyword to specify the interface type. Replace the instance argument with the node-id in the rack/slot/module format.
|
||
Step 10 |
bundle id bundle-id [ mode { active | on | passive} ] Example:
Adds the link to the specified bundle. To enable active or passive LACP on the bundle, include the optional mode active or mode passive keywords in the command string. To add the link to the bundle without LACP support, include the optional mode on keywords with the command string.
|
||
Step 11 |
no shutdown(optional) Example:
|
||
Step 12 |
exit Example:
Exits interface configuration submode for the Ethernet link bundle. |
||
Step 13 |
Repeat Step 8 through Step 11 to add more links to the bundle you created in Step 2. |
||
Step 14 |
Use the commit or end command. commit - Saves the configuration changes and remains within the configuration session. end - Prompts user to take one of these actions:
|
||
Step 15 |
exit Example:
Exits interface configuration mode. |
||
Step 16 |
exit Example:
Exits the XR Config mode. |
||
Step 17 |
Perform Step 1 through Step 15 on the remote end of the connection. Brings up the other end of the link bundle. |
||
Step 18 |
show bundle Bundle-Ether bundle-id [ reasons ] (optional) Example:
Shows information about the specified Ethernet link bundle |
||
Step 19 |
show lacp Bundle-Ether bundle-id (optional) Example:
Shows detailed information about LACP ports and their peers. |
This section describes how to configure a VLAN bundle. The creation of a VLAN bundle involves three main tasks:
Create an Ethernet bundle.
Create VLAN subinterfaces and assign them to the Ethernet bundle.
Assign Ethernet links to the Ethernet bundle.
These tasks are describe in detail in the procedure that follows.
Note |
In order for a VLAN bundle to be active, you must perform the same configuration on both ends of the bundle connection. |
The creation of a VLAN link bundle is described in the steps that follow.
Step 1 |
configure Example:
Enters XR Config mode. |
||||
Step 2 |
interface Bundle-Ether bundle-id Example:
Creates and names a new Ethernet link bundle. This interface Bundle-Ether command enters you into the interface configuration submode, where you can enter interface specific configuration commands are entered. Use the exit command to exit from the interface configuration submode back to the normal XR Config mode |
||||
Step 3 |
ipv4 address ipv4-address mask Example:
Assigns an IP address and subnet mask to the virtual interface using the ipv4 address configuration subcommand. |
||||
Step 4 |
bundle minimum-active bandwidth kbps (optional) Example:
(Optional) Sets the minimum amount of bandwidth required before a user can bring up a bundle. |
||||
Step 5 |
bundle minimum-active links links (optional) Example:
(Optional) Sets the number of active links required before you can bring up a specific bundle. |
||||
Step 6 |
bundle maximum-active links links (optional) Example:
(Optional) Designates one active link and one link in standby mode that can take over immediately for a bundle if the active link fails (1:1 protection).
|
||||
Step 7 |
exit Example:
Exits interface configuration submode. |
||||
Step 8 |
interface Bundle-Ether bundle-id.vlan-id Example:
Creates a new VLAN, and assigns the VLAN to the Ethernet bundle you created in Step 2. Replace the bundle-id argument with the bundle-id you created in Step 2. Replace the vlan-id with a subinterface identifier. Range is from 1 to 4094 inclusive (0 and 4095 are reserved).
|
||||
Step 9 |
encapsulation dot1q vlan-id Example:
Assigns a VLAN to the subinterface. Replace the vlan-id argument with a subinterface identifier. Range is from 1 to 4094 inclusive (0 and 4095 are reserved). |
||||
Step 10 |
ipv4 address ip-address mask Example:
Assigns an IP address and subnet mask to the subinterface. |
||||
Step 11 |
no shutdown Example:
|
||||
Step 12 |
exit Example:
Exits subinterface configuration mode for the VLAN subinterface. |
||||
Step 13 |
Repeat Step 7 through Step 12 to add more VLANs to the bundle you created in Step 2. (Optional) Adds more subinterfaces to the bundle. |
||||
Step 14 |
Use the commit or end command. commit - Saves the configuration changes and remains within the configuration session. end - Prompts user to take one of these actions:
|
||||
Step 15 |
exit Example:
Exits interface configuration mode. |
||||
Step 16 |
exit Example:
Exits XR Config mode. |
||||
Step 17 |
show ethernet trunk bundle-Ether instance Example:
(Optional) Displays the interface configuration. The Ethernet bundle instance range is from 1 through 65535. |
||||
Step 18 |
configure Example:
Enters XR Config mode. |
||||
Step 19 |
interface TenGigE instance Example:
Enters the interface configuration mode for the specified interface. Replace the instance argument with the node-id in the rack/slot/module format.
|
||||
Step 20 |
bundle id bundle-id [mode {active | on | passive}] Example:
Adds an Ethernet interface to the bundle you configured in Step 2 through Step 13. To enable active or passive LACP on the bundle, include the optional mode active or mode passive keywords in the command string. To add the interface to the bundle without LACP support, include the optional mode on keywords with the command string.
|
||||
Step 21 |
no shutdown Example:
|
||||
Step 22 |
Repeat Step 19 through Step 21 to add more Ethernet interfaces to the bundle you created in Step 2 . |
||||
Step 23 |
Use the commit or end command. commit - Saves the configuration changes and remains within the configuration session. end - Prompts user to take one of these actions:
|
||||
Step 24 |
Perform Step 1 through Step 23 on the remote end of the connection. Brings up the other end of the link bundle. |
||||
Step 25 |
show bundle Bundle-Ether bundle-id [ reasons ] Example:
(Optional) Shows information about the specified Ethernet link bundle. The show bundle Bundle-Ether command displays information about the specified bundle. If your bundle has been configured properly and is carrying traffic, the State field in the show bundle Bundle-Ether command output will show the number “4,” which means the specified VLAN bundle port is “distributing.” |
||||
Step 26 |
show ethernet trunk bundle-Ether instance Example:
(Optional) Displays the interface configuration. The Ethernet bundle instance range is from 1 through 65535. |
This example shows how to join two ports to form an EtherChannel bundle running LACP:
RP/0/RSP0/CPU0:Router# config
RP/0/RSP0/CPU0:Router(config)# interface Bundle-Ether 3
RP/0/RSP0/CPU0:Router(config-if)# ipv4 address 1.2.3.4/24
RP/0/RSP0/CPU0:Router(config-if)# bundle minimum-active bandwidth 620000
RP/0/RSP0/CPU0:Router(config-if)# bundle minimum-active links 1
RP/0/RSP0/CPU0:Router(config-if)# exit
RP/0/RSP0/CPU0:Router(config)# interface TenGigE 0/3/0/0
RP/0/RSP0/CPU0:Router(config-if)# bundle id 3 mode active
RP/0/RSP0/CPU0:Router(config-if)# no shutdown
RP/0/RSP0/CPU0:Router(config)# exit
RP/0/RSP0/CPU0:Router(config)# interface TenGigE 0/3/0/1
RP/0/RSP0/CPU0:Router(config-if)# bundle id 3 mode active
RP/0/RSP0/CPU0:Router(config-if)# no shutdown
RP/0/RSP0/CPU0:Router(config-if)# exit
This example shows how to create and bring up two VLANs on an Ethernet bundle:
RP/0/RSP0/CPU0:Router# config
RP/0/RSP0/CPU0:Router(config)# interface Bundle-Ether 1
RP/0/RSP0/CPU0:Router(config-if)# ipv4 address 1.2.3.4/24
RP/0/RSP0/CPU0:Router(config-if)# bundle minimum-active bandwidth 620000
RP/0/RSP0/CPU0:Router(config-if)# bundle minimum-active links 1
RP/0/RSP0/CPU0:Router(config-if)# exit
RP/0/RSP0/CPU0:Router(config)# interface Bundle-Ether 1.1
RP/0/RSP0/CPU0:Router(config-subif)# encapsulation dot1q 10
RP/0/RSP0/CPU0:Router(config-subif)# ip addr 10.2.3.4/24
RP/0/RSP0/CPU0:Router(config-subif)# no shutdown
RP/0/RSP0/CPU0:Router(config-subif)# exit
RP/0/RSP0/CPU0:Router(config)# interface Bundle-Ether 1.2
RP/0/RSP0/CPU0:Router(config-subif)# encapsulation dot1q 20
RP/0/RSP0/CPU0:Router(config-subif)# ip addr 20.2.3.4/24
RP/0/RSP0/CPU0:Router(config-subif)# no shutdown
RP/0/RSP0/CPU0:Router(config-subif)# exit
RP/0/RSP0/CPU0:Router(config)#interface tengige 0/1/5/7
RP/0/RSP0/CPU0:Router(config-if)# bundle-id 1 mode act
RP/0/RSP0/CPU0:Router(config-if)# commit
RP/0/RSP0/CPU0:Router(config-if)# exit
RP/0/RSP0/CPU0:Router(config)# exit
RP/0/RSP0/CPU0:Router # show ethernet trunk bundle-ether 1
This example is an end-to-end example of a bundle between NCS 6000 Series router and a Cisco 7600 Series Router (P19_C7609-S) in the Metro Ethernet network that supports both L2 and L3 services.
On the Cisco NCS 6000 Series Routers, the bundle is configured with LACP, 1:1 link protection, two L2 subinterfaces, and two layer 3 subinterfaces.
hostname PE44_IOS-XR_Router
interface Bundle-Ether16
description Connect to P19_C7609-S Port-Ch 16
mtu 9216
no ipv4 address
bundle maximum-active links 1
!
interface Bundle-Ether16.160 l2transport
description Connect to P19_C7609-S Port-Ch 16 EFP 160
encapsulation dot1q 160
!
interface Bundle-Ether16.161 l2transport
description Connect to P19_C7609-S Port-Ch 16 EFP 161
encapsulation dot1q 161
!
interface Bundle-Ether16.162
description Connect to P19_C7609-S Port-Ch 16.162
ipv4 address 10.194.8.44 255.255.255.0
encapsulation dot1q 162
!
interface Bundle-Ether16.163
description Connect to P19_C7609-S Port-Ch 16.163
ipv4 address 10.194.12.44 255.255.255.0
encapsulation dot1q 163
!
interface TenGigE 0/1/0/16
description Connected to P19_C7609-S GE 8/0/16
bundle id 16 mode active
bundle port-priority 1
!
interface TenGigE 0/1/0/17
description Connected to P19_C7609-S GE 8/0/17
bundle id 16 mode active
bundle port-priority 2
!
hostname PE44_IOS-XR_Router
interface TenGigE 0/1/0/3.160 l2transport
description VLAN 160 over BE 16.160
encapsulation dot1q 100 second-dot1q 160
rewrite ingress tag pop 1 symmetric
!
interface TenGigE 0/1/0/3.161 l2transport
description VLAN 161 over BE 16.161
encapsulation dot1q 161
!
l2vpn
!
xconnect group 160
p2p 160
interface Bundle-Ether16.160
interface TenGigE 0/1/0/3.160
description VLAN_160_over_BE_16.160
!
!
xconnect group 161
p2p 161
interface Bundle-Ether16.161
interface TenGigE 0/1/0/3.161
description VLAN_161_over_BE_16.161
!
!
hostname PE64_C3750-ME
!
vlan 161
!
interface TenGigE 1/0/1
description Connected to PE65_ME-C3400 GE 0/1
switchport access vlan 100
switchport mode dot1q-tunnel
!
interface TenGigE 1/0/2
description Connected to PE44_IOS-XR_Router GE 0/1/0/3
switchport trunk encapsulation dot1q
switchport trunk allowed vlan 100,161
switchport mode trunk
!
interface Vlan161
description VLAN 161 over BE 16.161 on PE44
ip address 161.0.0.64 255.255.255.0
!
hostname PE65_ME-C3400
!
vlan 160
!
interface TenGigE 0/1
description Connected to PE64_C3750-ME GE 1/0/1
port-type nni
switchport trunk allowed vlan 160
switchport mode trunk
!
interface Vlan160
description VLAN 160 over BE 16.160 on PE44
ip address 160.0.0.65 255.255.255.0
!
hostname P19_C7609-S
port-channel load-balance src-dst-port
!
interface Port-channel16
description Connected to PE44_IOS-XR_Router BE 16
mtu 9202
no ip address
logging event link-status
logging event status
speed nonegotiate
mls qos trust dscp
lacp fast-switchover
lacp max-bundle 1
service instance 160 ethernet
description Connected to PE44_IOS-XR_Router BE 16.160
encapsulation dot1q 160
!
service instance 161 ethernet
description Connected to PE44_IOS-XR_Router BE 16.161
encapsulation dot1q 161
!
!
interface Port-channel16.162
description Connected to PE44_IOS-XR_Router BE 16.162
encapsulation dot1Q 162
ip address 10.194.8.19 255.255.255.0
!
interface Port-channel16.163
description Connected to PE44_IOS-XR_Router BE 16.163
encapsulation dot1Q 163
ip address 10.194.12.19 255.255.255.0
!
interface TenGigE 8/0/16
no shut
description Connected to PE44_IOS-XR_Router GE 0/1/0/16
mtu 9202
no ip address
logging event link-status
logging event status
speed nonegotiate
no mls qos trust dscp
lacp port-priority 1
channel-protocol lacp
channel-group 16 mode active
!
interface TenGigE 8/0/17
no shut
description Connected to PE44_IOS-XR_Router GE 0/1/0/17
mtu 9202
no ip address
logging event link-status
logging event status
speed nonegotiate
no mls qos trust dscp
lacp port-priority 2
channel-protocol lacp
channel-group 16 mode active
!
hostname P19_C7609-S
interface TenGigE 8/0/7
description Connected to PE62_C3750-ME GE 1/0/2
mtu 9000
no ip address
speed nonegotiate
mls qos trust dscp
service instance 160 ethernet
description VLAN 160 over Port-Ch 16
encapsulation dot1q 100 second-dot1q 160
rewrite ingress tag pop 1 symmetric
!
service instance 161 ethernet
description VLAN 161 over Port-Ch 16
encapsulation dot1q 161
!
!
connect eline-161 Port-channel16 161 TenGigE 8/0/7 161
!
!
connect eline-160 Port-channel16 160 TenGigE 8/0/7 160
!
!
hostname PE62_C3750-ME
!
vlan 161
!
interface TenGigE 1/0/1
description Connected to PE63_ME-C3400 GE 0/1
switchport access vlan 100
switchport mode dot1q-tunnel
!
interface TenGigE 1/0/2
description Connected to P19_C7609-S GE 8/0/7
switchport trunk encapsulation dot1q
switchport trunk allowed vlan 100,161
switchport mode trunk
!
interface Vlan161
description VLAN 161 over Port-Chan 16 on P19
ip address 161.0.0.62 255.255.255.0
!
hostname PE63_ME-C3400
!
vlan 160
!
interface TenGigE 0/1
description Connected to PE62_C3750-ME GE 1/0/1
port-type nni
switchport trunk allowed vlan 160
switchport mode trunk
!
interface Vlan160
description VLAN 160 over Port-Chan 16 on P19
ip address 160.0.0.63 255.255.255.0
!