本文档介绍如何在思科统一计算系统(UCS)和Nexus 5000交换机之间通过以太网光纤通道(FCoE)配置N端口ID虚拟化(NPIV)或N端口虚拟化(NPV)。
本文档中的信息基于以下软件和硬件版本:
本文档中的信息都是基于特定实验室环境中的设备编写的。本文档中使用的所有设备最初均采用原始(默认)配置。如果您使用的是真实网络,请确保您已经了解所有命令的潜在影响。
图1.配置中使用的拓扑
此处列出了两个步骤,可帮助您配置UCS:
请注意,在NPV模式下,UCS不支持非默认FC-Map。有关详细信息,请参阅Cisco Bug ID CSCuJ62005和CSCud78290:
创建FCoE VSAN
您需要在UCS中创建VSAN和FCoE VLAN以传输FCoE流量。最佳做法(但不是要求)是将VSAN ID与FCoE VLAN ID对齐,以帮助跟踪和排除故障。
名称 | 输入VSAN的名称 |
FC分区 | 已禁用 — 仅在实施本地分区功能时使用 |
交换矩阵单选按钮 | 选择交换矩阵A |
VSAN ID | 输入在交换矩阵A上创建的VSAN的VSAN ID — 这应与将在Nexus 5000-A上创建的VSAN ID对应 |
FCoE VLAN | 输入映射到此VSAN的VLAN的FCoE VLAN ID — 这应与Nexus 5000-A上将创建的VLAN ID相对应 |
名称 | 输入VSAN的名称 |
FC分区 | 已禁用 — 仅在实施本地分区功能时使用 |
交换矩阵单选按钮 | 选择交换矩阵B |
VSAN ID | 输入在交换矩阵B上创建的VSAN的VSAN ID — 这应与将在Nexus 5000-B上创建的VSAN ID对应 |
FCoE VLAN | 输入映射到此VSAN的VLAN的FCoE VLAN ID — 这应与将在Nexus 5000-B上创建的VLAN ID相对应 |
配置UCS FCoE端口通道
为FCoE和NPIV配置Nexus 5000需要几个步骤:
启用功能FCoE
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# feature fcoe
FC license checked out successfully
fc_plugin extracted successfully
FC plugin loaded successfully
FCoE manager enabled successfully
FC enabled on all modules successfully
Enabled FCoE QoS policies successfully
Nexus 5000-A# show feature | include fcoe
Feature Name Instance State
-------------------- -------- --------
fcoe 1 enabled
在Nexus 5000上启用NPIV
Nexus 5000-A# configuration terminal
Nexus 5000-A(config)# feature npiv
Nexus 5000-A# show npiv status
NPIV is enabled
在Nexus 5000上启用LACP
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# feature lacp
Nexus 5000-A#show feature | include LACP
Feature Name Instance State
-------------------- -------- --------
lacp 1 enabled
配置Nexus 5000 FCoE QoS参数
可配置的Cisco NX-OS QoS功能允许您对网络流量进行分类、确定流量的优先级,并提供拥塞避免。Nexus 5000上的默认QoS配置为FC和FCoE流量提供无损服务,为以太网流量提供尽力而为服务。默认情况下,Nexus 5000 FCoE QoS参数应已配置。
Nexus 5000-A# show startup-config ipqos
. .
system qos
service-policy type queuing input fcoe-default-in-policy
service-policy type queuing output fcoe-default-out-policy
service-policy type qos input fcoe-default-in-policy
service-policy type network-qos fcoe-default-nq-policy
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# system qos
Nexus 5000-A(config-sys-qos)# service-policy type qos input
fcoe-default-in-policy
Nexus 5000-A(config-sys-qos)# service-policy type queuing input
fcoe-default-in-policy
Nexus 5000-A(config-sys-qos)# service-policy type queuing output
fcoe-default-out-policy
Nexus 5000-A(config-sys-qos)# service-policy type network-qos
fcoe-default-nq-policy
Nexus 5000-A# show startup-config ipqos
..
system qos
service-policy type queuing input fcoe-default-in-policy
service-policy type queuing output fcoe-default-out-policy
service-policy type qos input fcoe-default-in-policy
service-policy type network-qos fcoe-default-nq-policy
创建Nexus 5000 VLAN
创建两个VLAN供FCoE使用。偶数应与FI-A关联,奇数应与FI-B关联。使用本文档配置UCS部分中指定的FCoE VLAN ID。
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# vlan 100
Nexus 5000-A(config-vlan)# name FCoE-VLAN100
Nexus 5000-A# show vlan brief
VLAN Name Status Ports
---- ----------------------------- --------- -------------------------------
1 default active Eth1/1, Eth1/2, Eth1/3, Eth1/4
Eth1/5, Eth1/6, Eth1/7, Eth1/8
.
100 FCoE-VLAN100 active
Nexus 5000-B# configure terminal
Nexus 5000-B(config)# vlan 101
Nexus 5000-B(config-vlan)# name FCoE-VLAN101
Nexus 5000-B# show vlan brief
VLAN Name Status Ports
---- ----------------------------- --------- -------------------------------
1 default active Eth1/1, Eth1/2, Eth1/3, Eth1/4
Eth1/5, Eth1/6, Eth1/7, Eth1/8
.
100 FCoE-VLAN101 active
创建Nexus 5000 VSAN
创建两个VSAN。偶数应与FI-A关联,奇数应与FI-B关联。使用本文档配置UCS部分中指定的VSAN ID。
Nexus 5000-A# configure terminal
Nexus 5000-A(config)#vsan database
Nexus 5000-A(config-vsan)# vsan 100
Nexus 5000-A(config-vsan)# vsan 100 name FCoE-VSAN100
Nexus 5000-A#show vsan 100
vsan 100 information
name:FCoE-VSAN100 state:active
interoperability mode:default
loadbalancing:src-id/dst-id/oxid
operational state:down
Nexus 5000-B# configure terminal
Nexus 5000-B(config)#vsan database
Nexus 5000-B(config-vsan)# vsan 101
Nexus 5000-B(config-vsan)# vsan 101 name FCoE-VSAN101
Nexus 5000-A# show vsan 101
vsan 101 information
name:FCoE-VSAN101 state:active
interoperability mode:default
loadbalancing:src-id/dst-id/oxid
operational state:down
将VLAN映射到VSAN
Nexus 5000-A#configure terminal
Nexus 5000-A(config)# vlan 100
Nexus 5000-A(config-vlan)#fcoe vsan 100
Nexus 5000-A# show vlan fcoe
Original VLAN ID Translated VLAN ID Association State
---------------- ------------------ -----------------
10 100 Operational
Nexus 5000-B# configure terminal
Nexus 5000-B(config)# vlan 101
Nexus 5000-B(config-vlan)# fcoe vsan 101
Nexus 5000-B# show vlan fcoe
Original VLAN ID Translated VLAN ID Association State
---------------- ------------------ -----------------
10 101 Operational
配置Nexus 5000 FCoE上行链路端口和端口通道
Nexus 5000-A#configure terminal
Nexus 5000-A(config)# interface ethernet 1/5-6
Nexus 5000-A(config-if-range)# switchport mode trunk
Nexus 5000-A(config-if-range)# switchport trunk allowed vlan 100
Nexus 5000-A(config-if-range)# channel-group 2 mode active
Nexus 5000-A(config-if-range)#no shutdown
Nexus 5000-A(config-if-range)# exit
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# interface port-channel 2
Nexus 5000-A(config-if)# no shutdown
Nexus 5000-A# show port-channel database
port-channel2
Last membership update is successful
2 ports in total, 2 ports up
First operational port is Ethernet1/5
Age of the port-channel is 0d:00h:09m:19s
Time since last bundle is 0d:00h:05m:27s
Last bundled member is Ethernet1/6
Time since last unbundle is 0d:00h:05m:38s
Last unbundled member is Ethernet1/6
Ports: Ethernet1/5 [active ] [up] *
Ethernet1/6 [active ] [up]
Nexus 5000-B# configure terminal
Nexus 5000-B(config)# interface ethernet 1/5-6
Nexus 5000-B(config-if-range)# switchport mode trunk
Nexus 5000-B(config-if-range)# switchport trunk allowed vlan 101
Nexus 5000-B(config-if-range)# channel-group 3 mode active
Nexus 5000-B(config-if-range)# no shutdown
Nexus 5000-B(config-if-range)# exit
Nexus 5000-B# configure terminal
Nexus 5000-B)config)# interface port-channel 3
Nexus 5000-B(config-if)# no shutdown
Nexus 5000-B# show port-channel database
port-channel3
Last membership update is successful
2 ports in total, 2 ports up
First operational port is Ethernet1/5
Age of the port-channel is 0d:00h:00m:29s
Time since last bundle is 0d:00h:00m:29s
Last bundled member is Ethernet1/6
Ports: Ethernet1/5 [active ] [up] *
Ethernet1/6 [active ] [up]
创建Nexus 5000虚拟光纤通道(VFC)
需要创建VFC并将其绑定到传输FCoE流量的以太网接口(端口通道)。
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# interface vfc 2
Nexus 5000-A(config-if)# bind interface port-channel 2
Nexus 5000-A(config-if)# switchport trunk allowed vsan 100
Nexus 5000-A(config-if)# switchport mode F
Nexus 5000-A(config-if)# no shutdown
Nexus 5000-A# show interface vfc 2
vfc2 is trunking
Bound interface is port-channel2
Hardware is Ethernet
Port WWN is 20:01:54:7f:ee:8b:a6:ff
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 1
Trunk vsans (admin allowed and active) (100)
Trunk vsans (up) (100)
Trunk vsans (isolated) ()
Trunk vsans (initializing) ()
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1020 frames input, 102728 bytes
0 discards, 0 errors
1154 frames output, 478968 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
Interface last changed at Tue Aug 21 06:32:40 2012
Nexus 5000-B# configure terminal
Nexus 5000-B(config)# interface vfc 3
Nexus 5000-B(config-if)# bind interface port-channel 3
Nexus 5000-B(config-if)# switchport trunk allowed vsan 101
Nexus 5000-A(config-if)# switchport mode F
Nexus 5000-B(config-if)# no shutdown
Nexus 5000-B# show interface vfc 3
vfc3 is trunking
Bound interface is port-channel3
Hardware is Ethernet
Port WWN is 20:02:54:7f:ee:8c:e2:7f
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 1
Trunk vsans (admin allowed and active) (101)
Trunk vsans (up) (101)
Trunk vsans (isolated) ()
Trunk vsans (initializing) ()
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
738 frames input, 69404 bytes
0 discards, 0 errors
763 frames output, 427488 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
Interface last changed at Tue Aug 21 06:47:03 2012
在Nexus 5000上配置存储端口
将存储端口从启用FCoE的存储系统连接到Nexus 5000上的指定端口。需要为这些存储端口创建VFC,并配置相关接口。
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# interface Ethernet 1/32
Nexus 5000-A(config-if)# switchport mode trunk
Nexus 5000-A(config-if)# switchport trunk allowed vlan 100
Nexus 5000-A(config-if)# spanning-tree port type edge trunk
Warning: Edge port type (portfast) should only be enabled on ports connected to a single host.
Connecting hubs, concentrators, switches, bridges, etc... to this interface when edge port type
(portfast) is enabled, can cause temporary bridging loops.
Use with CAUTION
Nexus 5000-A(config-if)# no shut
Nexus 5000-A(config-if)# exit
Nexus 5000-A(config)# interface vfc 132
Nexus 5000-A(config-if)# switchport trunk allowed vsan 100
Nexus 5000-A(config-if)# bind interface Ethernet 1/32
Nexus 5000-A(config-if)# no shutdown
Nexus 5000-A(config-if)# exit
Nexus 5000-A(config)# vsan database
Nexus 5000-A(config-vsan-db)# vsan 100 interface vfc 132
Nexus 5000-A(config-vsan-db)# exit
Nexus 5000-A(config)# show interface vfc 132
vfc132 is trunking
Bound interface is Ethernet1/32
Hardware is Ethernet
Port WWN is 20:83:54:7f:ee:8b:a6:ff
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 100
Trunk vsans (admin allowed and active) (100)
Trunk vsans (up) (100)
Trunk vsans (isolated) ()
Trunk vsans (initializing) ()
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
10 frames input, 1060 bytes
0 discards, 0 errors
11 frames output, 1404 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
Interface last changed at Tue Aug 21 06:37:14 2012
Nexus 5000-B# configure terminal
Nexus 5000-B(config)# interface Ethernet 1/32
Nexus 5000-B(config-if)# switchport mode trunk
Nexus 5000-B(config-if)# switchport trunk allowed vlan 101
Nexus 5000-B(config-if)# spanning-tree port type edge trunk
Warning: Edge port type (portfast) should only be enabled on ports connected
to a single host. Connecting hubs, concentrators, switches, bridges, etc...
to this interface when edge port type (portfast) is enabled, can cause temporary
bridging loops.
Use with CAUTION
Nexus 5000-B(config-if)# no shut
Nexus 5000-B(config-if)# exit
Nexus 5000-B(config)# interface vfc 132
Nexus 5000-B(config-if)# switchport trunk allowed vsan 101
Nexus 5000-B(config-if)# bind interface Ethernet 1/32
Nexus 5000-B(config-if)# no shutdown
Nexus 5000-B(config-if)# exit
Nexus 5000-B(config)# vsan database
Nexus 5000-B(config-vsan-db)# vsan 101 interface vfc 132
Nexus 5000-B(config-vsan-db)# exit
Nexus 5000-B(config)# show interface vfc 132
vfc132 is trunking
Bound interface is Ethernet1/32
Hardware is Ethernet
Port WWN is 20:83:54:7f:ee:8c:e2:7f
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 101
Trunk vsans (admin allowed and active) (101)
Trunk vsans (up) (101)
Trunk vsans (isolated) ()
Trunk vsans (initializing) ()
1 minute input rate 136 bits/sec, 17 bytes/sec, 0 frames/sec
1 minute output rate 200 bits/sec, 25 bytes/sec, 0 frames/sec
10 frames input, 1060 bytes
0 discards, 0 errors
11 frames output, 1404 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
Interface last changed at Tue Aug 21 06:50:31 2012
交换矩阵A 配置
zone name ESXI01_1 vsan 100
member pwwn 10:00:e4:11:5b:65:c1:11
member pwwn 50:01:43:80:11:36:37:5c
zone name ESXI02_1 vsan 100
member pwwn 10:00:e4:11:5b:65:c0:c9
member pwwn 50:01:43:80:11:36:37:5c
zone name ESXI03_1 vsan 100
member pwwn 10:00:e4:11:5b:65:c2:01
member pwwn 50:01:43:80:11:36:37:5c
zoneset name Fabric-A vsan 100
member ESXI01_1
member ESXI02_1
member ESXI03_1
zoneset activate name Fabric-A vsan 100
交换矩阵A验证
Nexus 5000-A# show flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
vfc2 100 0xab0000 10:00:e4:11:5b:65:c1:11 20:00:e4:11:5b:65:c1:11
vfc2 100 0xab0040 10:00:e4:11:5b:65:c0:c9 20:00:e4:11:5b:65:c0:c9
vfc2 100 0xab0020 10:00:e4:11:5b:65:c2:01 20:00:e4:11:5b:65:c2:01
vfc132 100 0xab00c0 50:01:43:80:11:36:37:5c 50:01:43:80:11:36:37:50
This flogi table shows three hosts (pwwns starting with 10:) and one storage pwwn
(50:01:43:80:11:36:37:5c).
交换矩阵B 配置
zone name EVA_1-ESXI01_2 vsan 101
member pwwn 10:00:e4:11:5b:67:c1:12
member pwwn 50:01:43:80:11:36:37:5d
zone name EVA_1-ESXI02_2 vsan 101
member pwwn 10:00:e4:11:5b:67:c0:c8
member pwwn 50:01:43:80:11:36:37:5d
zone name EVA_1-ESXI03_2 vsan 101
member pwwn 10:00:e4:11:5b:67:c2:04
member pwwn 50:01:43:80:11:36:37:5d
zoneset name Fabric-B vsan 101
member EVA_1-ESXI01_2
member EVA_1-ESXI02_2
member EVA_1-ESXI03_2
zoneset activate name Fabric-B vsan 101
交换矩阵B验证
Nexus 5000-B# show flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
vfc3 101 0xab0000 10:00:e4:11:5b:67:c1:12 20:00:e4:11:5b:65:c1:12
vfc3 101 0xab0040 10:00:e4:11:5b:67:c0:c8 20:00:e4:11:5b:65:c0:c8
vfc3 101 0xab0020 10:00:e4:11:5b:67:c2:04 20:00:e4:11:5b:65:c2:04
vfc132 101 0xab00c0 50:01:43:80:11:36:37:5d 50:01:43:80:11:36:37:50
This flogi table shows three hosts (pwwns starting with 10:) and one storage pwwn
(50:01:43:80:11:36:37:5d).
目前没有针对此配置的故障排除信息。
版本 | 发布日期 | 备注 |
---|---|---|
1.0 |
01-May-2014 |
初始版本 |