本檔案介紹如何在Cisco Unified Computing System(UCS)和Nexus 5000交換機之間使用乙太網光纖通道(FCoE)配置N_Port ID虛擬化(NPIV)或N_Port虛擬化(NPV)。
本文中的資訊係根據以下軟體和硬體版本:
本文中的資訊是根據特定實驗室環境內的裝置所建立。文中使用到的所有裝置皆從已清除(預設)的組態來啟動。如果您的網路正在作用,請確保您已瞭解任何指令可能造成的影響。
圖1.配置中使用的拓撲
此處概述了兩個步驟來幫助您配置UCS:
必須注意的是,在NPV模式下,UCS不支援非預設FC-Map。如需更多資訊,請參閱思科錯誤ID CSCuJ62005和CSCud78290:
建立FCoE VSAN
您需要在UCS中建立VSAN和FCoE VLAN以傳輸FCoE流量。最佳實踐(但不是要求)是將VSAN ID與FCoE VLAN ID對齊,以幫助跟蹤和排除故障。
名稱 | 輸入VSAN的名稱 |
FC分割槽 | 禁用 — 僅當實施本地分割槽功能時才使用 |
交換矩陣單選按鈕 | 選擇交換矩陣A |
VSAN ID | 輸入在交換矩陣A上建立的VSAN的VSAN ID — 這應與Nexus 5000-A上建立的VSAN ID相對應 |
FCoE VLAN | 輸入對映到此VSAN的VLAN的FCoE VLAN ID — 這應與Nexus 5000-A上建立的VLAN ID相對應 |
名稱 | 輸入VSAN的名稱 |
FC分割槽 | 禁用 — 僅當實施本地分割槽功能時才使用 |
交換矩陣單選按鈕 | 選擇交換矩陣B |
VSAN ID | 輸入在交換矩陣B上建立的VSAN的VSAN ID — 這應與Nexus 5000-B上建立的VSAN ID相對應 |
FCoE VLAN | 輸入對映到此VSAN的VLAN的FCoE VLAN ID — 這應與Nexus 5000-B上建立的VLAN ID相對應 |
配置UCS FCoE埠通道
為FCoE和NPIV配置Nexus 5000需要以下幾個步驟:
啟用功能FCoE
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# feature fcoe
FC license checked out successfully
fc_plugin extracted successfully
FC plugin loaded successfully
FCoE manager enabled successfully
FC enabled on all modules successfully
Enabled FCoE QoS policies successfully
Nexus 5000-A# show feature | include fcoe
Feature Name Instance State
-------------------- -------- --------
fcoe 1 enabled
在Nexus 5000上啟用NPIV
Nexus 5000-A# configuration terminal
Nexus 5000-A(config)# feature npiv
Nexus 5000-A# show npiv status
NPIV is enabled
在Nexus 5000上啟用LACP
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# feature lacp
Nexus 5000-A#show feature | include LACP
Feature Name Instance State
-------------------- -------- --------
lacp 1 enabled
配置Nexus 5000 FCoE QoS引數
可配置的Cisco NX-OS QoS功能允許您對網路流量進行分類、確定流量優先順序並提供擁塞避免。Nexus 5000上的預設QoS配置為FC和FCoE流量提供無損服務,為乙太網流量提供盡力服務。預設情況下應已配置Nexus 5000 FCoE QoS引數。
Nexus 5000-A# show startup-config ipqos
. .
system qos
service-policy type queuing input fcoe-default-in-policy
service-policy type queuing output fcoe-default-out-policy
service-policy type qos input fcoe-default-in-policy
service-policy type network-qos fcoe-default-nq-policy
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# system qos
Nexus 5000-A(config-sys-qos)# service-policy type qos input
fcoe-default-in-policy
Nexus 5000-A(config-sys-qos)# service-policy type queuing input
fcoe-default-in-policy
Nexus 5000-A(config-sys-qos)# service-policy type queuing output
fcoe-default-out-policy
Nexus 5000-A(config-sys-qos)# service-policy type network-qos
fcoe-default-nq-policy
Nexus 5000-A# show startup-config ipqos
..
system qos
service-policy type queuing input fcoe-default-in-policy
service-policy type queuing output fcoe-default-out-policy
service-policy type qos input fcoe-default-in-policy
service-policy type network-qos fcoe-default-nq-policy
建立Nexus 5000 VLAN
建立兩個VLAN以供FCoE使用。偶數應與FI-A相關,奇數應與FI-B相關。使用本文配置UCS部分中指定的FCoE VLAN ID。
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# vlan 100
Nexus 5000-A(config-vlan)# name FCoE-VLAN100
Nexus 5000-A# show vlan brief
VLAN Name Status Ports
---- ----------------------------- --------- -------------------------------
1 default active Eth1/1, Eth1/2, Eth1/3, Eth1/4
Eth1/5, Eth1/6, Eth1/7, Eth1/8
.
100 FCoE-VLAN100 active
Nexus 5000-B# configure terminal
Nexus 5000-B(config)# vlan 101
Nexus 5000-B(config-vlan)# name FCoE-VLAN101
Nexus 5000-B# show vlan brief
VLAN Name Status Ports
---- ----------------------------- --------- -------------------------------
1 default active Eth1/1, Eth1/2, Eth1/3, Eth1/4
Eth1/5, Eth1/6, Eth1/7, Eth1/8
.
100 FCoE-VLAN101 active
建立Nexus 5000 VSAN
建立兩個VSAN。偶數應與FI-A相關,奇數應與FI-B相關。使用本文配置UCS部分中指定的VSAN ID。
Nexus 5000-A# configure terminal
Nexus 5000-A(config)#vsan database
Nexus 5000-A(config-vsan)# vsan 100
Nexus 5000-A(config-vsan)# vsan 100 name FCoE-VSAN100
Nexus 5000-A#show vsan 100
vsan 100 information
name:FCoE-VSAN100 state:active
interoperability mode:default
loadbalancing:src-id/dst-id/oxid
operational state:down
Nexus 5000-B# configure terminal
Nexus 5000-B(config)#vsan database
Nexus 5000-B(config-vsan)# vsan 101
Nexus 5000-B(config-vsan)# vsan 101 name FCoE-VSAN101
Nexus 5000-A# show vsan 101
vsan 101 information
name:FCoE-VSAN101 state:active
interoperability mode:default
loadbalancing:src-id/dst-id/oxid
operational state:down
將Vlan對映到VSAN
Nexus 5000-A#configure terminal
Nexus 5000-A(config)# vlan 100
Nexus 5000-A(config-vlan)#fcoe vsan 100
Nexus 5000-A# show vlan fcoe
Original VLAN ID Translated VLAN ID Association State
---------------- ------------------ -----------------
10 100 Operational
Nexus 5000-B# configure terminal
Nexus 5000-B(config)# vlan 101
Nexus 5000-B(config-vlan)# fcoe vsan 101
Nexus 5000-B# show vlan fcoe
Original VLAN ID Translated VLAN ID Association State
---------------- ------------------ -----------------
10 101 Operational
配置Nexus 5000 FCoE上行鏈路埠和埠通道
Nexus 5000-A#configure terminal
Nexus 5000-A(config)# interface ethernet 1/5-6
Nexus 5000-A(config-if-range)# switchport mode trunk
Nexus 5000-A(config-if-range)# switchport trunk allowed vlan 100
Nexus 5000-A(config-if-range)# channel-group 2 mode active
Nexus 5000-A(config-if-range)#no shutdown
Nexus 5000-A(config-if-range)# exit
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# interface port-channel 2
Nexus 5000-A(config-if)# no shutdown
Nexus 5000-A# show port-channel database
port-channel2
Last membership update is successful
2 ports in total, 2 ports up
First operational port is Ethernet1/5
Age of the port-channel is 0d:00h:09m:19s
Time since last bundle is 0d:00h:05m:27s
Last bundled member is Ethernet1/6
Time since last unbundle is 0d:00h:05m:38s
Last unbundled member is Ethernet1/6
Ports: Ethernet1/5 [active ] [up] *
Ethernet1/6 [active ] [up]
Nexus 5000-B# configure terminal
Nexus 5000-B(config)# interface ethernet 1/5-6
Nexus 5000-B(config-if-range)# switchport mode trunk
Nexus 5000-B(config-if-range)# switchport trunk allowed vlan 101
Nexus 5000-B(config-if-range)# channel-group 3 mode active
Nexus 5000-B(config-if-range)# no shutdown
Nexus 5000-B(config-if-range)# exit
Nexus 5000-B# configure terminal
Nexus 5000-B)config)# interface port-channel 3
Nexus 5000-B(config-if)# no shutdown
Nexus 5000-B# show port-channel database
port-channel3
Last membership update is successful
2 ports in total, 2 ports up
First operational port is Ethernet1/5
Age of the port-channel is 0d:00h:00m:29s
Time since last bundle is 0d:00h:00m:29s
Last bundled member is Ethernet1/6
Ports: Ethernet1/5 [active ] [up] *
Ethernet1/6 [active ] [up]
建立Nexus 5000虛擬光纖通道(VFC)
需要建立VFC,並將其繫結到傳輸FCoE流量的乙太網介面(埠通道)。
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# interface vfc 2
Nexus 5000-A(config-if)# bind interface port-channel 2
Nexus 5000-A(config-if)# switchport trunk allowed vsan 100
Nexus 5000-A(config-if)# switchport mode F
Nexus 5000-A(config-if)# no shutdown
Nexus 5000-A# show interface vfc 2
vfc2 is trunking
Bound interface is port-channel2
Hardware is Ethernet
Port WWN is 20:01:54:7f:ee:8b:a6:ff
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 1
Trunk vsans (admin allowed and active) (100)
Trunk vsans (up) (100)
Trunk vsans (isolated) ()
Trunk vsans (initializing) ()
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1020 frames input, 102728 bytes
0 discards, 0 errors
1154 frames output, 478968 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
Interface last changed at Tue Aug 21 06:32:40 2012
Nexus 5000-B# configure terminal
Nexus 5000-B(config)# interface vfc 3
Nexus 5000-B(config-if)# bind interface port-channel 3
Nexus 5000-B(config-if)# switchport trunk allowed vsan 101
Nexus 5000-A(config-if)# switchport mode F
Nexus 5000-B(config-if)# no shutdown
Nexus 5000-B# show interface vfc 3
vfc3 is trunking
Bound interface is port-channel3
Hardware is Ethernet
Port WWN is 20:02:54:7f:ee:8c:e2:7f
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 1
Trunk vsans (admin allowed and active) (101)
Trunk vsans (up) (101)
Trunk vsans (isolated) ()
Trunk vsans (initializing) ()
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
738 frames input, 69404 bytes
0 discards, 0 errors
763 frames output, 427488 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
Interface last changed at Tue Aug 21 06:47:03 2012
配置Nexus 5000上的儲存埠
將儲存埠從支援FCoE的儲存系統連線到Nexus 5000上的指定埠。需要為這些儲存埠建立VFC,並且需要配置關聯的介面。
Nexus 5000-A# configure terminal
Nexus 5000-A(config)# interface Ethernet 1/32
Nexus 5000-A(config-if)# switchport mode trunk
Nexus 5000-A(config-if)# switchport trunk allowed vlan 100
Nexus 5000-A(config-if)# spanning-tree port type edge trunk
Warning: Edge port type (portfast) should only be enabled on ports connected to a single host.
Connecting hubs, concentrators, switches, bridges, etc... to this interface when edge port type
(portfast) is enabled, can cause temporary bridging loops.
Use with CAUTION
Nexus 5000-A(config-if)# no shut
Nexus 5000-A(config-if)# exit
Nexus 5000-A(config)# interface vfc 132
Nexus 5000-A(config-if)# switchport trunk allowed vsan 100
Nexus 5000-A(config-if)# bind interface Ethernet 1/32
Nexus 5000-A(config-if)# no shutdown
Nexus 5000-A(config-if)# exit
Nexus 5000-A(config)# vsan database
Nexus 5000-A(config-vsan-db)# vsan 100 interface vfc 132
Nexus 5000-A(config-vsan-db)# exit
Nexus 5000-A(config)# show interface vfc 132
vfc132 is trunking
Bound interface is Ethernet1/32
Hardware is Ethernet
Port WWN is 20:83:54:7f:ee:8b:a6:ff
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 100
Trunk vsans (admin allowed and active) (100)
Trunk vsans (up) (100)
Trunk vsans (isolated) ()
Trunk vsans (initializing) ()
1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
10 frames input, 1060 bytes
0 discards, 0 errors
11 frames output, 1404 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
Interface last changed at Tue Aug 21 06:37:14 2012
Nexus 5000-B# configure terminal
Nexus 5000-B(config)# interface Ethernet 1/32
Nexus 5000-B(config-if)# switchport mode trunk
Nexus 5000-B(config-if)# switchport trunk allowed vlan 101
Nexus 5000-B(config-if)# spanning-tree port type edge trunk
Warning: Edge port type (portfast) should only be enabled on ports connected
to a single host. Connecting hubs, concentrators, switches, bridges, etc...
to this interface when edge port type (portfast) is enabled, can cause temporary
bridging loops.
Use with CAUTION
Nexus 5000-B(config-if)# no shut
Nexus 5000-B(config-if)# exit
Nexus 5000-B(config)# interface vfc 132
Nexus 5000-B(config-if)# switchport trunk allowed vsan 101
Nexus 5000-B(config-if)# bind interface Ethernet 1/32
Nexus 5000-B(config-if)# no shutdown
Nexus 5000-B(config-if)# exit
Nexus 5000-B(config)# vsan database
Nexus 5000-B(config-vsan-db)# vsan 101 interface vfc 132
Nexus 5000-B(config-vsan-db)# exit
Nexus 5000-B(config)# show interface vfc 132
vfc132 is trunking
Bound interface is Ethernet1/32
Hardware is Ethernet
Port WWN is 20:83:54:7f:ee:8c:e2:7f
Admin port mode is F, trunk mode is on
snmp link state traps are enabled
Port mode is TF
Port vsan is 101
Trunk vsans (admin allowed and active) (101)
Trunk vsans (up) (101)
Trunk vsans (isolated) ()
Trunk vsans (initializing) ()
1 minute input rate 136 bits/sec, 17 bytes/sec, 0 frames/sec
1 minute output rate 200 bits/sec, 25 bytes/sec, 0 frames/sec
10 frames input, 1060 bytes
0 discards, 0 errors
11 frames output, 1404 bytes
0 discards, 0 errors
last clearing of "show interface" counters never
Interface last changed at Tue Aug 21 06:50:31 2012
交換矩陣A 組態
zone name ESXI01_1 vsan 100
member pwwn 10:00:e4:11:5b:65:c1:11
member pwwn 50:01:43:80:11:36:37:5c
zone name ESXI02_1 vsan 100
member pwwn 10:00:e4:11:5b:65:c0:c9
member pwwn 50:01:43:80:11:36:37:5c
zone name ESXI03_1 vsan 100
member pwwn 10:00:e4:11:5b:65:c2:01
member pwwn 50:01:43:80:11:36:37:5c
zoneset name Fabric-A vsan 100
member ESXI01_1
member ESXI02_1
member ESXI03_1
zoneset activate name Fabric-A vsan 100
交換矩陣A驗證
Nexus 5000-A# show flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
vfc2 100 0xab0000 10:00:e4:11:5b:65:c1:11 20:00:e4:11:5b:65:c1:11
vfc2 100 0xab0040 10:00:e4:11:5b:65:c0:c9 20:00:e4:11:5b:65:c0:c9
vfc2 100 0xab0020 10:00:e4:11:5b:65:c2:01 20:00:e4:11:5b:65:c2:01
vfc132 100 0xab00c0 50:01:43:80:11:36:37:5c 50:01:43:80:11:36:37:50
This flogi table shows three hosts (pwwns starting with 10:) and one storage pwwn
(50:01:43:80:11:36:37:5c).
交換矩陣B 組態
zone name EVA_1-ESXI01_2 vsan 101
member pwwn 10:00:e4:11:5b:67:c1:12
member pwwn 50:01:43:80:11:36:37:5d
zone name EVA_1-ESXI02_2 vsan 101
member pwwn 10:00:e4:11:5b:67:c0:c8
member pwwn 50:01:43:80:11:36:37:5d
zone name EVA_1-ESXI03_2 vsan 101
member pwwn 10:00:e4:11:5b:67:c2:04
member pwwn 50:01:43:80:11:36:37:5d
zoneset name Fabric-B vsan 101
member EVA_1-ESXI01_2
member EVA_1-ESXI02_2
member EVA_1-ESXI03_2
zoneset activate name Fabric-B vsan 101
交換矩陣B驗證
Nexus 5000-B# show flogi database
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
vfc3 101 0xab0000 10:00:e4:11:5b:67:c1:12 20:00:e4:11:5b:65:c1:12
vfc3 101 0xab0040 10:00:e4:11:5b:67:c0:c8 20:00:e4:11:5b:65:c0:c8
vfc3 101 0xab0020 10:00:e4:11:5b:67:c2:04 20:00:e4:11:5b:65:c2:04
vfc132 101 0xab00c0 50:01:43:80:11:36:37:5d 50:01:43:80:11:36:37:50
This flogi table shows three hosts (pwwns starting with 10:) and one storage pwwn
(50:01:43:80:11:36:37:5d).
目前尚無適用於此組態的具體疑難排解資訊。
修訂 | 發佈日期 | 意見 |
---|---|---|
1.0 |
01-May-2014 |
初始版本 |