Table Of Contents
MDS 9000 Switch and McData Dual Core Topology (Interop Mode 1)
Specifications
Expected Topology Behavior
Zoning
FSPF
Trunking and PortChannels
Domain IDs
Configuration
Configuring the McData 6064 Switch
Configuring the MDS 9000 Switch
Verification
Verifying the McData 6064 Switch
Verifying the MDS 9509 Switch
Zoning
MDS 9000 Switch and McData Dual Core Topology (Interop Mode 1)
This chapter describes how to set up a basic dual-core topology with an MDS 9000 switch configured for interop mode 1 and a McData 6064 switch. Devices are connected to both core switches and all traffic must flow through both cores to reach its destination.
This chapter includes the following sections:
•Specifications
•Expected Topology Behavior
•Configuration
•Verification
•Zoning
Specifications
The following switches and code levels were used for this example configuration:
•MDS 9509 running SAN-OS Release 1.0(1)
•McData 6064 Version 04.01.00 12
Figure 5-1 shows the topology used for this example configuration.
Figure 5-1 MDS 9509 Switch and McData Switch Dual Core Topology
Note The VZ1 JBOD is an arbitrated loop with 7 private drives.
Expected Topology Behavior
This section covers the Fibre Channel services and features that act differently in this topology (Figure 5-1) as compared to a homogeneous, single-vendor implementation.
It contains the following topics:
•Zoning
•FSPF
•Trunking and PortChannels
•Domain IDs
Zoning
In the core-core topology, zone members are all pWWNs, because the McData domain/port nomenclature is not a valid form according to the FC standard. When a zone set activation is made at one core switch, the zone set activation is sent to the other core switch. Either core switch may make zoning changes and have them be propagated to the other core switch.
Both core switches provide all of the zone security for the device attached ports because the MDS 9000 switch and the McData switches do not check the source and destination of the frame when traversing E ports. The MDS 9000 switch only provides hardware enforced security on the ingress ports to the fabric, while the McData switch only provides soft zoning.
Note After two active zone sets successfully merge, always copy the active zone set to the full zone set database prior to modifying it on the MDS 9000 switch.
FSPF
All links within the topology show the link cost of 1000, because the McData 6064 switch used in this example only supports 1Gbps.
The McData switches load balance their routes using source/destination; the ingress edge switch uses the same ISL for all traffic that has the same source/destination pair. If the McData switch can load balance using source/destination/ox-id, then it can choose either of the ISLs for the route through the fabric. The MDS switch continues to load balance across ISLs using source/destination/ox-id of the frame.
Trunking and PortChannels
The lack of MDS 9000 switch-to-MDS 9000-switch connections prohibits the topology from containing TE ports or PortChannels. Only standard E ports are used for the ISLs.
Domain IDs
The domain IDs are limited to the 97 to 127 range due to a restriction imposed by McData's inability to handle IDs outside of that range. While the MDS 9000 switch can handle domain IDs outside of this range in its normal mode of operation, the implementation of interoperability mode includes this limitation.
Domain ID modifications can be handled in two ways, disruptively or nondisruptively:
•Disruptive—This event impacts the entire switch. When changing domain IDs, McData requires the entire switch to be taken offline and/or rebooted.
•Nondisruptive—This event is limited to the VSAN where the event is taking place. Only the MDS 9000 switch can perform this action, as the domain manager process for this VSAN is restarted and not the entire switch. This restart requires any device logged into the VSAN to log into the fabric again to obtain a new FC ID.
Configuration
This section describes the configuration process and includes the following topics:
•Configuring the McData 6064 Switch
•Configuring the MDS 9000 Switch
Configuring the McData 6064 Switch
In this example, the McData 6064 switch is configured for interop mode using Telnet and the CLI. The switch is placed in an offline state, the default zone is set to deny, the domain ID is set to 0x61 (97), and timers are altered to match the fabric.
Follow these steps to configure the McData 6064 switch.
Step 1 Display current switch information.
R_A_TOV: 100 <==== must match other fabric switches
E_D_TOV: 20 <==== must match other fabric switches
Rerouting Delay: Disabled
Operating Mode: Open Systems
Interop Mode: Open Fabric 1.0 <==== non interop mode
World Wide Name: 10:00:08:00:88:20:80:43
Insistent Domain ID: Disabled
Step 2 Alter the timers, RA_TOV and ED_TOV, if needed. These options are listed in the config switch menu.
bbCredit - Set the buffer to buffer credit value for the switch
commadelim - Toggle comma-delimited display mode
domainRSCN - Set the Domain RSCN state for the switch
edTOV - Set the E_D_TOV for the switch
insistDomainId - Set the Insistent Domain ID state for the switch
interopMode - Set the Interoperability mode for the switch
login - Login to CLI under different access rights
prefDomainId - Set the preferred domain id for the switch
priority - Set the switch priority
raTOV - Set the R_A_TOV for the switch
rerouteDelay - Enable or disable the reroute delay
root - Move back to root level
show - Display the switch configuration
speed - Set the switch operating speed
Step 3 Set the switch offline. The switch must be offline before changing the mode to interop.
Config.Switch> interopmode open
Error 45: Not Allowed While Switch Online
Note To change to interop mode, the switch must be set to offline.
Maint.System> setOnlineState 0
State: Offline <==== switch is now offline
Rerouting Delay: Disabled
Operating Mode: Open Systems
Interop Mode: McDATA Fabric 1.0
World Wide Name: 10:00:08:00:88:20:80:43
Insistent Domain ID: Disabled
Step 4 Set the default zone to deny, and set the mode to interop. As shown in this example, the switch cannot be set to interop mode without first setting the default zone to deny.
Config.Switch> interopmode open
Error 81: Default Zone Enabled
Config.Zoning> setDefZoneState 0
Config.Switch> interopmode open
State: Offline <==== still offline
Rerouting Delay: Disabled
Operating Mode: Open Systems
Interop Mode: Open Fabric 1.0 <==== now in interop mode
World Wide Name: 10:00:08:00:88:20:80:43
Insistent Domain ID: Disabled
Step 5 Set the preferred domain ID, with an offset of 0x60. In this example, the McData switch is domain ID 0x61 (decimal 97). The FC IDs for nodes on this switch are 61xxxx.
Config.Switch> prefDomainId 1
Maint.System> setonlinestate 1
State: Online <==== online
Rerouting Delay: Disabled
Operating Mode: Open Systems
Interop Mode: Open Fabric 1.0 <=== interop mode
World Wide Name: 10:00:08:00:88:20:80:43
Insistent Domain ID: Disabled
Configuring the MDS 9000 Switch
See "MDS 9000 Core with Brocade Edge Topology (Interop Mode 1)," for examples of how to set the MDS 9000 switch to interop mode.
Verification
This section highlights the commands used to verify that the fabric is up and running in interoperability mode. It includes the following topics:
•Verifying the McData 6064 Switch
•Verifying the MDS 9509 Switch
Verifying the McData 6064 Switch
The following examples show the commands used to verify the configuration of the McData 6064 switch.
Rerouting Delay: Disabled
Operating Mode: Open Systems
Interop Mode: Open Fabric 1.0
World Wide Name: 10:00:08:00:88:20:80:43
Insistent Domain ID: Disabled
Description: FC Director Class Switch
Date/Time: 12/17/2002 12:50:18
Firmware Version: 04.01.00 12
Issue the show port status command to verify that the correct ports are online, and are type E port or F port.
Port State Type Attached WWN Beaconing
---- ------------------ ----- ----------------------- ---------
0 No Light gPort 00:00:00:00:00:00:00:00 Off
1 No Light gPort 00:00:00:00:00:00:00:00 Off
2 No Light gPort 00:00:00:00:00:00:00:00 Off
3 Online fPort 21:00:00:E0:8B:07:A4:36 Off
4 Not Installed gPort 00:00:00:00:00:00:00:00 Off
5 Not Installed gPort 00:00:00:00:00:00:00:00 Off
6 Not Installed gPort 00:00:00:00:00:00:00:00 Off
7 Not Installed gPort 00:00:00:00:00:00:00:00 Off
8 No Light gPort 00:00:00:00:00:00:00:00 Off
9 No Light gPort 00:00:00:00:00:00:00:00 Off
10 Online ePort 20:63:00:05:30:00:86:9F Off
11 No Light gPort 00:00:00:00:00:00:00:00 Off
12 Not Installed gPort 00:00:00:00:00:00:00:00 Off
13 Not Installed gPort 00:00:00:00:00:00:00:00 Off
14 Not Installed gPort 00:00:00:00:00:00:00:00 Off
15 Not Installed gPort 00:00:00:00:00:00:00:00 Off
16 Not Installed gPort 00:00:00:00:00:00:00:00 Off
17 Not Installed gPort 00:00:00:00:00:00:00:00 Off
18 Not Installed gPort 00:00:00:00:00:00:00:00 Off
19 Not Installed gPort 00:00:00:00:00:00:00:00 Off
20 Not Installed gPort 00:00:00:00:00:00:00:00 Off
21 Not Installed gPort 00:00:00:00:00:00:00:00 Off
22 Not Installed gPort 00:00:00:00:00:00:00:00 Off
23 Not Installed gPort 00:00:00:00:00:00:00:00 Off
24 Not Installed gPort 00:00:00:00:00:00:00:00 Off
25 Not Installed gPort 00:00:00:00:00:00:00:00 Off
26 Not Installed gPort 00:00:00:00:00:00:00:00 Off
27 Not Installed gPort 00:00:00:00:00:00:00:00 Off
28 Not Installed gPort 00:00:00:00:00:00:00:00 Off
29 Not Installed gPort 00:00:00:00:00:00:00:00 Off
30 Not Installed gPort 00:00:00:00:00:00:00:00 Off
31 Not Installed gPort 00:00:00:00:00:00:00:00 Off
32 Not Installed gPort 00:00:00:00:00:00:00:00 Off
33 Not Installed gPort 00:00:00:00:00:00:00:00 Off
34 Not Installed gPort 00:00:00:00:00:00:00:00 Off
35 Not Installed gPort 00:00:00:00:00:00:00:00 Off
36 Not Installed gPort 00:00:00:00:00:00:00:00 Off
37 Not Installed gPort 00:00:00:00:00:00:00:00 Off
38 Not Installed gPort 00:00:00:00:00:00:00:00 Off
39 Not Installed gPort 00:00:00:00:00:00:00:00 Off
40 Not Installed gPort 00:00:00:00:00:00:00:00 Off
41 Not Installed gPort 00:00:00:00:00:00:00:00 Off
42 Not Installed gPort 00:00:00:00:00:00:00:00 Off
43 Not Installed gPort 00:00:00:00:00:00:00:00 Off
44 Not Installed gPort 00:00:00:00:00:00:00:00 Off
45 Not Installed gPort 00:00:00:00:00:00:00:00 Off
46 Not Installed gPort 00:00:00:00:00:00:00:00 Off
47 Not Installed gPort 00:00:00:00:00:00:00:00 Off
48 Not Installed gPort 00:00:00:00:00:00:00:00 Off
49 Not Installed gPort 00:00:00:00:00:00:00:00 Off
50 Not Installed gPort 00:00:00:00:00:00:00:00 Off
51 Not Installed gPort 00:00:00:00:00:00:00:00 Off
52 Online ePort 20:63:00:05:30:00:86:9F Off
53 No Light gPort 00:00:00:00:00:00:00:00 Off
54 No Light gPort 00:00:00:00:00:00:00:00 Off
55 No Light gPort 00:00:00:00:00:00:00:00 Off
56 Not Installed gPort 00:00:00:00:00:00:00:00 Off
57 Not Installed gPort 00:00:00:00:00:00:00:00 Off
58 Not Installed gPort 00:00:00:00:00:00:00:00 Off
59 Not Installed gPort 00:00:00:00:00:00:00:00 Off
60 No Light gPort 00:00:00:00:00:00:00:00 Off
61 No Light gPort 00:00:00:00:00:00:00:00 Off
62 No Light gPort 00:00:00:00:00:00:00:00 Off
63 No Light gPort 00:00:00:00:00:00:00:00 Off
The show nameserver command shows that the Netfinity host has logged into the McData switch.
Type Port Id Port Name Node Name COS FC4 Types
---- ------- ----------------------- ----------------------- --- ------
fPort 610713 20:00:00:E0:8B:07:A4:36 21:00:00:E0:8B:07:A4:36 3 N/A
1. ISO/IEC 8802-2 LLC/SNAP
Port BB Crdt RxFldSz COS Port Name Node Name
---- ------- ------- --- ----------------------- -----------------------
3 3 2048 3 20:00:00:E0:8B:07:A4:36 21:00:00:E0:8B:07:A4:36
To view the FSPF routes used by the McData 3032 switch, use the Web GUI tool (Figure 5-2). There is no command line entry available to show this information.
Figure 5-2 McData Core Displaying Routes
Verifying the MDS 9509 Switch
The following examples show the commands used to verify the configuration of the MDS 9509 switch.
Cisco Storage Area Networking Operating System (SAN-OS) Software
TAC support: http://www.cisco.com/tac
Copyright (c) 2002 by Cisco Systems, Inc. All rights reserved.
The copyright for certain works contained herein are owned by
Andiamo Systems, Inc. and/or other third parties and are used and
distributed under license.
kickstart: version 1.0(1)
BIOS compile time: 10/18/02
kickstart image file is: bootflash:/boot-1.0.1.bin
kickstart compile time: 12/4/2002 21:00:00
system image file is: bootflash:/isan-1.0.1.bin
system compile time: 12/4/2002 21:00:00
bootflash: 503808 blocks (block size 512b)
slot0: 0 blocks (block size 512b)
172.22.93.10 uptime is 0 days 2 hours 16 minute(s) 21 second(s)
Reason: Watchdog Timeout/External Reset
-------------------------------------------------------------------------------
Interface Vsan Admin Admin Status Oper Oper Port-channel
-------------------------------------------------------------------------------
fc1/1 1 FX -- fcotAbsent -- -- --
fc1/2 99 TL -- up TL 1 --
fc1/3 1 FX -- fcotAbsent -- -- --
fc1/4 1 FX -- fcotAbsent -- -- --
fc1/5 1 FX -- fcotAbsent -- -- --
fc1/6 1 FX -- fcotAbsent -- -- --
fc1/7 1 FX -- fcotAbsent -- -- --
fc1/8 1 FX -- fcotAbsent -- -- --
fc1/9 1 FX -- fcotAbsent -- -- --
fc1/10 1 FX -- fcotAbsent -- -- --
fc1/11 1 FX -- fcotAbsent -- -- --
fc1/12 1 FX -- fcotAbsent -- -- --
fc1/13 1 FX -- fcotAbsent -- -- --
fc1/14 1 FX -- fcotAbsent -- -- --
fc1/15 1 FX -- fcotAbsent -- -- --
fc1/16 1 FX -- fcotAbsent -- -- --
fc1/17 1 FX -- fcotAbsent -- -- --
fc1/18 1 FX -- fcotAbsent -- -- --
fc1/19 1 FX -- fcotAbsent -- -- --
fc1/20 1 FX -- fcotAbsent -- -- --
fc1/21 1 FX -- fcotAbsent -- -- --
fc1/22 1 FX -- fcotAbsent -- -- --
fc1/23 1 FX -- fcotAbsent -- -- --
fc1/24 1 FX -- fcotAbsent -- -- --
fc1/25 1 FX -- fcotAbsent -- -- --
fc1/26 1 FX -- fcotAbsent -- -- --
fc1/27 1 FX -- fcotAbsent -- -- --
fc1/28 1 FX -- fcotAbsent -- -- --
fc1/29 99 E auto up E 1 --
fc1/30 1 FX -- fcotAbsent -- -- --
fc1/31 1 FX -- fcotAbsent -- -- --
fc1/32 1 FX -- fcotAbsent -- -- --
fc3/1 1 auto on fcotAbsent -- -- --
fc3/2 1 auto on fcotAbsent -- -- --
fc3/3 1 auto on fcotAbsent -- -- --
fc3/4 1 auto on fcotAbsent -- -- --
fc3/5 99 auto off up E 1 --
fc3/6 1 auto on fcotAbsent -- -- --
fc3/7 1 auto on fcotAbsent -- -- --
fc3/8 1 auto on fcotAbsent -- -- --
fc3/9 1 E on fcotAbsent -- -- --
fc3/10 1 auto on fcotAbsent -- -- --
fc3/11 1 auto on fcotAbsent -- -- --
fc3/12 1 auto on fcotAbsent -- -- --
fc3/13 1 E off notConnected -- -- --
fc3/14 1 auto on fcotAbsent -- -- --
fc3/15 1 auto on fcotAbsent -- -- --
fc3/16 1 auto on fcotAbsent -- -- --
-------------------------------------------------------------------------------
-------------------------------------------------------------------------------
-------------------------------------------------------------------------------
Interface Status IP Address Speed MTU
-------------------------------------------------------------------------------
mgmt0 up 172.22.93.10/24 100 Mbps 1500
name:VSAN0099 state:active
interoperability mode:yes
loadbalancing:src-id/dst-id/oxid
switch# show fcdomain v 99
The local switch is the Principal Switch.
Local switch run time information:
Local switch WWN: 20:63:00:05:30:00:86:9f
Running fabric name: 20:63:00:05:30:00:86:9f
Current domain ID: 0x78(120)
Local switch configuration information:
Auto-reconfiguration: Disabled
Contiguous-allocation: Disabled
Configured fabric name: 20:01:00:05:30:00:28:df
Configured domain ID: 0x00(0) (preferred)
Principal switch run time information:
Interface Role RCF-reject
---------------- ------------- ------------
fc1/29 Downstream Disabled
fc3/5 Non-principal Disabled
---------------- ------------- ------------
switch# show fcdomain domain-list v 99
--------- -----------------------
0x78(120) 20:63:00:05:30:00:86:9f [Local] [Principal]
0x61(97) 10:00:08:00:88:20:80:43
--------- -----------------------
switch# show fspf internal route vsan 99
---------------------------
VSAN Number Dest Domain Route Cost Next hops
-----------------------------------------------
switch# show fcns database vsan 99
--------------------------------------------------------------------------
FCID TYPE PWWN (VENDOR) FC4-TYPE:FEATURE
--------------------------------------------------------------------------
0x610713 N 21:00:00:e0:8b:07:a4:36 (QLogic)
0x7800d5 NL 22:00:00:20:37:0e:65:da (Seagate) scsi-fcp:target
0x7800d6 NL 22:00:00:20:37:14:74:e8 (Seagate) scsi-fcp:target
0x7800d9 NL 22:00:00:20:37:04:f8:a1 (Seagate) scsi-fcp:target
0x7800da NL 22:00:00:20:37:0c:6f:a9 (Seagate) scsi-fcp:target
0x7800dc NL 22:00:00:20:37:0d:b6:4b (Seagate) scsi-fcp:target
0x7800e0 NL 22:00:00:20:37:0e:65:44 (Seagate) scsi-fcp:target
0x7800e1 NL 22:00:00:20:37:0c:75:d5 (Seagate) scsi-fcp:target
0x7800e2 NL 22:00:00:20:37:04:ea:2b (Seagate) scsi-fcp:target
0x7800e4 NL 22:00:00:20:37:14:74:49 (Seagate) scsi-fcp:target
0x7800e8 NL 22:00:00:20:37:14:74:fc (Seagate) scsi-fcp:target
Total number of entries = 11
You can use Fabric Manager and Device Manager to verify the current state of the fabric.
Figure 5-3 shows the fabric topology from Fabric Manager.
Figure 5-3 MDS 9000 Switch and McData Dual Core Displayed in Fabric Manager
Figure 5-4 shows Device Manager on the MDS 9509 switch in the example topology. It shows which ports are active as E ports.
Figure 5-4 MDS 9509 Switch Device Manager Showing Active Ports
Figure 5-5 shows the status of the E ports and can verify link speed.
Figure 5-5 Fabric Manager Verifying Port Status and Type
Figure 5-6 shows the domain ID of the switches in the fabric.
Figure 5-6 Fabric Manager Verifying Domains
Figure 5-7 shows that VSAN 99 is operating in interop mode.
Figure 5-7 Verifying Interop Mode is Set
Figure 5-8 shows the MDS 9509 switch name server. This shows the edge devices that have registered.
Figure 5-8 MDS 9509 Switch Name Server Entries
Figure 5-9 shows the FSPF routes as calculated by this switch.
Figure 5-9 FSPF Calculations in Fabric Manager
Zoning
In this example topology, Fabric Manager was used to create zones and zone sets. Fabric Manager displays are also used to verify the zone and zone set information.
Figure 5-10 shows the zones and zone sets displayed in Fabric Manager.
Figure 5-10 Zoning Configuration for MDS 9000 Switch and McData Dual Core Topology
Figure 5-11 shows the zone VZ1.
Figure 5-11 Zone VZ1 Displayed in Fabric Manager
Figure 5-12 shows the FSPF traffic flow in this multi-vendor fabric.
Figure 5-12 MDS 9000 Switch and McData Dual Core FSPF Data Flow