Table Of Contents

MDS 9000 Core with Brocade and McData Edge Topology (Interop Mode 1)

Specifications

Expected Topology Behavior

Zoning

FSPF

Trunking and PortChannels

Domain IDs

Configuration

Configuring the McData 3032 Switch

Configuring the MDS 9000 Switch and the Brocade Switches

Verification

Verifying the MDS 9509 Switch

Verifying the Brocade 3800 Switch

Verifying the Brocade 3200 Switch

Verifying the McData 3032 Switch

Zoning

Verifying Zoning with Fabric Manager

Verifying Zoning with the Brocade 3800 Switch

Verifying Zoning with the Brocade 3200 Switch

Verifying Zoning with the McData 3032 Switch

MDS 9000 Core with Brocade and McData Edge Topology (Interop Mode 1)

---

This chapter describes how to set up a basic core-edge topology with an MDS 9000 switch configured for interop mode 1 at the core, and two Brocade switches and one McData switch at the edge. All devices are connected to the edge switches. However, all traffic must flow through the core switch to reach its destination.

This chapter includes the following sections:

•Specifications

•Expected Topology Behavior

•Configuration

•Verification

•Zoning

Specifications

The following switches and code levels were used for this example configuration:

•MDS 9509 running MDS SAN-OS Release 1.0(1)

•Brocade 3800 Version 3.0.2

•Brocade 3200 Version 3.0.2

•McData 3032 Version 04.01.00 12

The example configuration uses MDS 9509 switches in the core, and Brocade 3200, Brocade 3800, and McData 3032 switches on the edge.

Figure 4-1 shows the topology used for this example configuration.

Figure 4-1 Dual MDS 9509 Switch Core with Brocade and McData Switch Edge Topology

---

Note The VZ1 JBOD is an arbitrated loop with three public drives, and the VZ2 JBOD is an arbitrated loop with seven private drives.

---

Expected Topology Behavior

This section covers the Fibre Channel services and features that act differently in this topology (Figure 4-1) as compared to a homogeneous, single-vendor implementation.

This section includes the following topics:

•Zoning

•FSPF

•Trunking and PortChannels

•Domain IDs

Zoning

All zone members will be pWWNs in the core-edge topology because the Brocade domain/port nomenclature is not a valid form (per the FC standard), and the McData switch only supports zone members based upon pWWNs. When a zone set (or configuration, in Brocade terminology) activation is made at the core, the zone set activation reaches all switches at the same time because all the switches are one hop away (except for the other core switch, which is two hops away).

The edge switches provide all of the zone security, because the MDS 9000 switch does not check the source or destination of the frame when traversing E ports. Brocade switches only check the zoning information on the egress port of the fabric.

---

Note After two active zone sets successfully merge, always copy the active zone set to the full zone set database prior to modifying it on the MDS 9000 switch.

---

FSPF

All links within the topology appear with the link cost of 500, except for the two paths leading to the McData 3032 switches. These paths are running at 1 Gbps and appear with a cost of 1000.

The Brocade switches load balance their routes using source and destination; the ingress edge switch uses the same core switch for all traffic that has the same source and destination pair. If the Brocade switch could load balance using source/destination/ox-id, then it could choose either of the two core switches for the route through the fabric. The two-level core does not allow the MDS 9000 switch, which can load balance using source/destination/ox-id, to load balance across multiple edge switches.

Trunking and PortChannels

The lack of MDS 9000 switch-to-MDS 9000-switch connections prohibits the topology from containing TE ports or PortChannels. While in interop mode, the Brocade switches do not support trunked ports of any type. Only standard E ports are used for the ISLs.

Domain IDs

The domain IDs are limited to the 97 to 127 range due to a restriction imposed by McData's inability to handle IDs outside of that range. While Brocade switches and MDS 9000 switches can handle domain IDs outside of this range, their implementation of interoperability mode includes this limitation.

Domain ID modifications can be handled in two ways, disruptively or nondisruptively:

•Disruptive—This event impacts the entire switch. When changing domain IDs, Brocade and McData both require the entire switch to be taken offline and/or rebooted.

•Nondisruptive—This event is limited to the VSAN where the event is taking place. Only the MDS 9000 switch can perform this action, as the domain manager process for this VSAN is restarted and not the entire switch. This requires any device logged into the VSAN to log into the fabric again to obtain a new FC ID.

Configuration

This section describes the configuration process and includes the following topics:

•Configuring the McData 3032 Switch

•Configuring the MDS 9000 Switch and the Brocade Switches

Configuring the McData 3032 Switch

In this example, the McData 3032 switch is configured for interop mode using Telnet and the CLI. The switch is placed in an offline state, the default zone is set to deny, the domain ID is set, and timers are altered to match the fabric.

Follow these steps to configure the McData 3032 switch.

---

Step 1 Display current switch information.

Root> show switch

Switch Information

State:                  Online

BB Credit:              16

R_A_TOV:                100   <==== must match other fabric switches

E_D_TOV:                20    <==== must match other fabric switches

Preferred Domain ID:    1

Switch Priority:        Default

Speed:                  1 Gb/sec

Rerouting Delay:        Disabled

Operating Mode:         Open Systems

Interop Mode:           McDATA Fabric 1.0          <==== non interop mode

Active Domain ID:       1

World Wide Name:        10:00:08:00:88:60:A0:DB

Insistent Domain ID:    Disabled

Domain RSCN:            Disabled

Step 2 Alter the timers, RA_TOV and ED_TOV, if needed. These options are listed in the config switch menu.

Root> config switch

Config.Switch> 

..                - Move back one level

bbCredit          - Set the buffer to buffer credit value for the switch

commadelim        - Toggle comma-delimited display mode

domainRSCN        - Set the Domain RSCN state for the switch

edTOV             - Set the E_D_TOV for the switch

insistDomainId    - Set the Insistent Domain ID state for the switch

interopMode       - Set the Interoperability mode for the switch

login             - Login to CLI under different access rights

logout            - Logout of CLI

prefDomainId      - Set the preferred domain id for the switch

priority          - Set the switch priority

raTOV             - Set the R_A_TOV for the switch

rerouteDelay      - Enable or disable the reroute delay

root              - Move back to root level

show              - Display the switch configuration

speed             - Set the switch operating speed

Step 3 Set the switch offline. The switch must be offline before changing the mode to interop.

Config.Switch> interopmode open

Error 45:  Not Allowed While Switch Online

---

Note To change to interop mode, the switch must be set to offline.

---

Root> maint

Maint> system

Maint.System> setOnlineState 0

Maint.System> .

Maint> .

Root> show switch

Switch Information

State:                  Offline   <==== switch is now offline

BB Credit:              16

R_A_TOV:                100

E_D_TOV:                20

Preferred Domain ID:    1

Switch Priority:        Default

Speed:                  1 Gb/sec

Rerouting Delay:        Disabled

Operating Mode:         Open Systems

Interop Mode:           McDATA Fabric 1.0

Active Domain ID:       1

World Wide Name:        10:00:08:00:88:60:A0:DB

Insistent Domain ID:    Disabled

Domain RSCN:            Disabled

Step 4 Set the default zone to deny, and set the mode to interop. As shown in this example, the switch cannot be set to interop mode without first setting the default zone to deny.

Root> config switch

Config.Switch> interopmode open

Error 81:  Default Zone Enabled

Root> config zoning

Config.Zoning> setDefZoneState 0

Config.Zoning> ..

Config> switch

Config.Switch> interopmode open

Config.Switch> ..

Config> ..

Root> show switch

Switch Information

State:                  Offline   <==== still offline

BB Credit:              16

R_A_TOV:                100

E_D_TOV:                20

Preferred Domain ID:    1

Switch Priority:        Default

Speed:                  1 Gb/sec

Rerouting Delay:        Disabled

Operating Mode:         Open Systems

Interop Mode:           Open Fabric 1.0     <==== now in interop mode

Active Domain ID:       1

World Wide Name:        10:00:08:00:88:60:A0:DB

Insistent Domain ID:    Disabled

Domain RSCN:            Disabled

Step 5 Set the preferred domain ID, with an offset of 0x60. In this example, the McData switch is domain ID 0x61 (97). The FC_IDs for nodes on this switch are 61xxxx.

Root> config switch

Config.Switch> prefDomainId 1

Config.Switch> ..

Config> ..

Root> maint

Maint> system

Maint.System> setonlinestate 1

Maint.System> ..

Maint> ..

Root> show switch

Switch Information

State:                  Online            <==== online

BB Credit:              16

R_A_TOV:                100

E_D_TOV:                20

Preferred Domain ID:    1

Switch Priority:        Default

Speed:                  1 Gb/sec

Rerouting Delay:        Disabled

Operating Mode:         Open Systems

Interop Mode:           Open Fabric 1.0   <==== interop mode      

Active Domain ID:       0

World Wide Name:        10:00:08:00:88:60:A0:DB

Insistent Domain ID:    Disabled

Domain RSCN:            Disabled

Configuring the MDS 9000 Switch and the Brocade Switches

See "MDS 9000 Core with Brocade Edge Topology (Interop Mode 1)," for examples of how to set the MDS 9000 switch and Brocade switches to interop mode.

Verification

This section highlights the commands used to verify that the fabric is up and running in interoperability mode. It includes the following topics:

•Verifying the MDS 9509 Switch

•Verifying the Brocade 3800 Switch

•Verifying the Brocade 3200 Switch

•Verifying the McData 3032 Switch

Verifying the MDS 9509 Switch

The following examples show the commands used to verify the configuration of the first MDS 9509 switch (MDS 9509-A) (see Figure 4-1).

MDS9509A# show ver

Cisco Storage Area Networking Operating System (SAN-OS) Software

TAC support: http://www.cisco.com/tac

Copyright (c) 1986-2002 by cisco Systems, Inc.

Software

  kickstart: version 1.0(1) [build 1.0(0.260c)] [gdb]

  system:    version 1.0(1) [build 1.0(0.260c)] [gdb]

Hardware

  RAM 1932864 kB

  bootflash: 503808 blocks (block size 512b)

  slot0:          0 blocks (block size 512b)

  kickstart compile time: 11/7/2002 21:00:00

  system compile time: 11/7/2002 20:00:00

MDS9509A# show int brief

-------------------------------------------------------------------------------

Interface  Vsan   Admin  Admin   Status           Oper  Oper   Port-channel

                  Mode   Trunk                    Mode  Speed

                         Mode                           (Gbps)

-------------------------------------------------------------------------------

fc2/1      1      auto   on      up               E     2      --

fc2/2      1      auto   off     up               E     1      --

fc2/3      1      auto   on      notConnected     --    --     --

fc2/4      1      auto   on      down             --    --     --

fc2/5      1      auto   on      notConnected     --    --     --

fc2/6      1      auto   on      down             --    --     --

fc2/7      1      auto   on      up               E     2      --

fc2/8      1      auto   on      notConnected     --    --     --

fc2/9      1      auto   on      notConnected     --    --     --

fc2/10     1      auto   on      fcotAbsent       --    --     --

fc2/11     1      SD     --      up               SD    1      --

fc2/12     1      auto   on      notConnected     --    --     --

fc2/13     1      auto   on      down             --    --     --

fc2/14     4094   auto   on      down             --    --     --

fc2/15     4094   auto   on      fcotAbsent       --    --     --

fc2/16     1      auto   on      notConnected     --    --     --

-------------------------------------------------------------------------------

Interface          Status   IP Address               Speed        MTU

-------------------------------------------------------------------------------

sup-fc0            up       --                       1 Gbps       2596

-------------------------------------------------------------------------------

Interface          Status   IP Address               Speed        MTU

-------------------------------------------------------------------------------

mgmt0              up       6.1.1.96/24              100 Mbps     1500

MDS9509A# show run

Building Configuration ...

 interface fc2/1

no shutdown

 interface fc2/2

switchport speed 1000

switchport trunk mode off

no shutdown

 interface fc2/3

no shutdown

 interface fc2/4

 interface fc2/5

no shutdown

 interface fc2/6

 interface fc2/7

no shutdown

 interface fc2/8

no shutdown

 interface fc2/9

no shutdown

 interface fc2/10

no shutdown

 interface fc2/11

switchport mode SD

switchport speed 1000

no shutdown

 interface fc2/12

no shutdown

 interface fc2/13

 interface fc2/14

 interface fc2/15

 interface fc2/16

no shutdown

 interface mgmt0

ip address 6.1.1.96 255.255.255.0

no shutdown

vsan database

vsan 1 interop

vsan 4094 interface fc2/14

vsan 4094 interface fc2/15

aaa accounting logsize 30000

boot system curr-isan.img_1419289659 sup-1

boot kickstart curr-ks.img_3653485566 sup-1

boot system curr-isan.img_1419289659 sup-2

boot kickstart curr-ks.img_3653485566 sup-2

fcdomain priority 254 vsan 1

fcdomain fabric-name 41:6e:64:69:61:6d:6f:21 vsan 1

fcdomain domain 100 preferred vsan 1

[snip]

MDS9509A# sh vsan 1

vsan 1 information

         name:VSAN0001  state:active

         interoperability mode:yes

         loadbalancing:src-id/dst-id/oxid

         operational state:up

MDS9509A# sh fcdomain vsan 1

The local switch is a Subordinated Switch.

Local switch run time information:

        State: Stable

        Local switch WWN:    20:01:00:05:30:00:51:1f

        Running fabric name: 10:00:00:60:69:50:0c:fe

        Running priority: 254

        Current domain ID: 0x64(100)

Local switch configuration information:

        State: Enabled

        Auto-reconfiguration: Disabled

        Contiguous-allocation: Disabled

        Configured fabric name: 41:6e:64:69:61:6d:6f:21

        Configured priority: 254

        Configured domain ID: 0x64(100) (preferred)

Principal switch run time information:

        Running priority: 2

Interface               Role          RCF-reject

----------------    -------------    ------------

fc2/1               Downstream       Disabled

fc2/2               Downstream       Disabled

fc2/7               Upstream         Disabled

----------------    -------------    ------------

MDS9509A# sh fcdomain domain-list vsan 1

Number of domains: 5

Domain ID              WWN

---------    -----------------------

 0x61(97)    10:00:08:00:88:60:a0:db

 0x63(99)    10:00:00:60:69:c0:0c:1d

0x64(100)    20:01:00:05:30:00:51:1f [Local]

0x65(101)    10:00:00:60:69:50:0c:fe [Principal]

0x6d(109)    20:01:00:05:30:00:47:9f

---------    -----------------------

MDS9509A# sh fspf internal route vsan 1

 FSPF Unicast Routes

---------------------------

 VSAN Number  Dest Domain   Route Cost    Next hops

-----------------------------------------------

           1     0x61(97)         1000        fc2/2

           1     0x63(99)          500        fc2/1

           1    0x65(101)          500        fc2/7

           1    0x6d(109)         1000        fc2/1

                                              fc2/7

MDS9509A# sh fcns data vsan 1

VSAN 1:

--------------------------------------------------------------------------

FCID        TYPE  PWWN                    (VENDOR)        FC4-TYPE:FEATURE

--------------------------------------------------------------------------

0x610813    N     10:00:00:00:c9:24:3d:90 (Emulex)        scsi-fcp

0x610a13    N     50:06:01:60:88:02:90:cb                 scsi-fcp

0x630400    N     10:00:00:00:c9:24:3f:75 (Emulex)        scsi-fcp

0x6305e2    NL    21:00:00:20:37:a7:ca:b7 (Seagate)       scsi-fcp

0x6305e4    NL    21:00:00:20:37:a7:c7:e0 (Seagate)       scsi-fcp

0x6305e8    NL    21:00:00:20:37:a7:c7:df (Seagate)       scsi-fcp

0x6504dc    NL    21:00:00:20:37:28:34:9e (Seagate)       scsi-fcp

0x6504e0    NL    21:00:00:20:37:28:23:8a (Seagate)       scsi-fcp

0x6504e1    NL    21:00:00:20:37:28:31:70 (Seagate)       scsi-fcp

0x6504e2    NL    21:00:00:20:37:28:28:c2 (Seagate)       scsi-fcp

0x6504e4    NL    21:00:00:20:37:28:2f:46 (Seagate)       scsi-fcp

0x6504e8    NL    21:00:00:20:37:28:26:0d (Seagate)       scsi-fcp

0x6504ef    NL    21:00:00:20:37:28:2e:65 (Seagate)       scsi-fcp

0x650500    N     10:00:00:e0:69:f0:43:9f (JNI)

Total number of entries = 14

The following examples show the commands used to verify the configuration of the second MDS 9509 switch (MDS 9509-B) (see Figure 4-1).

MDS9509B# show version

Cisco Storage Area Networking Operating System (SAN-OS) Software

TAC support: http://www.cisco.com/tac

Copyright (c) 1986-2002 by cisco Systems, Inc.

Software

  kickstart: version 1.0(1) [build 1.0(0.260c)] [gdb]

  system:    version 1.0(1) [build 1.0(0.260c)] [gdb]

Hardware

  RAM 963116 kB

  bootflash: 503808 blocks (block size 512b)

  slot0:          0 blocks (block size 512b)

  kickstart compile time: 11/7/2002 21:00:00

  system compile time: 11/7/2002 21:00:00

MDS9509B# sh int brief 

Interface  Vsan   Admin  Admin   Status           Oper  Oper   Port-channel

                  Mode   Trunk                    Mode  Speed

                         Mode                           (Gbps)

-------------------------------------------------------------------------------

fc1/1      1      auto   on      up               E     1      --

fc1/2      1      auto   on      fcotAbsent       --    --     --

fc1/3      1      auto   on      up               E     2      --

fc1/4      1      auto   on      notConnected     --    --     --

fc1/5      1      auto   on      notConnected     --    --     --

fc1/6      1      auto   on      up               E     2      --

fc1/7      1      auto   on      fcotAbsent       --    --     --

fc1/8      1      auto   on      fcotAbsent       --    --     --

fc1/9      1      auto   on      notConnected     --    --     --

fc1/10     1      SD     --      fcotAbsent       --    --     --

fc1/11     1      auto   off     fcotAbsent       --    --     --

fc1/12     1      auto   on      notConnected     --    --     --

fc1/13     1      auto   on      fcotAbsent       --    --     --

fc1/14     1      auto   on      notConnected     --    --     --

fc1/15     1      auto   on      fcotAbsent       --    --     --

fc1/16     1      auto   on      fcotAbsent       --    --     --

-------------------------------------------------------------------------------

Interface          Status   IP Address               Speed        MTU

-------------------------------------------------------------------------------

sup-fc0            up       --                       1 Gbps       2596

-------------------------------------------------------------------------------

Interface          Status   IP Address               Speed        MTU

-------------------------------------------------------------------------------

mgmt0              up       6.1.1.95/24              100 Mbps     1500

MDS9509B# sh run

Building Configuration ...

 interface fc1/1

no shutdown

 interface fc1/2

no shutdown

 interface fc1/3

no shutdown

 interface fc1/4

no shutdown

 interface fc1/5

no shutdown

 interface fc1/6

no shutdown

 interface fc1/7

no shutdown

 interface fc1/8

no shutdown

 interface fc1/9

no shutdown

 interface fc1/10

switchport mode SD

switchport speed 2000

no shutdown

 interface fc1/11

switchport trunk mode off

no shutdown

 interface fc1/12

no shutdown

 interface fc1/13

no shutdown

 interface fc1/14

no shutdown

 interface fc1/15

no shutdown

 interface fc1/16

no shutdown

interface mgmt0

ip address 6.1.1.95 255.255.255.0

no shutdown

vsan database

vsan 1 interop

aaa accounting logsize 30000

boot system bootflash:/m9200-ek9-mzg.1.0.0.260c.bin

boot kickstart bootflash:/m9200-ek9-kickstart-mzg.1.0.0.260c.bin

fcdomain fabric-name 41:6e:64:69:61:6d:6f:21 vsan 1

fcdomain domain 109 preferred vsan 1

line console

  speed 38400

switchname MDS9509B

MDS9509B# sh vsan 1

vsan 1 information

         name:VSAN0001  state:active

         interoperability mode:yes

         loadbalancing:src-id/dst-id/oxid

         operational state:up

MDS9509B# sh fcdomain vsan 1

The local switch is a Subordinated Switch.

Local switch run time information:

        State: Stable

        Local switch WWN:    20:01:00:05:30:00:47:9f

        Running fabric name: 10:00:00:60:69:50:0c:fe

        Running priority: 128

        Current domain ID: 0x6d(109)

Local switch configuration information:

        State: Enabled

        Auto-reconfiguration: Disabled

        Contiguous-allocation: Disabled

        Configured fabric name: 41:6e:64:69:61:6d:6f:21

        Configured priority: 128

        Configured domain ID: 0x6d(109) (preferred)

Principal switch run time information:

        Running priority: 2

Interface               Role          RCF-reject

----------------    -------------    ------------

fc1/1               Upstream         Disabled

fc1/3               Non-principal    Disabled

fc1/6               Non-principal    Disabled

----------------    -------------    ------------

MDS9509B# sh fcdomain domain-list vsan 1

Number of domains: 5

Domain ID              WWN

---------    -----------------------

 0x61(97)    10:00:08:00:88:60:a0:db

 0x63(99)    10:00:00:60:69:c0:0c:1d

0x64(100)    20:01:00:05:30:00:51:1f

0x65(101)    10:00:00:60:69:50:0c:fe [Principal]

0x6d(109)    20:01:00:05:30:00:47:9f [Local]

---------    -----------------------

MDS9509B# sh fspf internal route vsan 1

FSPF Unicast Routes

---------------------------

 VSAN Number  Dest Domain   Route Cost    Next hops

-----------------------------------------------

           1     0x61(97)         1000        fc1/1

           1     0x63(99)          500        fc1/3

           1    0x64(100)         1000        fc1/3

                                              fc1/6

           1    0x65(101)          500        fc1/6

MDS9509B# sh fcns data vsan 1

VSAN 1:

--------------------------------------------------------------------------

FCID        TYPE  PWWN                    (VENDOR)        FC4-TYPE:FEATURE

--------------------------------------------------------------------------

0x610813    N     10:00:00:00:c9:24:3d:90 (Emulex)        scsi-fcp

0x610a13    N     50:06:01:60:88:02:90:cb                 scsi-fcp

0x630400    N     10:00:00:00:c9:24:3f:75 (Emulex)        scsi-fcp

0x6305e2    NL    21:00:00:20:37:a7:ca:b7 (Seagate)       scsi-fcp

0x6305e4    NL    21:00:00:20:37:a7:c7:e0 (Seagate)       scsi-fcp

0x6305e8    NL    21:00:00:20:37:a7:c7:df (Seagate)       scsi-fcp

0x6504dc    NL    21:00:00:20:37:28:34:9e (Seagate)       scsi-fcp

0x6504e0    NL    21:00:00:20:37:28:23:8a (Seagate)       scsi-fcp

0x6504e1    NL    21:00:00:20:37:28:31:70 (Seagate)       scsi-fcp

0x6504e2    NL    21:00:00:20:37:28:28:c2 (Seagate)       scsi-fcp

0x6504e4    NL    21:00:00:20:37:28:2f:46 (Seagate)       scsi-fcp

0x6504e8    NL    21:00:00:20:37:28:26:0d (Seagate)       scsi-fcp

0x6504ef    NL    21:00:00:20:37:28:2e:65 (Seagate)       scsi-fcp

0x650500    N     10:00:00:e0:69:f0:43:9f (JNI)

Total number of entries = 14

Verifying the Brocade 3800 Switch

The following examples show the commands used to verify the configuration of the Brocade 3800 switch (see Figure 4-1).

B3800_IBM_SAN:admin> version

Kernel:     5.3.1

Fabric OS:  v3.0.2

Made on:    Thu Jan 10 17:41:15 PST 2002

Flash:      Thu Jan 10 17:42:37 PST 2002

BootProm:   Wed May 23 12:37:30 PDT 2001

B3800_IBM_SAN:admin> licenseshow

R99yydyQzcSAAzz1:

    Web license

    Zoning license

    Fabric license

SSbdSSQRR9TTceT8:

    QuickLoop license

B3800_IBM_SAN:admin> switchshow

switchName:     B3800_IBM_SAN

switchType:     9.1

switchState:    Online

switchMode:     Interop

switchRole:     Principal

switchDomain:   101

switchId:       fffc65

switchWwn:      10:00:00:60:69:50:0c:fe

switchBeacon:   OFF

Zoning:         OFF

port  0: -- N2 No_Module

port  1: -- N2 No_Module

port  2: id 1G No_Light

port  3: id 1G No_Light

port  4: id N1 Online       L-Port 7 private, 1 phantom

port  5: id N1 Online       F-Port 10:00:00:e0:69:f0:43:9f

port  6: id N2 Online       E-Port 20:01:00:05:30:00:47:9f

port  7: id N2 Online       E-Port 20:01:00:05:30:00:51:1f (downstream)

port  8: id N2 No_Light

port  9: -- N2 No_Module

port 10: -- N2 No_Module

port 11: -- N2 No_Module

port 12: -- N2 No_Module

port 13: -- N2 No_Module

port 14: -- N2 No_Module

port 15: -- N2 No_Module

B3800_IBM_SAN:admin> topologyshow

5 domains in the fabric; Local Domain ID: 101

Domain   Metric   Hops   Out Port   In Ports   Flags   Bandwidth   Name

-----------------------------------------------------------------------

  97      1500      2        6     0x00000020    D      2 (Gbs)   Unreachable

                             7     0x00000010    D      2 (Gbs)

  99      1000      2        7     0x00000020    D      2 (Gbs)   "3200_TOP"

                             6     0x00000010    D      2 (Gbs)

 100       500      1        7     0x00000070    D      2 (Gbs)   Unreachable

 109       500      1        6     0x000000b0    D      2 (Gbs)   Unreachable

B3800_IBM_SAN:admin> nsshow

{

 Type Pid    COS     PortName                NodeName                 TTL(sec)

 NL   6504dc;      3;21:00:00:20:37:28:34:9e;20:00:00:20:37:28:34:9e; na

    FC4s: FCP [SEAGATE ST118202FC      FDF6]

    Fabric Port Name: 20:04:00:60:69:50:0c:fe

 NL   6504e0;      3;21:00:00:20:37:28:23:8a;20:00:00:20:37:28:23:8a; na

    FC4s: FCP [SEAGATE ST118202FC      FDF6]

    Fabric Port Name: 20:04:00:60:69:50:0c:fe

 NL   6504e1;      3;21:00:00:20:37:28:31:70;20:00:00:20:37:28:31:70; na

    FC4s: FCP [SEAGATE ST118202FC      FDF6]

    Fabric Port Name: 20:04:00:60:69:50:0c:fe

 NL   6504e2;      3;21:00:00:20:37:28:28:c2;20:00:00:20:37:28:28:c2; na

    FC4s: FCP [SEAGATE ST118202FC      FDF6]

    Fabric Port Name: 20:04:00:60:69:50:0c:fe

 NL   6504e4;      3;21:00:00:20:37:28:2f:46;20:00:00:20:37:28:2f:46; na

    FC4s: FCP [SEAGATE ST118202FC      FDF6]

    Fabric Port Name: 20:04:00:60:69:50:0c:fe

 NL   6504e8;      3;21:00:00:20:37:28:26:0d;20:00:00:20:37:28:26:0d; na

    FC4s: FCP [SEAGATE ST118202FC      FDF6]

    Fabric Port Name: 20:04:00:60:69:50:0c:fe

 NL   6504ef;      3;21:00:00:20:37:28:2e:65;20:00:00:20:37:28:2e:65; na

    FC4s: FCP [SEAGATE ST118202FC      FDF6]

    Fabric Port Name: 20:04:00:60:69:50:0c:fe

 N    650500;      3;10:00:00:e0:69:f0:43:9f;10:00:00:e0:69:f0:43:9f; na

    Fabric Port Name: 20:05:00:60:69:50:0c:fe

The Local Name Server has 8 entries }

B3800_IBM_SAN:admin> nsallshow

{

  610813 610a13 630400 6305e2 6305e4 6305e8 6504dc 6504e0

  6504e1 6504e2 6504e4 6504e8 6504ef 65050014 Nx_Ports in the Fabric }

B3800_IBM_SAN:admin> urouteshow

Local Domain ID: 101

In Port    Domain    Out Port    Metric    Hops    Flags    Next (Dom, Port)

----------------------------------------------------------------------------

   4         97          7        1500       2       D          100,65798

             99          6        1000       2       D          109,65541

            100          7         500       1       D          100,65798

            109          6         500       1       D          109,65541

   5         97          6        1500       2       D          109,65541

             99          7        1000       2       D          100,65798

            100          7         500       1       D          100,65798

            109          6         500       1       D          109,65541

   6        100          7         500       1       D          100,65798

   7        109          6         500       1       D          109,65541

You can use Fabric Manager and Device Manager to verify the current state of the fabric.

Figure 4-2 shows the fabric topology using Fabric Manager.

Figure 4-2 MDS 9509 Switch Fabric Manager Map

Figure 4-3 shows the Cisco Device Manager on an MDS 9509 switch in the example topology. This shows which ports are active E ports.

Figure 4-3 MDS 9509 Switch Device Manager

Figure 4-4 shows the status of the E ports and can verify link speed.

Figure 4-4 MDS 9509 Switch E ports

Figure 4-5 shows the domain ID of the switches in the fabric.

Figure 4-5 MDS 9509 Switch Domain Manager

Figure 4-6 shows that VSAN 1 is operating in interop mode.

Figure 4-6 VSAN 1 Operating in Interop Mode on an MDS 9509 Switch

Figure 4-7 shows the MDS 9509 switch name server. This shows the edge devices that have registered.

Figure 4-7 MDS 9509 Switch Name Server Showing McData and Brocade Devices

Figure 4-8 shows the FSPF routes as calculated by this switch.

Figure 4-8 MDS 9509 Switch Showing FC Routes

Verifying the Brocade 3200 Switch

The following examples show the commands used to verify the configuration of the Brocade 3200 switch (see Figure 4-1).

3200_TOP:admin> version

Kernel:     5.3.1

Fabric OS:  v3.0.2

Made on:    Thu Jan 10 17:41:15 PST 2002

Flash:      Thu Jan 10 17:42:37 PST 2002

BootProm:   Tue Oct 30 10:24:38 PST 2001

3200_TOP:admin> licenseshow

R9bdbybzSQSAcecJ:

    Web license

bQyecQdSbScRzfd7:

    Zoning license

RbbSed9RRSSccTfd:

    QuickLoop license

b99dde9cSdcAAeer:

    Fabric license

3200_TOP:admin> switchshow

switchName:     3200_TOP

switchType:     16.2

switchState:    Online

switchMode:     Interop

switchRole:     Subordinate

switchDomain:   99

switchId:       fffc63

switchWwn:      10:00:00:60:69:c0:0c:1d

switchBeacon:   OFF

Zoning:         OFF

port  0: id N2 No_Light

port  1: id N2 Online       E-Port 20:01:00:05:30:00:51:1f (upstream)

port  2: id N2 No_Light

port  3: id N2 Online       E-Port 20:01:00:05:30:00:47:9f

port  4: id N1 Online       F-Port 10:00:00:00:c9:24:3f:75

port  5: id N1 Online       L-Port 3 public

port  6: id N2 No_Light

port  7: -- N2 No_Module

3200_TOP:admin> topologyshow

5 domains in the fabric; Local Domain ID: 99

Domain   Metric   Hops   Out Port   In Ports   Flags   Bandwidth   Name

-----------------------------------------------------------------------

  97      1500      2        1     0x00000020    D      2 (Gbs)   Unreachable

                             3     0x00000010    D      2 (Gbs)

 100       500      1        1     0x00000038    D      2 (Gbs)   Unreachable

 101      1000      2        1     0x00000020    D      2 (Gbs)   "B3800_IBM_SAN"

                             3     0x00000010    D      2 (Gbs)

 109       500      1        3     0x00000032    D      2 (Gbs)   Unreachable

3200_TOP:admin> nsshow

{

 Type Pid    COS     PortName                NodeName                 TTL(sec)

 N    630400;    2,3;10:00:00:00:c9:24:3f:75;20:00:00:00:c9:24:3f:75; na

    FC4s: FCP

    Fabric Port Name: 20:04:00:60:69:c0:0c:1d

 NL   6305e2;      3;21:00:00:20:37:a7:ca:b7;20:00:00:20:37:a7:ca:b7; na

    FC4s: FCP [SEAGATE ST318451FC      0001]

    Fabric Port Name: 20:05:00:60:69:c0:0c:1d

 NL   6305e4;      3;21:00:00:20:37:a7:c7:e0;20:00:00:20:37:a7:c7:e0; na

    FC4s: FCP [SEAGATE ST318451FC      0001]

    Fabric Port Name: 20:05:00:60:69:c0:0c:1d

 NL   6305e8;      3;21:00:00:20:37:a7:c7:df;20:00:00:20:37:a7:c7:df; na

    FC4s: FCP [SEAGATE ST318451FC      0001]

    Fabric Port Name: 20:05:00:60:69:c0:0c:1d

The Local Name Server has 4 entries }

3200_TOP:admin> nsallshow

{

  610813 610a13 630400 6305e2 6305e4 6305e8 6504dc 6504e0

  6504e1 6504e2 6504e4 6504e8 6504ef 650500

14 Nx_Ports in the Fabric }

3200_TOP:admin> urouteshow

Local Domain ID: 99

In Port    Domain    Out Port    Metric    Hops    Flags    Next (Dom, Port)

----------------------------------------------------------------------------

   1        109          3         500       1       D          109,65538

   3        100          1         500       1       D          100,65792 

   4         97          3        1500       2       D          109,65538

            100          1         500       1       D          100,65792

            101          3        1000       2       D          109,65538

            109          3         500       1       D          109,65538

   5         97          1        1500       2       D          100,65792

            100          1         500       1       D          100,65792

            101          1        1000       2       D          100,65792

            109          3         500       1       D          109,65538

Verifying the McData 3032 Switch

Issue the show switch command to show current switch information.

Root> show switch

Switch Information

State:                  Online

BB Credit:              16

R_A_TOV:                100

E_D_TOV:                20

Preferred Domain ID:    1

Switch Priority:        Default

Speed:                  1 Gb/sec

Rerouting Delay:        Disabled

Operating Mode:         Open Systems

Interop Mode:           Open Fabric 1.0    Interop mode

Active Domain ID:       1

World Wide Name:        10:00:08:00:88:60:A0:DB

Insistent Domain ID:    Disabled

Domain RSCN:            Disabled

Issue the show system command to show current system information.

Root> show system

System Information

Name:                McData_3032

Description:         Fibre Channel Switch

Contact:             RTP_SAN_team

Location:            End User Premise (please configure)

Date/Time:           11/19/2002 16:41:11

Serial Number:       S200138

Type Number:         ES3032

Model Number:        ES

EC Level:            -

Firmware Version:    04.01.00 12

Beaconing:           Disabled

Issue the show port status command to verify that the correct ports are online and are of type E port or F port.

Root> show port status

Port  State               Type   Attached WWN             Beaconing  Reason

----  ------------------  -----  -----------------------  ---------  ------

0     No Light            gPort  00:00:00:00:00:00:00:00  Off

1     Online              ePort  20:01:00:05:30:00:47:9F  Off

2     Online              ePort  20:01:00:05:30:00:51:1F  Off

3     Not Installed       gPort  00:00:00:00:00:00:00:00  Off

4     Online              fPort  10:00:00:00:C9:24:3D:90  Off

5     Inactive            gPort  00:00:00:00:00:00:00:00  Off        28

6     Online              fPort  50:06:01:60:88:02:90:CB  Off

7     Not Installed       gPort  00:00:00:00:00:00:00:00  Off

8     Not Installed       gPort  00:00:00:00:00:00:00:00  Off

9     Not Installed       gPort  00:00:00:00:00:00:00:00  Off

10    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

11    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

12    No Light            gPort  00:00:00:00:00:00:00:00  Off

13    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

14    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

15    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

16    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

17    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

18    No Light            gPort  00:00:00:00:00:00:00:00  Off

19    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

20    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

21    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

22    No Light            gPort  00:00:00:00:00:00:00:00  Off

23    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

24    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

25    No Light            gPort  00:00:00:00:00:00:00:00  Off

26    No Light            gPort  00:00:00:00:00:00:00:00  Off

27    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

28    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

29    No Light            gPort  00:00:00:00:00:00:00:00  Off

30    No Light            gPort  00:00:00:00:00:00:00:00  Off

31    Not Installed       gPort  00:00:00:00:00:00:00:00  Off

28: Optics Speed Conflict

The show nameserver command shows that the EMC Clarion 4500 and Dellsrv1 host have logged into the McData switch.

Root> show nameserver

Type  Port Id  Port Name                Node Name                COS  FC4 Types

----  -------  -----------------------  -----------------------  ---  ----------

fPort 610813   20:00:00:00:C9:24:3D:90  10:00:00:00:C9:24:3D:90  2-3  2

fPort 610A13   50:06:01:60:11:02:90:CB  50:06:01:60:88:02:90:CB  3    2

0. ISO/IEC 8802-2 LLC

1. ISO/IEC 8802-2 LLC/SNAP

2. SCSI-FCP

3. SCSI-GPP

4. IPI-3 Master

5. IPI-3 Slave

6. IPI-3 Peer

7. CP IPI-3 Master

8. CP IPI-3 Slave

9. CP IPI-3 Peer

10. SBCCS-Channel

11. SBCCS-Cntrl Unit

12. FC Srvcs

13. FC-FG

14. FC-XS

15. FC-AL

16. SNMP

17. HIPPI-FP

18. Vendor Unique

Root> show loginserver

Port  BB Crdt  RxFldSz  COS  Port Name                Node Name

----  -------  -------  ---  -----------------------  -----------------------

4     64       2048     2-3  20:00:00:00:C9:24:3D:90  10:00:00:00:C9:24:3D:90

6     4        1024     3    50:06:01:60:11:02:90:CB  50:06:01:60:88:02:90:CB

To view the FSPF routes used by the McData 3032 switch, use the WebTools GUI (see Figure 4-9 and Figure 4-10). There is no command line display available to show this information.

Figure 4-9 McData 3032 Switch FSPF Routes

Figure 4-10 McData 3032 Switch Topology View

Zoning

In this section, the zones and zone sets are created using the Fabric Manager (see Figure 4-11.) The Fabric Manager is also used to verify the zoning, along with the Brocade and McData switch command line displays.

This section includes the following topics:

•Verifying Zoning with Fabric Manager

•Verifying Zoning with the Brocade 3800 Switch

•Verifying Zoning with the Brocade 3200 Switch

•Verifying Zoning with the McData 3032 Switch

Figure 4-11 Configuring Zones in Fabric Manager

Verifying Zoning with Fabric Manager

Figure 4-12 shows the zone VZ1 on the Fabric Manager.

Figure 4-12 Highlighting Zone VZ1 in Fabric Manager

Figure 4-13 shows the zone VZ2 on the Fabric Manager.

Figure 4-13 Highlighting Zone VZ2 in Fabric Manager

Figure 4-14 shows the zone VZ3 on the Fabric Manager.

Figure 4-14 Highlighting Zone VZ3 in Fabric Manager

Verifying Zoning with the Brocade 3800 Switch

The following examples show the commands used to verify zoning for the Brocade 3800 switch (see Figure 4-1).

B3800_IBM_SAN:admin> cfgshow

Defined configuration:

 no configuration defined

Effective configuration:

 cfg:   mdszoneset1

 zone:  vz1     21:00:00:20:37:a7:ca:b7

                21:00:00:20:37:a7:c7:e0

                21:00:00:20:37:a7:c7:df

                10:00:00:00:c9:24:3d:90

 zone:  vz2     21:00:00:20:37:28:28:c2

                21:00:00:20:37:28:26:0d

                21:00:00:20:37:28:31:70

                21:00:00:20:37:28:2f:46

                21:00:00:20:37:28:23:8a

                21:00:00:20:37:28:34:9e

                10:00:00:00:c9:24:3f:75

                21:00:00:20:37:28:2e:65

 zone:  vz3     50:06:01:60:88:02:90:cb

                10:00:00:e0:69:f0:43:9f

Verifying Zoning with the Brocade 3200 Switch

The following examples show the commands used to verify zoning for the Brocade 3200 switch (see Figure 4-1).

3200_TOP:admin> cfgshow

Defined configuration:

 no configuration defined

Effective configuration:

 cfg:   mdszoneset1

 zone:  vz1     21:00:00:20:37:a7:ca:b7

                21:00:00:20:37:a7:c7:e0

                21:00:00:20:37:a7:c7:df

                10:00:00:00:c9:24:3d:90

 zone:  vz2     21:00:00:20:37:28:28:c2

                21:00:00:20:37:28:26:0d

                21:00:00:20:37:28:31:70

                21:00:00:20:37:28:2f:46

                21:00:00:20:37:28:23:8a

                21:00:00:20:37:28:34:9e

                10:00:00:00:c9:24:3f:75

                21:00:00:20:37:28:2e:65

 zone:  vz3     50:06:01:60:88:02:90:cb

                10:00:00:e0:69:f0:43:9f

Verifying Zoning with the McData 3032 Switch

The following examples show the commands used to verify zoning for the McData 3032 switch in the configuration (see Figure 4-1).

Root> show zoning

Active Zone Set

Default Zone Enabled:    False

Zone Set:  mdszoneset1

  Zone:  vz1

    Zone Member:  21:00:00:20:37:A7:CA:B7

    Zone Member:  21:00:00:20:37:A7:C7:E0

    Zone Member:  21:00:00:20:37:A7:C7:DF

    Zone Member:  10:00:00:00:C9:24:3D:90

  Zone:  vz2

    Zone Member:  21:00:00:20:37:28:28:C2

    Zone Member:  21:00:00:20:37:28:26:0D

    Zone Member:  21:00:00:20:37:28:31:70

    Zone Member:  21:00:00:20:37:28:2F:46

    Zone Member:  21:00:00:20:37:28:23:8A

    Zone Member:  21:00:00:20:37:28:34:9E

    Zone Member:  10:00:00:00:C9:24:3F:75

    Zone Member:  21:00:00:20:37:28:2E:65

  Zone:  vz3

    Zone Member:  50:06:01:60:88:02:90:CB

    Zone Member:  10:00:00:E0:69:F0:43:9F

Figure 4-15 shows the FSPF traffic flow in this multi-vendor fabric.

Figure 4-15 Data Flow of Dual MDS 9509 Switch Core with Brocade and McData Switch Edge Topology