Chapter 1. Introduction

Deciding When to Upgrade EPLDs

Switch Requirements

EPLD Upgrades Available for Releases 6.1(2)I1(1) to 6.1(2)I2(3)

Determining Whether to Upgrade EPLD Images

Downloading the EPLD Images

Installation Guidelines

Upgrading the EPLD Images

Verifying the EPLD Upgrades

Displaying the Status of EPLD Upgrades

Chapter 1. Introduction

The Cisco Nexus 9000 Series switches contain several programmable logical devices (PLDs) that provide hardware functionalities in all modules. Cisco provides electronic programmable logic device (EPLD) image upgrades to enhance hardware functionality or to resolve known issues. PLDs include electronic programmable logic devices (EPLDs), field programmable gate arrays (FPGAs), and complex programmable logic devices (CPLDs), but they do not include ASICs. In this document, the term EPLD is used for FPGA and CPLDs.

The advantage of having EPLDs for some module functions is that when you need to upgrade those functions, you just upgrade their software images instead of replacing their hardware.

Note

EPLD image upgrades for an I/O module disrupt the traffic going through the module because the module must power down briefly during the upgrade. The system performs EPLD upgrades on one module at a time, so at any one time the upgrade disrupts only the traffic going through one module.

Cisco provides the latest EPLD images with each release. Typically, these images are the same as provided in earlier releases but occasionally some of these images are updated. These EPLD image updates are not mandatory unless otherwise specified. The EPLD image upgrades are independent from the Cisco NX-OS In Service Software Upgrade (ISSU) process, which upgrades the system and kickstart images with no impact on the network environment.

When Cisco makes an EPLD image upgrade available, these release notes announce their availability, and you can download them from Click Here .

- Deciding When to Upgrade EPLDs

- Switch Requirements

- EPLD Upgrades Available for Releases 6.1(2)I1(1) to 6.1(2)I2(3)

- Determining Whether to Upgrade EPLD Images

- Downloading the EPLD Images

- Installation Guidelines

- Upgrading the EPLD Images

- Verifying the EPLD Upgrades

- Displaying the Status of EPLD Upgrades

Deciding When to Upgrade EPLDs

When new EPLD images are available, the upgrades are always recommended if your network environment allows for a maintenance period in which some level of traffic disruption is acceptable. If such a disruption is not acceptable at this time, then you might consider postponing the upgrade until a better time.

Note

The EPLD upgrade operation is a disruptive operation. You should execute this operation only at a programmed maintenance time. The system/kickstart ISSU upgrade is a nondisruptive upgrade.

Note

Do not perform an EPLD upgrade during an ISSU system/kickstart upgrade.

Switch Requirements

The Cisco Nexus 9000 Series switch must be running the Cisco NX-OS operating system and include the following hardware:

- Supervisor modules—one or two, each with at least 200 MB of available bootflash memory (Cisco Nexus 95xx switches only)

- System controller modules—one or two (Cisco Nexus 95xx switches only)

- I/O modules (Cisco Nexus 95xx switches only)

- one to four for the Cisco Nexus 9504

- one to eight for the Cisco Nexus 9508

- Fabric modules—three or six (Cisco Nexus 95xx switches only)

- Fan tray modules—three for the Cisco Nexus 93128TX, 9396PX, and 95xx switches

You must be able to access the switch through a console, SSH, or Telnet (required for setting up a switch running in NX-OS mode but not required for a switch running in ACI-mode).

You must have administrator privileges to work with the Cisco Nexus 9000 Series switch.

EPLD Upgrades Available for Releases 6.1(2)I1(1) to 6.1(2)I2(3)

Each EPLD image that you can download from Click Here is a bundle of EPLD upgrades. To see the updated EPLD versions for the current release, see the following table (updates shown in boldface).

Switch/Component

Release 6.1(2)i1(1) (11/2013)

Release 6.1(2)i1(2) (12/2013)

Releases 6.1(2)i2(1) (3/2014)

Release 6.1(2)i2(2) (4/2014)

Release 6.1(2)i2(2a) (6/2014)

Release 6.1(2)i2(3) (6/2014)

Release 6.1(2)i2(2b) (8/2014)

Release 6.1(2)i1(3) (8/2014)

EPLD Device

Cisco Nexus 3000 Series switches running NX-OS software that supports the Cisco Nexus 9000 Series switches

Cisco Nexus 3164Q switch (N3K-C3164Q-40GE)

IO FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x04 (0.004)

N.A.1

0x04 (0.004)

N.A.[1]

MI FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x18 (0.024)1

N.A.1

0x18 (0.024)1

N.A.1

Cisco Nexus 93xxx switches and uplink modules

Cisco Nexus 93128TX ToR/leaf switch (N9K-C93128TX)

IO FPGA

N.A.1

N.A.1

0x07 (0.007)

0x07 (0.007)

0x07 (0.007)

0x07 (0.007)

0x07 (0.007)

N.A.1

MI FPGA

N.A.1

N.A.1

0x09 (0.009)

0x09 (0.009)

0x09 (0.009)

0x09 (0.009)

0x09 (0.009)

N.A.1

Cisco Nexus 9396PX ToR/leaf switch (N9K-C9396PX)

IO FPGA

N.A.1

N.A.1

0x13 (0.019)

0x13 (0.019)

0x13 (0.019)

0x13 (0.019)

0x13 (0.019)

N.A.1

MI FPGA

N.A.1

N.A.1

0x13 (0.019)

0x14 (0.020)

0x14 (0.020)

0x14 (0.020)

0x14 (0.020)

N.A.1

12-port optical uplink module (N9K-M12PK)

MI FPGA ML

N.A.1

N.A.1

0x15 (0.021)

0x15 (0.021)

0x15 (0.021)

0x15 (0.021)

0x15 (0.021)

N.A.1

Cisco Nexus 95xx spine/modular switch modules

Supervisor module (N9K-SUP-A)

IO FPGA

0x16 (0.022)

0x19 (0.025)

0x19 (0.025)

0x19 (0.025)

0x19 (0.025)

0x19 (0.025)

0x19 (0.025)

0x19 (0.025)

System Controller module (N9K-SC-A)

IO FPGA

0x14 (0.020)

0x16 (0.022)

0x16 (0.022)

0x17 (0.023)

0x17 (0.023)

0x17 (0.023)

0x17 (0.023)

0x17 (0.023)

36-port 40-Gigabit QSFP+ Aggragation I/O module (N9K-X9636PQ)

IO FPGA

0x9 (0.009)

0x9 (0.009)

0x9 (0.009)

0x9 (0.009)

0x12 (0.018)

0x12 (0.018)

0x12 (0.018)

0x15 (0.021)

MI FPGA

0x14 (0.020)

0x15 (0.021)

0x15 (0.021)

0x15 (0.021)

0x15 (0.021)

0x15 (0.021)

0x15 (0.021)

0x17(0.023)

36-port 40-Gigabit QSFP+ I/O module (N9K-X9536PQ)

MI FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x10 (0.016)

N.A.1

0x10 (0.016)

N.A.1

IO FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x5 (0.005)

N.A.1

0x5 (0.005)

N.A.1

48-port 1-/10-Gigabit SFP+ plus 4-port QSFP+ I/O module (N9K-X9564PX)

IO FPGA

N.A.1

N.A.1

0x10 (0.016)

0x10 (0.016)

0x10 (0.016)

0x10 (0.016)

0x10 (0.016)

N.A.1

MI FPGA

N.A.1

N.A.1

0x7 (0.007)

0x7 (0.007)

0x10 (0.016)

0x10 (0.016)

0x10 (0.016)

N.A.1

48-port 1-/10-Gigabit BASE-T plus 4-port QSFP+ I/O module (N9K-X9564TX))

IO FPGA

N.A.1

N.A.1

0x8 (0.008)

0x8 (0.008)

0x8 (0.008)

0x8 (0.008)

0x8 (0.008)

N.A.1

MI FPGA

N.A.1

N.A.1

0x4 (0.004)

0x4 (0.004)

0x4 (0.004)

0x4 (0.004)

0x4 (0.004)

N.A.1

48-port 1-/10-Gigabit SFP+ plus 4-port 40-Gigibit QSFP+ I/O module (N9K-X9464PX)

IO FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x10 (0.016)

N.A.1

0x10 (0.016)

N.A.1

MI FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x7 (0.007)

N.A.1

0x7 (0.007)

N.A.1

48-port 1-/10-GBASE-T plus 4-port 40-Gigibit QSFP+ I/O module (N9K-X9464TX)

IO FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x8 (0.008)

N.A.1

0x8 (0.008)

N.A.1

MI FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x4 (0.004)

N.A.1

0x4 (0.004)

N.A.1

32-port 40-Gigabit QSFP+ I/O module (N9K-X9432PQ)

IO FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x12 (0.018)

N.A.1

0x12 (0.018)

N.A.1

MI FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x15 (0.021)

N.A.1

0x15 (0.021)

N.A.1

Fabric module for the Cisco Nexus 9504 (N9K-C9504-FM)

IO FPGA

N.A.1

0x18 (0.024)

0x18 (0.024)

0x18 (0.024)

0x18 (0.024)

0x18 (0.024)

0x18 (0.024)

0x18 (0.024)

Fabric module for the Cisco Nexus 9508 (N9K-C9508-FM)

IO FPGA

0x15 (0.021)

0x15 (0.021)

0x18 (0.024)

0x18 (0.024)

0x18 (0.024)

0x18 (0.024)

0x18 (0.024)

0x18 (0.024)

Fabric module for the Cisco Nexus 9516 (N9K-C9516-FM)

IO FPGA

N.A.1

N.A.1

N.A.1

N.A.1

0x12 (0.018)

N.A.1

0x12 (0.018)

N.A.1

[1] N.A. (not applicable) EPLD image was not available for this release

Determining Whether to Upgrade EPLD Images

You can use the show install impact epld bootflash: command to determine whether the EPLDs can be upgraded for all the modules or for specific modules on a switch. This command indicates the current EPLD images, new EPLD images, and whether the upgrades would be disruptive to switch operations.

The following example shows the results of using the show install impact epld bootflash: command on a Cisco Nexus 93xxx switch. In this case, the MI FPGA and IO FPGA EPLD images can be upgraded for the switch supervisor (slot 1) and the MI FPGA2 EPLD image can be upgraded for the supervisor in the uplink module (slot 2). Both upgrades are disruptive.

switch# show install all impact epld bootflash:n9000-epld.6.1.2.I2.3.img
Compatibility check:
Module        Type         Upgradable        Impact   Reason
------  -----------------  ----------    ----------   ------
1            SUP           Yes       disruptive   Module Upgradable
2      Expansion           Yes       disruptive   Module Upgradable

Retrieving EPLD versions... Please wait.

Images will be upgraded according to following table:
Module  Type           EPLD      Running-Version   New-Version  Upg-Required
------  ----  -------------      ---------------   -----------  ------------
1   SUP  MI FPGA                   0x10        0x12            Yes
1   SUP  IO FPGA                   0x12        0x13            Yes
2   SUP  MI FPGA2                  0x12        0x15            Yes
switch#

The following example shows the results of using the show install impact epld bootflash: command on a Cisco Nexus 95xx switch.

switch# show install all impact epld bootflash:n9000-epld.6.1.2.I2.3.img
Compatibility check:
Module        Type         Upgradable        Impact   Reason
------  -----------------  ----------    ----------   ------
2             LC           Yes       disruptive   Module Upgradable
6             LC            No             none   Module is not Online
7             LC           Yes       disruptive   Module Upgradable
22             FM           Yes       disruptive   Module Upgradable
23             FM           Yes       disruptive   Module Upgradable
24             FM           Yes       disruptive   Module Upgradable
25             FM           Yes       disruptive   Module Upgradable
26             FM           Yes       disruptive   Module Upgradable
27            SUP           Yes       disruptive   Module Upgradable
29             SC           Yes       disruptive   Module Upgradable

Retrieving EPLD versions... Please wait.

Images will be upgraded according to following table:
Module  Type           EPLD      Running-Version   New-Version  Upg-Required
------  ----  -------------      ---------------   -----------  ------------
2    LC  MI FPGA                   0x06        0x07            Yes
2    LC  IO FPGA                   0x10        0x10             No
7    LC  MI FPGA                   0x09        0x09             No
7    LC  IO FPGA                   0x14        0x15            Yes
22    FM  IO FPGA                   0x17        0x18            Yes
23    FM  IO FPGA                   0x18        0x18             No
24    FM  IO FPGA                   0x17        0x18            Yes
25    FM  IO FPGA                   0x18        0x18             No
26    FM  IO FPGA                   0x17        0x18            Yes
27   SUP  IO FPGA                   0x19        0x19             No
29    SC  IO FPGA                   0x16        0x16             No

Downloading the EPLD Images

Before you can prepare the EPLD images for installation, you must download them to the FTP or management server.

Procedure

Command or Action

Purpose

Step 1

From a browser, go to Click Here .

The browser will display the Cisco website.

Step 2

From the Products & Services tab, choose Switches.

The Switches page opens.

Step 3

In the Data Center area, click the arrow next to View Products.

The page lists the Data Center products.

Step 4

Click Nexus 9000.

The Cisco Nexus 9000 Series Switches page opens.

Step 5

In the Support area, click Download Software.

The Downloads page opens and lists the Data Center switches.

Step 6

Choose a Cisco Nexus 9000 Series switch from the list under Data Center Switches > Cisco Nexus 9000 Series Switches.

The Log In page opens.

Step 7

Log in as follows:

- If you are an existing user, enter your username in the User Name field and your password in the Password field.

- If you are a new user, click Register Now and provide the required information before returning to the Log In page and logging in with your new username.

The Downloads page lists the software types that can be downloaded for the switch that you specified.

Step 8

Click NX-OS EPLD Updates.

The Downloads page lists software releases that you can download.

Step 9

Choose Latest Releases > 6.1(2)I2(3).

The Downloads page displays image information, including a link to the downloadable Tar file, to the right of the releases.

Step 10

Click the link for the Tar file.

The Downloads page displays a Download button and lists information for the Tar file.

Step 11

Click Download.

The Supporting Documents page opens to display the rules for downloading the software.

Step 12

Read the rules and click Agree.

A File Download dialog box opens to ask if you want to open or save the images file.

Step 13

Click Save.

The Save As dialog box appears.

Step 14

Indicate where to save the Tar file and click Save.

The Tar file saves to the location that you specified.

What to Do Next

You are ready to prepare the EPLD images for Installation (see Upgrading the EPLD Images).

Installation Guidelines

You can upgrade EPLDs using CLI commands on the Cisco Nexus 9000 Series switch. Follow these guidelines when you upgrade EPLDs:

- Before you upgrade any EPLD images, be sure that you have updated the Cisco NX-OS operating system to the level required for the images and be sure that you have an EPLD image file.

- You can execute an upgrade from the active supervisor module only. This upgrade is for one or all of the modules as follows:

- You can upgrade a module individually.

- You can upgrade all modules sequentially.

- You can upgrade all modules in parallel.

- You can update the images for one or all modules whether the switch is online or offline as follows:

- If the modules are online, only the EPLD images with version numbers that differ from the new EPLD images are upgraded.

- If the modules are offline, all of the EPLD images are upgraded.

- On a Cisco Nexus 95xx switch that has two supervisor modules, upgrade the EPLDs for the standby supervisor and then switch the active supervisor to the standby mode to upgrade its EPLDs (the supervisor switchover is not disruptive to traffic on Cisco Nexus 95xx switches). On a switch that has only one supervisor module, you can upgrade the active supervisor, but this will disrupt its operations during the upgrade.

- If you interrupt an upgrade, you must upgrade the module that is being upgraded again.

- The upgrade process disrupts traffic on the targeted module.

- Do not insert or remove any modules while an EPLD upgrade is in progress.

Upgrading the EPLD Images

If you have a Cisco Nexus 9000 Series switch that is running Cisco NX-OS Release 6.1(2)I2(1) build 6.1(2)I2(0.206) or any earlier build of 6.1(2)I2(0. xxx ), follow the special upgrade steps presented here.

Procedure

Step 1

Copy the n9000-dk9.6.1.2.I2.3.bin and n9000-epld.6.1.2.I2.3.img images to bootflash.

Step 2

To determine if you need to upgrade the BIOS for the image, use the show install all impact command and see the Upgrade Required (Upg-Required) field for the BIOS row in the command output.

Step 3

If you do not need to upgrade the BIOS, set the boot variable using the boot nxos boot flash:n9000-dk9.6.1.2.I2.3.bin command.

Step 4

Enter the copy running-config startup-config command to set the startup boot variables to the NX-OS image.

Step 5

If you need to upgrade the BIOS, enter the install all nxos bootflash:n9000-dk9.6.1.2.I2.3.bin command.

Step 6

Enter the install epld bootflash:n9000-epld.6.1.2.I2.3.img module all command to upgrade the EPLD. The chassis will reboot automatically.

Verifying the EPLD Upgrades

You can verify the EPLD upgrades for each slot in a modular switch by using the command the show version module slot_numberepld command.

Displaying the Status of EPLD Upgrades

To display the status of EPLD upgrades on the switch, use the show install epld status command.