Field Notice: FN - 62987 - Groups of Fibre Channel Ports May Be Impacted When Upgrading to SAN-OS 3.0(x) or SAN-OS 3.1(x) on DS-X9016 and DS-X9032

Available Languages

Updated:October 25, 2007

Document ID:FN62987

Bias-Free Language

The documentation set for this product strives to use bias-free language. For the purposes of this documentation set, bias-free is defined as language that does not imply discrimination based on age, disability, gender, racial identity, ethnic identity, sexual orientation, socioeconomic status, and intersectionality. Exceptions may be present in the documentation due to language that is hardcoded in the user interfaces of the product software, language used based on RFP documentation, or language that is used by a referenced third-party product. Learn more about how Cisco is using Inclusive Language.

October 25, 2007

NOTICE:

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.

Revision History

Revision	Date	Comment
1.0	25-OCT-2007	Initial Public Release

Products Affected

Products Affected
MDS9000 - DS-X9016
MDS9000 - DS-X9032

Problem Description

There is a small probability that groups of Fibre Channel Ports may be impacted when upgrading to SAN-OS 3.0(x) or SAN-OS 3.1(x) on DS-X9016 and DS-X9032. DS-X9016 may have groups of 4 ports disabled and DS-X9032 may have groups of 8 ports disabled during an upgrade.

Background

This issue has been identified as being caused by a software process reading unused memory locations at the time of the SAN-OS upgrade. Reading memory locations that have not been utilized may result in a memory read error and disabling of the ports that are affected.

Problem Symptoms

Groups of Fibre Channel ports may not come up after the software upgrade to SAN-OS 3.0(x) or SAN-OS 3.1(x) on DS-X9016 and DS-X9032. The problem can occur on groups of 4 ports on the DS-X9016 module or groups of 8 ports on the DS-X9032 module.

Example of show logging log command output:

IMAGE_DNLD-SLOT4-2-IMG_DNLD_STARTED: Module image download process. Please wait until completion... 
%IMAGE_DNLD-SLOT4-2-IMG_DNLD_COMPLETE: Module image download process. Download successful. 
%MODULE-2-MOD_DIAG_FAIL: Module 4 (serial: xyz) reported failure on ports 4/13-4/16 (Fibre Channel) 
due to Q-Engine instance shutdown in device 7 (device error 0xc0703572) 
%MODULE-2-MOD_SOMEPORTS_FAILED: Module 4 (serial: xyz) reported failure on ports 4/13-4/16 (Fibre Channel) 
due to Q-Engine instance shutdown in device 7 (error 0xc0703572) 
%PORT-5-IF_DOWN_HW_FAILURE: %$VSAN 4094%$ Interface fc4/16 is down (Hardware Failure) 
%PORT-5-IF_DOWN_HW_FAILURE: %$VSAN 4094%$ Interface fc4/15 is down (Hardware Failure) 
%PORT-5-IF_DOWN_HW_FAILURE: %$VSAN 1003%$ Interface fc4/14 is down (Hardware Failure)

Example of show module internal exceptionlog command output:

==================== EXCEPTION LOG ==================== 

*** Log# 0 *** 
Device Id : 7 
Device Name : aladdin 
Device Error Code : c0703572(H) 
Sys Error : Q-Engine instance shutdown 
Errtype : NON-CATASTROPHIC 
PhyPortLayer : Fibre Channel 
Port(s) Affected : 13-16 
Error Description : aladdin instance #3 shutdown: 0xc0703572 
DSAP : 0 
UUID : 0 
Time : Mon Jul 9 22:33:18 2007 
(954381 usecs 823(H) jiffies)

Workaround/Solution

The software process causing this issue has been fixed in SAN-OS 3.2(1a) to not read unused memory locations. Upgrading to SAN-OS 3.2(1a) and later software release will ensure that Fibre Channel ports are not affected by this issue.

Also, either resetting the affected module or physically pulling out the module and re-inserting it will allow the impacted Fibre Channel ports to be powered up.

Use the following command to reload the affected module:

Switch# reload module x

Where x is the number for the module that was affected.

Note: Customers should not RMA the hardware as this is a software-only issue.

DDTS

To follow the bug ID link below and see detailed bug information, you must be a registered user and you must be logged in.

DDTS	Description
CSCsj72662 (registered customers only)	MDS gen 1 linecards fail on upgrade with Q-Engine failure VOQMEM parity

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods:

Receive Email Notification For New Field Notices

Product Alert Tool - Set up a profile to receive email updates about reliability, safety, network security, and end-of-sale issues for the Cisco products you specify.