Field Notice: FN - 72178 - 5100 Series: Earlier SSDs Might Have Firmware Issues on ASR 9000 - Workaround Provided

Notice

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.

Revision History

Revision	Publish Date	Comments
1.0	30-Apr-22	Initial Release

Products Affected

Affected Product ID	Comments
A9K-RSP880-LT-SE
A9K-RSP880-LT-TR
A9K-RSP5-SE
A9K-RSP5-TR
A99-RP3-SE
A99-RP3-TR
ASR-9901
A99-10X400GE-X-TR
A99-32X100GE-X-SE
A99-32X100GE-X-TR
A9K-20HG-FLEX-SE
A9K-20HG-FLEX-TR
A9K-8HG-FLEX-TR
A99-4HG-FLEX-TR
A99-4HG-FLEX-SE
ASR-9903
A99-RP-F
A99-RP-F-FC

Defect Information

Defect ID	Headline
CSCvz66349	Micron 5100 SSD Firmware version D0MU075 integration on eXR
CSCvx77131	Micron 5100 SSD Firmware version D0MU075 support on cXR

Problem Description

The products listed in this field notice might have earlier solid state drive (SSD) firmware versions that are exposed to file system/disk corruption and uncorrectable errors. This is specific to this SSD series and these firmware versions:

• 5100 Series SSDs only
• SSD Firmware Versions D0MU027, D0MU037, D0MU051, and D0MU071

The new Firmware Version D0MU075 is qualified and will be released in eXR 7.4.2. Software Maintenance Upgrades (SMUs) have been created and are to be used to upgrade the firmware in earlier Cisco IOS^® XR versions (cXR and eXR).

Note: No issues have been reported with Firmware Version D0MU071. However, it is recommended to use the latest Firmware Version D0MU075.

Background

An engineering failure analysis on some returned ASR 9000 Series Aggregation Services Routers (ASR 9000) units confirmed that earlier firmware on some SSDs might cause uncorrectable errors.

Problem Symptom

This issue might cause these problems:

• Unable to run show commands, any commit changes, and install operations. The Route Switch Processor (RSP) can go into a boot loop after reboot.
• Generic I/O errors or anomalies when the packages are verified.
• Potential bad sectors on disk.

Note: This issue will not impact live traffic.

There are two ways to validate if a device might be impacted:

• Verify the network device serial numbers through the Cisco Serial Number Validation Tool listed in this field notice. It lists all of the serial numbers of the products that were originally shipped with earlier SSD firmware.
• The user can verify the SSD series and firmware version manually with the commands in the next section.

Check the SSD Series and Firmware Version

cXR

show filesystem disk0: location 0/rsp0/cpu0

Model:
Micron_5100_MTFDDAV240TCB
Serial Number: Micron_5100_MTFDDAV240TCBMSA221304
Firmware: No Firmware

Note: The firmware will not show up here. Enter the smart ata /dev/hd0 and smart ata /dev/hd1 commands from run mode.

# smart ata /dev/hd0
Micron_5100_MTFDDAV240TCB fw D0MU051 cable40, max udma 6, cur udma 6, max mdma 2, cur mdma 0, max sdma -1, cur sdma -1,pio 4

user addressable sectors: 250066575
user addressable sectors: 250066575

Note: The smart utility is available in Cisco IOS XR Release 6.5.x and later.

eXR

Enter the show smart-monitor location 0/RSPx command in sysadmin mode.

sysadmin-vm:0_RSP1# show smart-monitor location 0/RSP1
Mon May 31 06:28:32.527 UTC+00:00 *************************************
Location : 0/RSP1

======== SmartCtl info for sda ========
smartctl 6.2 2019-08-20 r4950 [x86_64-linux-3.14.23-WR7.0.0.2_standard] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===

Model Family:     Micron 5100 Pro / 52x0 / 5300 SSDs
Device Model:     Micron_5100_MTFDDAV240TCB
Serial Number:    MSA242506BH
LU WWN Device Id: 5 00a075 128ae5182
Firmware Version: D0MU051
+++++++SNIPPED+++++++++

Notes:

• Most of the uncorrectable issues are observed on Firmware Versions D0MU027, D0MU037, and D0MU051, although D0MU051 is less exposed to such issues. Devices that run eXR will have D0MU051.
• cXR to eXR upgrades will automatically upgrade the firmware to D0MU051. The upgrade might fail in builds earlier than Cisco IOS XR 6.7.3. This issue is fixed in Cisco IOS XR 6.7.3 and later.
• No issues have been reported with Firmware Version D0MU071. However, it is recommended to use the latest firmware version, which is D0MU075.

Workaround/Solution

In order to fix this issue, upgrade any impacted firmware to D0MU075 via the SMUs listed in this section.

cXR

• The cXR 6.4.2 SMU is a "Reload" SMU and requires a reload to implement it on the impacted devices.
• cXR 6.5.3 and 6.6.3 SMUs are "Non-Reload" SMUs, and will not cause network disruption (that is, hitless).

eXR

• All eXR SMUs listed in this section are "Reload" SMUs and require a reload in order to implement it on the impacted devices.

Note: All new shipments will have the new SSD controller and will not have this issue.

The links to the .tar files will take you to the Software Download site, and the applicable software version page. The user must then search the page for the specific file name.

Cisco IOS XR Software Type	Cisco IOS XR Software Version	SMU Name/Link
cXR/32bit	6.4.2	asr9k-px-6.4.2.CSCvx77131.tar
	6.5.3	asr9k-px-6.5.3.CSCvx77131.tar
	6.6.3	asr9k-px-6.6.3.CSCvx77131.tar
	6.7.3	asr9k-px-6.7.3.CSCvx77131.tar
eXR/64bit	6.5.3	asr9k-sysadmin-6.5.3.CSCwa39086.tar
	6.6.3	asr9k-sysadmin-6.6.3.CSCvz66349.tar
	7.0.2	asr9k-sysadmin-7.0.2.CSCwa36722.tar
	7.1.2	asr9k-sysadmin-7.1.2.CSCvz66349.tar
	7.1.3	asr9k-sysadmin-7.1.3.CSCvz66349.tar
	7.3.2	asr9k-sysadmin-7.3.2.CSCvz66349.tar

Serial Number Validation

Cisco provides a tool to verify whether a device is impacted by this issue. In order to check the device, enter the device's serial number in the Serial Number Validation Tool.

Note: For security reasons, you must click on the Serial Number Validation Tool link provided in this section to check the serial number for the device. Use of the Serial Number Validation Tool URL external to this field notice will fail.

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods:

• Open a service request on Cisco.com
• By email or telephone

Receive Email Notification For New Field Notices

My Notifications—Set up a profile to receive email updates about reliability, safety, network security, and end-of-sale issues for the Cisco products you specify.