Introduction
This document describes how to identify an unexpected shutdown of any application on top of Cisco customized Voice Operating System (VOS).
Prerequisites
Requirements
There are no specific requirements for this document.
Components Used
This document is not restricted to specific software and hardware versions.
The information in this document was created from the devices in a specific lab environment. All of the devices used in this document started with a cleared (default) configuration. If your network is live, ensure that you understand the potential impact of any command.
Background Information
The Cisco Unified Communications Manager (CUCM), Cisco Unity Connection (CUC), Cisco Unified Contact Center Express (UCCX), Cisco Emergency Responder (CER), Cisco Prime are considered as UC Applications.
If the server experiences an unexpected shutdown, the file system consistency cannot be guaranteed. Files can be removed unexpectedly, ownership of file permissions can be changed, or the contents of files can be corrupted.
In order to temporarily recover the system, run the system recovery disc released for the corresponding software version.
Verify Improper Shutdown
Review the system-history.log in order to determine if a system has been shut down improperly.
Note: The history.log was enhanced in order to track improper shutdowns with Cisco bug ID CSCtr88859 in order to add alarms and alerts for unexpected reboots that are integrated in CUCM Versions 9.1(1) and later.
- Download the install/upgrade logs from the Cisco Unified Real-Time Monitoring Tool (RTMT), and gather the system-history.log.
or
Enter the file view install system-history.log command on the command-line interface (CLI).
- Examine each instance of root: Boot, and confirm that each instance is preceded by one of these lines:
root: Restart
root: Shutdown
root: Install
root: Upgrade
- If a boot instance is not proceeded by a Restart, Shutdown, Install, or Upgrade, there was likely an unclean shutdown.
This is an example of an unclean shutdown:
08/14/2012 13:36:09 | root: Boot 9.0.1.10000-37 Start
08/14/2012 17:28:25 | root: Boot 9.0.1.10000-37 Start
In this example, the server must be rebuilt in order to ensure file system consistency. See these Cisco bug IDs for further details:
- Cisco bug ID CSCth60800, "Recovery Disc warning to rebuild system after file system repair"
- Cisco bug ID CSCth53322, "Document the need for system rebuild after file system repair"
- Cisco bug ID CSCuy94644, "Cisco Emergency Responder corruption after unexpected shutdown"
Note: If the server runs on VMware on a version without the fix for Cisco bug ID CSCtw73590, "VSphere initiated shutdown or restart not logged to system-history.log" and if the server is shut down through VSphere when a guest shutdown is initiated, that entry is not included in the system-history.log.