Useful Commands
You can log in to any of the cluster nodes as rescue-user
for a limited access to system data. You can use the following commands to perform various operations in Cisco Nexus Dashboard.
-
acs passwd
— allows you to change the password for therescue-user
.
You must use this command if you want to set different passwords for the GUI 'admin' user and CLI
rescue-user
. If you change the password for theadmin
user in the GUI, that same password is automatically configured for therescue-user
as well.
-
acs health
— displays cluster health information and any existing issues. -
acs show cluster
— displays cluster configuration. -
acs show nodes
— displays information about all nodes in the cluster. -
acs show masters
— displays information aboutprimary
nodes in the cluster. -
acs show workers
— displays information aboutsecondary
nodes in the cluster. -
acs show standbys
— displays information aboutstandby
nodes in the cluster. -
acs ntp show
— displays NTP information. -
acs techsupport
- collects tech support information for the specified category:-
acs techsupport collect -s system
— collects Infra tech support information. -
acs techsupport collect -s cisco-mso
— collects Nexus Dashboard Orchestrator service tech support information. -
acs techsupport collect -s cisco-nir
— collects Nexus Dashboard Insights service tech support information. -
acs techsupport collect -s cisco-appcenter
— collects App Store tech support information.
-
-
acs version
— returns the Nexus Dashboard version. -
acs deployment
— allows you to manage the deployment mode of the cluster:-
acs deployment show
— shows the deployment modes supported by the current cluster.$ acs deployment show ================================================================= Deployment Name Services ----------------------------------------------------------------- ndfc Controller ndi Insights ndo Orchestrator ndfc-ndi Controller,Insights ndo-ndi Orchestrator,Insights =================================================================
-
acs deployment running
– shows the current deployment mode.$ acs deployment running Running deployment mode ndfc-ndi
-
acs deployment clear
- removes the currently deployed services effectively removing the configured deployment mode.You can verify the command succeeded using the
acs deployment running
command:$ acs deployment running No running deployment mode
After using this command, you can select a new deployment mode using the
acs deployment set
command described below. -
acs deployment set --mode <ndfc, ndo, ndi>`
— sets a new deployment mode.You must clear the deployment mode before setting a new one. The command will return an error if a deployment mode is already set.
The following example shows how to use all of the described commands to remove an existing deployment mode and set a new one. Note that the entire process may take up to 20 minutes to complete.
$ acs deployment show ================================================================= Deployment Name Services ----------------------------------------------------------------- ndfc Controller ndo Orchestrator ================================================================= $ acs deployment running Running deployment mode ndfc $ acs deployment clear Warning: This command will update deployment that can DELETE all the data and state for the app. Proceed? (y/n): y deployment mode cleared successfully $ acs deployment running No running deployment mode $ acs deployment set --mode ndo Warning: This command will update deployment that can DELETE all the data and state for the app. Proceed? (y/n): y deployment mode updated successfully $ acs deployment running No running deployment mode, desired deployment mode set to ndo. Please wait for release to be in running state. $ acs deployment running Running deployment mode ndo
-
-
acs reboot
— reboots the node with all services and configurations intact. -
acs reboot clean
— removes all data for Nexus Dashboard and applications, but preserves the Nexus Dashboard bootstrap configuration and pod images.Clean reboot must be done on all notes simulataneously; if you clean reboot a single node while the other 2
primary
nodes remain, the rebooted node will come up and recover from the existing cluster.When you first bring up your Nexus Dashboard cluster, initial deployment process installs all required pod images. Retaining pod images will speed up cluster bring up after reboot.
If you plan to re-install all the nodes in the cluster, you must clean up the site and app information first. In this case, ensure that the sites are disabled in all applications and removed from the ND cluster.
If you have configured a different password for the
rescue-user
using theacs passwd
command, the password will be reset to the original password that you had configured during initial cluster bootstrap process.
-
acs reboot factory-reset
— removes all data for Nexus Dashboard and applications including cluster bootstrap configuration, but preserves application images.When you first bring up your Nexus Dashboard cluster, initial deployment process installs all required pod images. Retaining pod images will speed up cluster bring up.
If you plan to re-install all the nodes in the cluster, you must clean up the site and app information first. In this case, ensure that the sites are disabled in all applications and removed from the ND cluster.
-
The
/logs
directory is mounted into therescue-user
container and can be inspected with standard tools. -
ping
command is supported with most options. -
ip
command supports a read-only subset of commands, includingip addr show
andip route show
. -
kubectl
command supports read-only Kubernetes commands.For example, you can use it to get a list of all pods running in the system:
$ kubectl get pods -A NAMESPACE NAME READY STATUS RESTARTS AGE aaamgr aaamgr-54494fdbc8-q8rc4 2/2 Running 0 3d3h authy-oidc authy-oidc-75fdf44b57-x48xr 1/1 Running 3 (3d3h ago) 3d4h authy authy-857fbb7fdc-7cwgg 3/3 Running 0 3d4h cisco-appcenter apiserver-686655896d-kmqhq 1/1 Running 0 3d3h [...]
-
acs elasticsearch
command invokes a custom utility that allows you to get debug information about the services.$ acs elasticsearch --name cisco-ndfc-controller-elasticsearch health { "cluster_name" : "cisco-ndfc-controller-elasticsearch", "status" : "green", "timed_out" : false, "number_of_nodes" : 3, "number_of_data_nodes" : 3, "discovered_master" : true, "active_primary_shards" : 10, "active_shards" : 21, "relocating_shards" : 0, "initializing_shards" : 0, "unassigned_shards" : 0, "delayed_unassigned_shards" : 0, "number_of_pending_tasks" : 0, "number_of_in_flight_fetch" : 0, "task_max_waiting_in_queue_millis" : 0, "active_shards_percent_as_number" : 100.0 }
You can obtain the list of the service-specific pod names using the
kubectl
command, for example:$ kubectl get pods -A | grep elasticsearch cisco-ndfc-controller-elasticsearch es-data-0 2/2 Running 0 109m cisco-ndfc-controller-elasticsearch es-data-1 2/2 Running 0 163m cisco-ndfc-controller-elasticsearch es-data-2 2/2 Running 0 104m
-
acs apps instances
command displays all applications running on the cluster. -
acs apps actions
command displays the history operations done on the applications, such as installations, upgrades, or deletions.
Upgrading UCS Server Firmware
When you upgrade Nexus Dashboard software, you may also have to upgrade the Cisco UCS server firmware (which includes CIMC, BIOS, RAID controller, and disk and NIC adapter firmware) that is running in your Nexus Dashboard nodes.
Supported UCS server firmware versions for each Nexus Dashboard release are listed in the Release Notes specific to that release.
The following steps describe how to upgrade the Nexus Dashboard UCS server firmware using the Cisco Host Upgrade Utility (HUU). Additional details about the Host Upgrade Utility are available at Upgrading the Firmware on a Cisco UCS C-Series Server Using the HUU.
-
Check the Release Notes for your Nexus Dashboard release to confirm the UCS server firmware versions supported by that release.
-
Allow for the appropriate amount of time for the upgrade.
The time required for the upgrade process depends on a number of factors, such as the speed of the link between the local machine and the UCS-C chassis, the source and target software images, as well as other internal component versions.
-
If you’re upgrading a single node that is running an older firmware to add it to an existing cluster, you will perform the following steps on that node only and not on all nodes in the cluster.
-
Updating UCS server firmware may also require updating your browser and/or Java software version to run the vKVM used to upgrade the UCS server firmware.
Upgrading the UCS server firmware version does not affect your production network as the Nexus Dashboard nodes are not in the data path of the traffic.
To upgrade the Nexus Dashboard UCS server firmware:
-
Open your browser, navigate to the CIMC IP address, and log in using the CIMC credentials.
Note that the CIMC credentials may be different from the Nexus Dashboard GUI credentials.
-
Determine the model of UCS platform for your Nexus Dashboard by locating the first part of the BIOS version under Server > Summary .
Nexus Dashboard supports the UCS-C220-M5 and UCS-C225-M6 servers.
-
If necessary, clear the existing logs.
-
Click the hamburger menu to show the available options.
-
Choose Faults and Logs.
-
In the main pane, choose the System Event Log tab and wait for the logs to load.
-
If the log is full, click Clear Log.
-
-
Download the appropriate HUU ISO image.
-
Navigate to the software download page for your server model.
For UCS-C220-M5, browse to https://software.cisco.com/download/home/286318809/type/283850974.
For UCS-C225-M6, browse to https://software.cisco.com/download/home/286329390/type/283850974.
-
In the left sidebar, select the version supported by your target Nexus Dashboard release.
The list of supported releases is available in the Release Notes.
-
In the main pane, click on the Download icon.
-
Click Accept License Agreement.
-
-
Launch the KVM console from CIMC GUI.
If you are unable to open the KVM console, you may need to update Java version.
-
Mount the HUU ISO image you downloaded in Step 3.
-
From KVM console’s Virtual Media menu, choose Activate Virtual Devices.
This adds virtual media options under the Virtual Media menu.
-
From KVM console’s Virtual Media menu, choose Map CD/DVD.
-
In the Virtual Media - CD/DVD dialog that opens, click Browse and choose the HUU image.
-
Finally, click Map Drive.
-
-
From KVM console’s Power menu, choose Power Cycle System to reboot the server.
-
As the server is starting up, press F6 to enter the boot menu and choose the Cisco vKVM-Mapped vDVD.
-
When prompted to accept Cisco Software License Agreement, choose Accept.
-
In the Update & Activate All dialog, choose Update & Activate.
You can verify that the upgrade was completed successfully through the GUI or by booting up the Cisco Host Upgrade Utility (HUU) and selecting the Last Update Verify option to ensure that all of the components were upgraded successfully.
-
After upgrade is completed, ensure that Trusted Platform Module State (TPM) is enabled.
You can check and enable it in the BIOS > Configure BIOS > Security menu.
Manual Cluster Upgrades
If you are performing a manual upgrade on Nexus Dashboard 3.1.1k, contact Cisco TAC to receive guidance on further course of action.
We recommend using the procedure described in Firmware Management (Cluster Upgrades)#_firmware_management_cluster_upgrades section to upgrade your cluster.
However, if you want to perform a manual upgrade of a single node (if you’re adding a new node to the cluster but the node is running older firmware) or entire cluster (in case the GUI upgrade did not succeed), you can use the following steps instead.
If you’re upgrading a single node that is running an older firmware to add it to an existing cluster, you will perform the following steps on that node only and not on the entire cluster.
-
Log in to the nodes you want to upgrade as
rescue-user
. -
Copy the upgrade ISO image file into the
/tmp
directory on each node. -
Start the upgrade on all nodes.
You can upgrade all nodes in parallel.
# acs installer update -f /tmp/nd-dk9.3.0.1a.iso Warning: This command will initiate node update to new version. Proceed? (y/n): y Update in Progress ... Do not press Ctrl^C
-
Wait for the upgrade to complete.
You must wait for all nodes to finish upgrading before proceeding to the next step.
Update succeeded, reboot your host
Re-Imaging Nodes
When you first receive the Nexus Dashboard physical hardware, it comes preloaded with the software image. If you simply want to configure the existing software, skip this section and proceed to Managing Secondary Nodes or Managing Standby Nodes.
If you are looking to manually upgrade the node to the latest software version, follow the instructions in Manual Cluster Upgrades instead.
This section describes how to redeploy the software stack on the Nexus Dashboard hardware. You may need to use the following steps in case of a catastrophic failure where you are no longer able to access the server’s operating system and GUI, or in case you want to deploy a different release that does not support direct upgrade or downgrade from your existing cluster.
If you are planning to re-install an existing Nexus Dashboard cluster, you must clean up the site and app information first. In this case, ensure that the sites are disabled in all applications and removed from the ND cluster before bringing it down.
-
You must be able to connect to the server’s CIMC using the Serial over LAN (SoL) port, so ensure that you have the server’s CIMC IP address and an SSH client.
Detailed information about CIMC configuration is available at https://www.cisco.com/c/en/us/support/servers-unified-computing/ucs-c-series-integrated-management-controller/products-installation-and-configuration-guides-list.html
-
Ensure that you are running a supported version of Cisco UCS server firmware.
Supported UCS server firmware versions are listed in the Nexus Dashboard Release Notes for the target release.
UCS server firmware upgrade is described in detail in Upgrading UCS Server Firmware.
Installing Nexus Dashboard Using Remotely-Hosted Image
To re-install the Nexus Dashboard software:
-
Download the Cisco Nexus Dashboard image.
-
Browse to the Nexus Dashboard page and download the image.
https://www.cisco.com/c/en/us/support/data-center-analytics/nexus-dashboard/series.html
-
Click the
Downloads
tab. -
Choose the Nexus Dashboard version you want to download.
-
Download the Cisco Nexus Dashboard image (nd-dk9.<version>.iso).
-
Host the image in a web server in your enviornment
You will need to provide an
http
URL when mounting the image.
-
-
Deploy the ISO to the server.
This step requires you to connect to the server’s CIMC. Detailed information about CIMC configuration is available at https://www.cisco.com/c/en/us/support/servers-unified-computing/ucs-c-series-integrated-management-controller/products-installation-and-configuration-guides-list.html.
-
SSH into the server’s CIMC.
-
Connect to the virtual media.
C220-WZP21510DHS# scope vmedia C220-WZP21510DHS /vmedia #
-
Map the Nexus Dashboard image you downloaded to the
CIMC-Mapped vDVD
.C220-WZP21510DHS /vmedia # map-www image http://<ip-address>/<path> <image>
For example:
C220-WZP21510DHS /vmedia # map-www image http://172.31.131.47/images nd-dk9.2.0.1.iso
-
Verify that the image is mounted.
C220-WZP21510DHS /vmedia # show mappings Volume Map-Status Drive-Type Remote-Share Remote-File Mount-Type ------- ----------- ----------- -------------- ----------------- -------- image OK CD [<ip>/<path>] nd-dk9.2.0.1.iso www
-
Reboot the server and connect to its console.
C220-WZP23150D4C /vmedia # exit C220-WZP23150D4C# scope chassis C220-WZP23150D4C /chassis # power cycle C220-WZP23150D4C /chassis # exit C220-WZP23150D4C# connect host CISCO Serial Over LAN: Press Ctrl+x to Exit the session
-
Open CIMC webpage, and login.
-
Click on
Launch KVM
. -
Click on
Power
followed byReset System
to perform a warm boot. -
Return to the Serial over LAN session and proceed with the next steps from there.
-
-
Select the boot device.
Watch the boot process until you see the following message:
Press <F2> Setup, <F6> Boot Menu, <F7> Diagnostics, <F8> Cisco IMC Configuration, <F12> Network Boot
Then press F6 and select the virtual media device where you mounted the image (
Cisco CIMC-Mapped vDVD1
):/------------------------------------\ | Please select boot device: | |------------------------------------| | (Bus 05 Dev 00)PCI RAID Adapter | | UNIGEN PHF16H0CM1-DTE PMAP | | Cisco vKVM-Mapped vHDD1.22 | | Cisco CIMC-Mapped vHDD1.22 | | Cisco vKVM-Mapped vDVD1.22 | | Cisco CIMC-Mapped vDVD1.22 | | Cisco vKVM-Mapped vFDD1.22 | | UEFI: Built-in EFI Shell | | IBA GE Slot 0100 v1585 | | IBA GE Slot 0101 v1585 | | Enter Setup | |------------------------------------| | ^ and v to move selection | | ENTER to select boot device | | ESC to boot using defaults | \------------------------------------/
-
Configure the networking.
When the server first boots, you will see the following output:
+ read -r -p '?' url ? http://172.31.131.47/nd-dk9.2.0.1.iso 1 + '[' http://172.31.131.47/nd-dk9.2.0.1.iso = skip ']' + '[' http://172.31.131.47/nd-dk9.2.0.1.iso = '' ']' + '[' http = nfs: ']' + echo http://172.31.131.47/nd-dk9.2.0.1.iso + grep -q '\[.*\]' ++ awk -F '/|:' '{print $4}' + urlip=172.31.131.47 + '[' -z 172.31.131.47 ']' + break + '[' -n http://172.31.131.47/nd-dk9.2.0.1.iso ']' + set +e + configured=0 + '[' 0 -eq 0 ']' + echo 'Configuring network interface' Configuring network interface + echo 'type static, dhcp, bash for a shell to configure networking, or url to re-enter the url: ' type static, dhcp, bash for a shell to configure networking, or url to re-enter the url: + read -p '? ' ntype ? static 2 + case $ntype in + configure_static + echo 'Available interfaces' Available interfaces + ls -l /sys/class/net total 0 lrwxrwxrwx. 1 root root 0 Apr 26 01:21 enp1s0f0 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/net/enp1s0f0 lrwxrwxrwx. 1 root root 0 Apr 26 01:21 enp1s0f1 -> ../../devices/pci0000:3a/0000:3a:00.0/0000:3b:00.1/net/enp1s0f1 lrwxrwxrwx. 1 root root 0 Apr 26 01:21 enp1s0f4 -> ../../devices/pci0000:5d/0000:5d:00.0/0000:5e:00.0/0000:5f:01.0/0000:61:00.0/0000:62:00.0/0000:63:00.0/net/enp1s0f4 lrwxrwxrwx. 1 root root 0 Apr 26 01:21 enp1s0f5 -> ../../devices/pci0000:5d/0000:5d:00.0/0000:5e:00.0/0000:5f:01.0/0000:61:00.0/0000:62:00.0/0000:63:00.1/net/enp1s0f5 lrwxrwxrwx. 1 root root 0 Apr 26 01:21 lo -> ../../devices/virtual/net/lo + read -p 'Interface to configure: ' interface Interface to configure: enp1s0f0 3 + read -p 'address: ' addr address: 172.23.53.59/21 4 + read -p 'gateway: ' gw gateway: 172.23.48.1 5 + ip addr add 172.23.53.59/23 dev enp1s0f0 + ip link set enp1s0f0 up + ip route add default via 172.23.48.1 RTNETLINK answers: Network is unreachable ++ seq 1 2 + for count in '$(seq 1 2)' + ping -c 1 172.31.131.47
1 Enter the remote location for the image (for example, http://172.31.131.47/nd-dk9.2.0.1.iso
).2 For IP address, enter dchp
if there is a DHCP server in your environment orstatic
.3 For the interface, enter the first management port (enp1s0f0). Note that 'enp1s0f0' and 'enp1s0f1' are the management ports for UCS-C225-M6 servers, whereas 'eno1' and 'eno2' are the management ports for UCS-C220-M5 servers. 4 If you chose static
, provide the IP address for the connection.5 If you chose static
, provide the gateway for the connection.
-
-
After the server boots from the provided image, select the only available installation option.
It may take up to 20 minutes for the installation process to complete.
After the image is deployed, you can add the node to your cluster as described in Managing Secondary Nodes or Managing Standby Nodes.
Installing Nexus Dashboard Using Bootable USB
You can also re-install Nexas Dashboard using Bootable USB drive. Note that you create a bootable USB drive from the Nexus Dashboard software image (.iso
).
We recommend using a high speed USB 3.2 or later.
To create a bootable USB drive and reinstall the Nexus Dashboard software:
-
Download the Cisco Nexus Dashboard ISO image.
-
Browse to the Nexus Dashboard page.
https://www.cisco.com/c/en/us/support/data-center-analytics/nexus-dashboard/series.html
-
Click the
Downloads
tab. -
Choose the Nexus Dashboard version you want to download and click
Download Options
. -
Download the Cisco Nexus Dashboard ISO image (nd-dk9.<version>.iso).
-
-
Plug in the USB to your computer.
-
To find the USB and the correspoding path:
-
Access the USB icon on Windows.
-
Enter
fdisk -l
on Linux. -
Enter
diskutil list
on Mac.
-
-
Navigate to the directory where you downloaded the Nexus Dashboard image.
-
Create the bootable USB drive using the downloaded image.
Use the following command:
sudo dd if=nd-dk9.<version>.iso of=/dev/dsg iflag=direct oflag=direct status=progress bs=4M
In the above command:
-
Replace
nd-dk9.<version>.iso
with the ISO image you downloaded in Step 1. -
Replace
/dev/dsg
with the path to the USB drive.
-
-
Unmount the USB drive safely from your system.
For example, if you’re using USB on a Mac in the path /dev/disk4, run the following command.
diskutil unmountDisk /dev/disk4
-
Install Nexus Dashboard software from the USB.
This step requires you to connect to the server’s CIMC. Detailed information about CIMC configuration is available at https://www.cisco.com/c/en/us/support/servers-unified-computing/ucs-c-series-integrated-management-controller/products-installation-and-configuration-guides-list.html.
-
Plug in the USB to pND (Physical Nexus Dashboard).
-
SSH into the server’s CIMC and connect to the server’s console using the
connect host
command. -
Browse to the server’s CIMC address, boot it from the USB drive you created, and install the software.
You can SSH into the CIMC and connect to the host’s console.
-
Access the KVM console to monitor the installation by clicking
Launch vKVM
.C220-WZP23150D4C# connect host CISCO Serial Over LAN: Press Ctrl+x to Exit the session
-
-
Reboot the Nexus Dashboard server.
-
Monitor the progress on the KVM console.
-
As the server is starting up, press F6 to enter the boot menu and choose the USB drive you created in the previous step.
-
Enter the password, if required.
-
At the prompt to select the boot device, select the USB.
-
Enter
skip
to install from the USB when you see the following prompt:+ echo 'To speed up the install, enter iso url. Type '\"skip'\" to use local media: To speed up the install, enter iso url. Type '\"skip'\" to use local media: + echo ' Either http://server/path/to/file or nfs:server:/path/to/file are supported' Either http://server/path/to/file or nfs:server:/path/to/file are supported + read -r -p '?' url 15 ? skip
The Nexus Dashboard ISO image is copied to the server. Depending on the USB speed, the process can take up to an hour or more. Hence, we recommend using USB 3.2 or later.
Once the installation is complete, the Nexus Dashboard server powers off.
-
-
Unmount the USB drive and power on the server.
You can power the server off using the KVM or the
poweroff
command in the SSH console.After you finish installing Nexus Dashboard software, add the node(s) to your cluster.
If you are building a brand new cluster, complete the deployment process as described in the "Deploying as Physical Appliance" chapter of the Nexus Dashboard Deployment Guide for your release.
If you are adding an extra node to an existing cluster, see Managing Worker Nodes. or Managing Standby Nodes. for additional info.
Rebuilding Existing Cluster
In some cases, you may need to re-build an existing cluster, for example if you want to change the data network’s subnet or the nodes' data IP addresses, which requires redeploying the cluster.
-
Back up the Nexus Dashboard cluster configuration as described in "Backup and Restore" in Nexus Dashboard Operations.
-
Back up the configuration for all services deployed in your cluster.
For NDO, see Operations > Backup and Restore in the Nexus Dashboard Orchestrator Configuration Guide.
For NDI, see Operations > Backup and Restore in the Nexus Dashboard Insights User Guide.
For NDFC, see Operations > Backup and Restore in the NDFC Fabric Controller Configuration Guide.
-
If your cluster is deployed as a physical appliance…
-
Log in to each node as
rescue-user
. -
On each node, run the
acs reboot factory-reset
.This resets the node to factory settings and reboots it.
-
Redeploy the cluster using the same hardware.
You can follow the same procedure as you did when you first deployed the cluster, which is described in the "Deploying as Physical Appliance" chapter of the Nexus Dashboard Deployment Guide
-
-
If your cluster is deployed in virtual machines (VMs)…
-
Power down existing VMs.
You can keep the existing cluster’s VMs until you deploy a new cluster and restore services and their configuration in it. Then you can simply delete the old cluster’s VMs.
-
Redeploy a brand new cluster.
You can follow the same procedure as you did when you first deployed the cluster, which is described in the "Deploying in VMware ESX" or "Deploying in Linux KVM" chapter of the Nexus Dashboard Deployment Guide
-
-
Restore Nexus Dashboard configuration as described in "Backup and Restore" in Nexus Dashboard Operations.
-
Restore each service’s configuration from the backups you created in Step 1.
For NDO, see Operations > Backup and Restore in the Nexus Dashboard Orchestrator Configuration Guide.
For NDI, see Operations > Backup and Restore in the Nexus Dashboard Insights User Guide.
For NDFC, see Operations > Backup and Restore in the NDFC Fabric Controller Configuration Guide.
AppStore Errors
When attempting to access the Services > AppStore tab in the Nexus Dashboard GUI, you may encounter the following error:
{ "error": "There was a problem proxying the request" }
When a primary node where the AppStore service is running fails, it may take up to 5 minutes for the AppStore services to relocate to another primary node
Simply wait for the services to recover and refresh the page.
Event Export
Syslog events are not reaching the intended external events monitoring service.
Most common cause of this issue is not configured or improperly configured Syslog destination server.
Ensure that the external server configuration in Cluster Configuration > Syslog is correct. For more information, see System Settings.
Remote server is allowing traffic from only a specific set of IP addresses and the traffic from the Nexus Dashboard nodes' IP addresses is not allowed.
Update your external server’s configuration to allow traffic from the Nexus Dashboard cluster nodes.
Factory Reset
You can reset the entire physical cluster by running the following command on each node:
# acs reboot factory-reset
Doing this will lose all cluster configuration and applications and you will need to rebuild the cluster.
If you have a virtual or cloud Nexus Dashboard cluster, we recommend simply deleting the existing VMs and re-deploying the entire cluster instead of reseting all the nodes, as described in the Cisco Nexus Dashboard Deployment Guide.
Changing Node IP Addresses
Changing the data network IP address is not supported. If you want to change the data IP address for the cluster nodes, you must re-create the cluster.
If you are running a single-node cluster, changing the management IP address is also not supported without re-creating the cluster.
If you are running a multi-node cluster, you can change the management IP addresses of one or more nodes as follows:
-
Navigate to your Nexus Dashboard’s Admin Console.
-
From the main navigation menu, select System Resources > Nodes.
-
From the (…) menu next to the node, choose Edit Node.
Note that you can only change the IP address of a node that you are not currently logged in to. To change the IP of the current node, navigate to a different node’s management IP address, log in, and repeat this procedure for the last node.
-
Update the Management Network Address and Management Network Gateway for the node.
For example,
172.31.140.58/24
and172.31.140.1
respectively. -
Click Save.
The changes will take effect immediately and you can access the nodes using the new IP addresses.
Cluster Configuration Errors
When you configure or change the proxy server in Nexus Dashboard, you may see a number of cisco-mso service: Replicaset() not in desired state
errors in the Cluster Configuration page.
The errors are displayed while the service is restarting and will resolve on their own within 30-60 seconds.
Simply wait for the services to recover and refresh the page.
Two-Factor Authentication (2FA) Not Prompting for Login Info
After the initial login using two-factor authentication, subsequent login attempts do not ask for username and password information and present a blank page instead.
The cookie timeout configured for the OIDC application is longer than the authentication token timeout set in the Nexus Dashboard.
Clear your browser cache and the authentication process will work as expected.
Red Hat Enterprise Linux (RHEL) Deployments
You can view the installation logs by logging into your RHEL system and checking the /logs/ndlinux/
directory.
In order to run the common Nexus Dashboard troubleshooting commands described in the Troubleshooting sections, you must first access the Nexus Dashboard environment.
To access the Nexus Dashboard environment from your RHEL system:
-
Log in to your RHEL system using the Nexus Dashboard user you provided in the YAML configuration file during installation.
-
Run the
attach-nd
command to access the Nexus Dashboard environment./usr/bin/attach-nd
After you access the Nexus Dashboard environment, you can use all the common Nexus Dashboard commands described in the Troubleshooting section of this guide.
Unable to Connect to Site After APIC Configuration Import
When you onboard a Cisco APIC site to Nexus Dashboard, APIC configuration is updated to reflect the onboarding. If you subsequently import an earlier configuration in APIC, the site may show as unavailable in Nexus Dashboard or services.
Earlier site configuration does not contain information specific to the Nexus Dashboard cluster where it is onboarded.
We recommend exporting APIC configuration after the site is onboarded in Nexus Dashboard for any future config restores.
To resolve the issue after it occurs, you can re-register the site in the Nexus Dashboard GUI:
-
Log in to your Nexus Dashboard cluster.
-
Navigate to Admin Console > Sites
-
From the Actions (…) menu next to the site, select Edit Site.
-
In the Site Edit screen, check the
Re-register Site
checkbox and provide the site details again. -
Click Save.
Re-Adding Same Primary Node to Physical Cluster
This section describes how to re-add a primary node to a physical cluster. This scenario can happen if the node was accidentally or deliberately removed via configuration reset (such as acs reboot factory-reset
) or vMedia re-install.
If you have a standby node in your cluster, simply convert the standby into a primary node as described in Replacing Single Primary Node with Standby Node and then add the old primary node as a new standby node as described in Adding Standby Nodes.
If you need to completely replace (RMA) a primary node due to hardware failure and do not have a standby node available, follow the procedure described in Replacing Single Physical Primary Node Without Standby Node instead.
To re-add the primary node to the same cluster:
-
Ensure that the node is reset to factory settings.
If the node is in a bad state, log in to the node as
rescue-user
and reset the node using the following command:# acs reboot factory-reset
-
Log in to the Nexus Dashboard GUI using the management IP address of one of the healthy nodes.
-
Navigate to System Resoruces > Nodes.
The node you want to replace will be listed as
Inactive
in the UI. -
From the actions (…) menu for the node, select Register.
Register Node page will open.
-
In the Register Node page, provide the required information and click Validate.
For physical nodes, you need to provide the CIMC IP address and login information.
For virtual nodes, the management IP address will be retained and you need to provide only the password for the
rescue-user
. -
Ensure the rest of the node information is accurate.
-
Click Register to re-register the node and re-add it as a
primary
node to the cluster.It will take up to 20 minutes to bootstrap, configure, and re-add the node. After it’s done, the node will show as an
Active
primary node in the UI.
Replacing a Single Virtual Primary Node Without a Standby Node
This section describes how to recover from a primary node failure in a VMware ESX or Linux KVM virtual Nexus Dashboard cluster. The procedure involves deploying a brand new Nexus Dashboard node using the same form factor as the node which you are replacing and joining it as a primary node to the remaining cluster.
-
Ensure that the failed node’s VM is powered down.
-
Bring up a new Nexus Dashboard node.
Ensure that you use the same exact network configuration settings as you used for the failed node.
-
Power on the new node’s VM and wait for it to boot up.
-
Log in to the Nexus Dashboard GUI.
You can use the management IP address of one of the remaining healthy
primary
nodes. -
Replace the node.
-
From the left navigation pane, select System Resources > Nodes.
The node you are replacing will be listed as
Inactive
. -
Click the (…) menu next to the inactive primary node you want to replace and select Replace.
The Replace window will open.
-
Provide the Management IP Address and Password for the node, then click Verify.
The cluster will connect to the node’s management IP address to verify connectivity.
-
Click Replace.
It may take up to 20 minutes for the node to be configured and join the cluster.
If you are running Nexus Dashboard Insights, after replacing the node, disable and re-enable Nexus Dashboard Insights.
Nexus Dashboard Insights must be restarted to properly redistribute the services to the new node.
-
Replacing Single Physical Primary Node Without Standby Node
The following section describes how to recover from a single primary node failure in a physical Nexus Dashboard cluster without a standby node. This procedure is for hardware issues that require it to be physically replaced. If the node is simply in a bad software state, you can use the acs reboot clean
commands instead and re-add the same node to the cluster as described in Re-Adding Same Primary Node to Physical Cluster.
If your cluster has a standby node configured, we recommend using the steps described in Replacing Single Primary Node with Standby Node instead.
-
Ensure that at least 2 primary nodes are healthy.
-
Ensure that the primary node you want to replace is powered off.
-
Prepare and deploy the new node.
-
Ensure that you have the same CIMC IP address and login information on the new node as you configured for the failed node.
The remaining primary nodes will use the CIMC information to restore configuration to the new node.
-
Ensure that the new node is powered on and note down its serial number.
-
A known issue exists if you are performing a fresh virtual media installation of the 3.1.1k software on a cluster with UCS-C225-M6 (ND-NODE-L4) nodes and ACI sites, where onboarding the site to NDI or NDO will fail. The workaround for this issue is to perform a fresh installation of the 3.1.1l version of the software instead. Note that upgrading from release 3.1.1k to 3.1.1l will not resolve the issue; you must perform a fresh installation of the 3.1.1l software to resolve the issue.
In addition to fresh installations, the issue can also occur if you performed an upgrade to the 3.1.1k release and you need to replace (RMA) a master node. You will also encounter this issue when you have RMAed all master nodes after upgrading to release 3.1.1k. You will have to perform a fresh installation of release 3.1.1l and perform a restore of services from a previously-taken backup.
To replace a single failed primary node:
-
Log in to your Nexus Dashboard GUI using the management IP of one of the other
primary
nodes. -
From the main navigation menu, select System Resources > Nodes.
-
In the nodes list, find the Serial number of the node you want to replace and ensure that the node’s Status shows
Inactive
. -
In the Nexus Dashboard’s Nodes screen, select the inactive node by clicking the checkbox next to it.
-
From the Actions menu, select Replace.
-
In the New Serial Number field, provide the serial number of the new node and click Replace.
After the process is completed, you will see the serial number of the old node updated to the new node’s serial number and the status will change to
Active
once the new primary has successfully joined the cluster.
If you are running Nexus Dashboard Insights, after replacing the node, disable and re-enable Nexus Dashboard Insights.
Nexus Dashboard Insights must be restarted to properly redistribute the services to the new node.
Replacing Secondary or Standby Nodes
When replacing a failed secondary or standby node, you can simply delete the Inactive
node from the GUI and then deploy a brand new secondary or standby node as you typically would.
-
Ensure that the secondary node you want to replace is powered off.
To replace a failed secondary or standby node:
-
Navigate to your Nexus Dashboard’s Admin Console.
-
From the main navigation menu, select System Resources > Nodes.
-
In the nodes list, find the Serial number of the node you want to replace and ensure that the node’s Status shows
Inactive
. -
Select the inactive node by clicking the checkbox next to it.
-
From the Actions menu, select Delete.
This will remove the failed node from the list.
-
Power on the new node and add it as a new
secondary
orstandby
node to the cluster as described in Managing Secondary Nodes or Managing Standby Nodes.You can use the same configuration parameters as you used to set up the old node.
Initial Cluster Bootstrap Issues
This section describes the different stages of the initial cluster bootstrap process and summarizes some common issues you may run into when first deploying your Nexus Dashboard cluster.
After you bring up the nodes and provide each node’s information during the GUI setup, the initial bootstrap process goes through a number of stages to bring up the nodes, configure the required information, and create the cluster. The bootstrap screen allows you to track the progress and indicates any issues that may come up:
-
Bootstrap Master Node
andBootstrap Peer Nodes
— bring up the first primary node with the management and data networks IP addresses you provided. Then brings up the 2nd and 3rd primary nodes with their respective IPs.If the process fails at one of these stages, connect to each node’s console and verify that all the information you provided is correct. You can view the configuration you provided using the
acs system-config
command.You can also check the bootstrap logs (
/logs/k8/install.log
) for additional details.Typically, you can resolve any issues caused by misconfiguration by resetting the node using
acs reboot factory-reset
and restarting the setup process. -
Discover Cluster Members
— establishes connectivity between all primary nodes in the cluster over the data network.Failures at this stage typically indicate misconfiguration of the data network IP address and the node being unable to reach its other 2 peers.
You can use
acs cluster masters
command on any of the nodes to confirm the data IP you have provided.If the command does not return any information, use
ip addr
to check the data interface’s (bond0br
) IP adress and ensure that all nodes' IPs are reachable from the other nodes.$ ip addr [..] 6: bond0br: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 52:54:00:e1:93:06 brd ff:ff:ff:ff:ff:ff inet 10.195.255.165/24 brd 10.195.255.255 scope global bond0br valid_lft forever preferred_lft forever inet6 fe80::5054:ff:fee1:9306/64 scope link valid_lft forever preferred_lft forever [..]
-
Setup Security
— sets up Key Management Service (KMS) to enable data encryption between the nodes.If the
acs cluster masters
command returnsca cert not found
error, it indicates a KMS issue. For additional details, check the/logs/kms
logs. -
Setup Initial Cluster
andBootstrap Kubernetes Cluster
— any failures during these stages typically indicate Kubernetes issues.You can get additional details from the logs in
/logs/k8
on each node. -
After the Bootstrap stages are complete, the process advances go to the Cluster Bringup stages.
From
Initialize System
to theWait for infra services to be ready
stages finalize the cluster creation by bringing up the remaining services.At this stage, you can use the
acs health
command on any of the nodes to see which service is not coming up correctly. Then check the specific service’s logs in/logs/k8_infra/<service>
Multi-Cluster Connectivity Issues
The following sections list common issues with multi-cluster connectivity.
For additional information about connecting multiple clusters together, see Multi-Cluster Connectivity.
Non-Primary Cluster Unable to Reconnect
If you clean reboot and redeploy a cluster that was part of a multi-cluster connectivity group, the group’s primary cluster will not be able to recognize it and will indicate that the cluster remains unreachable.
To resolve this issue, disconnect and reconnect the cluster:
-
Log in to the primary cluster.
-
Remove the cluster you re-deployed from the group.
This is described in Disconnecting Clusters.
-
Re-add the cluster to the group.
This is described in Connecting Multiple Clusters.
Non-Primary Cluster Redeployed with Older Version
If for any reason you redeploy one of the non-primary clusters in the group with a version of Nexus Dashboard that does not support this feature, the primary cluster will still be able to connect to that cluster, but will not be able to retrieve any information and the UI will remain blank.
To resolve this issue, remove that cluster from the group:
-
Log in to the primary cluster as a local
admin
user.If you log in with the remote user shared across all clusters, the UI page will remain blank.
-
Remove the cluster you re-deployed from the group.
This is described in Disconnecting Clusters.
-
Log out and log back in using the remote user you use to manage the multi-cluster connectivity and verify that UI loads correctly.
Generating Private Key, Creating CSR, and Obtaining CA-Signed Certificate
This section provides an example of how to generate a private key, creat a certificate signing request (CSR), and obtain a certificate signed by a Certificate Authority (CA) for use in your Nexus Dashboard cluster.
If you want to generate both a key and a self-signed certificate, skip this section and follow the steps described in Generating Private Key and Self-Signed Certificate instead.
The configuration steps required to add the keys and certificates in the Nexus Dashboard GUI are described in the xref:https://www.cisco.com/c/en/us/td/docs/dcn/nd/3x/articles-311/nexus-dashboard-admin-311.html#_securitySecurity] chapter.
-
Generate private key.
You can generate the private key on any platform that has OpenSSL installed or you can SSH into one of your Nexus Dashboard nodes as the
rescue-user
and perform these steps there.[rescue-user@localhost ~]$ openssl genrsa -out nd.key 2048 Generating RSA private key, 2048 bit long modulus ........................ ............. e is 65537 (0x10001) [rescue-user@localhost ~]$ ls nd.key
-
Generate your CSR signed with the private key you generated in the first step.
-
Create the CSR configuration file (
csr.cfg
) with the required information.An example configuration file is shown below:
[req] default_bits = 2048 distinguished_name = req_distinguished_name req_extensions = req_ext prompt = no [req_distinguished_name] countryName = US stateOrProvinceName = Texas localityName = Plano organizationName = CSS organizationalUnitName = DC commonName = nd.dc.css emailAddress = no-reply@mydomain.com [req_ext] subjectAltName = @alt_names [alt_names] DNS.1 = *.dc.css IP.1 = 10.0.0.96 IP.2 = 10.0.0.97
-
Generate your CSR.
[rescue-user@localhost ~]$ openssl req -new -key nd.key -out nd.csr -config csr.cfg [rescue-user@localhost ~]$ ls csr.cfg nd.csr nd.key
You can view the generated CSR using the following command:
[rescue-user@localhost ~]$ openssl req -in nd.csr -text -noout
-
-
Obtain a CA-signed certificate.
In production deployments, you will provide the CSR (
ca.csr
) from the previous step to a public CA, such as IdenTrust or DigiCert, to obtain the CA-signed certificate (ca.crt
). -
Verify the signed certificate.
The following command assumes you copied the CA-signed certificate (
ca.crt
) into the same folder as the private key you generated.[rescue-user@localhost ~]$ openssl verify -verbose -CAfile ca.crt nd.crt nd.crt: OK
-
Add the contents of the generated files in your Nexus Dashboard’s GUI.
Following the steps described in [Security Configuration], where you will need to provide the contents of the following 3 files generated in the previous steps:
-
Private key (
nd.key
) -
Certificate Authority’s (CA) public certificate (
ca.crt
) -
CA-signed certificate (
nd.crt
)
-
Generating Private Key and Self-Signed Certificate
This section provides an example of how to generate a private key and custom certificates should you want to use them in your Nexus Dashboard cluster.
If you want to use a CA-signed certificate, skip this section and follow the steps described in Creating CSR, and Obtaining CA-Signed Certificate.
The configuration steps required to add the keys and certificates in the Nexus Dashboard GUI are described in the xref:https://www.cisco.com/c/en/us/td/docs/dcn/nd/3x/articles-311/nexus-dashboard-admin-311.html#_securitySecurity] chapter.
-
Generate private key.
You can generate the private key on any platform that has OpenSSL installed or you can SSH into one of your Nexus Dashboard nodes as the
rescue-user
and perform these steps there.[rescue-user@localhost ~]$ openssl genrsa -out nd.key 2048 Generating RSA private key, 2048 bit long modulus ........................ ............. e is 65537 (0x10001) [rescue-user@localhost ~]$ ls nd.key
-
Generate Certificate Authority (CA) key.
To generate a self-signed CA, for example for lab and testing purposes, run the following command:
[rescue-user@localhost ~]$ openssl genrsa -out ca.key 2048 Generating RSA private key, 2048 bit long modulus .................. ............. e is 65537 (0x10001) [rescue-user@localhost ~]$ ls ca.key nd.key
-
Generate CSR for the CA.
[rescue-user@localhost ~]$ openssl req -new -key ca.key -subj "/CN=Self/C=US/O=Private/ST=Texas" -out ca.csr [rescue-user@localhost ~]$ ls ca.csr ca.key nd.key
You can view the generated CSR using the following command:
[rescue-user@localhost ~]$ openssl req -in ca.csr -text -noout
-
Create self-signed root certificate.
[rescue-user@localhost ~]$ openssl x509 -req -in ca.csr -signkey ca.key -CAcreateserial -out ca.crt -days 3650 Signature ok subject=/CN=Self/C=US/O=Private/ST=Texas Getting Private key [rescue-user@localhost ~]$ ls ca.crt ca.csr ca.key nd.key
You can view the generated root certificate using the following command:
[rescue-user@localhost ~]$ openssl x509 -in ca.crt -text -noout
-
Generate your CSR signed with the private key you generated in the first step.
-
Create the CSR configuration file (
csr.cfg
) with the required information.An example configuration file is shown below:
[req] default_bits = 2048 distinguished_name = req_distinguished_name req_extensions = req_ext prompt = no [req_distinguished_name] countryName = US stateOrProvinceName = Texas localityName = Plano organizationName = CSS organizationalUnitName = DC commonName = nd.dc.css emailAddress = no-reply@mydomain.com [req_ext] subjectAltName = @alt_names [alt_names] DNS.1 = *.dc.css IP.1 = 10.0.0.96 IP.2 = 10.0.0.97
-
Generate your CSR.
[rescue-user@localhost ~]$ openssl req -new -key nd.key -out nd.csr -config csr.cfg [rescue-user@localhost ~]$ ls ca.crt ca.csr ca.key csr.cfg nd.csr nd.key
You can view the generated CSR using the following command:
[rescue-user@localhost ~]$ openssl req -in nd.csr -text -noout
-
-
Self-sign the certificate you generated.
[rescue-user@localhost ~]$ openssl x509 -req -in nd.csr -CA ca.crt -CAkey ca.key -CAcreateserial -out nd.crt -days 3600 Signature ok subject=/C=US/ST=Texas/L=Plano/O=CSS/OU=DC/CN=nd.dc.css/emailAddress=no-reply@mydomain.com Getting CA Private Key [rescue-user@localhost ~]$ ls ca.crt ca.csr ca.key ca.srl csr.cfg nd.crt nd.csr nd.key
-
Verify the signed certificate.
[rescue-user@localhost ~]$ openssl verify -verbose -CAfile ca.crt nd.crt nd.crt: OK
-
Add the contents of the generated files in your Nexus Dashboard’s GUI.
Following the steps described in [Security Configuration], where you will need to provide the contents of the following 3 files generated in the previous steps:
-
Private key (
nd.key
) -
Certificate Authority’s (CA) public certificate (
ca.crt
) -
CA-signed certificate (
nd.crt
)
-
Updating NDO Configuration After Replacing Switch Devices Managed by NDFC
If your Nexus Dashboard Fabric Controller (NDFC) fabric is managed by Nexus Dashboard Orchestrator (NDO) and you replace one or more devices that are managed by the NDFC, you must ensure that NDO is aware of the new switch serial numbers.
The following sections provide a summary of the steps required to synchronize the new fabric device’s information with NDO.
Replacing a Core or Route Server (RS) Device
-
Log in to NDFC.
-
To replace a physical switch in a Fabric when using NDFC Easy Fabric mode, follow the Return Material Authorization (RMA) steps mentioned in the Cisco NDFC Fabric Controller Configuration Guide.
-
Log in to NDO.
-
Navigate to Infrastructure > Site Connectivity.
-
Click Refresh on the Control Plane Configuration in the General Settings page where the RS/Core is present.
-
Click Deploy.
Replacing a Leaf Switch
-
Log in to NDFC.
-
To replace a physical switch in a Fabric when using NDFC Easy Fabric mode, follow the Return Material Authorization (RMA) steps mentioned in the Cisco NDFC Fabric Controller Configuration Guide.
-
Log in to NDO.
-
Navigate to Application Management > Schema and click the Schema/Template for that Site/Device.
-
Re-import VRF/Network that was present on the device:
-
In the View Overview drop-down list, select the template.
-
In the Template Properties section, click the VRF/Network from the VRFs box.
-
Select the site from the Import drop-down list.
-
Select the VRF after clicking VRF.
-
Click Import.
-
Replacing Border Gateway (BGW) Devices
-
Log in to NDFC.
-
To replace a physical switch in a Fabric when using NDFC Easy Fabric mode, follow the Return Material Authorization (RMA) steps mentioned in the Cisco NDFC Fabric Controller Configuration Guide.
-
Log in to NDO.
-
Navigate to Infrastructure > Site Connectivity.
-
Click Refresh on the site where BGW is present and click Deploy.
-
Navigate to Application Management > Schema and click the Schema/Template for that Site/Device.
-
Re-import VRF/Network that was present on the device:
-
In the View Overview drop-down list, select the template.
-
In the Template Properties section, click the VRF/Network from the VRFs box.
-
Select the site from the Import drop-down list.
-
Select the VRF after clicking VRF.
-
Click Import.
-
Trademarks
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS" WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional and coincidental.
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: http://www.cisco.com/go/trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (1110R)
© 2017-2024 Cisco Systems, Inc. All rights reserved.
First Published: 2024-03-01
Last Modified: 2024-03-01
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 527-0883
Bias-Free Language
The documentation set for this product strives to use bias-free language. For the purposes of this documentation set, bias-free is defined as language that does not imply discrimination based on age, disability, gender, racial identity, ethnic identity, sexual orientation, socioeconomic status, and intersectionality. Exceptions may be present in the documentation due to language that is hardcoded in the user interfaces of the product software, language used based on RFP documentation, or language that is used by a referenced third-party product. Learn more about how Cisco is using Inclusive Language.
Need help?
- Open a Support Case
- (Requires a Cisco Service Contract)