Sample End-to-end Configuration

This appendix describes an end-to-end provisioning example for a Routed Optical Networking topology.

Sample Configuration

This section details the step-by-step approach to build a new Routed Optical Networking based, 75 km fiber span to replace an existing legacy span in a two-node DCI topology.

Network Sizing Requirements

This section details the sizing requirements for a network. For a small lab installation, three servers with 256 GB of RAM is enough to run the Crosswork, Crosswork Network Controller, Cisco Optical Network Controller, NSO, Crosswork Hierarchical Controller, and EPNM in a non-HA deployment. For a production setup, calculate the total resources required using information in the following tables.

Network Profiles

Network profiles are defined based on network size, services, and application features.

Network Entity/Feature

 Lab

(20%)

Production

(100%)

Devices 2000 10000
Total number of interfaces 100000 650000
IGP interfaces 20000 100000
VPN Services (L2, L3) 40000 200000
Endpoints per VPN service 2 to 10 50
Total LSPs (SR policies and RSVP tunnels) 12000 60000
Number of PCEP sessions 2000 10000

Note


Each SR-PCE pair can only support 2000 PCEP sessions which means only 2000 headends for lab networks and 10000 headends for production networks. While counting headends, LCM nodes must be included.


Deployment Size per Network Profile

The following table is the recommended deployment sizing requirement based on the defined network profiles for solution using Cisco Crosswork Network Controller.

Network Profile Crosswork Cluster Crosswork Data Gateway NSO SR-PCE HA Pairs Crosswork Hierarchical Controller
Lab 3 VMs 1+1 VM 1+1 VM 1 1+1 VM
Production 5 VMs

Essentials package: 3 Hybrid VMs + 1 Worker VM

Advantage package: 3 Hybrid VMs + 2 Worker VMs

5+5 VM 1+1 VM 6 1+1 VM

VM Resources

The following table provide the details on CPU, memory, and disk requirements needed for each Crosswork VM and the other VMs in the deployment.

Crosswork VM Crosswork Data Gateway NSO

SR-PCE

Crosswork Hierarchical Controller EPNM
  • CPU: 12 vCPU

  • RAM: 96 GB

  • DISK: 1 TB (SSD)

  • CPU: 20 vCPU

  • RAM: 112 GB

  • DISK: 0.5 TB

  • Small Network Profile

    • CPU: 8 vCPU

    • RAM: 64 GB

    • DISK: 250 GB

  • Large Network Profile

    • CPU: 24 vCPU

    • RAM: 132 GB

    • DISK: 1TB

  • CPU: 8 vCPU

  • RAM: 24 GB

  • DISK: 45 GB

  • CPU: 10 cores

  • RAM: 96 GB

  • DISK: 400G SSD (lab) , 3TB SSD (production)

  • Professional (Small)

    • CPU: 16 vCPU

    • RAM: 64 GB

    • DISK: 2.8 TB

  • Extended (Medium/Large)

    • CPU: 24 vCPU

    • RAM: 128 GB

    • DISK: 4 TB


Note


When Cisco Optical Network Controller is deployed on the same cluster as Crosswork Network Controller, the Crosswork VM must be deployed with 12 cores and 96 GB of RAM.


Cisco Optical Network Controller Scale Support

Cisco Optical Network Controller supports a maximum of 500 nodes and 600 services. Cisco Optical Network Controller can run on the same cluster. Cisco Optical Network Controller adds more resources incrementally at the maximum supported scale. It is captured in Crosswork VM resources in the table above.

Planning and Design Phase

The planning and design phase involves:

  1. Network Planning and Design

    Inputs needed: Packet layer traffic demands, optical fiber topology, resiliency criteria, and other network constraints.

    1. WAE can be used to determine a new network build or augmentations to an existing network.

    2. After the IP network circuits have been determined, Cisco ONP is used to determine the optical layer feasibility and components that are used to support the network.

    Output for a sample configuration:

    This topology uses two Cisco 8201 routers, two NCS 2006 terminal nodes with NCS1K-MD-64 add/drop multiplexers, and EDFA-35 bi-directional amplifiers. The span length is 75 kms. Longer spans may require additional ILA nodes for amplification.
  2. Automation Software Resource Planning

    Server requirements for the Routed Optical Networking software elements

    Determine the servers required for the full solution. See Network Sizing Requirements and Installation Requirements for Routed Optical Networking Components.

    1. For a lab or EFT setup, it is recommended to use three servers each with 384 G of RAM, 32 cores, and two TB SSD.

    2. The solution requires the use of VMware ESX 6.7 or higher.

Installation Requirements for Routed Optical Networking Components

The following list points to the installation requirements for different Routed Optical Networking components.

Implement Phase

The implement phase involves:

  1. Installation of hardware components

    1. Hardware staging or installation and initial base configuration required for management connectivity.

    2. All onboard software updates must be completed to the required revision.

    3. All associated base wiring must be completed to support the network. This includes connections between the optical elements and connections between routers and optical add/drop end-points to support Routed Optical Networking circuits using ZR/ZR+ optics. See Deployment Topologies.

    4. SVO 12.2 server or line card based installation to support NCS 2000 nodes. See Install the External Server, and Run the SVO Installation Tool.

    5. Create SVO instances for all NCS 2000 nodes. See Create an SVO Instance.

  2. Installation of the Automation Software Components

    1. Complete all server hardware installation and base configuration to support the solution, including VMWare ESX if not already installed.

    2. Install the following software components to support the Routed Optical Networking solution.

  3. Onboarding of Devices

    1. Add devices to Cisco Optical Network Controller. See Onboard Devices to Cisco Optical Network Controller.

    2. Add NSO, SR-PCE, and devices to Crosswork Network Controller. See Add SR-PCE, NSO, and Routers to Crosswork Network Controller.

    3. Add routers to NSO using the IOS-XR CLI NED. See Step 3 in Provision ML Service Using NSO Routed Optical Networking CFP.

    4. Add Cisco Optical Network Controller to NSO using the ONF TAPI NED.

    5. Add and configure the following Crosswork Hierarchical Controller adapters. See Add Adapters to Crosswork Hierarchical Controller.


      Note


      This step is required only if the Routed Optical Networking ML service is provisioned via the Crosswork Hierarchical Controller GUI.


      • Add and configure the Crosswork Network Controller adapter.

      • Create or import sites in Crosswork Hierarchical Controller. See the sections, "Add Sites" and "Export and Import Sites" in the Cisco Crosswork Hierarchical Controller Administration Guide 5.1.

      • Add and configure the IOS-XR adapter. Create router devices in Crosswork Hierarchical Controller using the IOS-XR adapter type. After the routers are created, add the Crosswork Network Controller adapter to the router device.

      • Add and configure the Cisco Optical Network Controller adapter.

  4. Provisioning of Services

    1. Ensure all device interconnections are complete.

    2. To provision the Routed Optical Networking ML service, use either one of the procedures:

      1. Using the NSO GUI:

        1. Utilize the Routed Optical Networking FP ML services to provision and end-to-end service. See Provision ML Service Using NSO Routed Optical Networking CFP.

        2. Verify that the end-to-end service has been deployed by checking the NSO service deployment status using the check-sync status.

        3. Verify the router optics controller state using the CLI or in EPNM. See Troubleshoot Provisioning Issues.

      2. Using the Crosswork Hierarchical Controller GUI:

        1. Utilize the Crosswork Hierarchical Controller GUI to provision and end-to-end Routed Optical Networking ML service. See Provision Routed Optical Networking ML Service Using Crosswork Hierarchical Controller.

        2. Verify the router optics controller state using the Link Assurance tool in Crosswork Hierarchical Controller. See Step 3 in Provision Routed Optical Networking ML Service Using Crosswork Hierarchical Controller.

Add SR-PCE, NSO, and Routers to Crosswork Network Controller

Perform these steps to add SR-PCE providers, NSO providers, and routers to Crosswork Network Controller.


Note


When you add or import devices, or create providers, you need to specify the credential profile.


  1. Log in to the Crosswork user interface.

  2. To create a credential profile, choose Device Management > Credential Profiles from the main menu. See Manage Credential Profiles.

    1. For the NSO credential profile, the connectivity type must be set to NETCONF and HTTPS. Optionally, HTTP can also be defined if HTTPS is not used in NSO.

      NSO Credential Profile
    2. The SR-PCE credential profile requires HTTP credentials to communicate with the SR-PCE Northbound API.

      SR-PCE credential profile
    3. The router credential profile requires at a minimum, the SNMPv2 or SNMPv3 and SSH connectivity types. NETCONF is optional. GNMi is used when utilizing GNMi to configure streaming telemetry sensors on the node.

      Router credential profile
  3. Add the providers. See About Adding Providers.

    1. To add the SR-PCE or NSO provider, choose Administration > Manage Provider Access from the main menu. See Manage Providers.

    2. Add the NSO provider. See Add Cisco NSO Providers.

      Select the credential profile created for NSO. Select the family as NSO. The Device Key may be set to either the HOST_NAME or INVENTORY_ID depending on the specific deployment.

      The following image demonstrates the connectivity to NSO’s RESTCONF API over SSL using port 8888 and NETCONF using the default port of 2022. Since the Routed Optical Networking NSO CFP utilizes the XR NETCONF NED, the Cisco-IOS-XR model is not applicable and may be set to any version.

      Edit NSO provider
    3. Add the SR-PCE provider. See Add Cisco SR-PCE Providers.

      Select the credential profile created for SR-PCE. Select the family type as SR_PCE. The connectivity type for SR-PCE must be the HTTP. In the following image, the default API port of 8080 is specified. When the Property Key, "auto-onboard" is set to a Property value, "off", Crosswork Network Controller does not automatically add nodes that are discovered via the SR-PCE IGP topology to the device inventory. Devices must be added through the Crosswork Network Controller UI or inventory API.

      Edit SR-PCE provider
  4. Validate communications with one or more providers. Check on the provider's reachability using the steps in Get Provider Details.

  5. Onboard devices. See Add Devices Through the UI.

    1. The Administration State, Reachability Check, and Credential Profile are mandatory elements. The Host Name must be used if the NSO provider device key is set to the Host Name value. If the NSO provider device key is set to Inventory ID that field must be populated. The Software Type, Software Version, UUID, Serial Number, MAC address, and Product Type are filled by device discovery. Optionally, tags can be applied to the device. The GNMI encoding type can be set to JSON or PROTO.

      Add new device

      Optionally, location information can be entered. Latitude and Longitude information place the node at a specific location on a geographic map.

      Add the previously configured NSO provider as a provider for the device.

      Add new device
    2. Attach the devices to an active Cisco Crosswork Data Gateway pool to manage them (device discovery).

      Review the Data Gateways pane (see Overview of Cisco Crosswork Data Gateway). The operational state of the Cisco Crosswork Data Gateway pool to which you want to attach devices must be Up.

      Follow the steps in Attach Devices to Cisco Crosswork Data Gateway.

      Data gateways pane

Add Adapters to Crosswork Hierarchical Controller

Prerequisite

When you work with Crosswork Hierarchical Controller adapters you are required to use credentials. These credentials are used for authentication when a device is assigned to an adapter. The same credentials may be shared by multiple adapters. The credentials are added under the Services > Device Manager > Credentials tab in the Crosswork Hierarchical Controller GUI. The adapters needed for the Routed Optical Networking solution are:

Table 1. Routed Optical Networking Adapters

Adapter

Credential Type

Crosswork Network Controller

HTTP (username/password)

Crosswork Network Controller Crosswork Data Gateway

HTTP (username/password)

Cisco Optical Network Controller

HTTP (username/password)

IOS-XR

SSH - User and password


Note


If Cisco Optical Network Controller and Crosswork Network Controller are on the same Crosswork cluster, they can use the same credential profile.


To add the adapters, perform the following steps:

  1. In the applications bar in Crosswork Hierarchical Controller, select Services > Device Manager > Adapters.

  2. Click Add new adapter.

  3. Enter the adapter details:

    • Adapter Type: Select an adapter type from the list of available adapter types currently installed in Crosswork Hierarchical Controller.

    • Adapter Name: Unique user defined name of this adapter type instance (there can be several instances of the same adapter type).

  4. To configure the adapter, select the adapter in the Adapters pane. Configure the parameters as displayed in the following images.

    • Crosswork Network Controller Adapter:


      Note


      API version for Crosswork Network Controller must be V2.


      Figure 1. Crosswork Network Controller Adapter Configuration - General Tab

      Note


      The Full Data Fetch Interval must be set to 300s or higher in a production network.


      The following parameters must be configured for Crosswork Network Controller notifications and collection.

      Figure 2. Crosswork Network Controller Adapter Configuration - General Tab
    • IOS-XR Adapter

      Figure 3. IOS-XR Adapter - General Tab

      Note


      The Polling Cycle should not be less than 300s in a production network. Concurrency can be increased. The Logging Level must be set to Info if everything is working correctly.


      The following collection parameters must be configured. These parameters collect optical power values for the link assurance application.

      Figure 4. IOS-XR Adapter - General Tab

      The status of the devices must be ok in the Devices tab after the addition and completion of a successful collection cycle.

      Figure 5. IOS-XR Adapter - Devices Tab

      To add routers to Crosswork Hierarchical Controller, click the Managed Devices tab and then + Add Device.

      Figure 6. IOS-XR Adapter -Add New Device - General Tab

      It is recommended to use the hostname+hco (ron-8201-1-hco) or the device IP address. The device must be assigned a site for it to be displayed in the Explorer UI.

      Assign both the IOS-XR and Crosswork Network Controller adapter type to the device. Do not enable discovery for the Crosswork Network Controller adapter.

      Figure 7. IOS-XR Adapter -Add New Device - Adapters Tab
    • Cisco Optical Network Controller Adapter

      Figure 8. Cisco Optical Network Controller Adapter - General Tab

      The Polling cycle must be set to 300s or higher in a production network. Polling retrieves TAPI SIPs, topology, and connectivity services. The URL in the following figure is for the Cisco Optical Network Controller cApp installed on the CW cluster.

      The optical nodes are discovered automatically from Cisco Optical Network Controller. Nodes must be assigned a site for it to be displayed in the Explorer UI.

      Figure 9. Cisco Optical Network Controller Adapter - Devices Tab
    • Crosswork Network Controller Crosswork Data Gateway Adapter

      Crosswork Network Controller Crosswork Data Gateway adapter is used to collect telemetry data via gNMI to the router. In Crosswork Network Controller, the routers must be configured with the gNMI protocol with the encoding type set to “PROTO” and the GNMI capability enabled. In IOS XR, the routers must be configured for gRPC so that Crosswork Data Gateway can create gNMI telemetry subscriptions.

      Figure 10. Crosswork Network Controller Crosswork Data Gateway Adapter
      Crosswork Network Controller Crosswork Data Gateway Adapter

      The Crosswork Data Gateway adapter is configured to connect to Crosswork Network Controller controlling Crosswork Data Gateway instance. It can be the same as the Crosswork Network Controller used for the topology or a different Crosswork Network Controller. The collection parameters describe the supported telemetry collection jobs. The statistics show up in the physical interface statistics and in the Link Assurance application.

      Figure 11. Crosswork Network Controller Crosswork Data Gateway Adapter - General Tab
      Crosswork Network Controller Crosswork Data Gateway Adapter - General Tab
    • The device name in Cisco Crosswork Hierarchical Controller must match the device name in Crosswork Network Controller for successful deployment. If successful, you will see Cisco Crosswork Hierarchical Controller as a new destination in Crosswork Network Controller. This is setup by Cisco Crosswork Hierarchical Controller and user interaction is not required. As Crosswork Data Gateway is enabled on devices, new collection jobs are populated. A single collection job is available for each router collecting multiple KPIs.

      Figure 12. Crosswork Network Controller Crosswork Data Gateway Adapter - Data Destinations
      Crosswork Network Controller Crosswork Data Gateway Adapter
      Figure 13. Crosswork Network Controller Crosswork Data Gateway Adapter - Collection Jobs
      Crosswork Network Controller Crosswork Data Gateway Adapter

Provision ML Service Using NSO Routed Optical Networking CFP

Perform the following steps to provision the Routed Optical Networking ML service using the NSO Web UI.

  1. To add a new device, perform these steps:

    1. In the Device manager, click the + to add a new device. Specify a name for the new device. Click Confirm.

      Add device
    2. After creating the new device, click the device name to fill required and optional parameters. In this screen, the required parameters are the authgroup and IP address of the device.

      Configuration editor
    3. Scroll down in the device configuration screen. Click the “device-type” to bring up the device type selection screen. The device-type that is supported in the Routed Optical Networking ML FP is IOS-XR CLI NED.

      Configuration editor
    4. Click the blue NETCONF text to select the proper NED. The Routed Optical Networking ML FP requires the use of the cisco-iosxr-nc-7.3 NED.

      Configuration editor
    5. Click the Commit manager to view the NSO CLI configuration being applied. Click Commit to save the device configuration to NSO.

      Commit manager
  2. To configure the interlayer link service in NSO, perform these steps:

    1. In the Service manager, select the inter-layer-link service point from the drop-down list.

      Service manager
    2. Specify the end-point-device and the line-port. These are required values. The end-point-device is the 8201 router. Specify the router optics port that is connected to the optical line system add/drop port in the line-port field. Click Confirm.

      Service manager
    3. In the Configuration editor, edit the inter-layer-link service by clicking the newly created draft service to complete the information required. In this example, we add the site name, optical add/drop network element, and the optical add/drop port. The optical-controller field specifies the Optical Network Controller instance to be used for provisioning. This parameter is optional if a global instance is defined. A global Cisco Optical Network Controller instance can be set in NSO and will be used if the field is not populated. The add/drop port corresponds with the inventory ID of the physical port on the NCS1K-MD-64-C multiplexer corresponding to a frequency XXXX.YY. Both the RX and TX directions are included as part of the add/drop reference. In addition to specifying the network-element and add/drop in R/S/I/P form, a TAPI SIP can also be used to identify the add/drop port.

      Configuration editor

      These elements are the only required elements in the inter-layer-link service type.

    4. Perform Ols-domain optical-service-interface configuration.

      • Optical-controller specifies the Cisco Optical Network Controller instance managing the OLS.

      • Network-element specifies the optical element name as show in TAPI topology.

      • Optical-add-drop specifies the port to be used on the optical network element.

        Service manager
      • The optical-service-interface can also be added as a TAPI SIP UUID.

        Service manager
    5. Click the config tab in the Commit manager to see the NSO CLI configuration that will be committed to NSO.

      Service manager
    6. Click Commit in the upper right corner to commit the service. An end-to-end service requires two inter-layer-links, one for each router connected to its optical line system add/drop port.

      Commit manager

    Note


    Next we add the multilayer end-to-end service to configure and provision both the optical line system and routers. We recommend you to click check-sync in the Device manager to ensure that the device configuration is properly in sync with NSO before provisioning. If the device is out of sync, initial provisioning fails.

    Service manager
  3. To create Routed Optical Networking ML service, perform these steps:

    1. In the Service manager, select the Routed Optical Networking ML service point from the drop-down list. When we create the new Routed Optical Networking ML service, the required components are the service name, mode of the service (transponder or muxponder), and the bandwidth. The bandwidth corresponds to the line rate of the ZR/ZR+ optics. Click Confirm.

      Service manager
    2. In the Configuration editor, click the newly created service name for editing the additional parameters that are required for the service. In this example, we set the circuit-id name in the global parameters. The frequency is set by the optical controller based on the specified optical add/drop port. The dac-rate is set to the default value. Configuration editor


      Note


      • User configuration global options are frequency and dac-rate

      • If OLS provisioning is being performed and OLS can provide the frequency, it is optional, otherwise frequency must be provided.

      • Dac-rate controls the TX shaping parameters: 1x1.25 = enabled, 1x1 = disabled. Leaving it blank uses system default of enabled, and can be used in most circumstances


    3. After the ols-domain is added, you must add end-points to the circuit. Two end-points are always required. The end-points are the routers with ZR/ZR+ optics.

      Configuration editor
    4. Add the end-point-device to the service. Click Confirm.

      Configuration editor

      After the end-point is created, click the end-point to edit the end-point parameters. The line-port is a required parameter and refers to the optics port on the router. In this example, this is the same as the line-port specified in the inter-layer-link service for the end-point router.

      Service managerService manager

      The transmit-power is an optional parameter for end-to-end provisioning. If it is omitted the optical controller (Cisco Optical Network Controller) will provide the transmit power. Transmit power sets the transmit power, the value is in 100*value in 0.1dBm increments. For example, –100 is -10dBm. If no value is specified the default of -10dBM is used for QDD-400G-ZR-S or QDD-400G-ZRP-S, or 0dBm for DP04QSDD-HE0 (Bright ZR+). The transceiver-capability field specifies the optic type and is only required if no packet layer configuration is being performed. In this example, you are performing packet layer provisioning so specifying the transceiver capability is not required.

      Add the line-port of 0/0/0/20 to the Routed Optical Networking ML service.

      Configuration editor
    5. Click end-point to go back to the top-level endpoint configuration, click terminal-device-packet to configure Ethernet/IP parameters

      Service manager

      Note


      • Ethernet/IP configuration is optional.

      • Bundle configuration adds an interface to an existing bundle or creates a new bundle and adds the newly created IP interface to it.

        Interface configuration is used for configuring IP address parameters on newly created Ethernet interfaces.

        In this example we add a new Bundle and assign an IP address to the Bundle.


    6. Click the plus sign next to bundle to add a bundle, in this case with an identifier of 500. This creates a bundle interface Bundle-Ether 500 on the endpoint router

      The interface index for a bundle use case is always 0. In case of a non-bundle configuration in muxponder mode, the index can be 0–3 representing the number of interfaces created as part of the muxponder configuration.

      Service manager
    7. Click the bundle number and ip-address to configure an IP address on the bundle.

      Service manager
    8. Return to the top-level endpoint configuration, select the index 0 previously created and click membership to add the interface to the bundle

      Service manager

      Note


      • Bundle-id selects the previously created bundle.

      • Mode sets the bundle LAG signaling mode. Active=LACP, passive=LACP listener only, on=No active signaling, inherit=Inherit signaling from Bundle interface configuration. Default is active.


    9. Return to the top level of the service configuration and similarly configure the second endpoint.

      Service manager
    10. Click ols-domain to enable OLS provisioning through Cisco Optical Network Controller.

      Service manager
    11. Select “Unlocked” under service-state, no additional configuration is necessary as all configuration needed for OLS provisioning is part of the interlayer link and the rest of the ron-ml service.

      Service manager
    12. Click SRLG to perform SRLG configuration

      Service manager

      Note


      • Configuration options are to specify a preconfigured group, a list of numeric SRLG values, or a list of SRLG names associated with preconfigured name:value pairs.

      • Each type can be populated in the same configuration.

      • In this example we specify a list of explicit numeric values. An index is used along with the numeric value.


  4. In the Commit manager, click the config tab. The NSO CLI configuration for the end-to-end service is displayed. If the ols-domain component is not specified in the global configuration, no optical line system provisioning is performed, only router provisioning. You can preview and then commit the configuration.

    Commit manager
  5. Verify status in NSO UI.

    You can verify the status by inspecting the plan associated with the service. You can find the plan under the main ron-ml configuration which you can access by clicking the top portion of the service configuration. An example is highlighted in the following image.

    Commit manager
    1. Inspect the plan by clicking on the newly created service

      Commit manager

      If all steps are green and complete, the service has been properly deployed to the network

      Commit manager
    2. Inspect router configuration.

      The show configuration commit changes last 1 command shows the CLI config applied to the device during the NSO provisioning.

      The show optics controller 0/0/0/20 command verifies the operational status.

      Commit manager

Provision Routed Optical Networking ML Service Using Crosswork Hierarchical Controller

  1. To create the router DCO port to the NMC cross-connect:

    1. In the applications bar in the Crosswork Hierarchical Controller, click the NMC Cross Connections icon.

      Figure 14. NMC Cross Connections
      NMC Cross Connections

      The Network Media Channel (NMC) is the service across the optical line system of the network.

    2. Click the magnifying glass icon in the Router OCH port field.

      The application displays routers and ports with ZR/ZR+ transceivers in the Advanced tab in a new window. The description indicates whether it is a ZR or ZR+ transceiver.

    3. Select the router ZR/ZR+ optics interface. In this case, select ron-ncs57c3-1 0/0/0/20. Click OK after selecting the port. You can filter the selection criteria by clicking on the down arrow in each column.

      Figure 15. List of Routers with ZR/ZR+ Transceivers
      List of Routers with ZR/ZR+ Transceivers
    4. Click the magnifying glass icon in the Optical NMC port field.

      The app displays optical devices and ports. Due to the potentially long list of ports, it is best to filter the selection criteria.

      Figure 16. Optical Add/drop Ports
      Optical Add/drop Ports

      Select the optical add/drop port. In this case, select 0/1/0/6 port on ron2_olt1 and click OK.

      Figure 17. Optical Add/drop Ports
      Optical Add/drop Ports
      Figure 18. Optical Add/drop Ports
      Optical Add/drop Ports
    5. After the router and optical interfaces are selected, click Add to add the NMC cross-connect.

      Figure 19. NMC Cross Connection Creation
      NMC Cross Connection Creation
    6. Select and add second router port, ron-5504-1 0/0/0/0 and OLS add/drop port, ron2_olt2 0/3/0/6.

      Figure 20. Second Router Port and OLS Port
      Second Router Port and OLS Port
  2. To provision the Routed Optical Networking IP link, perform these steps:

    1. In the applications bar in the Crosswork Hierarchical Controller, click the Services Manager icon.
      Figure 21. Services Manager
      Services Manager
    2. Select the Point to Point tab and click IP Link from the Create New P2P drop-down list to start the provisioning process.
      Figure 22. Create IP Link
      Create IP Link

      The IP Link Creation wizard appears.

      Figure 23. IP Link Creation Wizard
      IP Link Creation Wizard
    3. Enter the Cisco Crosswork Hierarchical Controller service name, description of the router optical controller, and the link type in the General tab.

      Figure 24. IP Link Creation Wizard - General
      IP Link Creation Wizard - General

      (Optional) Check the Router Configuration Only check box to configure only the router optical controller and IP information and not the optical line system. This configuration is used when the OCHNC is created outside Cisco Crosswork Hierarchical Controller.

      Figure 25. IP Link Creation Wizard - General
      IP Link Creation Wizard - General
    4. Select the two router ports in the service. This is done by selecting the Site and Port. ​The transmit power for each endpoint is an optional parameter. The default TX power is used if no value is provided.

      Figure 26. IP Link Creation Wizard - Router Endpoints
      IP Link Creation - Router Endpoints
    5. Click the magnifying glass icon to select the site. The site can be selected either by selecting from the list or by using the 3D Explorer.

      Figure 27. IP Link Creation Wizard - Site Selection
      IP Link Creation Wizard - Site Selection
    6. Click the magnifying glass icon to select the router port.

      The ports are displayed based on the following criteria:

      • Is a ZR/ZR+ interface

      • Has no existing optics configuration

      • Has a proper NMC cross-connect configured

      Figure 28. IP Link Creation Wizard - Port Selection
      IP Link Creation Wizard - Port Selection
    7. Select the second site using the 3D Explorer. VAL is the site of the other endpoint router and port.

      Figure 29. IP Link Creation Wizard - Site Selection Using 3D Explorer
      Site Selection Using 3D Explorer
    8. Select the second router port.

      Figure 30. IP Link Creation Wizard - Router Port Selection
      Router Port Selection

      Both the router ports are selected.

      Router Ports Selection
    9. (Optional) Enter the IP address information for interfaces. If IP addresses are not entered, ZR/ZR+ router optical configuration happens; however, IP addresses are not configured.

      Figure 31. IP Link Creation Wizard - IP Addresses
      IP Link Creation Wizard - IP Addresses
    10. In the optical path configuration, optical node exclusion can be configured. The frequency can be manually set in this step. In router only configuration, the frequency is mandatory. If OLS provisioning is performed, Cisco Optical Network Controller returns the proper frequency to be configured on the router endpoints; hence, the frequency may be omitted. In this case, the manual frequency is set to the same value returned by Cisco Optical Network Controller.

      Figure 32. IP Link Creation Wizard - Path
      IP Link Creation Wizard - Path
    11. Click Next to review the final configuration. Click Finish to start provisioning, or click Save to save for later provisioning.

      Figure 33. IP Link Creation Wizard - Summary
      IP Link Creation Wizard - Summary
    12. The progress of provisioning is shown in the Services Manager​.

      Figure 34. Provisioning Progress - Services Manager
      Provisioning Progress - Services Manager
    13. Click the Operations > Logs tab to view the provisioning API calls used and responses.

      Figure 35. Provisioning Progress - Logs
      Provisioning Progress - Logs
    14. If the provisioning is successful, the Configuration State field changes to INSTALLED state and the Operational State field changes to UP​ state.

      Figure 36. Successful Provisioning
      Successful Provisioning
    15. Click the Summary tab to see the new service link and click the square to show the new link in the 3D Explorer view​.

      Figure 37. Provisioned Service Link
      Provisioned Service Link
    16. 3D Explorer view highlights the new logical router link along with the underlying optical path that is shown in Green.

      Figure 38. Provisioned Link in 3D Explorer
      Provisioned Link in 3D Explorer
    17. Click Path to show the full multilayer path including each optical line system segment​.

      Figure 39. Multilayer Path View in 3D Explorer
      Multi-layer Path in 3D Explorer
  3. The Link Assurance app can be used to inspect the end-to-end link path.

    Figure 40. Link Assurance Tool
    Link Assurance Tool

    Select a specific layer to show PM data (ZRM, OCH, and OTS layers only).

    Figure 41. Link Assurance Tool
    Link Assurance Tool

    Select a specific port to show PM data for the port​.

    Figure 42. Link Assurance Tool
    Link Assurance Tool

Operate Phase

To monitor the ZR/Z+ optics:

  1. Use either CLI commands or EPNM to monitor router ZR/ZR+ optics for proper operation. See Monitor ZR or ZR+ Optics Using EPNM.

  2. (Optional) Setup router ZR/ZR+ optics data collection in CW Health Insights. See Monitor Performance of ZR/ZR+ Optics Using KPIs.

Monitor ZR or ZR+ Optics Using EPNM

This section adds the 8201 router to EPNM for monitoring the PM parameters on the ZR or ZR+ optics.

  1. To add a new device to EPNM choose Inventory > Device Management > Network Devices. Click Routers or a subgroup if it is already defined in the left panel.

    Network device pane
  2. Click the icon above the Network Devices table, then choose Add Device.

    Add device
  3. Configure the General, SNMP, and SSH parameters as seen in that following figures. Click Verify Credentials to validate that Cisco EPN Manager can reach the device. Click Add to add the device to EPNM.

    General parameters
    Telnet/SSH paramaters
    SNMP parameters
  4. To open the chassis view from the Network devices table, click the device name link. The following figure displays the chassis view of the 8201 router.

    Chassis view
  5. Click the QSFP-DD ZR+ port to see specific data about that port.

    Chassis view

    Here you can view the port and specific optical channel and CoherentDSP entities.

    QDD-400G-ZRP-S details
  6. Clicking the additional information icon for the optical channel and then the Optical Physical measurement tab displays the relevant optical PM values such as RX/TX signal power and OSNR values.

    Optical physical parameters
  7. Clicking the additional information icon for the coherent DSP and then the FEC measurement tab displays the relevant coherent DSP FEC statistics such as PreFEC Bit Error Rate, Bit Error Rate Count (BIEC), and Uncorrected Words (UCW). The UCW value must remain 0.

    FEC parameters

The following figures display the current and historical performance monitoring data in EPNM that is specific to the ZR or ZR+ optics.

Figure 43. Optical Physical Parameters
Optical physical parameters
Figure 44. Historical Optical Physical Parameters
Historical optical physical parameters
Figure 45. Historical Optical Physical Parameters
Historical optical physical parameters
Figure 46. Historical Optical Physical Parameters
Historical optical physical parameters
Figure 47. FEC Parameters
FEC parameters
Figure 48. Historical FEC Parameters
Historical FEC parameters
Figure 49. Historical FEC Parameters
Historical FEC parameters
Figure 50. Historical OTN Parameters
Historical OTN parameters
Figure 51. Historical OTN Parameters
Historical OTN parameters

Monitor Performance of ZR/ZR+ Optics Using KPIs

Perform the following steps to create KPI Profiles in Health Insights and enable them on the devices to monitor network health.


Note


Plan which Cisco-supplied KPIs you want to begin using, based on each device's function and the device performance characteristics you want to monitor. Review the Cisco-supplied KPIs documented in List of Health Insights KPIs. In the following image, you see the available default L1 optics KPIs.

Key performance indicators
  1. Group the relevant KPIs to form a KPI Profile. A KPI profile can have many different KPIs assigned. In this case, the focus is only on some specific optics KPIs to add to the optics_profile KPI profile.

    KPI profile

    See Create a New KPI Profile.

  2. Enable the appropriate KPI Profiles on the devices you want to monitor. From the main menu, choose Performance Alerts > Enable/Disable KPI Profiles. Check the checkboxes of all the nodes to which the profile must be applied to, and click Enable KPI Profiles.

    Multiple nodes may be selected. In the following figure, we are applying the KPI profile to a single node.

    KPI proflie
  3. Select the optics_profile KPI profile that was created in the previous step and click next to finalize enabling the KPI for the selected device.

    KPI profile
  4. The following image displays the final page before enabling the KPI profile for the router. After you click Enable, the appropriate configuration is applied to the router to begin streaming the telemetry sensors data for the selected optical KPIs.

    KPI profile

    See Enable KPI Profiles on Devices.

  5. To view alerts from network devices, see View Alerts for Network Devices.

    The following figure displays the RX and TX power of the QDD-400G-ZR-S transceiver.

    RX and TX power of the QDD-400G-ZR-S

Optimization Phase

The optimization phase involves:

  1. Return to planning stage.

  2. Continue to add or change circuits on the network to match packet demands.