Contents

Flexible NetFlow - Top N Talkers Support

This document contains information about and instructions for using the Flexible NetFlow - Top N Talkers Support feature. The Flexible NetFlow - Top N Talkers Support feature helps you analyze the large amount of data that Flexible NetFlow captures from the traffic in your network by providing the ability to filter, aggregate, and sort the data in the Flexible NetFlow cache as you display it. When you are sorting and displaying the data in the cache, you can limit the display output to a specific number of entries with the highest values (Top N Talkers) for traffic volume, packet counters, and so on. The Flexible NetFlow - Top N Talkers Support feature facilitates real-time traffic analysis by requiring only the use of show commands, which can be entered in many different variations using the available keywords and arguments to meet your traffic data analysis requirements.

NetFlow is a Cisco technology that provides statistics on packets flowing through the router. NetFlow is the standard for acquiring IP operational data from IP networks. NetFlow provides data to support network and security monitoring, network planning, traffic analysis, and IP accounting.

Flexible NetFlow improves on original NetFlow by adding the capability to customize the traffic analysis parameters for your specific requirements. Flexible NetFlow facilitates the creation of more complex configurations for traffic analysis and data export through the use of reusable configuration components.

Finding Feature Information

Your software release may not support all the features documented in this module. For the latest caveats and feature information, see Bug Search Tool and the release notes for your platform and software release. To find information about the features documented in this module, and to see a list of the releases in which each feature is supported, see the feature information table at the end of this module.

Use Cisco Feature Navigator to find information about platform support and Cisco software image support. To access Cisco Feature Navigator, go to www.cisco.com/​go/​cfn. An account on Cisco.com is not required.

Prerequisites for Flexible NetFlow - Top N Talkers Support

  • The networking device is running a Cisco release that supports the Flexible NetFlow - Top N Talkers Support feature.

No configuration tasks are associated with the Flexible NetFlow - Top N Talkers Support feature. Therefore, in order for you to use the Flexible NetFlow - Top N Talkers Support feature, traffic analysis with Flexible NetFlow must already be configured on the networking device.

Information About Flexible NetFlow - Top N Talkers Support

Flexible NetFlow Data Flow Filtering

The flow filtering function of the Flexible NetFlow - Top N Talkers Support feature filters the flow data in a flow monitor cache based on the criteria that you specify, and displays the data.

The flow filtering function of the Flexible NetFlow - Top N Talkers Support feature is provided by the show flow monitor cache filter command. For more information on the show flow monitor cache filter command, refer to the Cisco IOS Flexible NetFlow Command Reference.

Flexible NetFlow Data Flow Aggregation

Flow aggregation using the show flow monitor cache aggregate command allows you to dynamically view the flow information in a cache using a different flow record than the cache was originally created from. Only the fields in the cache will be available for the aggregated flows.

The flow aggregation function of the Flexible NetFlow - Top N Talkers Support feature is provided by the show flow monitor cache aggregate command. For more information on the show flow monitor cache aggregate command, refer to the Cisco IOS Flexible NetFlow Command Reference.

Flow Sorting and Top N Talkers

The flow sorting function of the Flexible NetFlow - Top N Talkers Support feature sorts flow data from the Flexible NetFlow cache based on the criteria that you specify and displays the data. You can also use the flow sorting function of the Flexible NetFlow - Top N Talkers Support feature to limit the display output to a specific number of entries (top n talkers, where n is the number or talkers to display) by using the top keyword of the show flow monitor cache sort command.

The flow sorting and Top N Talkers function of the Flexible NetFlow - Top N Talkers Support feature is provided by the show flow monitor cache sort command. For more information on the show flow monitor cache sort command, refer to the Cisco IOS Flexible NetFlow Command Reference.

Combined Use of Flow Filtering and Flow Aggregation and Flow Sorting with Top N Talkers

Although each of the show commands that make up the Flexible NetFlow - Top N Talkers Support feature can be used individually for traffic analysis, they provide much greater analytical capabilities when they are used together. When you use any combination of the three show commands, you enter only the common prefix of show flow monitor monitor-name cachefollowed by filter, aggregation, or sort, and the arguments and keywords available for filter, aggregation, and sort, as required. For example,

show flow monitor 
monitor-name 
cache filter
 
options
 aggregation 
options
 sort 
options
 

where options is any permissible combination of arguments and keywords. See the "Configuration Examples for Flexible NetFlow - Top N Talkers Support " section for more information.

Memory and Performance Impact of Top N Talkers

The Flexible NetFlow - Top N Talkers Support feature can use a large number of CPU cycles and possibly also system memory for a short time. However, because the Flexible NetFlow - Top N Talkers Support feature uses only show commands, the CPU usage should be run at a low priority because no real-time data processing is involved. The memory usage can be mitigated by using a larger granularity of aggregation or no aggregation at all.

How to Analyze Network Traffic Using Flexible NetFlow Top N Talkers

Filtering Flow Data from the Flexible NetFlow Cache

This task shows you how to use the show flow monitor cache filter command with a regular expression to filter the flow monitor cache data and display the results. For more information on regular expressions and the show flow monitor cache filter command, refer to the Cisco IOS Flexible NetFlow Command Reference.

Perform this task to filter the flow monitor cache data using a regular expression and display the results.

SUMMARY STEPS

    1.    enable

    2.    show flow monitor [name] monitor-name cache filter options [regexp regexp] [...options [regexp regexp]] [format {csv | record | table}]


DETAILED STEPS
    Step 1   enable

    Enters privileged EXEC mode.



    Example:
    Device> enable
    
    Step 2   show flow monitor [name] monitor-name cache filter options [regexp regexp] [...options [regexp regexp]] [format {csv | record | table}]

    Filters the flow monitor cache data on the IPv4 type of service (ToS) value.



    Example:
    Device# show flow monitor FLOW-MONITOR-3 cache filter ipv4 tos regexp 0x(C0|50)
    
    Cache type:                            Normal
      Cache size:                              4096
      Current entries:                           19
      High Watermark:                            38
      Flows added:                             3516
      Flows aged:                              3497
        - Active timeout   (  1800 secs)         52
        - Inactive timeout (    15 secs)       3445
        - Event aged                              0
        - Watermark aged                          0
        - Emergency aged                          0
    IPV4 SOURCE ADDRESS:       10.1.1.1
    IPV4 DESTINATION ADDRESS:  255.255.255.255
    TRNS SOURCE PORT:          520
    TRNS DESTINATION PORT:     520
    INTERFACE INPUT:           Et0/0
    FLOW SAMPLER ID:           0
    IP TOS:                    0xC0
    IP PROTOCOL:               17
    ip source as:              0
    ip destination as:         0
    ipv4 next hop address:     0.0.0.0
    ipv4 source mask:          /24
    ipv4 destination mask:     /0
    tcp flags:                 0x00
    interface output:          Null
    counter bytes:             52
    counter packets:           1
    timestamp first:           18:59:46.199
    timestamp last:            18:59:46.199
    Matched 1 flow
     
    
    
    

    Aggregating Flow Data from the Flexible NetFlow Cache

    This task shows you how to use the show flow monitor cache aggregate command to aggregate the flow monitor cache data with a different record than the cache was created with and display the results. For more information on the show flow monitor cache aggregate command, refer to the Cisco IOS Flexible NetFlow Command Reference.

    Perform this task to aggregate the flow monitor cache data and display the results.

    SUMMARY STEPS

      1.    enable

      2.    show flow monitor [name] monitor-name cache aggregate {options [...options] [collect options [...options]] | record record-name} [format {csv | record | table}]


    DETAILED STEPS
      Step 1   enable

      Enters privileged EXEC mode.



      Example:
      Device> enable
      
      Step 2   show flow monitor [name] monitor-name cache aggregate {options [...options] [collect options [...options]] | record record-name} [format {csv | record | table}]

      Aggregates the flow monitor cache data on the IPv4 destination address and displays the cache data for the IPv4 protocol type and input interface nonkey fields:



      Example:
      Device# show flow monitor FLOW-MONITOR-3 cache aggregate ipv4 destination address collect ipv4 protocol interface input
      
      Processed 17 flows
      Aggregated to 7 flows
      IPV4 DST ADDR    intf input                 flows       bytes        pkts  ip prot
      ===============  ====================  ==========  ==========  ==========  =======
      224.192.16.4     Et0/0                          3       42200        2110        1
      224.192.16.1     Et0/0                          3       17160         858        1
      224.192.18.1     Et0/0                          4       18180         909        1
      224.192.45.12    Et0/0                          4       14440         722        1
      255.255.255.255  Et0/0                          1          52           1       17
      224.0.0.13       Et0/0                          1          54           1      103
      224.0.0.1        Et0/0                          1          28           1        2
      
      

      Sorting Flow Data from the Flexible NetFlow Cache

      This task shows you how to use the show flow monitor cache sort command to sort the flow monitor cache data, and display the results. For more information on the show flow monitor cache sort command, refer to the Cisco IOS Flexible NetFlow Command Reference.

      Perform this task to sort the flow monitor cache data and display the results.

      SUMMARY STEPS

        1.    enable

        2.    show flow monitor [name] monitor-name cache sort options [top [number]] [format {csv | record | table}]


      DETAILED STEPS
        Step 1   enable

        Enters privileged EXEC mode.



        Example:
        Device> enable
        
        Step 2   show flow monitor [name] monitor-name cache sort options [top [number]] [format {csv | record | table}]

        Displays the cache data sorted on the number of packets from highest to lowest.

        Note   

        When the top keyword is not used, the default number of sorted flows shown is 20.



        Example:
        Device# show flow monitor FLOW-MONITOR-1 cache sort highest counter packets
        
        Processed 26 flows
        Aggregated to 26 flows
        Showing the top 20 flows
        IPV4 SOURCE ADDRESS:       10.1.1.3
        IPV4 DESTINATION ADDRESS:  172.16.10.11
        TRNS SOURCE PORT:          443
        TRNS DESTINATION PORT:     443
        INTERFACE INPUT:           Et0/0.1
        FLOW SAMPLER ID:           0
        IP TOS:                    0x00
        IP PROTOCOL:               6
        ip source as:              0
        ip destination as:         0
        ipv4 next hop address:     172.16.7.2
        ipv4 source mask:          /0
        ipv4 destination mask:     /24
        tcp flags:                 0x00
        interface output:          Et1/0.1
        counter bytes:             22760
        counter packets:           1569
        timestamp first:           19:42:32.924
        timestamp last:            19:57:28.656
        IPV4 SOURCE ADDRESS:       10.10.11.2
        IPV4 DESTINATION ADDRESS:  172.16.10.6
        TRNS SOURCE PORT:          65
        TRNS DESTINATION PORT:     65
        INTERFACE INPUT:           Et0/0.1
        FLOW SAMPLER ID:           0
        IP TOS:                    0x00
        IP PROTOCOL:               6
        ip source as:              0
        ip destination as:         0
        ipv4 next hop address:     172.16.7.2
        ipv4 source mask:          /0
        ipv4 destination mask:     /24
        tcp flags:                 0x00
        interface output:          Et1/0.1
        counter bytes:             22720
        counter packets:           568
        timestamp first:           19:42:34.264
        timestamp last:            19:57:28.428
        .
        .
        .
        IPV4 SOURCE ADDRESS:       192.168.67.6
        IPV4 DESTINATION ADDRESS:  172.16.10.200
        TRNS SOURCE PORT:          0
        TRNS DESTINATION PORT:     3073
        INTERFACE INPUT:           Et0/0.1
        FLOW SAMPLER ID:           0
        IP TOS:                    0x00
        IP PROTOCOL:               1
        ip source as:              0
        ip destination as:         0
        ipv4 next hop address:     172.16.7.2
        ipv4 source mask:          /0
        ipv4 destination mask:     /24
        tcp flags:                 0x00
        interface output:          Et1/0.1
        counter bytes:             15848
        counter packets:           344
        timestamp first:           19:42:36.852
        timestamp last:            19:57:27.836
        IPV4 SOURCE ADDRESS:       10.234.53.1
        IPV4 DESTINATION ADDRESS:  172.16.10.2
        TRNS SOURCE PORT:          0
        TRNS DESTINATION PORT:     2048
        INTERFACE INPUT:           Et0/0.1
        FLOW SAMPLER ID:           0
        IP TOS:                    0x00
        IP PROTOCOL:               1
        ip source as:              0
        ip destination as:         0
        ipv4 next hop address:     172.16.7.2
        ipv4 source mask:          /0
        ipv4 destination mask:     /24
        tcp flags:                 0x00
        interface output:          Et1/0.1
        counter bytes:             15848
        counter packets:           213
        timestamp first:           19:42:36.904
        timestamp last:            19:57:27.888
        
        

        Displaying the Top N Talkers with Sorted Flow Data

        This task shows you how to use the show flow monitor cache sort command to sort the flow monitor cache data, and to limit the display results to a specific number of high volume flows. For more information on the show flow monitor cache sort command, refer to the Cisco IOS Flexible NetFlow Command Reference.

        Perform this task to sort the flow monitor cache data and limit the display output using to a specific number of high volume flows.

        SUMMARY STEPS

          1.    enable

          2.    show flow monitor [name] monitor-name cache sort options [top [number]] [format {csv | record | table}]


        DETAILED STEPS
          Step 1   enable

          Enters privileged EXEC mode.



          Example:
          Device> enable
          
          Step 2   show flow monitor [name] monitor-name cache sort options [top [number]] [format {csv | record | table}]

          Displays the cache data sorted on the number of packets from highest to lowest and limits the output to the three highest volume flows.



          Example:
          Device# show flow monitor FLOW-MONITOR-1 cache sort highest counter packets top 3
          
          Processed 25 flows
          Aggregated to 25 flows
          Showing the top 3 flows
          IPV4 SOURCE ADDRESS:       10.1.1.3
          IPV4 DESTINATION ADDRESS:  172.16.10.11
          TRNS SOURCE PORT:          443
          TRNS DESTINATION PORT:     443
          INTERFACE INPUT:           Et0/0.1
          FLOW SAMPLER ID:           0
          IP TOS:                    0x00
          IP PROTOCOL:               6
          ip source as:              0
          ip destination as:         0
          ipv4 next hop address:     172.16.7.2
          ipv4 source mask:          /0
          ipv4 destination mask:     /24
          tcp flags:                 0x00
          interface output:          Et1/0.1
          counter bytes:             32360
          counter packets:           1897
          timestamp first:           19:42:32.924
          timestamp last:            20:03:47.100
          IPV4 SOURCE ADDRESS:       10.10.11.2
          IPV4 DESTINATION ADDRESS:  172.16.10.6
          TRNS SOURCE PORT:          65
          TRNS DESTINATION PORT:     65
          INTERFACE INPUT:           Et0/0.1
          FLOW SAMPLER ID:           0
          IP TOS:                    0x00
          IP PROTOCOL:               6
          ip source as:              0
          ip destination as:         0
          ipv4 next hop address:     172.16.7.2
          ipv4 source mask:          /0
          ipv4 destination mask:     /24
          tcp flags:                 0x00
          interface output:          Et1/0.1
          counter bytes:             32360
          counter packets:           809
          timestamp first:           19:42:34.264
          timestamp last:            20:03:48.460
          IPV4 SOURCE ADDRESS:       172.16.1.84
          IPV4 DESTINATION ADDRESS:  172.16.10.19
          TRNS SOURCE PORT:          80
          TRNS DESTINATION PORT:     80
          INTERFACE INPUT:           Et0/0.1
          FLOW SAMPLER ID:           0
          IP TOS:                    0x00
          IP PROTOCOL:               6
          ip source as:              0
          ip destination as:         0
          ipv4 next hop address:     172.16.7.2
          ipv4 source mask:          /24
          ipv4 destination mask:     /24
          tcp flags:                 0x00
          interface output:          Et1/0.1
          counter bytes:             32320
          counter packets:           345
          timestamp first:           19:42:34.512
          timestamp last:            20:03:47.140
          
          

          Configuration Examples for Flexible NetFlow Top N Talkers

          Example: Displaying the Top Talkers with Filtered and Aggregated and Sorted Flow Data

          The following example combines filtering, aggregation, collecting additional field data, sorting the flow monitor cache data, and limiting the display output to a specific number of high volume flows (top talkers).

          Device# show flow monitor FLOW-MONITOR-1 cache filter ipv4 protocol regexp (1|6) aggregate ipv4 destination address collect ipv4 protocol sort counter bytes top 4
          
          Processed 26 flows
          Matched 26 flows
          Aggregated to 13 flows
          Showing the top 4 flows
          IPV4 DST ADDR         flows       bytes        pkts
          ===============  ==========  ==========  ==========
          172.16.10.2              12     1358370        6708
          172.16.10.19              2       44640        1116
          172.16.10.20              2       44640        1116
          172.16.10.4               1       22360         559
          

          The following example combines filtering using a regular expression, aggregation using a predefined record, sorting the flow monitor cache data, limiting the display output to a specific number of high volume flows (top talkers), and displaying the output in record format.

          Device# show flow monitor FLOW-MONITOR-1 cache filter ipv4 source address regexp 10.* aggregate record netflow ipv4 protocol-port sort transport destination-port top 5 format record 
          
          Processed 26 flows
          Matched 15 flows
          Aggregated to 10 flows
          Showing the top 5 flows
          TRNS SOURCE PORT:       0
          TRNS DESTINATION PORT:  0
          FLOW DIRECTION:         Input
          IP PROTOCOL:            1
          counter flows:          1
          counter bytes:          387800
          counter packets:        700
          timestamp first:        17:12:30.712
          timestamp last:         17:30:52.936
          TRNS SOURCE PORT:       20
          TRNS DESTINATION PORT:  20
          FLOW DIRECTION:         Input
          IP PROTOCOL:            6
          counter flows:          2
          counter bytes:          56000
          counter packets:        1400
          timestamp first:        17:12:29.532
          timestamp last:         17:30:53.148
          TRNS SOURCE PORT:       21
          TRNS DESTINATION PORT:  21
          FLOW DIRECTION:         Input
          IP PROTOCOL:            6
          counter flows:          2
          counter bytes:          56000
          counter packets:        1400
          timestamp first:        17:12:29.572
          timestamp last:         17:30:53.196
          TRNS SOURCE PORT:       22
          TRNS DESTINATION PORT:  22
          FLOW DIRECTION:         Input
          IP PROTOCOL:            6
          counter flows:          1
          counter bytes:          28000
          counter packets:        700
          timestamp first:        17:12:29.912
          timestamp last:         17:30:52.168
          TRNS SOURCE PORT:       25
          TRNS DESTINATION PORT:  25
          FLOW DIRECTION:         Input
          IP PROTOCOL:            6
          counter flows:          2
          counter bytes:          56000
          counter packets:        1400
          timestamp first:        17:12:29.692
          timestamp last:         17:30:51.968
          
          

          Example: Filtering Using Multiple Filtering Criteria

          The following example filters the cache data on the IPv4 destination address and the destination port:

          Device# show flow monitor FLOW-MONITOR-1 cache filter ipv4 destination address regexp 172.16.10* transport destination-port 21
          
          Cache type:                            Normal
            Cache size:                              4096
            Current entries:                           26
            High Watermark:                            26
            Flows added:                              241
            Flows aged:                               215
              - Active timeout   (  1800 secs)         50
              - Inactive timeout (    15 secs)        165
              - Event aged                              0
              - Watermark aged                          0
              - Emergency aged                          0
          IPV4 SOURCE ADDRESS:       10.10.10.2
          IPV4 DESTINATION ADDRESS:  172.16.10.2
          TRNS SOURCE PORT:          21
          TRNS DESTINATION PORT:     21
          INTERFACE INPUT:           Et0/0.1
          FLOW SAMPLER ID:           0
          IP TOS:                    0x00
          IP PROTOCOL:               6
          ip source as:              0
          ip destination as:         0
          ipv4 next hop address:     172.16.7.2
          ipv4 source mask:          /0
          ipv4 destination mask:     /24
          tcp flags:                 0x00
          interface output:          Et1/0.1
          counter bytes:             17200
          counter packets:           430
          timestamp first:           17:03:58.071
          timestamp last:            17:15:14.615
          IPV4 SOURCE ADDRESS:       172.30.231.193
          IPV4 DESTINATION ADDRESS:  172.16.10.2
          TRNS SOURCE PORT:          21
          TRNS DESTINATION PORT:     21
          INTERFACE INPUT:           Et0/0.1
          FLOW SAMPLER ID:           0
          IP TOS:                    0x00
          IP PROTOCOL:               6
          ip source as:              0
          ip destination as:         0
          ipv4 next hop address:     172.16.7.2
          ipv4 source mask:          /0
          ipv4 destination mask:     /24
          tcp flags:                 0x00
          interface output:          Et1/0.1
          counter bytes:             17160
          counter packets:           429
          timestamp first:           17:03:59.963
          timestamp last:            17:15:14.887
          Matched 2 flows

          Example: Aggregation Using Multiple Aggregation Criteria

          The following example aggregates the flow monitor cache data on the destination and source IPv4 addresses:

          Device# show flow monitor FLOW-MONITOR-1 cache aggregate ipv4 destination address ipv4 source address
           
          Processed 26 flows
          Aggregated to 17 flows
          IPV4 SRC ADDR    IPV4 DST ADDR         flows       bytes        pkts
          ===============  ===============  ==========  ==========  ==========
          10.251.10.1      172.16.10.2               2     1400828        1364
          192.168.67.6     172.16.10.200             1       19096         682
          10.234.53.1      172.16.10.2               3       73656        2046
          172.30.231.193   172.16.10.2               3       73616        2045
          10.10.10.2       172.16.10.2               2       54560        1364
          192.168.87.200   172.16.10.2               2       54560        1364
          10.10.10.4       172.16.10.4               1       27280         682
          10.10.11.1       172.16.10.5               1       27280         682
          10.10.11.2       172.16.10.6               1       27280         682
          10.10.11.3       172.16.10.7               1       27280         682
          10.10.11.4       172.16.10.8               1       27280         682
          10.1.1.1         172.16.10.9               1       27280         682
          10.1.1.2         172.16.10.10              1       27280         682
          10.1.1.3         172.16.10.11              1       27280         682
          172.16.1.84      172.16.10.19              2       54520        1363
          172.16.1.85      172.16.10.20              2       54520        1363
          172.16.6.1       224.0.0.9                 1          52           1
          
          

          Additional References

          Related Documents

          Related Topic

          Document Title

          Cisco IOS commands

          Cisco IOS Master Command List, All Releases

          Flexible NetFlow conceptual information and configuration tasks

          Flexible NetFlow Configuration Guide

          Flexible NetFlow commands

          Cisco IOS Flexible NetFlow Command Reference

          Standards/RFCs

          Standard

          Title

          No new or modified standards/RFCs are supported by this feature.

          MIBs

          MIB

          MIBs Link

          None

          To locate and download MIBs for selected platforms, Cisco software releases, and feature sets, use Cisco MIB Locator found at the following URL:

          http:/​/​www.cisco.com/​go/​mibs

          Technical Assistance

          Description

          Link

          The Cisco Support and Documentation website provides online resources to download documentation, software, and tools. Use these resources to install and configure the software and to troubleshoot and resolve technical issues with Cisco products and technologies. Access to most tools on the Cisco Support and Documentation website requires a Cisco.com user ID and password.

          http:/​/​www.cisco.com/​cisco/​web/​support/​index.html

          Feature Information for Flexible NetFlow - Top N Talkers

          The following table provides release information about the feature or features described in this module. This table lists only the software release that introduced support for a given feature in a given software release train. Unless noted otherwise, subsequent releases of that software release train also support that feature.

          Use Cisco Feature Navigator to find information about platform support and Cisco software image support. To access Cisco Feature Navigator, go to www.cisco.com/​go/​cfn. An account on Cisco.com is not required.

          Table 1 Feature Information for Flexible NetFlow - Top N Talkers

          Feature Name

          Releases

          Feature Information

          Flexible NetFlow - Top N Talkers Support

          12.2(33)SRE

          12.2(50)SY

          12.4(22)T

          15.0(1)SY

          15.0(1)SY1

          Cisco IOS XE Release 3.2SE

          Thsi feature helps you analyze the large amount of data Flexible NetFlow captures from the traffic in your network by providing the ability to filter, aggregate, and sort the data in the Flexible NetFlow cache as you display it.

          Support for this feature was added for Cisco 7200 and 7300 Network Processing Engine (NPE) series routers in Cisco IOS Release 12.2(33)SRE.

          The following commands were introduced or modified: show flow monitor cache aggregate, show flow monitor cache filter, show flow monitor cache sort.


          Flexible NetFlow - Top N Talkers Support

          Contents

          Flexible NetFlow - Top N Talkers Support

          This document contains information about and instructions for using the Flexible NetFlow - Top N Talkers Support feature. The Flexible NetFlow - Top N Talkers Support feature helps you analyze the large amount of data that Flexible NetFlow captures from the traffic in your network by providing the ability to filter, aggregate, and sort the data in the Flexible NetFlow cache as you display it. When you are sorting and displaying the data in the cache, you can limit the display output to a specific number of entries with the highest values (Top N Talkers) for traffic volume, packet counters, and so on. The Flexible NetFlow - Top N Talkers Support feature facilitates real-time traffic analysis by requiring only the use of show commands, which can be entered in many different variations using the available keywords and arguments to meet your traffic data analysis requirements.

          NetFlow is a Cisco technology that provides statistics on packets flowing through the router. NetFlow is the standard for acquiring IP operational data from IP networks. NetFlow provides data to support network and security monitoring, network planning, traffic analysis, and IP accounting.

          Flexible NetFlow improves on original NetFlow by adding the capability to customize the traffic analysis parameters for your specific requirements. Flexible NetFlow facilitates the creation of more complex configurations for traffic analysis and data export through the use of reusable configuration components.

          Finding Feature Information

          Your software release may not support all the features documented in this module. For the latest caveats and feature information, see Bug Search Tool and the release notes for your platform and software release. To find information about the features documented in this module, and to see a list of the releases in which each feature is supported, see the feature information table at the end of this module.

          Use Cisco Feature Navigator to find information about platform support and Cisco software image support. To access Cisco Feature Navigator, go to www.cisco.com/​go/​cfn. An account on Cisco.com is not required.

          Prerequisites for Flexible NetFlow - Top N Talkers Support

          • The networking device is running a Cisco release that supports the Flexible NetFlow - Top N Talkers Support feature.

          No configuration tasks are associated with the Flexible NetFlow - Top N Talkers Support feature. Therefore, in order for you to use the Flexible NetFlow - Top N Talkers Support feature, traffic analysis with Flexible NetFlow must already be configured on the networking device.

          Information About Flexible NetFlow - Top N Talkers Support

          Flexible NetFlow Data Flow Filtering

          The flow filtering function of the Flexible NetFlow - Top N Talkers Support feature filters the flow data in a flow monitor cache based on the criteria that you specify, and displays the data.

          The flow filtering function of the Flexible NetFlow - Top N Talkers Support feature is provided by the show flow monitor cache filter command. For more information on the show flow monitor cache filter command, refer to the Cisco IOS Flexible NetFlow Command Reference.

          Flexible NetFlow Data Flow Aggregation

          Flow aggregation using the show flow monitor cache aggregate command allows you to dynamically view the flow information in a cache using a different flow record than the cache was originally created from. Only the fields in the cache will be available for the aggregated flows.

          The flow aggregation function of the Flexible NetFlow - Top N Talkers Support feature is provided by the show flow monitor cache aggregate command. For more information on the show flow monitor cache aggregate command, refer to the Cisco IOS Flexible NetFlow Command Reference.

          Flow Sorting and Top N Talkers

          The flow sorting function of the Flexible NetFlow - Top N Talkers Support feature sorts flow data from the Flexible NetFlow cache based on the criteria that you specify and displays the data. You can also use the flow sorting function of the Flexible NetFlow - Top N Talkers Support feature to limit the display output to a specific number of entries (top n talkers, where n is the number or talkers to display) by using the top keyword of the show flow monitor cache sort command.

          The flow sorting and Top N Talkers function of the Flexible NetFlow - Top N Talkers Support feature is provided by the show flow monitor cache sort command. For more information on the show flow monitor cache sort command, refer to the Cisco IOS Flexible NetFlow Command Reference.

          Combined Use of Flow Filtering and Flow Aggregation and Flow Sorting with Top N Talkers

          Although each of the show commands that make up the Flexible NetFlow - Top N Talkers Support feature can be used individually for traffic analysis, they provide much greater analytical capabilities when they are used together. When you use any combination of the three show commands, you enter only the common prefix of show flow monitor monitor-name cachefollowed by filter, aggregation, or sort, and the arguments and keywords available for filter, aggregation, and sort, as required. For example,

          show flow monitor 
          monitor-name 
          cache filter
           
          options
           aggregation 
          options
           sort 
          options
           
          

          where options is any permissible combination of arguments and keywords. See the "Configuration Examples for Flexible NetFlow - Top N Talkers Support " section for more information.

          Memory and Performance Impact of Top N Talkers

          The Flexible NetFlow - Top N Talkers Support feature can use a large number of CPU cycles and possibly also system memory for a short time. However, because the Flexible NetFlow - Top N Talkers Support feature uses only show commands, the CPU usage should be run at a low priority because no real-time data processing is involved. The memory usage can be mitigated by using a larger granularity of aggregation or no aggregation at all.

          How to Analyze Network Traffic Using Flexible NetFlow Top N Talkers

          Filtering Flow Data from the Flexible NetFlow Cache

          This task shows you how to use the show flow monitor cache filter command with a regular expression to filter the flow monitor cache data and display the results. For more information on regular expressions and the show flow monitor cache filter command, refer to the Cisco IOS Flexible NetFlow Command Reference.

          Perform this task to filter the flow monitor cache data using a regular expression and display the results.

          SUMMARY STEPS

            1.    enable

            2.    show flow monitor [name] monitor-name cache filter options [regexp regexp] [...options [regexp regexp]] [format {csv | record | table}]


          DETAILED STEPS
            Step 1   enable

            Enters privileged EXEC mode.



            Example:
            Device> enable
            
            Step 2   show flow monitor [name] monitor-name cache filter options [regexp regexp] [...options [regexp regexp]] [format {csv | record | table}]

            Filters the flow monitor cache data on the IPv4 type of service (ToS) value.



            Example:
            Device# show flow monitor FLOW-MONITOR-3 cache filter ipv4 tos regexp 0x(C0|50)
            
            Cache type:                            Normal
              Cache size:                              4096
              Current entries:                           19
              High Watermark:                            38
              Flows added:                             3516
              Flows aged:                              3497
                - Active timeout   (  1800 secs)         52
                - Inactive timeout (    15 secs)       3445
                - Event aged                              0
                - Watermark aged                          0
                - Emergency aged                          0
            IPV4 SOURCE ADDRESS:       10.1.1.1
            IPV4 DESTINATION ADDRESS:  255.255.255.255
            TRNS SOURCE PORT:          520
            TRNS DESTINATION PORT:     520
            INTERFACE INPUT:           Et0/0
            FLOW SAMPLER ID:           0
            IP TOS:                    0xC0
            IP PROTOCOL:               17
            ip source as:              0
            ip destination as:         0
            ipv4 next hop address:     0.0.0.0
            ipv4 source mask:          /24
            ipv4 destination mask:     /0
            tcp flags:                 0x00
            interface output:          Null
            counter bytes:             52
            counter packets:           1
            timestamp first:           18:59:46.199
            timestamp last:            18:59:46.199
            Matched 1 flow
             
            
            
            

            Aggregating Flow Data from the Flexible NetFlow Cache

            This task shows you how to use the show flow monitor cache aggregate command to aggregate the flow monitor cache data with a different record than the cache was created with and display the results. For more information on the show flow monitor cache aggregate command, refer to the Cisco IOS Flexible NetFlow Command Reference.

            Perform this task to aggregate the flow monitor cache data and display the results.

            SUMMARY STEPS

              1.    enable

              2.    show flow monitor [name] monitor-name cache aggregate {options [...options] [collect options [...options]] | record record-name} [format {csv | record | table}]


            DETAILED STEPS
              Step 1   enable

              Enters privileged EXEC mode.



              Example:
              Device> enable
              
              Step 2   show flow monitor [name] monitor-name cache aggregate {options [...options] [collect options [...options]] | record record-name} [format {csv | record | table}]

              Aggregates the flow monitor cache data on the IPv4 destination address and displays the cache data for the IPv4 protocol type and input interface nonkey fields:



              Example:
              Device# show flow monitor FLOW-MONITOR-3 cache aggregate ipv4 destination address collect ipv4 protocol interface input
              
              Processed 17 flows
              Aggregated to 7 flows
              IPV4 DST ADDR    intf input                 flows       bytes        pkts  ip prot
              ===============  ====================  ==========  ==========  ==========  =======
              224.192.16.4     Et0/0                          3       42200        2110        1
              224.192.16.1     Et0/0                          3       17160         858        1
              224.192.18.1     Et0/0                          4       18180         909        1
              224.192.45.12    Et0/0                          4       14440         722        1
              255.255.255.255  Et0/0                          1          52           1       17
              224.0.0.13       Et0/0                          1          54           1      103
              224.0.0.1        Et0/0                          1          28           1        2
              
              

              Sorting Flow Data from the Flexible NetFlow Cache

              This task shows you how to use the show flow monitor cache sort command to sort the flow monitor cache data, and display the results. For more information on the show flow monitor cache sort command, refer to the Cisco IOS Flexible NetFlow Command Reference.

              Perform this task to sort the flow monitor cache data and display the results.

              SUMMARY STEPS

                1.    enable

                2.    show flow monitor [name] monitor-name cache sort options [top [number]] [format {csv | record | table}]


              DETAILED STEPS
                Step 1   enable

                Enters privileged EXEC mode.



                Example:
                Device> enable
                
                Step 2   show flow monitor [name] monitor-name cache sort options [top [number]] [format {csv | record | table}]

                Displays the cache data sorted on the number of packets from highest to lowest.

                Note   

                When the top keyword is not used, the default number of sorted flows shown is 20.



                Example:
                Device# show flow monitor FLOW-MONITOR-1 cache sort highest counter packets
                
                Processed 26 flows
                Aggregated to 26 flows
                Showing the top 20 flows
                IPV4 SOURCE ADDRESS:       10.1.1.3
                IPV4 DESTINATION ADDRESS:  172.16.10.11
                TRNS SOURCE PORT:          443
                TRNS DESTINATION PORT:     443
                INTERFACE INPUT:           Et0/0.1
                FLOW SAMPLER ID:           0
                IP TOS:                    0x00
                IP PROTOCOL:               6
                ip source as:              0
                ip destination as:         0
                ipv4 next hop address:     172.16.7.2
                ipv4 source mask:          /0
                ipv4 destination mask:     /24
                tcp flags:                 0x00
                interface output:          Et1/0.1
                counter bytes:             22760
                counter packets:           1569
                timestamp first:           19:42:32.924
                timestamp last:            19:57:28.656
                IPV4 SOURCE ADDRESS:       10.10.11.2
                IPV4 DESTINATION ADDRESS:  172.16.10.6
                TRNS SOURCE PORT:          65
                TRNS DESTINATION PORT:     65
                INTERFACE INPUT:           Et0/0.1
                FLOW SAMPLER ID:           0
                IP TOS:                    0x00
                IP PROTOCOL:               6
                ip source as:              0
                ip destination as:         0
                ipv4 next hop address:     172.16.7.2
                ipv4 source mask:          /0
                ipv4 destination mask:     /24
                tcp flags:                 0x00
                interface output:          Et1/0.1
                counter bytes:             22720
                counter packets:           568
                timestamp first:           19:42:34.264
                timestamp last:            19:57:28.428
                .
                .
                .
                IPV4 SOURCE ADDRESS:       192.168.67.6
                IPV4 DESTINATION ADDRESS:  172.16.10.200
                TRNS SOURCE PORT:          0
                TRNS DESTINATION PORT:     3073
                INTERFACE INPUT:           Et0/0.1
                FLOW SAMPLER ID:           0
                IP TOS:                    0x00
                IP PROTOCOL:               1
                ip source as:              0
                ip destination as:         0
                ipv4 next hop address:     172.16.7.2
                ipv4 source mask:          /0
                ipv4 destination mask:     /24
                tcp flags:                 0x00
                interface output:          Et1/0.1
                counter bytes:             15848
                counter packets:           344
                timestamp first:           19:42:36.852
                timestamp last:            19:57:27.836
                IPV4 SOURCE ADDRESS:       10.234.53.1
                IPV4 DESTINATION ADDRESS:  172.16.10.2
                TRNS SOURCE PORT:          0
                TRNS DESTINATION PORT:     2048
                INTERFACE INPUT:           Et0/0.1
                FLOW SAMPLER ID:           0
                IP TOS:                    0x00
                IP PROTOCOL:               1
                ip source as:              0
                ip destination as:         0
                ipv4 next hop address:     172.16.7.2
                ipv4 source mask:          /0
                ipv4 destination mask:     /24
                tcp flags:                 0x00
                interface output:          Et1/0.1
                counter bytes:             15848
                counter packets:           213
                timestamp first:           19:42:36.904
                timestamp last:            19:57:27.888
                
                

                Displaying the Top N Talkers with Sorted Flow Data

                This task shows you how to use the show flow monitor cache sort command to sort the flow monitor cache data, and to limit the display results to a specific number of high volume flows. For more information on the show flow monitor cache sort command, refer to the Cisco IOS Flexible NetFlow Command Reference.

                Perform this task to sort the flow monitor cache data and limit the display output using to a specific number of high volume flows.

                SUMMARY STEPS

                  1.    enable

                  2.    show flow monitor [name] monitor-name cache sort options [top [number]] [format {csv | record | table}]


                DETAILED STEPS
                  Step 1   enable

                  Enters privileged EXEC mode.



                  Example:
                  Device> enable
                  
                  Step 2   show flow monitor [name] monitor-name cache sort options [top [number]] [format {csv | record | table}]

                  Displays the cache data sorted on the number of packets from highest to lowest and limits the output to the three highest volume flows.



                  Example:
                  Device# show flow monitor FLOW-MONITOR-1 cache sort highest counter packets top 3
                  
                  Processed 25 flows
                  Aggregated to 25 flows
                  Showing the top 3 flows
                  IPV4 SOURCE ADDRESS:       10.1.1.3
                  IPV4 DESTINATION ADDRESS:  172.16.10.11
                  TRNS SOURCE PORT:          443
                  TRNS DESTINATION PORT:     443
                  INTERFACE INPUT:           Et0/0.1
                  FLOW SAMPLER ID:           0
                  IP TOS:                    0x00
                  IP PROTOCOL:               6
                  ip source as:              0
                  ip destination as:         0
                  ipv4 next hop address:     172.16.7.2
                  ipv4 source mask:          /0
                  ipv4 destination mask:     /24
                  tcp flags:                 0x00
                  interface output:          Et1/0.1
                  counter bytes:             32360
                  counter packets:           1897
                  timestamp first:           19:42:32.924
                  timestamp last:            20:03:47.100
                  IPV4 SOURCE ADDRESS:       10.10.11.2
                  IPV4 DESTINATION ADDRESS:  172.16.10.6
                  TRNS SOURCE PORT:          65
                  TRNS DESTINATION PORT:     65
                  INTERFACE INPUT:           Et0/0.1
                  FLOW SAMPLER ID:           0
                  IP TOS:                    0x00
                  IP PROTOCOL:               6
                  ip source as:              0
                  ip destination as:         0
                  ipv4 next hop address:     172.16.7.2
                  ipv4 source mask:          /0
                  ipv4 destination mask:     /24
                  tcp flags:                 0x00
                  interface output:          Et1/0.1
                  counter bytes:             32360
                  counter packets:           809
                  timestamp first:           19:42:34.264
                  timestamp last:            20:03:48.460
                  IPV4 SOURCE ADDRESS:       172.16.1.84
                  IPV4 DESTINATION ADDRESS:  172.16.10.19
                  TRNS SOURCE PORT:          80
                  TRNS DESTINATION PORT:     80
                  INTERFACE INPUT:           Et0/0.1
                  FLOW SAMPLER ID:           0
                  IP TOS:                    0x00
                  IP PROTOCOL:               6
                  ip source as:              0
                  ip destination as:         0
                  ipv4 next hop address:     172.16.7.2
                  ipv4 source mask:          /24
                  ipv4 destination mask:     /24
                  tcp flags:                 0x00
                  interface output:          Et1/0.1
                  counter bytes:             32320
                  counter packets:           345
                  timestamp first:           19:42:34.512
                  timestamp last:            20:03:47.140
                  
                  

                  Configuration Examples for Flexible NetFlow Top N Talkers

                  Example: Displaying the Top Talkers with Filtered and Aggregated and Sorted Flow Data

                  The following example combines filtering, aggregation, collecting additional field data, sorting the flow monitor cache data, and limiting the display output to a specific number of high volume flows (top talkers).

                  Device# show flow monitor FLOW-MONITOR-1 cache filter ipv4 protocol regexp (1|6) aggregate ipv4 destination address collect ipv4 protocol sort counter bytes top 4
                  
                  Processed 26 flows
                  Matched 26 flows
                  Aggregated to 13 flows
                  Showing the top 4 flows
                  IPV4 DST ADDR         flows       bytes        pkts
                  ===============  ==========  ==========  ==========
                  172.16.10.2              12     1358370        6708
                  172.16.10.19              2       44640        1116
                  172.16.10.20              2       44640        1116
                  172.16.10.4               1       22360         559
                  

                  The following example combines filtering using a regular expression, aggregation using a predefined record, sorting the flow monitor cache data, limiting the display output to a specific number of high volume flows (top talkers), and displaying the output in record format.

                  Device# show flow monitor FLOW-MONITOR-1 cache filter ipv4 source address regexp 10.* aggregate record netflow ipv4 protocol-port sort transport destination-port top 5 format record 
                  
                  Processed 26 flows
                  Matched 15 flows
                  Aggregated to 10 flows
                  Showing the top 5 flows
                  TRNS SOURCE PORT:       0
                  TRNS DESTINATION PORT:  0
                  FLOW DIRECTION:         Input
                  IP PROTOCOL:            1
                  counter flows:          1
                  counter bytes:          387800
                  counter packets:        700
                  timestamp first:        17:12:30.712
                  timestamp last:         17:30:52.936
                  TRNS SOURCE PORT:       20
                  TRNS DESTINATION PORT:  20
                  FLOW DIRECTION:         Input
                  IP PROTOCOL:            6
                  counter flows:          2
                  counter bytes:          56000
                  counter packets:        1400
                  timestamp first:        17:12:29.532
                  timestamp last:         17:30:53.148
                  TRNS SOURCE PORT:       21
                  TRNS DESTINATION PORT:  21
                  FLOW DIRECTION:         Input
                  IP PROTOCOL:            6
                  counter flows:          2
                  counter bytes:          56000
                  counter packets:        1400
                  timestamp first:        17:12:29.572
                  timestamp last:         17:30:53.196
                  TRNS SOURCE PORT:       22
                  TRNS DESTINATION PORT:  22
                  FLOW DIRECTION:         Input
                  IP PROTOCOL:            6
                  counter flows:          1
                  counter bytes:          28000
                  counter packets:        700
                  timestamp first:        17:12:29.912
                  timestamp last:         17:30:52.168
                  TRNS SOURCE PORT:       25
                  TRNS DESTINATION PORT:  25
                  FLOW DIRECTION:         Input
                  IP PROTOCOL:            6
                  counter flows:          2
                  counter bytes:          56000
                  counter packets:        1400
                  timestamp first:        17:12:29.692
                  timestamp last:         17:30:51.968
                  
                  

                  Example: Filtering Using Multiple Filtering Criteria

                  The following example filters the cache data on the IPv4 destination address and the destination port:

                  Device# show flow monitor FLOW-MONITOR-1 cache filter ipv4 destination address regexp 172.16.10* transport destination-port 21
                  
                  Cache type:                            Normal
                    Cache size:                              4096
                    Current entries:                           26
                    High Watermark:                            26
                    Flows added:                              241
                    Flows aged:                               215
                      - Active timeout   (  1800 secs)         50
                      - Inactive timeout (    15 secs)        165
                      - Event aged                              0
                      - Watermark aged                          0
                      - Emergency aged                          0
                  IPV4 SOURCE ADDRESS:       10.10.10.2
                  IPV4 DESTINATION ADDRESS:  172.16.10.2
                  TRNS SOURCE PORT:          21
                  TRNS DESTINATION PORT:     21
                  INTERFACE INPUT:           Et0/0.1
                  FLOW SAMPLER ID:           0
                  IP TOS:                    0x00
                  IP PROTOCOL:               6
                  ip source as:              0
                  ip destination as:         0
                  ipv4 next hop address:     172.16.7.2
                  ipv4 source mask:          /0
                  ipv4 destination mask:     /24
                  tcp flags:                 0x00
                  interface output:          Et1/0.1
                  counter bytes:             17200
                  counter packets:           430
                  timestamp first:           17:03:58.071
                  timestamp last:            17:15:14.615
                  IPV4 SOURCE ADDRESS:       172.30.231.193
                  IPV4 DESTINATION ADDRESS:  172.16.10.2
                  TRNS SOURCE PORT:          21
                  TRNS DESTINATION PORT:     21
                  INTERFACE INPUT:           Et0/0.1
                  FLOW SAMPLER ID:           0
                  IP TOS:                    0x00
                  IP PROTOCOL:               6
                  ip source as:              0
                  ip destination as:         0
                  ipv4 next hop address:     172.16.7.2
                  ipv4 source mask:          /0
                  ipv4 destination mask:     /24
                  tcp flags:                 0x00
                  interface output:          Et1/0.1
                  counter bytes:             17160
                  counter packets:           429
                  timestamp first:           17:03:59.963
                  timestamp last:            17:15:14.887
                  Matched 2 flows

                  Example: Aggregation Using Multiple Aggregation Criteria

                  The following example aggregates the flow monitor cache data on the destination and source IPv4 addresses:

                  Device# show flow monitor FLOW-MONITOR-1 cache aggregate ipv4 destination address ipv4 source address
                   
                  Processed 26 flows
                  Aggregated to 17 flows
                  IPV4 SRC ADDR    IPV4 DST ADDR         flows       bytes        pkts
                  ===============  ===============  ==========  ==========  ==========
                  10.251.10.1      172.16.10.2               2     1400828        1364
                  192.168.67.6     172.16.10.200             1       19096         682
                  10.234.53.1      172.16.10.2               3       73656        2046
                  172.30.231.193   172.16.10.2               3       73616        2045
                  10.10.10.2       172.16.10.2               2       54560        1364
                  192.168.87.200   172.16.10.2               2       54560        1364
                  10.10.10.4       172.16.10.4               1       27280         682
                  10.10.11.1       172.16.10.5               1       27280         682
                  10.10.11.2       172.16.10.6               1       27280         682
                  10.10.11.3       172.16.10.7               1       27280         682
                  10.10.11.4       172.16.10.8               1       27280         682
                  10.1.1.1         172.16.10.9               1       27280         682
                  10.1.1.2         172.16.10.10              1       27280         682
                  10.1.1.3         172.16.10.11              1       27280         682
                  172.16.1.84      172.16.10.19              2       54520        1363
                  172.16.1.85      172.16.10.20              2       54520        1363
                  172.16.6.1       224.0.0.9                 1          52           1
                  
                  

                  Additional References

                  Related Documents

                  Related Topic

                  Document Title

                  Cisco IOS commands

                  Cisco IOS Master Command List, All Releases

                  Flexible NetFlow conceptual information and configuration tasks

                  Flexible NetFlow Configuration Guide

                  Flexible NetFlow commands

                  Cisco IOS Flexible NetFlow Command Reference

                  Standards/RFCs

                  Standard

                  Title

                  No new or modified standards/RFCs are supported by this feature.

                  MIBs

                  MIB

                  MIBs Link

                  None

                  To locate and download MIBs for selected platforms, Cisco software releases, and feature sets, use Cisco MIB Locator found at the following URL:

                  http:/​/​www.cisco.com/​go/​mibs

                  Technical Assistance

                  Description

                  Link

                  The Cisco Support and Documentation website provides online resources to download documentation, software, and tools. Use these resources to install and configure the software and to troubleshoot and resolve technical issues with Cisco products and technologies. Access to most tools on the Cisco Support and Documentation website requires a Cisco.com user ID and password.

                  http:/​/​www.cisco.com/​cisco/​web/​support/​index.html

                  Feature Information for Flexible NetFlow - Top N Talkers

                  The following table provides release information about the feature or features described in this module. This table lists only the software release that introduced support for a given feature in a given software release train. Unless noted otherwise, subsequent releases of that software release train also support that feature.

                  Use Cisco Feature Navigator to find information about platform support and Cisco software image support. To access Cisco Feature Navigator, go to www.cisco.com/​go/​cfn. An account on Cisco.com is not required.

                  Table 1 Feature Information for Flexible NetFlow - Top N Talkers

                  Feature Name

                  Releases

                  Feature Information

                  Flexible NetFlow - Top N Talkers Support

                  12.2(33)SRE

                  12.2(50)SY

                  12.4(22)T

                  15.0(1)SY

                  15.0(1)SY1

                  Cisco IOS XE Release 3.2SE

                  Thsi feature helps you analyze the large amount of data Flexible NetFlow captures from the traffic in your network by providing the ability to filter, aggregate, and sort the data in the Flexible NetFlow cache as you display it.

                  Support for this feature was added for Cisco 7200 and 7300 Network Processing Engine (NPE) series routers in Cisco IOS Release 12.2(33)SRE.

                  The following commands were introduced or modified: show flow monitor cache aggregate, show flow monitor cache filter, show flow monitor cache sort.