Cisco 3640 problems

secure.boy

Limp Gawd
Joined
Oct 22, 2007
Messages
474
I have problems...
the router worked very well, but we had to increased the speed from 128Kbps to 256Kbps (14 points are connected to this router by one serial interface through tellabs 2048bps, the other sites have cisco 2600 routers)
when i ping this router from 10.1.1.0/24 i get various time responses also lost packets
is the time to change the router?
for a week I need to remove the serial wic and to put the new FE, to replace from 2048bps to 10Mbps
Code:
cisco3640-hq#sh processes cpu
CPU utilization for five seconds: 99%/53%; one minute: 99%; five minutes: 99%
 PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
   1     1068948   3018949    354   0.00%  0.00%  0.00%   0 Load Meter
   2     2954692   1545913   1911   0.00%  0.01%  0.00%   0 PPP auth
   3    22536828   2362921   9537   0.00%  0.09%  0.12%   0 Check heaps
   4           0         1      0   0.00%  0.00%  0.00%   0 Chunk Manager
   5        4948     13264    373   0.00%  0.00%  0.00%   0 Pool Manager
   6           0         2      0   0.00%  0.00%  0.00%   0 Timers
   7           4       267     14   0.00%  0.00%  0.00%   0 Serial Backgroun
   8       58724   3009931     19   0.00%  0.00%  0.00%   0 ALARM_TRIGGER_SC
   9           0         1      0   0.00%  0.00%  0.00%   0 OIR Handler
  10        7744    503407     15   0.00%  0.00%  0.00%   0 Environmental mo
  11     6706132   8040824    834   0.00%  0.05%  0.05%   0 ARP Input
  12     3443404  16695761    206   0.00%  0.05%  0.02%   0 DDR Timers
  13           0         2      0   0.00%  0.00%  0.00%   0 Dialer event
  14          20         2  10000   0.00%  0.00%  0.00%   0 Entity MIB API
  15           0         1      0   0.00%  0.00%  0.00%   0 SERIAL A'detect
  16           0        34      0   0.00%  0.00%  0.00%   0 Critical Bkgnd
  17     3485800   9355071    372   0.16%  0.05%  0.02%   0 Net Background
  18     1161672   1792038    648   0.00%  0.03%  0.00%   0 Logger
  19     1275924  15047790     84   0.16%  0.03%  0.02%   0 TTY Background
  20     1216124  15115542     80   0.00%  0.05%  0.03%   0 Per-Second Jobs
  21           0         2      0   0.00%  0.00%  0.00%   0 Hawkeye Backgrou
  22           0         1      0   0.00%  0.00%  0.00%   0 HDV background
 PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
  23           0         2      0   0.00%  0.00%  0.00%   0 VNM DSPRM MAIN
  24      221680   1941270    114   0.00%  0.00%  0.00%   0 Net Input
  25     5155112   3018949   1707   0.08%  0.07%  0.07%   0 Compute load avg
  26     4798940    255034  18816   0.00%  0.02%  0.00%   0 Per-minute Jobs
  27           0         1      0   0.00%  0.00%  0.00%   0 CES Line Conditi
  28     1186096  59142839     20   0.00%  0.00%  0.00%   0 Framer backgroun
  29  39859438003298223501   1208  44.12% 42.76% 42.69%   0 IP Input
  30         688       230   2991   0.81%  0.17%  0.10% 130 Virtual Exec
  31           0         1      0   0.00%  0.00%  0.00%   0 X.25 Encaps Mana
  32           0         2      0   0.00%  0.00%  0.00%   0 PASVC create VA
  33           0         2      0   0.00%  0.00%  0.00%   0 ATM OAM Input
  34           0         2      0   0.00%  0.00%  0.00%   0 ATM OAM TIMER
  35           0         1      0   0.00%  0.00%  0.00%   0 Asy FS Helper
  36      414096   1912592    216   0.00%  0.00%  0.00%   0 PPP IP Add Route
  37     7846444   2607775   3008   0.24%  0.13%  0.10%   0 IP Background
  38       42272    253533    166   0.00%  0.00%  0.00%   0 Adj Manager
  39        5732     11407    502   0.00%  0.00%  0.00%   0 TCP Timer
  40        2956      3007    983   0.00%  0.00%  0.00%   0 TCP Protocols
  41           0         1      0   0.00%  0.00%  0.00%   0 Probe Input
  42           0         1      0   0.00%  0.00%  0.00%   0 RARP Input
  43           0         1      0   0.00%  0.00%  0.00%   0 HTTP Timer
  44           0         1      0   0.00%  0.00%  0.00%   0 Socket Timers
  45      264576    348642    758   0.00%  0.00%  0.00%   0 DHCPD Receive
 PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
  46     1380132    251594   5485   0.00%  0.08%  0.05%   0 IP Cache Ager
  47           0         1      0   0.00%  0.00%  0.00%   0 COPS
  48           4         1   4000   0.00%  0.00%  0.00%   0 PAD InCall
  49           0         2      0   0.00%  0.00%  0.00%   0 X.25 Background
  50           0         2      0   0.00%  0.00%  0.00%   0 ILMI Input
  51           0         1      0   0.00%  0.00%  0.00%   0 SNMP Timers
  52           0         2      0   0.00%  0.00%  0.00%   0 ILMI Request
  53           0         2      0   0.00%  0.00%  0.00%   0 ILMI Response
  54           0         1      0   0.00%  0.00%  0.00%   0 ILMI Timer Proce
  55          28         2  14000   0.00%  0.00%  0.00%   0 ATM PVC Discover
  56           0         2      0   0.00%  0.00%  0.00%   0 SSCOP Input
  57           0         2      0   0.00%  0.00%  0.00%   0 SSCOP Output
  58        6420    251727     25   0.00%  0.00%  0.00%   0 SSCOP Timer
  59           0         2      0   0.00%  0.00%  0.00%   0 ATMSIG DRIVERAPI
  60           0         1      0   0.00%  0.00%  0.00%   0 CES Client SVC R
  61           0         1      0   0.00%  0.00%  0.00%   0 Crypto HW Proc
  62          20        64    312   0.00%  0.00%  0.00%   0 ISDN Timer
  63         400       294   1360   0.00%  0.00%  0.00% 131 Virtual Exec
  64           4         2   2000   0.00%  0.00%  0.00%   0 CCVPM_HDSPRM
  65      210336  15047796     13   0.00%  0.00%  0.00%   0 Net Serv Timer
  66           0         1      0   0.00%  0.00%  0.00%   0 Crypto Support
  67           0         2      0   0.00%  0.00%  0.00%   0 Router Autoconf
  68           4         1   4000   0.00%  0.00%  0.00%   0 TSP
 PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
  69           0         1      0   0.00%  0.00%  0.00%   0 QOS_MODULE_MAIN
  70           0         1      0   0.00%  0.00%  0.00%   0 CCVPM_HTSP
  71           0         1      0   0.00%  0.00%  0.00%   0 CCVPM_R2
  72           0         1      0   0.00%  0.00%  0.00%   0 CCSWVOICE
  73           4         2   2000   0.00%  0.00%  0.00%   0 Background Loade
  74           0         1      0   0.00%  0.00%  0.00%   0 sssapp
  75          24        44    545   0.00%  0.00%  0.00%   0 Crypto ACL
  76           0         1      0   0.00%  0.00%  0.00%   0 Encrypt Proc
  77           0         5      0   0.00%  0.00%  0.00%   0 Key Proc
  78     1224896  15104587     81   0.08%  0.02%  0.00%   0 Crypto SM
  79           0         1      0   0.00%  0.00%  0.00%   0 Crypto SSL
  80           0         3      0   0.00%  0.00%  0.00%   0 Crypto CA
  81       36848   1009079     36   0.00%  0.00%  0.00%   0 Crypto IKMP
  82       40972   1678530     24   0.00%  0.00%  0.00%   0 IPSEC key engine
  83           0         1      0   0.00%  0.00%  0.00%   0 IPSEC manual key
  84       74444    475161    156   0.00%  0.00%  0.00%   0 ISDNMIB Backgrou
  85       51504    650000     79   0.00%  0.00%  0.00%   0 CallMIB Backgrou
  86           0         1      0   0.00%  0.00%  0.00%   0 SNMP ConfCopyPro
  87           0         1      0   0.00%  0.00%  0.00%   0 Syslog Traps
  88       79236   1507336     52   0.00%  0.00%  0.00%   0 BUSYOUT SCAN
  89      205184  14924384     13   0.00%  0.00%  0.00%   0 trunk conditioni
  90           0         1      0   0.00%  0.00%  0.00%   0 trunk conditioni
  91    72604412   2429125  29889   0.32%  0.32%  0.23%   0 ISDN
 PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
  92      874636   9533070     91   0.00%  0.00%  0.00%   0 ISDN From Driver
  93           0         2      0   0.00%  0.00%  0.00%   0 IP Flow Backgrou
  94           0         2      0   0.00%  0.00%  0.00%   0 CCP manager
  95     4329212   3683217   1175   0.00%  0.01%  0.00%   0 PPP manager
  96      253120  15079444     16   0.00%  0.00%  0.00%   0 Multilink PPP
  97           0         2      0   0.00%  0.00%  0.00%   0 Multilink PPP ou
  98           0         2      0   0.00%  0.00%  0.00%   0 Multilink event
  99         232       495    468   0.00%  0.00%  0.00%   0 IP SNMP
 100         240       495    484   0.00%  0.00%  0.00%   0 PDU DISPATCHER
 101         196       494    396   0.00%  0.00%  0.00%   0 SNMP ENGINE
 102           0         1      0   0.00%  0.00%  0.00%   0 SNMP Traps
 103      399848  15176752     26   0.00%  0.00%  0.00%   0 NTP
 104     6191400  14145151    437   0.00%  0.05%  0.05%   0 ISDN L2 Process
 105           0         1      0   0.00%  0.00%  0.00%   0 ISDN L3 Timer Pr
 106     1118640   9324425    119   0.00%  0.00%  0.00%   0 ISDN L2D SRQ Pro
 108        3664    125868     29   0.00%  0.00%  0.00%   0 DHCPD Timer
 109      115248   4276012     26   0.00%  0.00%  0.00%   0 DHCPD Database
cisco3640-hq#sh processes cpu history
                                                             11
     9999999999999999999999999999999999999999999999999999999900
     9999999999999999999999999999999999999999999999999999999900
100  **********************************************************
 90  **********************************************************
 80  **********************************************************
 70  **********************************************************
 60  **********************************************************
 50  **********************************************************
 40  **********************************************************
 30  **********************************************************
 20  **********************************************************
 10  **********************************************************
    0....5....1....1....2....2....3....3....4....4....5....5....
              0    5    0    5    0    5    0    5    0    5

               CPU% per second (last 60 seconds)

     1     11
     0999990099999999999999999999999999999998999999999877788888
     0999990099999999999999899999998772218336049980242199326375
100  #########*####################***   *     *#*
 90  ##################################**##***#####*#*     * **
 80  #################################################*** ####*
 70  ##########################################################
 60  ##########################################################
 50  ##########################################################
 40  ##########################################################
 30  ##########################################################
 20  ##########################################################
 10  ##########################################################
    0....5....1....1....2....2....3....3....4....4....5....5....
              0    5    0    5    0    5    0    5    0    5

               CPU% per minute (last 60 minutes)
              * = maximum CPU%   # = average CPU%

     1                1111111
     0966677787789888900000009956555556654554455565555566565666767778888888
     0525201115712979900000006081737501028216700845288477787253164224357702
100  **              *#######*
 90  #*          *****#######**                                       ***
 80  #*      ********#########*                                     *******
 70  #* * *********###########*                        ** *  * ************
 60  ##******#**##############**** ** **        *** ** *************#######
 50  ##***#####################*********************************###########
 40  ###################################*******############################
 30  ######################################################################
 20  ######################################################################
 10  ######################################################################
    0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
              0    5    0    5    0    5    0    5    0    5    0    5    0

                   CPU% per hour (last 72 hours)
                  * = maximum CPU%   # = average CPU%


cisco3640-hq#sh ip cache flow
IP packet size distribution (1820M total packets):
   1-32   64   96  128  160  192  224  256  288  320  352  384  416  448  480
   .000 .015 .455 .136 .038 .043 .069 .030 .037 .075 .010 .016 .017 .016 .010

    512  544  576 1024 1536 2048 2560 3072 3584 4096 4608
   .000 .001 .006 .007 .010 .000 .000 .000 .000 .000 .000

IP Flow Switching Cache, 278544 bytes
  16 active, 4080 inactive, 7161744 added
  316004317 ager polls, 0 flow alloc failures
  Active flows timeout in 30 minutes
  Inactive flows timeout in 15 seconds
  last clearing of statistics never
Protocol         Total    Flows   Packets Bytes  Packets Active(Sec) Idle(Sec)
--------         Flows     /Sec     /Flow  /Pkt     /Sec     /Flow     /Flow
TCP-Telnet         202      0.0       226    46      0.0       9.7      15.1
TCP-WWW            189      0.0       163    48      0.0       7.4      15.4
TCP-SMTP             3      0.0       105    48      0.0       2.1      15.4
TCP-other       162281      0.0        85   142      3.2      13.7      12.9
UDP-DNS           1182      0.0       232    59      0.0       9.0      15.5
UDP-NTP            640      0.0        62    96      0.0       0.1      15.4
UDP-other         2329      0.0       412   254      0.2      12.9      15.4
ICMP             15271      0.0        14    57      0.0      32.8      15.4
GRE            6979631      1.6       258   171    420.1      26.6      15.4
Total:         7161728      1.6       254   170    423.7      26.3      15.3

SrcIf         SrcIPaddress    DstIf         DstIPaddress    Pr SrcP DstP  Pkts
Se0/0         XXX.YYY.28.250   Local         XXX.YYY.3.14     2F 0000 0000  2128
Se0/0         XXX.YYY.29.250   Local         XXX.YYY.3.14     2F 0000 0000   395
Se0/0         XXX.YYY.29.250   Local         XXX.YYY.3.14     2F 0000 0000    57K
Se0/0         XXX.YYY.30.10    Local         XXX.YYY.3.14     2F 0000 0000    60K
Se0/0         XXX.YYY.8.250    Local         XXX.YYY.3.14     2F 0000 0000    32K
Se0/0         XXX.YYY.25.250   Local         XXX.YYY.3.14     2F 0000 0000    40K
Se0/0         XXX.YYY.9.250    Local         XXX.YYY.3.14     2F 0000 0000    82K
Se0/0         XXX.YYY.10.250   Local         XXX.YYY.3.14     2F 0000 0000  2321
Se0/0         XXX.YYY.26.250   Local         XXX.YYY.3.14     2F 0000 0000    28K
Se0/0         XXX.YYY.11.250   Local         XXX.YYY.3.14     2F 0000 0000  7867
Se0/0         XXX.YYY.5.38     Local         XXX.YYY.3.14     2F 0000 0000    33K
Se0/0         XXX.YYY.21.250   Local         XXX.YYY.3.14     2F 0000 0000    31K
Se0/0         XXX.YYY.22.250   Local         XXX.YYY.3.14     2F 0000 0000  3220
Se0/0         10.1.5.1        Local         10.1.1.12       2F 0000 0000    39K
Se0/0         XXX.YYY.7.250    Local         XXX.YYY.3.14     2F 0000 0000  8933
Se0/0         10.14.1.3       Fa2/0         10.1.1.57       06 0F29 07E0   399

cisco3640-hq#
 
well, this is definately your problem:

cisco3640-hq#sh processes cpu
CPU utilization for five seconds: 99%/53%; one minute: 99%; five minutes: 99%



you are maxing the CPU. This could be due to just an overload of traffic, or maybe your configuration isn't optimal (i.e., no CEF, etc).

A 3640 should be able to handle 25 Mbps of traffic at most; how much are you pushing now?
 
do a "sh proc cpu sorted" to find the affecting process(es). Post that here.

If the process percentages don't add up to near 100%, the CPU is busy doing a lot of interrupts/process switching. This implies that packets are being punted back out to the general CPU for processing, which is always bad unless you're doing it for a reason (policy based routing) and it's contained. Another reason for punting might be because you don't have CEF turned on; enable it with "ip cef".
 
do a "sh proc cpu sorted" to find the affecting process(es). Post that here.

If the process percentages don't add up to near 100%, the CPU is busy doing a lot of interrupts/process switching. This implies that packets are being punted back out to the general CPU for processing, which is always bad unless you're doing it for a reason (policy based routing) and it's contained. Another reason for punting might be because you don't have CEF turned on; enable it with "ip cef".
i have enabled now "ip cef"
i'm going to the see tomorrow and to post here sh proc cpu and history
 
with ip cef enabled
Code:
User Access Verification

Password:
cisco3640-hq>en
Password:
cisco3640-hq#sh proc cpu history

     9999999999999988888999999999999999999999999999999999999998
     7777333334444499999000044444999999999988888555544444111119
100  ****                        *******************
 90  **********************************************************
 80  **********************************************************
 70  **********************************************************
 60  **********************************************************
 50  **********************************************************
 40  **********************************************************
 30  **********************************************************
 20  **********************************************************
 10  **********************************************************
    0....5....1....1....2....2....3....3....4....4....5....5....
              0    5    0    5    0    5    0    5    0    5

               CPU% per second (last 60 seconds)

                               1            1
     9999999999999999999999999909999999999990999999999999999999
     9999999999996998689979998703798899999990899976899997589777
100  *##########*******##******* ****#*****#********###********
 90  ##########################################################
 80  ##########################################################
 70  ##########################################################
 60  ##########################################################
 50  ##########################################################
 40  ##########################################################
 30  ##########################################################
 20  ##########################################################
 10  ##########################################################
    0....5....1....1....2....2....3....3....4....4....5....5....
              0    5    0    5    0    5    0    5    0    5

               CPU% per minute (last 60 minutes)
              * = maximum CPU%   # = average CPU%

     1                 11111111                1111111
     0964443334445677790000000096667778778988890000000995655555665455445556
     0987407794468763840000000052520111571297990000000608173750102821670084
100  **                #######**              *#######*
 90  #*               *########*          *****#######**
 80  ##            * **########*      ********#########*
 70  ##*          *****########* * *********###########*
 60  ##*         ******#########******#**##############**** ** **        **
 50  ###*       **##############***#####################*******************
 40  ###*********################################################*******###
 30  ######****#*##########################################################
 20  ######################################################################
 10  ######################################################################
    0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
              0    5    0    5    0    5    0    5    0    5    0    5    0

                   CPU% per hour (last 72 hours)
                  * = maximum CPU%   # = average CPU%


cisco3640-hq#sh proc cpu
CPU utilization for five seconds: 90%/64%; one minute: 94%; five minutes: 95%
 PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
   1     1076356   3037881    354   0.00%  0.00%  0.00%   0 Load Meter
   2     2991040   1560045   1917   0.00%  0.03%  0.00%   0 PPP auth
   3    22728472   2379711   9550   1.86%  0.24%  0.18%   0 Check heaps
   4           0         1      0   0.00%  0.00%  0.00%   0 Chunk Manager
   5        5076     13621    372   0.00%  0.00%  0.00%   0 Pool Manager
   6           0         2      0   0.00%  0.00%  0.00%   0 Timers
   7           4       267     14   0.00%  0.00%  0.00%   0 Serial Backgroun
   8       59732   3028598     19   0.00%  0.00%  0.00%   0 ALARM_TRIGGER_SC
   9           0         1      0   0.00%  0.00%  0.00%   0 OIR Handler
  10        7856    506567     15   0.00%  0.00%  0.00%   0 Environmental mo
  11     6755528   8084582    835   0.00%  0.05%  0.05%   0 ARP Input
  12     3508692  16830529    208   0.08%  0.03%  0.04%   0 DDR Timers
  13           0         2      0   0.00%  0.00%  0.00%   0 Dialer event
  14          20         2  10000   0.00%  0.00%  0.00%   0 Entity MIB API
  15           0         1      0   0.00%  0.00%  0.00%   0 SERIAL A'detect
  16           0        34      0   0.00%  0.00%  0.00%   0 Critical Bkgnd
  17     3535284   9437922    374   0.00%  0.04%  0.02%   0 Net Background
  18     1179332   1809127    651   0.16%  0.02%  0.00%   0 Logger
  19     1300244  15141153     85   0.00%  0.03%  0.00%   0 TTY Background
  20     1257360  15210107     82   0.00%  0.07%  0.06%   0 Per-Second Jobs
  21           0         2      0   0.00%  0.00%  0.00%   0 Hawkeye Backgrou
  22           0         1      0   0.00%  0.00%  0.00%   0 HDV background
 PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
  23           0         2      0   0.00%  0.00%  0.00%   0 VNM DSPRM MAIN
  24      223648   1953907    114   0.00%  0.00%  0.00%   0 Net Input
  25     5223996   3037891   1719   0.08%  0.08%  0.08%   0 Compute load avg
  26     4835896    256662  18841   0.00%  0.05%  0.00%   0 Per-minute Jobs
  27           0         1      0   0.00%  0.00%  0.00%   0 CES Line Conditi
  28     1208604  59498581     20   0.00%  0.01%  0.00%   0 Framer backgroun
  29  40337661123316202391   1216  24.35% 23.72% 24.60%   0 IP Input
  30        5436       563   9655   0.00%  0.00%  0.23% 130 Virtual Exec
  31           0         1      0   0.00%  0.00%  0.00%   0 X.25 Encaps Mana
  32           0         2      0   0.00%  0.00%  0.00%   0 PASVC create VA
  33           0         2      0   0.00%  0.00%  0.00%   0 ATM OAM Input
  34           0         2      0   0.00%  0.00%  0.00%   0 ATM OAM TIMER
  35           0         1      0   0.00%  0.00%  0.00%   0 Asy FS Helper
  36      420212   1930464    217   0.00%  0.00%  0.00%   0 PPP IP Add Route
  37     7937284   2630854   3016   0.00%  0.13%  0.12%   0 IP Background
  38       43128    255134    169   0.00%  0.00%  0.00%   0 Adj Manager
  39        5972     11640    513   0.00%  0.00%  0.00%   0 TCP Timer
  40        2976      3019    985   0.00%  0.00%  0.00%   0 TCP Protocols
  41           0         1      0   0.00%  0.00%  0.00%   0 Probe Input
  42           0         1      0   0.00%  0.00%  0.00%   0 RARP Input
  43           0         1      0   0.00%  0.00%  0.00%   0 HTTP Timer
  44           0         1      0   0.00%  0.00%  0.00%   0 Socket Timers
  45      267496    351585    760   0.00%  0.00%  0.00%   0 DHCPD Receive
 PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
  46     1440436    253172   5689   0.00%  0.14%  0.15%   0 IP Cache Ager
  47           0         1      0   0.00%  0.00%  0.00%   0 COPS
  48           4         1   4000   0.00%  0.00%  0.00%   0 PAD InCall
  49           0         2      0   0.00%  0.00%  0.00%   0 X.25 Background
  50           0         2      0   0.00%  0.00%  0.00%   0 ILMI Input
  51           0         1      0   0.00%  0.00%  0.00%   0 SNMP Timers
  52           0         2      0   0.00%  0.00%  0.00%   0 ILMI Request
  53           0         2      0   0.00%  0.00%  0.00%   0 ILMI Response
  54           0         1      0   0.00%  0.00%  0.00%   0 ILMI Timer Proce
  55          28         2  14000   0.00%  0.00%  0.00%   0 ATM PVC Discover
  56           0         2      0   0.00%  0.00%  0.00%   0 SSCOP Input
  57           0         2      0   0.00%  0.00%  0.00%   0 SSCOP Output
  58        6496    253308     25   0.00%  0.00%  0.00%   0 SSCOP Timer
  59           0         2      0   0.00%  0.00%  0.00%   0 ATMSIG DRIVERAPI
  60           0         1      0   0.00%  0.00%  0.00%   0 CES Client SVC R
  61           0         1      0   0.00%  0.00%  0.00%   0 Crypto HW Proc
  62          20        68    294   0.00%  0.00%  0.00%   0 ISDN Timer
  63       28216     72672    388   0.16%  0.07%  0.08%   0 CEF process
  64           4         2   2000   0.00%  0.00%  0.00%   0 CCVPM_HDSPRM
  65      214228  15141227     14   0.00%  0.00%  0.00%   0 Net Serv Timer
  66           0         1      0   0.00%  0.00%  0.00%   0 Crypto Support
  67           0         2      0   0.00%  0.00%  0.00%   0 Router Autoconf
  68           4         1   4000   0.00%  0.00%  0.00%   0 TSP
 PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
  69           0         1      0   0.00%  0.00%  0.00%   0 QOS_MODULE_MAIN
  70           0         1      0   0.00%  0.00%  0.00%   0 CCVPM_HTSP
  71           0         1      0   0.00%  0.00%  0.00%   0 CCVPM_R2
  72           0         1      0   0.00%  0.00%  0.00%   0 CCSWVOICE
  73           4         2   2000   0.00%  0.00%  0.00%   0 Background Loade
  74           0         1      0   0.00%  0.00%  0.00%   0 sssapp
  75          24        44    545   0.00%  0.00%  0.00%   0 Crypto ACL
  76           0         1      0   0.00%  0.00%  0.00%   0 Encrypt Proc
  77           0         5      0   0.00%  0.00%  0.00%   0 Key Proc
  78     1249304  15199511     82   0.08%  0.03%  0.02%   0 Crypto SM
  79           0         1      0   0.00%  0.00%  0.00%   0 Crypto SSL
  80           0         3      0   0.00%  0.00%  0.00%   0 Crypto CA
  81       37400   1015421     36   0.00%  0.00%  0.00%   0 Crypto IKMP
  82       41868   1689077     24   0.00%  0.00%  0.00%   0 IPSEC key engine
  83           0         1      0   0.00%  0.00%  0.00%   0 IPSEC manual key
  84       76040    479596    158   0.00%  0.00%  0.00%   0 ISDNMIB Backgrou
  85       52560    655520     80   0.00%  0.00%  0.00%   0 CallMIB Backgrou
  86           0         1      0   0.00%  0.00%  0.00%   0 SNMP ConfCopyPro
  87           0         1      0   0.00%  0.00%  0.00%   0 Syslog Traps
  88       80256   1516740     52   0.00%  0.00%  0.00%   0 BUSYOUT SCAN
  89      208920  15014348     13   0.00%  0.00%  0.00%   0 trunk conditioni
  90           0         1      0   0.00%  0.00%  0.00%   0 trunk conditioni
  91    73284332   2449880  29913   0.08%  0.40%  0.34%   0 ISDN
 PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
  92      883444   9604616     91   0.00%  0.00%  0.00%   0 ISDN From Driver
  93           0         2      0   0.00%  0.00%  0.00%   0 IP Flow Backgrou
  94           0         2      0   0.00%  0.00%  0.00%   0 CCP manager
  95     4374684   3711213   1178   0.08%  0.05%  0.05%   0 PPP manager
  96      258276  15173739     17   0.00%  0.00%  0.00%   0 Multilink PPP
  97           0         2      0   0.00%  0.00%  0.00%   0 Multilink PPP ou
  98           0         2      0   0.00%  0.00%  0.00%   0 Multilink event
  99         232       496    467   0.00%  0.00%  0.00%   0 IP SNMP
 100         240       496    483   0.00%  0.00%  0.00%   0 PDU DISPATCHER
 101         196       495    395   0.00%  0.00%  0.00%   0 SNMP ENGINE
 102           0         1      0   0.00%  0.00%  0.00%   0 SNMP Traps
 103      407532  15272816     26   0.00%  0.00%  0.00%   0 NTP
 104     6255232  14250339    438   0.08%  0.09%  0.08%   0 ISDN L2 Process
 105           0         1      0   0.00%  0.00%  0.00%   0 ISDN L3 Timer Pr
 106     1129848   9395629    120   0.00%  0.00%  0.00%   0 ISDN L2D SRQ Pro
 107          52       810     64   0.00%  0.00%  0.00%   0 CEF Scanner
 108        3772    126659     29   0.00%  0.00%  0.00%   0 DHCPD Timer
 109      116072   4302821     26   0.00%  0.00%  0.00%   0 DHCPD Database
 110         348       132   2636   0.00%  0.06%  0.03% 131 Virtual Exec
cisco3640-hq#sh ver
Cisco Internetwork Operating System Software
IOS (tm) 3600 Software (C3640-IK2S-M), Version 12.1(5)T,  RELEASE SOFTWARE (fc1)
Copyright (c) 1986-2000 by cisco Systems, Inc.
Compiled Sat 11-Nov-00 03:57 by ccai
Image text-base: 0x60008950, data-base: 0x612A4000

ROM: System Bootstrap, Version 11.1(20)AA2, EARLY DEPLOYMENT RELEASE SOFTWARE (f
c1)

cisco3640-hq uptime is 25 weeks, 22 hours, 6 minutes
System returned to ROM by reload at 04:28:27 UTC Fri Apr 2 1993
System restarted at 00:00:01 UTC Mon Mar 1 1993
System image file is "flash:c3640-ik2s-mz.121-5.T.bin"

cisco 3640 (R4700) processor (revision 0x00) with 58368K/7168K bytes of memory.
Processor board ID 25117741
R4700 CPU at 100Mhz, Implementation 33, Rev 1.0
Channelized E1, Version 1.0.
Bridging software.
X.25 software, Version 3.0.0.
SuperLAT software (copyright 1990 by Meridian Technology Corp).
Primary Rate ISDN software, Version 1.1.
2 Ethernet/IEEE 802.3 interface(s)
3 FastEthernet/IEEE 802.3 interface(s)
32 Serial network interface(s)
1 Channelized E1/PRI port(s)
DRAM configuration is 64 bits wide with parity disabled.
125K bytes of non-volatile configuration memory.
16384K bytes of processor board System flash (Read/Write)

Configuration register is 0x2102

cisco3640-hq#
 
You are running software that is 8 years old...I assume you don't have a SMARTNet contract with Cisco? There are a LOT of bugs and security issues fixed in newer releases.. and the fact that you are using an early build in the T train isn't going to help either.



IOS (tm) 3600 Software (C3640-IK2S-M), Version 12.1(5)T, RELEASE SOFTWARE (fc1)
Compiled Sat 11-Nov-00 03:57 by ccai
 
Yeah, the T train is dangerous. I've submitted 4 bugs within the past year on even the 12.4 T line. You should stick to mainline code unless you need new features in the T line. Judging from the fact that you're running 12.1, I don't think you have it for new features haha. Looking at my CCO, 12.4.23(MD) is available for the 3640. If you have a CCO, check out the bug toolkit for 12.1(5)T.

At any rate, I would need to see a topology, config.. that kind of stuff to troubleshoot this further. If you're running multicast, maybe you're getting RPFs out the ass. You could also try reloading the router. It's hard to help you without knowing your network because high CPU can be a lot of things...

Maybe these articles will help you:
http://www.cisco.com/en/US/products/hw/routers/ps133/products_tech_note09186a00800a70f2.shtml
http://www.cisco.com/en/US/products/hw/routers/ps359/products_tech_note09186a00801c2af0.shtml

I think the second link applies to you more because it looks like the CPU is mostly doing interrupts.
 
Back
Top