Apache crash

Posted in: darrelrussell.com edit
05 Jan 2009
  • Hmm very strange, suddenly my Apache Server ( 2.x ) opens alot of processes an the Server Load goes up to 32 !!
    So I did killall httpd and everything was ok.
    But this happens now the third time.

    Here the Top Stats :

    top - 12:09:12 up 1 day, 3:27, 2 users, load average: 33.17, 15.73, 6.14
    Tasks: 125 total, 20 running, 105 sleeping, 0 stopped, 0 zombie
    Cpu(s): 93.8% us, 5.6% sy, 0.0% ni, 0.0% id, 0.0% wa, 0.0% hi, 0.7% si
    Mem: 1036512k total, 970816k used, 65696k free, 1228k buffers
    Swap: 2096472k total, 1213080k used, 883392k free, 38416k cached

    PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
    20773 daemon 25 0 143m 45m 46m R 7.0 4.5 0:03.72 httpd
    20796 daemon 25 0 136m 42m 46m R 7.0 4.2 0:03.16 httpd
    20808 daemon 25 0 113m 48m 46m R 7.0 4.8 0:02.56 httpd
    20834 daemon 25 0 99752 45m 46m R 7.0 4.5 0:02.03 httpd
    20767 daemon 25 0 144m 48m 46m R 6.7 4.8 0:03.56 httpd
    20786 daemon 25 0 193m 49m 46m R 6.7 4.9 0:05.00 httpd
    20793 daemon 25 0 125m 46m 46m R 6.7 4.6 0:02.90 httpd
    20813 daemon 25 0 106m 45m 46m R 6.7 4.5 0:02.13 httpd
    20809 daemon 25 0 100m 44m 46m R 6.3 4.4 0:02.12 httpd
    20777 daemon 25 0 228m 52m 46m R 4.7 5.2 0:06.12 httpd
    20768 daemon 25 0 238m 42m 46m R 3.7 4.2 0:06.42 httpd
    20779 daemon 25 0 400m 54m 46m R 3.7 5.4 0:11.72 httpd
    20785 daemon 25 0 112m 48m 46m R 3.7 4.7 0:02.57 httpd
    20784 daemon 25 0 218m 44m 46m R 3.3 4.4 0:06.05 httpd
    20804 daemon 25 0 120m 47m 46m R 3.3 4.7 0:02.64 httpd
    20805 daemon 25 0 116m 44m 46m R 3.3 4.4 0:02.54 httpd
    20819 daemon 25 0 106m 43m 46m R 3.3 4.3 0:02.14 httpd


    normaly ( 5 mins later )

    top - 12:09:46 up 1 day, 3:28, 2 users, load average: 25.02, 15.64, 6.43
    Tasks: 37 total, 2 running, 35 sleeping, 0 stopped, 0 zombie
    Cpu(s): 0.0% us, 0.0% sy, 0.0% ni, 100.0% id, 0.0% wa, 0.0% hi, 0.0% si
    Mem: 1036512k total, 100380k used, 936132k free, 1312k buffers
    Swap: 2096472k total, 69136k used, 2027336k free, 35960k cached

    PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
    1 root 16 0 1504 76 1352 S 0.0 0.0 0:02.01 init
    2 root 34 19 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/0
    3 root 5 -10 0 0 0 S 0.0 0.0 0:02.69 events/0
    4 root 9 -10 0 0 0 S 0.0 0.0 0:00.00 khelper
    5 root 12 -10 0 0 0 S 0.0 0.0 0:00.00 kacpid
    37 root 5 -10 0 0 0 S 0.0 0.0 0:00.14 kblockd/0
    50 root 5 -10 0 0 0 S 0.0 0.0 0:00.00 aio/0
    49 root 15 0 0 0 0 S 0.0 0.0 0:18.85 kswapd0
    186 root 25 0 0 0 0 S 0.0 0.0 0:00.00 kseriod
    212 root 6 -10 0 0 0 S 0.0 0.0 0:00.00 ata/0
    213 root 16 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_0
    214 root 25 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_1
    215 root 25 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_2
    216 root 25 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_3
    260 root 15 0 0 0 0 S 0.0 0.0 0:02.21 kjournald
    489 root 16 0 1524 0 1360 S 0.0 0.0 0:00.00 dhcpcd-bin
    554 root 24 0 2504 0 2380 S 0.0 0.0 0:00.00 mysqld_safe


    Any ideas ?


  • Here the Access Log before the Crash :


    ::1 - - [04/Jul/2006:12:06:34 +0200] "GET /" 400 460 "-" "-"
    ::1 - - [04/Jul/2006:12:06:35 +0200] "GET /" 400 460 "-" "-"
    ::1 - - [04/Jul/2006:12:06:36 +0200] "GET /" 400 460 "-" "-"
    80.136.103.250 - - [04/Jul/2006:12:06:35 +0200] "GET /irc_bot.php?action=10last&pw=sdNoid9234 HTTP/1.1" 200 862 "-" "-"
    ::1 - - [04/Jul/2006:12:06:37 +0200] "GET /" 400 460 "-" "-"
    ::1 - - [04/Jul/2006:12:06:38 +0200] "GET /" 400 460 "-" "-"
    ::1 - - [04/Jul/2006:12:06:39 +0200] "GET /" 400 460 "-" "-"
    85.214.50.8 - - [04/Jul/2006:12:06:39 +0200] "GET /rdf.php HTTP/1.0" 200 13400 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.10) Gecko/20050716 Firefox/1.0.6"
    ::1 - - [04/Jul/2006:12:06:40 +0200] "GET /" 400 460 "-" "-"
    84.146.137.21 - - [04/Jul/2006:12:06:40 +0200] "GET /rdf.php?typ=kino HTTP/1.0" 200 13557 "http://85.214.38.181/rdf.php?typ=kino" "-"
    ::1 - - [04/Jul/2006:12:06:42 +0200] "GET /" 400 460 "-" "-"
    84.146.171.74 - - [04/Jul/2006:12:06:39 +0200] "GET /index.php?action=release&typ=xvid&from=&to=&rlsname=§ion=&rlsgrp=&limit=50&PHPSESSID=30c491053829254f0a978cd97a0a0d01 HTTP/1.1" 200 4473 "http://85.214.38.181/index.php?action=release&typ=xvid&from=&to=&rlsname=§ion=&rlsgrp=&limit=25&PHPSESSID=30c491053829254f0a978cd97a0a0d01" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Avant Browser; Avant Browser; .NET CLR 1.0.3705)"
    ::1 - - [04/Jul/2006:12:06:43 +0200] "GET /" 400 460 "-" "-"
    ::1 - - [04/Jul/2006:12:06:44 +0200] "GET /" 400 460 "-" "-"
    ::1 - - [04/Jul/2006:12:06:45 +0200] "GET /" 400 460 "-" "-"
    213.239.216.169 - - [04/Jul/2006:12:06:45 +0200] "GET /gns.xml HTTP/1.0" 200 13400 "-" "Opera/8.52 (X11; Linux x86_64; U; en)"
    211.75.91.2 - - [04/Jul/2006:12:06:52 +0200] "GET /tmp/15882 HTTP/1.0" 304 - "-" "Mozilla/3.01 (compatible;)"
    85.177.183.66 - - [04/Jul/2006:12:06:34 +0200] "GET /forum/showthread.php?goto=newpost&t=13141 HTTP/1.1" 301 - "http://85.214.38.181/forum/" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"
    80.135.170.59 - - [04/Jul/2006:12:06:54 +0200] "GET /img/gns_button.gif HTTP/1.0" 200 24674 "http://www.heaven-web.de/b0a3d/wiw.php?sortby=lastactivity&order=DESC" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    213.182.126.117 - - [04/Jul/2006:12:06:52 +0200] "GET /index.php HTTP/1.1" 200 5834 "http://85.214.38.181/index.php" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    84.167.71.99 - - [04/Jul/2006:12:06:49 +0200] "GET /index.php?action=release&typ=all&PHPSESSID=543d7ec9c4fe1b7012980d6bc2ab9da3 HTTP/1.1" 200 43135 "http://85.214.38.181/index.php?action=release&typ=nfo&id=14068&anzeige=png&PHPSESSID=543d7ec9c4fe1b7012980d6bc2ab9da3" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; .NET CLR 1.1.4322)"
    84.129.27.163 - - [04/Jul/2006:12:06:54 +0200] "GET /rdf.php HTTP/1.0" 200 13400 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"
    140.127.71.100 - - [04/Jul/2006:12:07:37 +0200] "GET /tmp/15750 HTTP/1.1" 200 7007 "http://forum.p2pzone.org/viewthread.php?tid=995660" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)"
    80.135.170.59 - - [04/Jul/2006:12:07:37 +0200] "GET /img/gns_button.gif HTTP/1.0" 200 24674 "http://www.heaven-web.de/b0a3d/wiw.php?sortby=lastactivity&order=DESC" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    213.239.216.169 - - [04/Jul/2006:12:07:45 +0200] "GET /gns.xml HTTP/1.0" 200 13400 "-" "Opera/8.52 (X11; Linux x86_64; U; en)"
    84.187.106.11 - - [04/Jul/2006:12:08:06 +0200] "GET /img/gns_button.gif HTTP/1.1" 200 24674 "http://www.heaven-web.de/b0a3d/index.php" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    221.126.82.181 - - [04/Jul/2006:12:08:09 +0200] "GET /tmp/15750 HTTP/1.1" 200 7007 "http://forum2.p2pzone.org/viewthread.php?tid=995660" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)"
    80.135.170.59 - - [04/Jul/2006:12:08:08 +0200] "GET /img/gns_button.gif HTTP/1.0" 200 24674 "http://www.heaven-web.de/b0a3d/wiw.php?sortby=lastactivity&order=DESC" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    211.22.33.19 - - [04/Jul/2006:12:08:33 +0200] "GET /tmp/15752 HTTP/1.0" 304 - "-" "Mozilla/3.01 (compatible;)"
    80.135.170.59 - - [04/Jul/2006:12:08:54 +0200] "GET /img/gns_button.gif HTTP/1.0" 200 24674 "http://www.heaven-web.de/b0a3d/wiw.php?sortby=lastactivity&order=DESC" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    213.239.216.169 - - [04/Jul/2006:12:08:57 +0200] "GET /gns.xml HTTP/1.0" 200 13400 "-" "Opera/8.52 (X11; Linux x86_64; U; en)"
    59.148.163.182 - - [04/Jul/2006:12:08:57 +0200] "GET /tmp/15750 HTTP/1.1" 200 7007 "http://forum.p2pzone.org/viewthread.php?tid=995660" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)"
    80.142.187.184 - - [04/Jul/2006:12:08:58 +0200] "GET /favicon.ico HTTP/1.1" 200 3317 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    84.60.114.67 - - [04/Jul/2006:12:07:56 +0200] "GET / HTTP/1.1" 200 226 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    80.136.103.250 - - [04/Jul/2006:12:07:42 +0200] "GET /irc_bot.php?action=10last&pw=sdNoid9234 HTTP/1.1" 200 862 "-" "-"
    89.49.219.67 - - [04/Jul/2006:12:08:27 +0200] "GET /rss.php HTTP/1.1" 200 5780 "-" "Mozilla/4.0 (compatible; MSIE 5.5; Windows 2000)"
    85.178.42.175 - - [04/Jul/2006:12:07:49 +0200] "GET /index.php HTTP/1.1" 200 3924 "http://gns.6x.to/" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    80.171.133.158 - - [04/Jul/2006:12:07:50 +0200] "GET /rdf.php?typ=kino HTTP/1.1" 200 13838 "-" "Mozilla/5.0"
    66.238.240.37 - - [04/Jul/2006:12:08:32 +0200] "GET /rdf.php HTTP/1.1" 200 13400 "-" "-"
    84.187.149.230 - - [04/Jul/2006:12:08:57 +0200] "GET /rdf.php HTTP/1.1" 200 13400 "-" "Opera/9.00 (Windows NT 5.1; U; de)"
    84.62.147.9 - - [04/Jul/2006:12:08:59 +0200] "GET /index.php?action=release&typ=all&PHPSESSID=ec8fad1fabf9f16361e24642d2ddf2ee HTTP/1.1" 200 4597 "http://85.214.38.181/index.php?action=release&typ=news&PHPSESSID=ec8fad1fabf9f16361e24642d2ddf2ee" "Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    88.134.159.150 - - [04/Jul/2006:12:09:06 +0200] "GET /index.php?action=release&typ=all&PHPSESSID=bdf19c971e835ddd4a7fbc54ca794e27 HTTP/1.1" 200 4597 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    213.39.185.64 - - [04/Jul/2006:12:09:03 +0200] "GET /index.php?action=release&typ=all&PHPSESSID=0e4b5b34f26ce34147815d9743a1a462 HTTP/1.1" 200 4595 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    217.81.177.12 - - [04/Jul/2006:12:07:39 +0200] "GET /index.php?action=release&typ=all&PHPSESSID=ad5f7419d83e20ee84c16ee142cb73d1 HTTP/1.1" 200 4595 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"
    84.139.127.14 - - [04/Jul/2006:12:08:35 +0200] "GET /index.php?action=release&typ=all&PHPSESSID=13b4fec252775186c0ba6d0282548271 HTTP/1.1" 200 4597 "http://85.214.38.181/index.php?action=release&typ=nfo&id=15863&anzeige=png&PHPSESSID=13b4fec252775186c0ba6d0282548271" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4"
    84.61.49.69 - - [04/Jul/2006:12:07:07 +0200] "GET /rdf.php?typ=kino HTTP/1.1" 200 13838 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)"
    84.129.27.163 - - [04/Jul/2006:12:08:16 +0200] "GET /rdf.php HTTP/1.0" 200 13400 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"


  • Swap: 2096472k total, 1213080k used there's your problem you're swapping to disk by nearly 1.2GB.. = lack of memory or something is chewing up all your memory

    need info asked at http://www.vbulletin.com/go/tweak







  • #If you have any other info about this subject , Please add it free.#
    Your name:
    E-mail:
    Telphone:

    Your comments:


    If you have any other info about Apache crash , Please add it free.