My server has recently started to crash very frequently. I see this on the console and also in the /var/log/messages.
I am running an old Redhat Linux on the system, and it has never failed before. I haven't installed anything on the server. The only thing that might have contributed was the / partition was 100% full due to some log file eating up all of the disk space. However I've cleaned that up but the problems continue.
Can you guy slook at the log file and give me an idea of what could be wrong? I'm thinking it's either the hard drive, cpu, or ram?
Code:
Apr 4 09:50:52 nma1 kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000300
Apr 4 09:50:52 nma1 kernel: printing eip:
Apr 4 09:50:52 nma1 kernel: c015244c
Apr 4 09:50:52 nma1 kernel: *pde = 00000000
Apr 4 09:50:52 nma1 kernel: Oops: 0000
Apr 4 09:50:52 nma1 kernel: parport_pc lp parport autofs e100 ipt_REJECT iptable_filter ip_tables keybdev mousedev hid input usb-ohci usbcore ext3 jbd
sym53c8xx sd_mod scsi_mod
Apr 4 09:50:52 nma1 kernel: CPU: 0
Apr 4 09:50:52 nma1 kernel: EIP: 0060:[<c015244c>] Not tainted
Apr 4 09:50:52 nma1 kernel: EFLAGS: 00010293
Apr 4 09:50:52 nma1 kernel:
Apr 4 09:50:52 nma1 kernel: EIP is at link_path_walk [kernel] 0x21c (2.4.20-8)
Apr 4 09:50:52 nma1 kernel: eax: e0868f40 ebx: df6fd900 ecx: 00000000 edx: 00000000
Apr 4 09:50:52 nma1 kernel: esi: ddc21005 edi: ffffffec ebp: deafdf84 esp: deafdef4
Apr 4 09:50:52 nma1 kernel: ds: 0068 es: 0068 ss: 0068
Apr 4 09:50:52 nma1 kernel: Process rm (pid: 1811, stackpage=deafd000)
Apr 4 09:50:52 nma1 kernel: Stack: c22f8a80 deafdf10 00000004 00000001 00000000 df684900 df6fd900 ddc21001
Apr 4 09:50:52 nma1 kernel: 00000003 0029e101 00000000 deafdf84 ddc21000 00000000 deafdf84 c0152af9
Apr 4 09:50:52 nma1 kernel: 00008000 00008001 42116b00 c0152f6e fffffff2 00001000 00001000 42116b00
Apr 4 09:50:52 nma1 kernel: Call Trace: [<c0152af9>] path_lookup [kernel] 0x39 (0xdeafdf30))
Apr 4 09:50:52 nma1 xfs: xfs startup succeeded
Apr 4 09:50:52 nma1 kernel: [<c0152f6e>] open_namei [kernel] 0x7e (0xdeafdf40))
Apr 4 09:50:52 nma1 kernel: [<c0145eb9>] filp_open [kernel] 0x49 (0xdeafdf70))
Apr 4 09:50:52 nma1 kernel: [<c0146273>] sys_open [kernel] 0x53 (0xdeafdfa8))
Apr 4 09:50:52 nma1 kernel: [<c0109537>] system_call [kernel] 0x33 (0xdeafdfc0))
Apr 4 09:50:52 nma1 kernel:
Apr 4 09:50:52 nma1 kernel:
Apr 4 09:50:53 nma1 kernel: Code: ff 0f 84 f3 00 00 00 bf 00 e0 ff ff 21 e7 8b 97 10 03 00 00
Apr 4 09:50:53 nma1 anacron: anacron startup succeeded
Apr 4 09:50:53 nma1 xfs: ignoring font path element /usr/X11R6/lib/X11/fonts/cyrillic (unreadable)
Apr 4 09:50:53 nma1 atd: atd startup succeeded
Apr 4 09:50:53 nma1 rhnsd[1843]: Red Hat Network Services Daemon starting up.
Apr 4 09:50:53 nma1 rhnsd: rhnsd startup succeeded
Apr 4 11:07:19 nma1 kernel: <1>Unable to handle kernel paging request at virtual address 003d7cc8
Apr 4 11:07:19 nma1 kernel: printing eip:
Apr 4 11:07:19 nma1 kernel: c01f151b
Apr 4 11:07:19 nma1 kernel: *pde = 00000000
Apr 4 11:07:19 nma1 kernel: Oops: 0002
Apr 4 11:07:19 nma1 kernel: parport_pc lp parport autofs e100 ipt_REJECT iptable_filter ip_tables keybdev mousedev hid input usb-ohci usbcore ext3 jbd
sym53c8xx sd_mod scsi_mod
Apr 4 11:07:19 nma1 kernel: CPU: 0
Apr 4 11:07:19 nma1 kernel: EIP: 0060:[<c01f151b>] Not tainted
Apr 4 11:07:19 nma1 kernel: EFLAGS: 00010006
Apr 4 11:07:19 nma1 kernel:
Apr 4 11:07:19 nma1 kernel: EIP is at skb_clone [kernel] 0x2b (2.4.20-8)
Apr 4 11:07:19 nma1 kernel: eax: daffb280 ebx: daf0669c ecx: 00000202 edx: dec0be80
Apr 4 11:07:19 nma1 kernel: esi: d588b880 edi: 00000558 ebp: daf065d8 esp: cfc93e6c
Apr 4 11:07:19 nma1 kernel: ds: 0068 es: 0068 ss: 0068
Apr 4 11:07:19 nma1 kernel: Process sshd (pid: 2055, stackpage=cfc93000)
Apr 4 11:07:19 nma1 kernel: Stack: fffffffd 00000046 c0370c08 daf0669c d588b880 c021e434 d588b880 00000020
Apr 4 11:07:19 nma1 kernel: 00000558 daf065d8 00000000 00000001 daf0669c cf302122 00000000 c021f1be
Apr 4 11:07:19 nma1 kernel: daf06580 00000001 00000001 00000558 daf065c8 daf06580 00000000 00000000
Apr 4 11:07:19 nma1 kernel: Call Trace: [<c021e434>] tcp_write_xmit [kernel] 0x174 (0xcfc93e80))
Apr 4 11:07:19 nma1 kernel: [<c021f1be>] tcp_send_fin [kernel] 0x17e (0xcfc93ea8))
Apr 4 11:07:19 nma1 kernel: [<c0215496>] tcp_close [kernel] 0x516 (0xcfc93ecc))
Apr 4 11:07:19 nma1 kernel: [<c012eb1c>] __free_pte [kernel] 0x4c (0xcfc93eec))
Apr 4 11:07:19 nma1 kernel: [<c0131187>] zap_pte_range [kernel] 0x137 (0xcfc93ef8))
Apr 4 11:07:19 nma1 kernel: [<c02301b4>] inet_release [kernel] 0x54 (0xcfc93f10))
Apr 4 11:07:19 nma1 kernel: [<c01ed8fc>] sock_release [kernel] 0x5c (0xcfc93f24))
Apr 4 11:07:19 nma1 kernel: [<c01edef9>] sock_close [kernel] 0x39 (0xcfc93f30))
Apr 4 11:07:19 nma1 kernel: [<c0147d62>] fput [kernel] 0x102 (0xcfc93f44))
Apr 4 11:07:19 nma1 kernel: [<c014633d>] filp_close [kernel] 0x4d (0xcfc93f60))
Apr 4 11:07:19 nma1 kernel: [<c011f01c>] put_files_struct [kernel] 0x6c (0xcfc93f78))
Apr 4 11:07:19 nma1 kernel: [<c011f710>] do_exit [kernel] 0x110 (0xcfc93f94))
Apr 4 11:07:19 nma1 kernel: [<c011f994>] do_group_exit [kernel] 0x54 (0xcfc93fb0))
Apr 4 11:07:19 nma1 kernel: [<c0109537>] system_call [kernel] 0x33 (0xcfc93fc0))
Apr 4 11:07:19 nma1 kernel:
Apr 4 11:07:19 nma1 kernel:
Apr 4 11:07:19 nma1 kernel: Code: ff 0d c8 7c 3d 00 00 89 43 10 8b 46 18 c7 43 08 00 00 00 00
Apr 4 13:34:49 nma1 kernel: ------------[ cut here ]------------
Apr 4 13:34:49 nma1 kernel: kernel BUG at vmscan.c:747!
Apr 4 13:34:49 nma1 kernel: invalid operand: 0000
Apr 4 13:34:49 nma1 kernel: parport_pc lp parport autofs e100 ipt_REJECT iptable_filter ip_tables keybdev mousedev hid input usb-ohci usbcore ext3 jbd
sym53c8xx sd_mod scsi_mod
Apr 4 13:34:49 nma1 kernel: CPU: 0
Apr 4 13:34:49 nma1 kernel: EIP: 0060:[<c013cb14>] Not tainted
Apr 4 13:34:49 nma1 kernel: EFLAGS: 00010202
Apr 4 13:34:49 nma1 kernel:
Apr 4 13:34:49 nma1 kernel: EIP is at rebalance_dirty_zone [kernel] 0x94 (2.4.20-8)
Apr 4 13:34:49 nma1 kernel: eax: 00000080 ebx: 0000003f ecx: c102c250 edx: c1708064
Apr 4 13:34:49 nma1 kernel: esi: c030d100 edi: 00000000 ebp: c030d334 esp: c25a9fb8
Apr 4 13:34:49 nma1 kernel: ds: 0068 es: 0068 ss: 0068
Apr 4 13:34:49 nma1 kernel: Process kswapd (pid: 5, stackpage=c25a9000)
Apr 4 13:34:49 nma1 kernel: Stack: c030ce00 000001d0 c102c250 c25a8000 c030d100 c25a8305 00000000 c013d0fc
Apr 4 13:34:49 nma1 kernel: c030d100 00000040 000001d0 c013cfa0 00000000 00000000 c010742d 00000000
Apr 4 13:34:49 nma1 kernel: 00000000 00000000
Apr 4 13:34:50 nma1 kernel: Call Trace: [<c013d0fc>] kswapd [kernel] 0x15c (0xc25a9fd4))
Apr 4 13:34:50 nma1 kernel: [<c013cfa0>] kswapd [kernel] 0x0 (0xc25a9fe4))
Apr 4 13:34:50 nma1 kernel: [<c010742d>] kernel_thread_helper [kernel] 0x5 (0xc25a9ff0))
Apr 4 13:34:50 nma1 kernel:
Apr 4 13:34:50 nma1 kernel:
Apr 4 13:34:50 nma1 kernel: Code: 0f 0b eb 02 d0 ee 25 c0 eb aa 89 f6 55 57 31 ff 56 53 83 ec
Apr 4 13:37:49 nma1 kernel: <1>Unable to handle kernel NULL pointer dereference at virtual address 00000074
Apr 4 13:37:49 nma1 kernel: printing eip:
Apr 4 13:37:49 nma1 kernel: c0143d8b
Apr 4 13:37:49 nma1 kernel: *pde = 00000000
Apr 4 13:37:49 nma1 kernel: Oops: 0000
Apr 4 13:37:49 nma1 kernel: parport_pc lp parport autofs e100 ipt_REJECT iptable_filter ip_tables keybdev mousedev hid input usb-ohci usbcore ext3 jbd
sym53c8xx sd_mod scsi_mod
Apr 4 13:37:49 nma1 kernel: CPU: 0
Apr 4 13:37:49 nma1 kernel: EIP: 0060:[<c0143d8b>] Not tainted
Apr 4 13:37:49 nma1 kernel: EFLAGS: 00010202
Apr 4 13:37:49 nma1 kernel:
Apr 4 13:37:49 nma1 kernel: EIP is at page_referenced [kernel] 0x21b (2.4.20-8)
Apr 4 13:37:49 nma1 kernel: eax: c1000030 ebx: 00000001 ecx: 00000000 edx: 00000001
Apr 4 13:37:50 nma1 kernel: esi: 0000001e edi: c6ef8000 ebp: 00000000 esp: c23a5f84
Apr 4 13:37:50 nma1 kernel: ds: 0068 es: 0068 ss: 0068
Apr 4 13:37:50 nma1 kernel: Process kscand/Normal (pid: 7, stackpage=c23a5000)
Apr 4 13:37:50 nma1 kernel: Stack: c1184654 00000000 00000001 c23a5fb4 c25a551c c25a551c c030d324 c6ef9000
Apr 4 13:37:50 nma1 kernel: 0000000e c013c68e c23a4000 c0125ba0 00000001 0000000e c23a4000 c030d100
Apr 4 13:37:50 nma1 kernel: c23a4000 c013d5a4 c030d100 0000000e 00000000 c025ef1b 000009c4 c013d4b0
Apr 4 13:37:50 nma1 kernel: Call Trace: [<c013c68e>] scan_active_list [kernel] 0x3e (0xc23a5fa8))
Apr 4 13:37:50 nma1 kernel: [<c0125ba0>] process_timeout [kernel] 0x0 (0xc23a5fb0))
Apr 4 13:37:50 nma1 kernel: [<c013d5a4>] kscand [kernel] 0xf4 (0xc23a5fc8))
Apr 4 13:37:50 nma1 kernel: [<c013d4b0>] kscand [kernel] 0x0 (0xc23a5fe0))
Apr 4 13:37:50 nma1 kernel: [<c010742d>] kernel_thread_helper [kernel] 0x5 (0xc23a5ff0))
Apr 4 13:37:50 nma1 kernel:
Apr 4 13:37:50 nma1 kernel:
Apr 4 13:37:50 nma1 kernel: Code: 8b 41 74 39 41 60 0f 43 54 24 04 45 4e 89 54 24 04 0f 89 3e
Apr 4 13:37:50 nma1 kernel: ------------[ cut here ]------------
Apr 4 13:37:50 nma1 kernel: kernel BUG at vmscan.c:118!
Apr 4 13:37:50 nma1 kernel: invalid operand: 0000
Apr 4 13:37:50 nma1 kernel: parport_pc lp parport autofs e100 ipt_REJECT iptable_filter ip_tables keybdev mousedev hid input usb-ohci usbcore ext3 jbd
sym53c8xx sd_mod scsi_mod
Apr 4 13:37:50 nma1 kernel: CPU: 0
Apr 4 13:37:50 nma1 kernel: EIP: 0060:[<c013b962>] Not tainted
Apr 4 13:37:51 nma1 kernel: EFLAGS: 00010206
Apr 4 13:37:51 nma1 kernel:
Apr 4 13:37:51 nma1 kernel: EIP is at reclaim_page [kernel] 0x2a2 (2.4.20-8)
Apr 4 13:37:51 nma1 kernel: eax: 00000201 ebx: c160b828 ecx: 000001fe edx: 00000001
Apr 4 13:37:51 nma1 kernel: esi: c030d100 edi: c160b80c ebp: 0000096b esp: dc7b7ea4
Apr 4 13:37:51 nma1 kernel: ds: 0068 es: 0068 ss: 0068
Apr 4 13:37:51 nma1 kernel: Process httpd (pid: 2744, stackpage=dc7b7000)
Apr 4 13:37:51 nma1 kernel: Stack: 000002e1 00000d1f c030d344 00000000 c030d100 000001ff 000001d2 00000000
Apr 4 13:37:51 nma1 kernel: c013e817 c1616278 c030d724 c013e97c 00008040 000002e1 c0134928 d9faac00
Apr 4 13:37:51 nma1 kernel: c1616278 000002e1 00000d1f d9faac20 00000001 c030d720 c23234fc 00000000
