LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 10-03-2008, 07:09 AM   #1
collym
LQ Newbie
 
Registered: Oct 2008
Posts: 1

Rep: Reputation: 0
Kernel errors on RHEL5


Does anyone know what these errors relate to? I'm relatively new to RHEL5.

Here is the server spec:
Linux 2.6.18-53.1.14.el5 EST 2008 x86_64 x86_64 x86_64 GNU/Linux
Red Hat Enterprise Linux Server release 5.1 (Tikanga)

Error:
--------------------- Kernel Begin ------------------------


WARNING: Kernel Errors Present
[<ffffffff8005cde9>] error_exit+0x0/0x84 ...: 1 Time(s)

1 Time(s): [<ffffffff800087ed>] __handle_mm_fault+0x1f8/0xdf4
1 Time(s): [<ffffffff8000f082>] __alloc_pages+0x22b/0x2b4
1 Time(s): [<ffffffff80012741>] __do_page_cache_readahead+0x95/0x1d9
1 Time(s): [<ffffffff800130cc>] filemap_nopage+0x148/0x322
1 Time(s): [<ffffffff800628e1>] __wait_on_bit_lock+0x5b/0x66
1 Time(s): [<ffffffff80065a6a>] do_page_fault+0x4b8/0x81d
1 Time(s): [<ffffffff800bffdf>] out_of_memory+0x8e/0x2f5
1 Time(s): [<ffffffff8819dc61>] :dm_mod:dm_any_congested+0x38/0x3f
1 Time(s): 21889 pages shared
1 Time(s): 2293760 pages of RAM
1 Time(s): 282958 reserved pages
1 Time(s): 315 pages swap cached
1 Time(s): Active:980810 inactive:991264 dirty:0 writeback:0 unstable:0 free:10351 slab:7861 mapped-file:1190 mapped-anon:1971678 pagetables:9928
1 Time(s): Call Trace:
1 Time(s): Free pages: 41404kB (0kB HighMem)
1 Time(s): Free swap = 0kB
1 Time(s): Free swap: 0kB
1 Time(s): Mem-info:
1 Time(s): Node 0 DMA free:11164kB min:12kB low:12kB high:16kB active:0kB inactive:0kB present:10812kB pages_scanned:0 all_unreclaimable? yes
1 Time(s): Node 0 DMA per-cpu:
1 Time(s): Node 0 DMA32 free:23804kB min:4632kB low:5788kB high:6948kB active:1563864kB inactive:1562128kB present:3329568kB pages_scanned:10087484 all_unreclaimable? yes
1 Time(s): Node 0 DMA32 per-cpu:
1 Time(s): Node 0 DMA32: 15*4kB 6*8kB 21*16kB 4*32kB 3*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 1*2048kB 5*4096kB = 23804kB
1 Time(s): Node 0 DMA: 3*4kB 6*8kB 4*16kB 5*32kB 4*64kB 3*128kB 0*256kB 0*512kB 2*1024kB 0*2048kB 2*4096kB = 11164kB
1 Time(s): Node 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
1 Time(s): Node 0 HighMem per-cpu: empty
1 Time(s): Node 0 HighMem: empty
1 Time(s): Node 0 Normal free:6436kB min:6836kB low:8544kB high:10252kB active:2359408kB inactive:2402984kB present:4912640kB pages_scanned:8178451 all_unreclaimable? yes
1 Time(s): Node 0 Normal per-cpu:
1 Time(s): Node 0 Normal: 1*4kB 32*8kB 66*16kB 2*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 1*4096kB = 6436kB
1 Time(s): Out of memory: Killed process 9630 (java).
1 Time(s): Swap cache: add 813824, delete 813510, find 264264/287170, race 0+44
1 Time(s): Total swap = 2031608kB
3 Time(s): bnx2: eth0 NIC Link is Up, 1000 Mbps full duplex, receive & transmit flow control ON
3 Time(s): bnx2: eth0: using MSI
1 Time(s): cpu 0 cold: high 0, batch 1 used:0
1 Time(s): cpu 0 cold: high 62, batch 15 used:43
1 Time(s): cpu 0 cold: high 62, batch 15 used:49
1 Time(s): cpu 0 hot: high 0, batch 1 used:0
1 Time(s): cpu 0 hot: high 186, batch 31 used:27
1 Time(s): cpu 0 hot: high 186, batch 31 used:83
1 Time(s): cpu 1 cold: high 0, batch 1 used:0
1 Time(s): cpu 1 cold: high 62, batch 15 used:53
1 Time(s): cpu 1 cold: high 62, batch 15 used:55
1 Time(s): cpu 1 hot: high 0, batch 1 used:0
1 Time(s): cpu 1 hot: high 186, batch 31 used:150
1 Time(s): cpu 1 hot: high 186, batch 31 used:30
1 Time(s): cpu 2 cold: high 0, batch 1 used:0
1 Time(s): cpu 2 cold: high 62, batch 15 used:37
1 Time(s): cpu 2 cold: high 62, batch 15 used:56
1 Time(s): cpu 2 hot: high 0, batch 1 used:0
1 Time(s): cpu 2 hot: high 186, batch 31 used:108
1 Time(s): cpu 2 hot: high 186, batch 31 used:12
1 Time(s): cpu 3 cold: high 0, batch 1 used:0
1 Time(s): cpu 3 cold: high 62, batch 15 used:45
1 Time(s): cpu 3 cold: high 62, batch 15 used:53
1 Time(s): cpu 3 hot: high 0, batch 1 used:0
1 Time(s): cpu 3 hot: high 186, batch 31 used:31
1 Time(s): cpu 3 hot: high 186, batch 31 used:59
1 Time(s): cpu 4 cold: high 0, batch 1 used:0
1 Time(s): cpu 4 cold: high 62, batch 15 used:14
1 Time(s): cpu 4 cold: high 62, batch 15 used:56
1 Time(s): cpu 4 hot: high 0, batch 1 used:0
1 Time(s): cpu 4 hot: high 186, batch 31 used:12
1 Time(s): cpu 4 hot: high 186, batch 31 used:168
1 Time(s): cpu 5 cold: high 0, batch 1 used:0
1 Time(s): cpu 5 cold: high 62, batch 15 used:40
1 Time(s): cpu 5 cold: high 62, batch 15 used:53
1 Time(s): cpu 5 hot: high 0, batch 1 used:0
1 Time(s): cpu 5 hot: high 186, batch 31 used:163
1 Time(s): cpu 5 hot: high 186, batch 31 used:30
1 Time(s): cpu 6 cold: high 0, batch 1 used:0
1 Time(s): cpu 6 cold: high 62, batch 15 used:46
1 Time(s): cpu 6 cold: high 62, batch 15 used:58
1 Time(s): cpu 6 hot: high 0, batch 1 used:0
1 Time(s): cpu 6 hot: high 186, batch 31 used:3
1 Time(s): cpu 6 hot: high 186, batch 31 used:30
1 Time(s): cpu 7 cold: high 0, batch 1 used:0
1 Time(s): cpu 7 cold: high 62, batch 15 used:27
1 Time(s): cpu 7 cold: high 62, batch 15 used:55
1 Time(s): cpu 7 hot: high 0, batch 1 used:0
1 Time(s): cpu 7 hot: high 186, batch 31 used:176
1 Time(s): cpu 7 hot: high 186, batch 31 used:77
1 Time(s): httpd invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0
2 Time(s): lowmem_reserve[]: 0 0 0 0
1 Time(s): lowmem_reserve[]: 0 0 4797 4797
1 Time(s): lowmem_reserve[]: 0 3251 8049 8049

---------------------- Kernel End -------------------------


Here is a top:

[root@iolar bin]# top
top - 13:05:34 up 18 days, 8 min, 5 users, load average: 0.04, 0.02, 0.03
Tasks: 216 total, 1 running, 215 sleeping, 0 stopped, 0 zombie
Cpu(s): 8.1%us, 0.1%sy, 0.0%ni, 91.8%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 8043208k total, 7930144k used, 113064k free, 427752k buffers
Swap: 2031608k total, 134368k used, 1897240k free, 6112136k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
23048 root 23 0 1712m 927m 16m S 65 11.8 15:59.21 java
24690 root 15 0 12712 1144 792 R 0 0.0 0:00.06 top
1 root 15 0 10316 108 72 S 0 0.0 5:21.70 init
2 root RT 0 0 0 0 S 0 0.0 0:00.15 migration/0


Thanks in advance
 
Old 10-06-2008, 12:25 PM   #2
unSpawn
Moderator
 
Registered: May 2001
Posts: 29,415
Blog Entries: 55

Rep: Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600
Quote:
Originally Posted by collym View Post
Does anyone know what these errors relate to?

1 Time(s): Free swap = 0kB

1 Time(s): Node 0 DMA32 free:23804kB min:4632kB low:5788kB high:6948kB active:1563864kB inactive:1562128kB present:3329568kB pages_scanned:10087484 all_unreclaimable? yes

1 Time(s): Node 0 HighMem per-cpu: empty

1 Time(s): [color=red][b]Out of memory: Killed process 9630 (java).

1 Time(s): httpd invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0
AFAIK Java has it's own style of memory management and it doesn't work like (or relinquish memory like) well-behaved "regular" C/C++/whateverelse applications do. I'd take a ten foot pole and push that Java application back at the development team and let them, or your application vendor, come up with debugging slash workaround slash solution. If you can't you'll have to get to know the gory details of your JVM/JDK/J2EE/Jwhatever and application and how to troubleshoot it. IBM Developerworks has good tutorials about troubleshooting and tuning (like this and this even tho old they could be good for basics), get to know free tools like JProbe, Xlink, Fprofiler, JVMstat, Jmemprof, the various Eclipse plugins and other tools mentioned here for instance, generic docs like this or else search LQ or use your favourite searchengine.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
how to install new kernel on rhel5.0 raut_2008 Red Hat 0 07-16-2008 06:05 AM
Kernel for RHEL5 tuxianD Red Hat 2 01-18-2008 03:55 PM
Errors starting tomboy on rhel5 terry_opie Linux - Software 2 09-10-2007 01:28 PM
RHEL5 debug kernel unixhack Linux - Kernel 3 12-14-2006 09:27 AM
Errors during filesystem check with one kernel while no errors with other kernel Potentials Linux - General 11 12-30-2003 04:24 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 06:18 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration