Hello everyone!
So I have an Alix (AMD Geode, 256MB ram) running flawlessly for about 5 years. It was running voyage linux 0.7. I was basically using it as a downloader and streamer (rutorrent and minidlna). But some day started to give disk i/o errors on the usb disk and after I tried with several disks I read that it was a hardware problem.
So I upgraded to the latest voyage linux distribution that is based on Jeesie. All good! problem of usb controller have dissapeared. But everything is consuming more memory, I needed to add swap and even after that sometimes the SO is rebooting or the applications are closing due to out of memory. I am not so pro to know what to do but I am thinking to go back to an older distribution based on 2.7 kernel and maybe use older versions of the software.
What should I do so you guys help me to diagnose and fix my issue?
Kernel and SO
Linux voyage 3.16.7-ckt9-voyage i586 Debian GNU/Linux 8
And this is one of my out of mems
Code:
[14375.796721] lowmem_reserve[]: 0 0 0 0
[14375.796721] DMA: 240*4kB (UMR) 0*8kB 1*16kB (R) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 976kB
[14375.796721] Normal: 93*4kB (MR) 18*8kB (R) 2*16kB (R) 0*32kB 0*64kB 1*128kB (R) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 676kB
[14375.796721] 4536 total pagecache pages
[14375.796721] 3134 pages in swap cache
[14375.796721] Swap cache stats: add 1359991, delete 1356857, find 597248/768510
[14375.796721] Free swap = 332kB
[14375.796721] Total swap = 511996kB
[14375.796721] 65439 pages RAM
[14375.796721] 0 pages HighMem/MovableOnly
[14375.796721] 1762 pages reserved
[14376.830280] ath: skbuff alloc of size 2368 failed
[14376.844382] ath5k: phy0: can't alloc skbuff of size 2368
[14376.860332] ath: skbuff alloc of size 2368 failed
[14376.874449] ath: skbuff alloc of size 2368 failed
...
[14381.700524] ath: skbuff alloc of size 2368 failed
[14381.722319] ath: skbuff alloc of size 2368 failed
[14382.009222] cron invoked oom-killer: gfp_mask=0x2000d0, order=1, oom_score_adj=0
[14382.031686] CPU: 0 PID: 2534 Comm: cron Not tainted 3.16.7-ckt9-voyage #1
[14382.052080] 00000000 00000000 cd0a9db4 c1317319 cb6ef2b0 cd0a9dfc c13166f8 c13c2081
[14382.075934] cb6ef55c 002000d0 00000001 00000000 cb6ef2b0 00000000 000000e8 00000001
[14382.099567] c1441e04 00000206 cd0a9dfc c11a1143 002000d0 cb6eee50 00000001 cd0a9e28
[14382.123179] Call Trace:
[14382.130559] [<c1317319>] dump_stack+0x41/0x52
[14382.143938] [<c13166f8>] dump_header.isra.11+0x4f/0x168
[14382.160220] [<c11a1143>] ? ___ratelimit+0x93/0xac
[14382.174721] [<c10840db>] oom_kill_process+0x4b/0x2b7
[14382.189922] [<c103023c>] ? has_ns_capability_noaudit+0x10/0x18
[14382.207678] [<c1084682>] out_of_memory+0x205/0x232
[14382.222347] [<c1086f8e>] __alloc_pages_nodemask+0x4fb/0x5d7
[14382.239559] [<c10870bc>] alloc_kmem_pages_node+0x13/0x15
[14382.255783] [<c1028c56>] copy_process.part.55+0xa4/0x1175
[14382.272280] [<c1029e9f>] do_fork+0xc7/0x25f
[14382.285144] [<c102a09a>] SyS_clone+0x16/0x18
[14382.298252] [<c131aa9e>] syscall_call+0x7/0x7
[14382.311845] Mem-Info:
[14382.318732] DMA per-cpu:
[14382.326369] CPU 0: hi: 0, btch: 1 usd: 0
[14382.340765] Normal per-cpu:
[14382.349324] CPU 0: hi: 90, btch: 15 usd: 17
[14382.363773] active_anon:27079 inactive_anon:27170 isolated_anon:203
active_file:13 inactive_file:23 isolated_file:0
unevictable:497 dirty:0 writeback:448 unstable:0
free:1219 slab_reclaimable:805 slab_unreclaimable:1344
mapped:420 shmem:197 pagetables:372 bounce:0
free_cma:0
[14382.459038] DMA free:1104kB min:124kB low:152kB high:184kB active_anon:4848kB inactive_anon:5132kB active_file:12kB inactive_file:12kB unevictable:100kB isolated(anon):0kB isolated(file):0kB present:15996kB managed:15916kB mlocked:100kB dirty:0kB writeback:0kB mapped:92kB shmem:20kB slab_reclaimable:228kB slab_unreclaimable:296kB kernel_stack:56kB pagetables:128kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:36 all_unreclaimable? yes
[14382.580382] lowmem_reserve[]: 0 232 232 232
[14382.593307] Normal free:3772kB min:1888kB low:2360kB high:2832kB active_anon:103468kB inactive_anon:103548kB active_file:40kB inactive_file:80kB unevictable:1888kB isolated(anon):812kB isolated(file):0kB present:245760kB managed:238712kB mlocked:1888kB dirty:0kB writeback:1792kB mapped:1588kB shmem:768kB slab_reclaimable:2992kB slab_unreclaimable:5080kB kernel_stack:536kB pagetables:1360kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:212 all_unreclaimable? yes
[14382.721603] lowmem_reserve[]: 0 0 0 0
[14382.733199] DMA: 268*4kB (UMR) 0*8kB 1*16kB (R) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1088kB
[14382.766986] Normal: 855*4kB (UMR) 24*8kB (MR) 2*16kB (R) 0*32kB 0*64kB 1*128kB (R) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3772kB
[14382.804346] 3775 total pagecache pages
[14382.815603] 3122 pages in swap cache
[14382.826345] Swap cache stats: add 1360074, delete 1356952, find 597248/768510
[14382.847732] Free swap = 0kB
[14382.856431] Total swap = 511996kB
[14382.866492] 65439 pages RAM
[14382.874931] 0 pages HighMem/MovableOnly
[14382.886627] 1762 pages reserved
[14382.896269] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[14382.919819] [ 1129] 0 1129 2751 302 3 115 -1000 udevd
[14382.943577] [ 1649] 0 1649 798 98 2 95 0 mount.ntfs
[14382.968652] [ 1967] 0 1967 2246 178 4 1166 0 dhclient
[14382.993263] [ 2009] 0 2009 1871 104 3 70 0 wpa_supplicant
[14383.019354] [ 2126] 0 2126 1030 13 3 68 0 rpcbind
[14383.043660] [ 2154] 105 2154 1079 326 4 125 0 rpc.statd
[14383.068789] [ 2167] 0 2167 666 0 3 43 0 rpc.idmapd
[14383.093954] [ 2318] 0 2318 510 301 3 13 0 syslogd
[14383.118208] [ 2385] 1000 2385 866 24 3 104 0 screen
[14383.142200] [ 2389] 1000 2389 215031 49974 207 110650 0 main
[14383.165701] [ 2406] 1000 2406 7417 567 10 3472 0 irssi
[14383.189647] [ 2453] 0 2453 4983 66 6 274 0 nmbd
[14383.213204] [ 2478] 106 2478 1098 122 3 42 0 dnsmasq
[14383.237485] [ 2534] 0 2534 786 275 3 36 0 cron
[14383.261001] [ 2538] 0 2538 887 317 3 73 0 cron
[14383.284512] [ 2550] 0 2550 505 48 2 16 0 sh
[14383.307510] [ 2553] 0 2553 538 333 3 7 0 inadyn
[14383.331750] [ 2579] 999 2579 1441 13 4 100 0 lighttpd
[14383.356627] [ 2649] 999 2649 22467 268 10 550 0 php-cgi
[14383.381149] [ 2678] 0 2678 482 299 3 27 0 startpar
[14383.406099] [ 2686] 999 2686 22467 1 7 550 0 php-cgi
[14383.430431] [ 2687] 999 2687 22467 1 7 550 0 php-cgi
[14383.454893] [ 2688] 999 2688 22467 1 7 550 0 php-cgi
[14383.479422] [ 2689] 999 2689 22467 1 7 550 0 php-cgi
[14383.503793] [ 2690] 999 2690 22467 1 7 550 0 php-cgi
[14383.528393] [ 2708] 0 2708 1983 309 4 120 -1000 sshd
[14383.551932] [ 2736] 0 2736 1209 243 3 68 0 vsftpd
[14383.576165] [ 2749] 0 2749 8038 44 10 386 0 smbd
[14383.599899] [ 2767] 0 2767 8038 42 10 382 0 smbd
[14383.623455] [ 2833] 0 2833 5239 212 8 3263 0 miniserv.pl
[14383.648771] [ 2858] 108 2858 10511 0 11 2194 0 minidlnad
[14383.673584] [ 2916] 0 2916 498 497 3 0 -1000 watchdog
[14383.698416] [ 2934] 0 2934 543 322 3 27 0 getty
[14383.722405] Out of memory: Kill process 2389 (main) score 839 or sacrifice child
[14383.744645] Killed process 2389 (main) total-vm:860124kB, anon-rss:199896kB, file-rss:0kB
Once also I have seen a reboot in front of my eyes (I cant remember what was the stack trace about)...
Alix 2D2out of mems and rebooting after Jessie
