Lose internet connection after "page allocation failure"

rdirks · 07-23-2022, 12:06 PM

I'm getting random internet connection loss (wifi). Frequency is about every 5-10 days. Hardware is a Raspberry Pi 4 8GB, running as a headless server (RPi OS).

I checked the syslog and found a "page allocation failure" right at the time of the internet disruption. I did a google search on that but there seem to be a lot of different scenarios where that can occur.

I ran memtester on available free memory and didn't uncover any problems.

Can anybody decipher the logs to tell me where I might focus my efforts on solving this problem?

Code:

Jul 22 18:46:04 kernel: [525980.627190] kworker/u9:2: page allocation failure: order:0, mode:0x40800(GFP_NOWAIT|__GFP_COMP), nodemask=(null),cpuset=/,mems_allowed=0
Jul 22 18:46:04 kernel: [525980.627234] CPU: 2 PID: 616 Comm: kworker/u9:2 Tainted: G         C        5.15.32-v8+ #1538
Jul 22 18:46:04 kernel: [525980.627241] Hardware name: Raspberry Pi 4 Model B Rev 1.4 (DT)
Jul 22 18:46:04 kernel: [525980.627245] Workqueue: brcmf_wq/mmc1:0001:1 brcmf_sdio_dataworker [brcmfmac]
Jul 22 18:46:04 kernel: [525980.627288] Call trace:
Jul 22 18:46:04 kernel: [525980.627290]  dump_backtrace+0x0/0x1b8
Jul 22 18:46:04 kernel: [525980.627303]  show_stack+0x20/0x30
Jul 22 18:46:04 kernel: [525980.627308]  dump_stack_lvl+0x8c/0xb8
Jul 22 18:46:04 kernel: [525980.627313]  dump_stack+0x18/0x34
Jul 22 18:46:04 kernel: [525980.627316]  warn_alloc+0x11c/0x1a0
Jul 22 18:46:04 kernel: [525980.627322]  __alloc_pages_slowpath.constprop.150+0xb78/0xba0
Jul 22 18:46:04 kernel: [525980.627328]  __alloc_pages+0x2b0/0x330
Jul 22 18:46:04 kernel: [525980.627333]  new_slab+0x34c/0x358
Jul 22 18:46:04 kernel: [525980.627338]  ___slab_alloc.part.102.constprop.112+0x434/0x7d8
Jul 22 18:46:04 kernel: [525980.627343]  __slab_alloc.isra.103.constprop.111+0x58/0x90
Jul 22 18:46:04 kernel: [525980.627349]  __kmalloc+0x508/0x510
Jul 22 18:46:04 kernel: [525980.627353]  bcm2835_dma_create_cb_chain+0x78/0x380
Jul 22 18:46:04 kernel: [525980.627359]  bcm2835_dma_prep_slave_sg+0x178/0x350
Jul 22 18:46:04 kernel: [525980.627363]  bcm2835_mmc_transfer_dma+0xc4/0x230
Jul 22 18:46:04 kernel: [525980.627368]  bcm2835_mmc_request+0xa4/0xc0
Jul 22 18:46:04 kernel: [525980.627372]  __mmc_start_request+0x84/0x1d0
Jul 22 18:46:04 kernel: [525980.627377]  mmc_start_request+0x8c/0xb8
Jul 22 18:46:04 kernel: [525980.627381]  mmc_wait_for_req+0x74/0xf8
Jul 22 18:46:04 kernel: [525980.627385]  mmc_submit_one.isra.11+0x90/0x120 [brcmfmac]
Jul 22 18:46:04 kernel: [525980.627407]  brcmf_sdiod_sglist_rw+0x22c/0x508 [brcmfmac]
Jul 22 18:46:04 kernel: [525980.627429]  brcmf_sdiod_send_pkt+0x110/0x130 [brcmfmac]
Jul 22 18:46:04 kernel: [525980.627451]  brcmf_sdio_dataworker+0x1810/0x22b8 [brcmfmac]
Jul 22 18:46:04 kernel: [525980.627473]  process_one_work+0x1f8/0x4a0
Jul 22 18:46:04 kernel: [525980.627480]  worker_thread+0x50/0x480
Jul 22 18:46:04 kernel: [525980.627484]  kthread+0x140/0x158
Jul 22 18:46:04 kernel: [525980.627487]  ret_from_fork+0x10/0x20
Jul 22 18:46:04 kernel: [525980.627493] Mem-Info:
Jul 22 18:46:04 kernel: [525980.627498] active_anon:220374 inactive_anon:287390 isolated_anon:0
Jul 22 18:46:04 kernel: [525980.627498]  active_file:423897 inactive_file:947451 isolated_file:0
Jul 22 18:46:04 kernel: [525980.627498]  unevictable:4 dirty:30388 writeback:0
Jul 22 18:46:04 kernel: [525980.627498]  slab_reclaimable:77494 slab_unreclaimable:8954
Jul 22 18:46:04 kernel: [525980.627498]  mapped:55017 shmem:7 pagetables:3158 bounce:0
Jul 22 18:46:04 kernel: [525980.627498]  kernel_misc_reclaimable:0
Jul 22 18:46:04 kernel: [525980.627498]  free:21618 free_pcp:26 free_cma:947
Jul 22 18:46:04 kernel: [525980.627508] Node 0 active_anon:881496kB inactive_anon:1149560kB active_file:1695588kB inactive_file:3789804kB unevictable:16kB isolated(anon):0kB isolated(file):0kB mapped:220068kB dirty:121552kB writeback:0kB shmem:28kB writeback_tmp:0kB kernel_stack:4288kB pagetables:12632kB all_unreclaimable? no
Jul 22 18:46:04 kernel: [525980.627518] DMA free:30760kB min:1812kB low:2696kB high:3580kB reserved_highatomic:0KB active_anon:31696kB inactive_anon:327444kB active_file:275296kB inactive_file:194616kB unevictable:0kB writepending:8884kB present:969728kB managed:885520kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:3788kB
Jul 22 18:46:04 kernel: [525980.627529] lowmem_reserve[]: 0 3008 6946 6946
Jul 22 18:46:04 kernel: [525980.627545] DMA32 free:25920kB min:10404kB low:13484kB high:16564kB reserved_highatomic:0KB active_anon:184344kB inactive_anon:519876kB active_file:692960kB inactive_file:1555352kB unevictable:0kB writepending:99324kB present:3080192kB managed:3080192kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jul 22 18:46:04 kernel: [525980.627554] lowmem_reserve[]: 0 0 3938 3938
Jul 22 18:46:04 kernel: [525980.627570] Normal free:30800kB min:32744kB low:36776kB high:40808kB reserved_highatomic:4096KB active_anon:665456kB inactive_anon:302076kB active_file:727332kB inactive_file:2039660kB unevictable:16kB writepending:12824kB present:4194304kB managed:4033236kB mlocked:16kB bounce:0kB free_pcp:256kB local_pcp:0kB free_cma:0kB
Jul 22 18:46:04 kernel: [525980.627579] lowmem_reserve[]: 0 0 0 0
Jul 22 18:46:04 kernel: [525980.627595] DMA: 61*4kB (UMEC) 66*8kB (UMEC) 305*16kB (UMEC) 211*32kB (UMEC) 77*64kB (UMEC) 22*128kB (UEC) 8*256kB (UE) 3*512kB (UE) 3*1024kB (U) 2*2048kB (UE) 0*4096kB = 30900kB
Jul 22 18:46:04 kernel: [525980.627664] DMA32: 274*4kB (UME) 129*8kB (UME) 726*16kB (UE) 294*32kB (UME) 50*64kB (UE) 3*128kB (ME) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 26736kB
Jul 22 18:46:04 kernel: [525980.627721] Normal: 3140*4kB (UMEH) 680*8kB (UMEH) 560*16kB (UMEH) 130*32kB (UE) 10*64kB (UE) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 31760kB
Jul 22 18:46:04 kernel: [525980.627775] 1372564 total pagecache pages
Jul 22 18:46:04 kernel: [525980.627778] 1509 pages in swap cache
Jul 22 18:46:04 kernel: [525980.627782] Swap cache stats: add 194319, delete 192810, find 352975/360977
Jul 22 18:46:04 kernel: [525980.627786] Free swap  = 2945788kB
Jul 22 18:46:04 kernel: [525980.627789] Total swap = 3145724kB
Jul 22 18:46:04 kernel: [525980.627793] 2061056 pages RAM
Jul 22 18:46:04 kernel: [525980.627796] 0 pages HighMem/MovableOnly
Jul 22 18:46:04 kernel: [525980.627799] 61319 pages reserved
Jul 22 18:46:04 kernel: [525980.627802] 81920 pages cma reserved
Jul 22 18:46:04 kernel: [525980.627807] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
Jul 22 18:46:04 kernel: [525980.627812]   cache: kmalloc-1k, object size: 1024, buffer size: 1024, default order: 2, min order: 0
Jul 22 18:46:04 kernel: [525980.627818]   node 0: slabs: 83, objs: 1328, free: 0
Jul 22 18:46:14 kernel: [525990.647958] mmc1: Timeout waiting for hardware interrupt.
Jul 22 18:46:59 dhcpcd[704]: wlan0: part of Router Advertisement expired
Jul 22 18:46:59 avahi-daemon[459]: Got SIGHUP, reloading.
Jul 22 18:46:59 avahi-daemon[459]: No service file found in /etc/avahi/services.

business_kid · 07-24-2022, 06:48 AM

Hello, rdirks & welcome to LQ.

RPi OS is easy to install & set up, and very difficult to fix, because your support is near zero. It's Debian in disguise, with a little fruit added. Page allocation failure is heavy stuff. It's looking for memory and being refused or messed around. It's a software issue. I wouldn't play with the wifi. Maybe update the kernel?

Have you done the obvious apt update & full-upgrade? Do it. There's also a line for updating the firmware. I ran away from RPi OS when Buster became Bullseye because of the lack of support. If you still have an SD Card, it could well be shot because they have a very poor tolerance for writes. I wouldn't advise testing/repairing, but get onto a usb drive. I'm using a 2.5" ssd in a usb-3.0 box. I leave the sdcard slot empty. It's handy, because I can stuff in an sdcard when there's boot issues, and sort them.

There's an official 'slackware arm' port (32 &64bit), and an unofficial 64bit port called slarm64, which I use. Both have better support, and are easier to fix. There's many arm distros now. But I promoted myself to slackware, and haven't looked back

rdirks · 07-25-2022, 11:00 AM

Thanks for the reply. My firmware is up-to-date, I just did a full-upgrade on the OS, and I've been booting off an SSD for awhile now ... I really love that feature! I'll have a look at slackware.