[SOLVED] --current, randomly timed kernel oops on bootup of two test boxen

hitest · 12-29-2010, 09:40 PM

Quote:

Originally Posted by EdGr

If this is too much work, it may be best to wait for Pat to issue an update. I emailed Pat and David Z. at Redhat this morning. I haven't received a reply - people may be on vacation.

(I'm actually on vacation too.)
Ed

Thanks for your work on this Ed. I'm also still getting the random kernel panics.

rworkman · 12-29-2010, 10:13 PM

Sorry for not catching this in testing, but thanks for figuring it out. I saw that you mailed David, and I poked Kay on IRC a little while ago. We'll see what happens

aaazen · 12-30-2010, 01:56 AM

EdGr wrote:

Quote:

I think I may have found what tickles the kernel panic.

I disabled the following change in udev-165:

It makes sense to me that it might be udev.

I have an SATA disk, no IDE disks.

I have now gotten the error running 4 different kernels using udev-165:

vmlinuz-huge-smp-2.6.35.7-smp
vmlinuz-huge-smp-2.6.35.9-smp
vmlinuz-huge-smp-2.6.36.2-smp

And sadly after I had last posted how "rock solid" the old kernel was,
it too crashed once:

vmlinuz-huge-smp-2.6.33.4-smp

My simple fix is to go back to udev-153 which is released under Slack 13.1

And I blacklisted udev in /etc/slackpkg/blacklist

To get around the problem of the /dev/root symbolic link missing in udev-153, I created an /etc/rc.d/rc.rootlink script which I call from rc.local:

Code:

#! /bin/sh
# Create a /dev/root symbolic link to the true disk
#set -x
if  [ ! -L /dev/root ]; then
  DEVNO=$(stat -c %d /)
  let MAJNO=$DEVNO/256
  let MINNO=$DEVNO%256
  ROOT_DEV=$(ls -l /dev |egrep " disk[ ]+$MAJNO,[ ]*$MINNO " | awk '{print $10}')
  if   [ -z "$ROOT_DEV" ]; then
    echo "$0: Error -  ROOT_DEV is an empty string"
    echo "$0: DEVNO=$DEVNO MAJNO=$MAJNO MINNO=$MINNO ROOT_DEV=$ROOT_DEV"
  elif [ ! -b /dev/$ROOT_DEV ]; then
    echo "$0: Error - /dev/ROOT_DEV is not a block device"
    echo "$0: DEVNO=$DEVNO MAJNO=$MAJNO MINNO=$MINNO ROOT_DEV=$ROOT_DEV"
  else
    echo "$0: ln -f -s /dev/$ROOT_DEV /dev/root"
              ln -f -s /dev/$ROOT_DEV /dev/root
  fi
fi

I will let you know if I get the same crash again...

Petri Kaukasoina · 12-30-2010, 03:26 AM

Here are the latest udev-164 packages from slackware-current, in case someone needs them.
http://butler.cc.tut.fi/~kaukasoi/slackware/

rworkman · 12-30-2010, 09:39 AM

comet.berkeley, the /dev/root symlink problem was already fixed.

Kay Sievers (udev maintainer) says that this is definitely a kernel bug, even though the change to ata_id is what triggered it. Any chance someone can try to reproduce this on 2.6.35.10? How about 2.6.36.2?

I personally am on 2.6.36.2 and I've not seen it on any of my systems, even those with old ide devices.

smoooth103 · 12-30-2010, 12:53 PM

Quote:

Originally Posted by EdGr

I can explain two more observations.

I just now saw the bug when ejecting the DVD at the end of a clean Slackware installation. I previously didn't notice this because I run with HAL disabled in normal use. Old_Fogie - you were right in that problems with ejecting DVDs and booting are the same.

Also, this bug occurs with IDE drives, which explains why my 64-bit machine with SATA drives works.
Ed

Observed same occurance - bug appeared while ejecting a dvd w/ IDE drive which resulted in a hard freeze/kernel panic.

aaazen · 12-31-2010, 01:35 AM

Slackware current is now running again on my machine including udev-165.

I took the slackware 13.1 configuration for the huge smp kernel and used it to create
a configuration for linux 2.6.36.2 and created a kernel.

Here is a console log of the "ioread32_rep" bug that I just created after rebooting multiple times. Again most of the time it works fine.

Here is part 1 of 2:

Code:

Linux version 2.6.36.2-smp (root@love) (gcc version 4.5.1 (GCC) ) #1 SMP Tue Dec 28 02:04:06 PST 2010
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000008f000 (usable)
 BIOS-e820: 000000000008f000 - 0000000000090000 (reserved)
 BIOS-e820: 0000000000090000 - 000000000009ec00 (usable)
 BIOS-e820: 000000000009ec00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000cee98000 (usable)
 BIOS-e820: 00000000cee98000 - 00000000ceebf000 (reserved)
 BIOS-e820: 00000000ceebf000 - 00000000cef48000 (usable)
 BIOS-e820: 00000000cef48000 - 00000000cefbf000 (ACPI NVS)
 BIOS-e820: 00000000cefbf000 - 00000000ceff1000 (usable)
 BIOS-e820: 00000000ceff1000 - 00000000cefff000 (ACPI data)
 BIOS-e820: 00000000cefff000 - 00000000cf000000 (usable)
 BIOS-e820: 00000000cf000000 - 00000000d0000000 (reserved)
 BIOS-e820: 00000000f8000000 - 00000000fc000000 (reserved)
 BIOS-e820: 00000000fff00000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000130000000 (usable)
Notice: NX (Execute Disable) protection cannot be enabled: non-PAE kernel!
DMI 2.5 present.
last_pfn = 0xcf000 max_arch_pfn = 0x100000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
found SMP MP-table at [c00fbe50] fbe50
init_memory_mapping: 0000000000000000-00000000377fe000
ACPI: RSDP 000f2110 00024 (v02 INTEL )
ACPI: XSDT ceffe120 0004C (v01 INTEL  MOPNV10N 000001F5      01000013)
ACPI: FACP ceffd000 000F4 (v03 INTEL  MOPNV10N 000001F5 MSFT 0100000D)
ACPI: DSDT ceff9000 039A7 (v01 INTEL  MOPNV10N 000001F5 MSFT 0100000D)
ACPI: FACS cef87000 00040
ACPI: APIC ceff8000 00084 (v02 INTEL  MOPNV10N 000001F5 MSFT 0100000D)
ACPI: MCFG ceff7000 0003C (v01 INTEL  MOPNV10N 000001F5 MSFT 0100000D)
ACPI: HPET ceff6000 00038 (v01 INTEL  MOPNV10N 000001F5 MSFT 0100000D)
ACPI: SSDT ceff2000 0377C (v01 INTEL  SSDT  PM 000001F5 MSFT 0100000D)
2424MB HIGHMEM available.
887MB LOWMEM available.
  mapped low ram: 0 - 377fe000
  low ram: 0 - 377fe000
Zone PFN ranges:
  DMA      0x00000001 -> 0x00001000
  Normal   0x00001000 -> 0x000377fe
  HighMem  0x000377fe -> 0x000cf000
Movable zone start PFN for each node
early_node_map[6] active PFN ranges
    0: 0x00000001 -> 0x0000008f
    0: 0x00000090 -> 0x0000009e
    0: 0x00000100 -> 0x000cee98
    0: 0x000ceebf -> 0x000cef48
    0: 0x000cefbf -> 0x000ceff1
    0: 0x000cefff -> 0x000cf000
Using APIC driver default
ACPI: PM-Timer IO Port: 0x408
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] disabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] disabled)
ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a201 base: 0xfed00000
SMP: Allowing 4 CPUs, 2 hotplug CPUs
PM: Registered nosave memory: 000000000008f000 - 0000000000090000
PM: Registered nosave memory: 000000000009e000 - 000000000009f000
PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
Allocating PCI resources starting at d0000000 (gap: d0000000:28000000)
setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:4 nr_node_ids:1
PERCPU: Embedded 13 pages/cpu @c3c00000 s31168 r0 d22080 u1048576
pcpu-alloc: s31168 r0 d22080 u1048576 alloc=1*4194304
pcpu-alloc: [0] 0 1 2 3 
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 840975
Kernel command line: BOOT_IMAGE=linux-a5 ro root=805 console=ttyS0,38400 console=tty0
PID hash table entries: 4096 (order: 2, 16384 bytes)
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
Subtract (55 early reservations)
  #1 [0000001000 - 0000002000]   EX TRAMPOLINE
  #2 [0001000000 - 0001e23cec]   TEXT DATA BSS
  #3 [0001e24000 - 0001e2c162]             BRK
  #4 [000009ec00 - 00000fbe50]   BIOS reserved
  #5 [00000fbe50 - 00000fbe60]    MP-table mpf
  #6 [00000fbea0 - 0000100000]   BIOS reserved
  #7 [00000fbe60 - 00000fbea0]    MP-table mpc
  #8 [0000002000 - 0000003000]      TRAMPOLINE
  #9 [0000003000 - 0000007000]     ACPI WAKEUP
  #10 [0000007000 - 0000008000]         PGTABLE
  #11 [0001e2d000 - 0001e2e000]         BOOTMEM
  #12 [0001e2e000 - 000380e000]         BOOTMEM
  #13 [0001e23d00 - 0001e23d04]         BOOTMEM
  #14 [0001e23d40 - 0001e23e00]         BOOTMEM
  #15 [0001e23e00 - 0001e23e54]         BOOTMEM
  #16 [000380e000 - 0003811000]         BOOTMEM
  #17 [0001e23e80 - 0001e23f64]         BOOTMEM
  #18 [0003811000 - 000381d000]         BOOTMEM
  #19 [0001e23f80 - 0001e23fa5]         BOOTMEM
  #20 [0001e23fc0 - 0001e23fe7]         BOOTMEM
  #21 [0001e2c180 - 0001e2c35c]         BOOTMEM
  #22 [0001e2c380 - 0001e2c3c0]         BOOTMEM
  #23 [0001e2c3c0 - 0001e2c400]         BOOTMEM
  #24 [0001e2c400 - 0001e2c440]         BOOTMEM
  #25 [0001e2c440 - 0001e2c480]         BOOTMEM
  #26 [0001e2c480 - 0001e2c4c0]         BOOTMEM
  #27 [0001e2c4c0 - 0001e2c500]         BOOTMEM
  #28 [0001e2c500 - 0001e2c540]         BOOTMEM
  #29 [0001e2c540 - 0001e2c580]         BOOTMEM
  #30 [0001e2c580 - 0001e2c5c0]         BOOTMEM
  #31 [0001e2c5c0 - 0001e2c600]         BOOTMEM
  #32 [0001e2c600 - 0001e2c640]         BOOTMEM
  #33 [0001e2c640 - 0001e2c680]         BOOTMEM
  #34 [0001e2c680 - 0001e2c6c0]         BOOTMEM
  #35 [0001e2c6c0 - 0001e2c700]         BOOTMEM
  #36 [0001e2c700 - 0001e2c740]         BOOTMEM
  #37 [0001e2c740 - 0001e2c780]         BOOTMEM
  #38 [0001e2c780 - 0001e2c790]         BOOTMEM
  #39 [0001e2c7c0 - 0001e2c7d0]         BOOTMEM
  #40 [0001e2c800 - 0001e2c841]         BOOTMEM
  #41 [0001e2c880 - 0001e2c8c1]         BOOTMEM
  #42 [0003c00000 - 0003c0d000]         BOOTMEM
  #43 [0003d00000 - 0003d0d000]         BOOTMEM
  #44 [0003e00000 - 0003e0d000]         BOOTMEM
  #45 [0003f00000 - 0003f0d000]         BOOTMEM
  #46 [0001e2c900 - 0001e2c904]         BOOTMEM
  #47 [0001e2c940 - 0001e2c944]         BOOTMEM
  #48 [0001e2c980 - 0001e2c990]         BOOTMEM
  #49 [0001e2c9c0 - 0001e2c9d0]         BOOTMEM
  #50 [0001e2ca00 - 0001e2caa0]         BOOTMEM
  #51 [0001e2cac0 - 0001e2cb08]         BOOTMEM
  #52 [000381d000 - 0003821000]         BOOTMEM
  #53 [0003821000 - 00038a1000]         BOOTMEM
  #54 [00038a1000 - 00038e1000]         BOOTMEM
Initializing HighMem for node 0 (000377fe:000cf000)
Memory: 3348304k/3391488k available (9790k kernel code, 42096k reserved, 3086k data, 592k init, 2481496k highmem)
virtual kernel memory layout:
    fixmap  : 0xffd37000 - 0xfffff000   (2848 kB)
    pkmap   : 0xff800000 - 0xffc00000   (4096 kB)
    vmalloc : 0xf7ffe000 - 0xff7fe000   ( 120 MB)
    lowmem  : 0xc0000000 - 0xf77fe000   ( 887 MB)
      .init : 0xc1c94000 - 0xc1d28000   ( 592 kB)
      .data : 0xc198fb77 - 0xc1c9367c   (3086 kB)
      .text : 0xc1000000 - 0xc198fb77   (9790 kB)
Checking if this processor honours the WP bit even in supervisor mode...Ok.
SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
Hierarchical RCU implementation.
	RCU-based detection of stalled CPUs is disabled.
	Verbose stalled-CPUs detection is disabled.
NR_IRQS:1280
Extended CMOS year: 2000
Console: colour dummy device 80x25
console [tty0] enabled
console [ttyS0] enabled
Fast TSC calibration using PIT
Detected 1662.694 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 3325.38 BogoMIPS (lpj=1662694)
pid_max: default: 32768 minimum: 301
Security Framework initialized
Mount-cache hash table entries: 512
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 5 MCE banks
CPU0: Thermal monitoring enabled (TM1)
using mwait in idle threads.
Performance Events: PEBS fmt0+, Atom events, Intel PMU driver.
... version:                3
... bit width:              40
... generic registers:      2
... value mask:             000000ffffffffff
... max period:             000000007fffffff
... fixed-purpose events:   3
... event mask:             0000000700000003
ACPI: Core revision 20100702
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 31951 entries in 63 pages
Enabling APIC mode:  Flat.  Using 1 I/O APICs
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Atom(TM) CPU D510   @ 1.66GHz stepping 0a
Booting Node   0, Processors  #1
Initializing CPU#1
Brought up 2 CPUs
Total of 2 processors activated (6650.56 BogoMIPS).
devtmpfs: initialized
xor: automatically using best checksumming function: pIII_sse
   pIII_sse  :  5088.000 MB/sec
xor: using function: pIII_sse (5088.000 MB/sec)
NET: Registered protocol family 16
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000)
PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820
PCI: Using MMCONFIG for extended config space
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
raid6: int32x1    171 MB/s
raid6: int32x2    234 MB/s
raid6: int32x4    269 MB/s
raid6: int32x8    304 MB/s
raid6: mmxx1      371 MB/s
raid6: mmxx2      726 MB/s
raid6: sse1x1     304 MB/s
raid6: sse1x2     570 MB/s
raid6: sse2x1     605 MB/s
raid6: sse2x2    1128 MB/s
raid6: using algorithm sse2x2 (1128 MB/s)
ACPI: BIOS _OSI(Linux) query ignored
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S3 S4 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3f])
pci_root PNP0A03:00: host bridge window [io  0x0000-0x0cf7]
pci_root PNP0A03:00: host bridge window [io  0x0d00-0xffff]
pci_root PNP0A03:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A03:00: host bridge window [mem 0xd0000000-0xf7ffffff]
pci 0000:00:1f.0: [Firmware Bug]: TigerPoint LPC.BM_STS cleared
pci 0000:00:1c.0: PCI bridge to [bus 01-01]
pci 0000:00:1c.1: PCI bridge to [bus 02-02]
pci 0000:00:1c.2: PCI bridge to [bus 03-03]
pci 0000:00:1c.3: PCI bridge to [bus 04-04]
pci 0000:00:1e.0: PCI bridge to [bus 05-05] (subtractive decode)
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 7 9 10 *11 12)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 7 9 10 11 12) *0, disabled.
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 7 *9 10 11 12)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 7 9 10 *11 12)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 7 9 10 11 12) *0, disabled.
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 7 9 10 11 12) *0, disabled.
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 7 *9 10 11 12)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 7 9 *10 11 12)
vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
HPET: 3 timers in total, 0 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
hpet0: 3 comparators, 64-bit 14.318180 MHz counter
Switching to clocksource tsc
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 14 devices
ACPI: ACPI bus type pnp unregistered
system 00:01: [mem 0xf8000000-0xfbffffff] has been reserved
system 00:01: [mem 0xfed14000-0xfed17fff] has been reserved
system 00:01: [mem 0xfed18000-0xfed18fff] has been reserved
system 00:01: [mem 0xfed19000-0xfed19fff] has been reserved
system 00:01: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:01: [mem 0x000c0000-0x000dffff] could not be reserved
system 00:01: [mem 0x000e0000-0x000fffff] could not be reserved
system 00:01: [mem 0xfff00000-0xffffffff] has been reserved
system 00:06: [io  0x0500-0x053f] has been reserved
system 00:06: [io  0x0400-0x047f] has been reserved
system 00:06: [io  0x0680-0x06ff] has been reserved
system 00:06: [io  0x0295-0x0296] has been reserved
pci 0000:01:00.0: no compatible bridge window for [mem 0xfffe0000-0xffffffff pref]
pci 0000:00:1c.0: BAR 8: assigned [mem 0xe0300000-0xe06fffff]
pci 0000:00:1c.1: BAR 8: assigned [mem 0xe0700000-0xe08fffff]
pci 0000:00:1c.1: BAR 9: assigned [mem 0xe0900000-0xe0afffff 64bit pref]
pci 0000:00:1c.2: BAR 8: assigned [mem 0xe0b00000-0xe0cfffff]
pci 0000:00:1c.2: BAR 9: assigned [mem 0xe0d00000-0xe0efffff 64bit pref]
pci 0000:00:1c.3: BAR 8: assigned [mem 0xe0f00000-0xe10fffff]
pci 0000:00:1c.3: BAR 9: assigned [mem 0xe1100000-0xe12fffff 64bit pref]
pci 0000:00:1c.1: BAR 7: assigned [io  0x3000-0x3fff]
pci 0000:00:1c.2: BAR 7: assigned [io  0x4000-0x4fff]
pci 0000:00:1c.3: BAR 7: assigned [io  0x5000-0x5fff]
pci 0000:01:00.0: BAR 6: assigned [mem 0xe0020000-0xe003ffff pref]
pci 0000:00:1c.0: PCI bridge to [bus 01-01]
pci 0000:00:1c.0:   bridge window [io  0x1000-0x1fff]
pci 0000:00:1c.0:   bridge window [mem 0xe0300000-0xe06fffff]
pci 0000:00:1c.0:   bridge window [mem 0xe0000000-0xe00fffff 64bit pref]
pci 0000:00:1c.1: PCI bridge to [bus 02-02]
pci 0000:00:1c.1:   bridge window [io  0x3000-0x3fff]
pci 0000:00:1c.1:   bridge window [mem 0xe0700000-0xe08fffff]
pci 0000:00:1c.1:   bridge window [mem 0xe0900000-0xe0afffff 64bit pref]
pci 0000:00:1c.2: PCI bridge to [bus 03-03]
pci 0000:00:1c.2:   bridge window [io  0x4000-0x4fff]
pci 0000:00:1c.2:   bridge window [mem 0xe0b00000-0xe0cfffff]
pci 0000:00:1c.2:   bridge window [mem 0xe0d00000-0xe0efffff 64bit pref]
pci 0000:00:1c.3: PCI bridge to [bus 04-04]
pci 0000:00:1c.3:   bridge window [io  0x5000-0x5fff]
pci 0000:00:1c.3:   bridge window [mem 0xe0f00000-0xe10fffff]
pci 0000:00:1c.3:   bridge window [mem 0xe1100000-0xe12fffff 64bit pref]
pci 0000:00:1e.0: PCI bridge to [bus 05-05]
pci 0000:00:1e.0:   bridge window [io  disabled]
pci 0000:00:1e.0:   bridge window [mem disabled]
pci 0000:00:1e.0:   bridge window [mem pref disabled]
pci 0000:00:1c.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
pci 0000:00:1c.1: enabling device (0000 -> 0003)
pci 0000:00:1c.1: PCI INT B -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.2: enabling device (0000 -> 0003)
pci 0000:00:1c.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
pci 0000:00:1c.3: enabling device (0000 -> 0003)
pci 0000:00:1c.3: PCI INT D -> GSI 19 (level, low) -> IRQ 19
NET: Registered protocol family 2
IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
UDP hash table entries: 512 (order: 2, 16384 bytes)
UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
NET: Registered protocol family 1
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
audit: initializing netlink socket (disabled)
type=2000 audit(1293749929.574:1): initialized
highmem bounce pool size: 64 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
DLM (built Dec 27 2010 23:33:09) installed
Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
NTFS driver 2.1.29 [Flags: R/W].
ROMFS MTD (C) 2007 Red Hat, Inc.
JFS: nTxBlock = 8192, nTxLock = 65536
SGI XFS with ACLs, security attributes, large block/inode numbers, no debug enabled
SGI XFS Quota Management subsystem
OCFS2 1.5.0
ocfs2: Registered cluster interface o2cb
ocfs2: Registered cluster interface user
OCFS2 DLMFS 1.5.0
OCFS2 User DLM kernel interface loaded
OCFS2 Node Manager 1.5.0
OCFS2 DLM 1.5.0
Btrfs loaded
GFS2 (built Dec 27 2010 23:36:00) installed
msgmni has been set to 1692
async_tx: api initialized (async)
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254)
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
vesafb: framebuffer at 0xd0000000, mapped to 0xf8500000, using 1536k, total 8128k
vesafb: mode is 1024x768x8, linelength=1024, pages=9
vesafb: scrolling: redraw
vesafb: Pseudocolor: size=8:8:8:8, shift=0:0:0:0
Console: switching to colour frame buffer device 128x48
fb0: VESA VGA frame buffer device
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
ÿserial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:0a: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:0b: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A

aaazen · 12-31-2010, 01:39 AM

Here is part 2 of 2 of the "ioread32_rep" bug using Slackware current with a
2.6.36.2 kernel

Code:

floppy0: no floppy controllers found
brd: module loaded
loop: module loaded
Compaq SMART2 Driver (v 2.6.0)
HP CISS Driver (v 3.6.26)
Loading iSCSI transport class v2.0-870.
fnic: Cisco FCoE HBA Driver, ver 1.4.0.145
Adaptec aacraid driver 1.1-5[26400]-ms
aic94xx: Adaptec aic94xx SAS/SATA driver version 1.0.3 loaded
scsi: <fdomain> Detection failed (no card)
sym53c416.c: Version 1.0.0-ac
qlogicfas: no cards were found, please specify I/O address and IRQ using iobase= and irq= options
QLogic Fibre Channel HBA Driver: 8.03.04-k0
iscsi: registered transport (qla4xxx)
QLogic iSCSI HBA Driver
Emulex LightPulse Fibre Channel SCSI driver 8.3.16
Copyright(c) 2004-2009 Emulex.  All rights reserved.
Brocade BFA FC/FCOE SCSI driver - version: 2.2.2.1
Failed initialization of WD-7000 SCSI card!
DC390: clustering now enabled by default. If you get problems load
       with "disable_clustering=1" and report to maintainers
megaraid cmm: 2.20.2.7 (Release Date: Sun Jul 16 00:01:03 EST 2006)
megaraid: 2.20.5.1 (Release Date: Thu Nov 16 15:32:35 EST 2006)
megasas: 00.00.04.17.1-rc1 Thu. Oct. 29, 11:41:51 PST 2009
mpt2sas version 06.100.00.00 loaded
GDT-HA: Storage RAID Controller Driver. Version: 3.05
3ware Storage Controller device driver for Linux v1.26.02.003.
3ware 9000 Storage Controller device driver for Linux v2.26.02.014.
LSI 3ware SAS/SATA-RAID Controller device driver for Linux v3.26.02.000.
ipr: IBM Power RAID SCSI Device Driver version: 2.5.0 (February 11, 2010)
RocketRAID 3xxx/4xxx Controller driver v1.6 (090910)
stex: Promise SuperTrak EX Driver version: 4.6.0000.4
st: Version 20081215, fixed bufsize 32768, s/g segs 256
ata_piix 0000:00:1f.2: PCI INT B -> GSI 19 (level, low) -> IRQ 19
ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
scsi2 : ata_piix
scsi3 : ata_piix
ata1: SATA max UDMA/133 cmd 0x20b8 ctl 0x20cc bmdma 0x20a0 irq 19
ata2: SATA max UDMA/133 cmd 0x20b0 ctl 0x20c8 bmdma 0x20a8 irq 19
scsi4 : pata_legacy
ata3: PATA max PIO4 cmd 0x1f0 ctl 0x3f6 irq 14
ata1.00: ATAPI: ATAPI   iHAS324   Y, BL1W, max UDMA/100
ata2.00: ATA-8: WDC WD10EADS-00M2B0, 01.00A01, max UDMA/133
ata2.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 0/32)
ata2.00: configured for UDMA/133
ata1.00: configured for UDMA/100
scsi 2:0:0:0: CD-ROM            ATAPI    iHAS324   Y      BL1W PQ: 0 ANSI: 5
sr0: scsi3-mmc drive: 48x/48x writer dvd-ram cd/rw xa/form2 cdda tray
cdrom: Uniform CD-ROM driver Revision: 3.20
scsi 3:0:0:0: Direct-Access     ATA      WDC WD10EADS-00M 01.0 PQ: 0 ANSI: 5
sd 3:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB)
sd 3:0:0:0: [sda] Write Protect is off
sd 3:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sda: sda1 sda2 sda3 sda4 < sda5 sda6 sda7 sda8 sda9 sda10 sda11 >
 sda2: <openbsd: sda12 sda13bad subpartition - ignored
bad subpartition - ignored
bad subpartition - ignored
bad subpartition - ignored
 >
sd 3:0:0:0: [sda] Attached SCSI disk
scsi5 : pata_legacy
ata4: PATA max PIO4 cmd 0x170 ctl 0x376 irq 15
I2O subsystem v1.325
i2o: max drivers = 8
I2O Configuration OSM v1.323
I2O Bus Adapter OSM v1.317
I2O Block Device OSM v1.325
I2O SCSI Peripheral OSM v1.316
I2O ProcFS OSM v1.316
Fusion MPT base driver 3.04.17
Copyright (c) 1999-2008 LSI Corporation
Fusion MPT SPI Host driver 3.04.17
Fusion MPT FC Host driver 3.04.17
Fusion MPT SAS Host driver 3.04.17
Fusion MPT misc device (ioctl) driver 3.04.17
mptctl: Registered with Fusion MPT base driver
mptctl: /dev/mptctl @ (major,minor=10,220)
Fusion MPT LAN driver 3.04.17
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1d.7: PCI INT A -> GSI 23 (level, low) -> IRQ 23
ehci_hcd 0000:00:1d.7: EHCI Host Controller
ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1d.7: using broken periodic workaround
ehci_hcd 0000:00:1d.7: debug port 1
ehci_hcd 0000:00:1d.7: irq 23, io mem 0xe0284400
ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.36.2-smp ehci_hcd
usb usb1: SerialNumber: 0000:00:1d.7
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 8 ports detected
116x: driver isp116x-hcd, 03 Nov 2005
driver isp1362-hcd, 2005-04-04
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 23 (level, low) -> IRQ 23
uhci_hcd 0000:00:1d.0: UHCI Host Controller
uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
uhci_hcd 0000:00:1d.0: irq 23, io base 0x00002080
usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: UHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.36.2-smp uhci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 19 (level, low) -> IRQ 19
uhci_hcd 0000:00:1d.1: UHCI Host Controller
uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
uhci_hcd 0000:00:1d.1: irq 19, io base 0x00002060
usb usb3: New USB device found, idVendor=1d6b, idProduct=0001
usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb3: Product: UHCI Host Controller
usb usb3: Manufacturer: Linux 2.6.36.2-smp uhci_hcd
usb usb3: SerialNumber: 0000:00:1d.1
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 2 ports detected
uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
uhci_hcd 0000:00:1d.2: UHCI Host Controller
uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
uhci_hcd 0000:00:1d.2: irq 18, io base 0x00002040
usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb4: Product: UHCI Host Controller
usb usb4: Manufacturer: Linux 2.6.36.2-smp uhci_hcd
usb usb4: SerialNumber: 0000:00:1d.2
hub 4-0:1.0: USB hub found
hub 4-0:1.0: 2 ports detected
uhci_hcd 0000:00:1d.3: PCI INT D -> GSI 16 (level, low) -> IRQ 16
uhci_hcd 0000:00:1d.3: UHCI Host Controller
uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
uhci_hcd 0000:00:1d.3: irq 16, io base 0x00002020
usb usb5: New USB device found, idVendor=1d6b, idProduct=0001
usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb5: Product: UHCI Host Controller
usb usb5: Manufacturer: Linux 2.6.36.2-smp uhci_hcd
usb usb5: SerialNumber: 0000:00:1d.3
hub 5-0:1.0: USB hub found
hub 5-0:1.0: 2 ports detected
sl811: driver sl811-hcd, 19 May 2005
r8a66597_hcd: driver r8a66597_hcd, 2009-05-26
Initializing USB Mass Storage driver...
usbcore: registered new interface driver usb-storage
USB Mass Storage support registered.
usbcore: registered new interface driver ums-alauda
usbcore: registered new interface driver ums-cypress
usbcore: registered new interface driver ums-datafab
usbcore: registered new interface driver ums-freecom
usbcore: registered new interface driver ums-isd200
usbcore: registered new interface driver ums-jumpshot
usbcore: registered new interface driver ums-karma
usbcore: registered new interface driver ums-onetouch
usbcore: registered new interface driver ums-sddr09
usbcore: registered new interface driver ums-sddr55
usbcore: registered new interface driver ums-usbat
PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mice: PS/2 mouse device common for all mice
md: linear personality registered for level -1
md: raid0 personality registered for level 0
md: raid1 personality registered for level 1
md: raid10 personality registered for level 10
md: raid6 personality registered for level 6
input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
md: raid5 personality registered for level 5
md: raid4 personality registered for level 4
md: multipath personality registered for level -4
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.18.0-ioctl (2010-06-29) initialised: dm-devel@redhat.com
cpuidle: using governor ladder
cpuidle: using governor menu
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
Registering the dns_resolver key type
Using IPI No-Shortcut mode
registered taskstats version 1
md: Waiting for all devices to be available before autodetect
md: If you don't use raid, use raid=noautodetect
md: Autodetecting RAID arrays.
md: Scanned 0 and added 0 devices.
md: autorun ...
md: ... autorun DONE.
UDF-fs: No partition found (1)
VFS: Mounted root (jfs filesystem) readonly on device 8:5.
devtmpfs: mounted
Freeing unused kernel memory: 592k freed
Write protecting the kernel text: 9792k
Write protecting the kernel read-only data: 2480k
udev[1120]: starting version 165
shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
sr 2:0:0:0: Attached scsi generic sg0 type 5
sd 3:0:0:0: Attached scsi generic sg1 type 0
Linux agpgart interface v0.103
input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input1
agpgart-intel 0000:00:00.0: Intel GMA3150 Chipset
agpgart-intel 0000:00:00.0: detected 7676K stolen memory
ACPI: Sleep Button [SLPB]
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2
ACPI: Power Button [PWRF]
agpgart-intel 0000:00:00.0: AGP aperture is 256M @ 0xd0000000
i801_smbus 0000:00:1f.3: PCI INT B -> GSI 19 (level, low) -> IRQ 19
parport_pc 00:09: reported by Plug and Play ACPI
parport0: PC-style at 0x378, irq 7 [PCSPP]
r8169 Gigabit Ethernet driver 2.3LK-NAPI loaded
r8169 0000:01:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
r8169 0000:01:00.0: eth0: RTL8168d/8111d at 0xf87f8000, 70:71:bc:18:2a:0b, XID 081000c0 IRQ 40
BUG: unable to handle kernel paging request at fffb2000
IP: [<c14c4bd8>] ioread32_rep+0x38/0x50
*pde = 01d34067 *pte = 00000000 
Oops: 0002 [#1] SMP 
last sysfs file: /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A03:00/device:00/PNP0400:00/uevent
Modules linked in: rtc_core r8169(+) mii thermal_sys parport_pc snd_pcm i2c_i801 snd_timer parport rtc_lib intel_agp button hwmon snd i2c_core evdev psmouse sg serio_raw output soundcore agpgart shpchp snd_page_alloc

Pid: 1179, comm: modprobe Not tainted 2.6.36.2-smp #1 D510MO/        
EIP: 0060:[<c14c4bd8>] EFLAGS: 00010006 CPU: 0
EIP is at ioread32_rep+0x38/0x50
EAX: 000020b8 EBX: 00000200 ECX: 00000071 EDX: 000020b8
ESI: fffb1fc4 EDI: fffb2000 EBP: f6badb6c ESP: f6badb68
 DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
Process modprobe (pid: 1179, ti=f6bac000 task=f68e5550 task.ti=f6bac000)
Stack:
 000120b8 f6badb90 c17a6b21 f6ba9e3c 00000000 f69380bc 00000000 f69380bc
<0> 00000000 c1c69b40 f6badbc0 c17a6917 00000000 c37e0100 f6938000 c1c69b40
<0> fffb1000 00000046 c3c072c0 f69380bc f6938000 00000058 f6badbd0 c17a69b9
Call Trace:
 [<c17a6b21>] ? ata_sff_data_xfer32+0x61/0x110
 [<c17a6917>] ? ata_pio_sector+0x127/0x160
 [<c17a69b9>] ? ata_pio_sectors+0x69/0xa0
 [<c17a765a>] ? ata_sff_hsm_move+0x19a/0x760
 [<c17a7e0e>] ? __ata_sff_port_intr+0x9e/0x100
 [<c17a7e9e>] ? ata_bmdma_port_intr+0x2e/0x100
 [<c17a63f0>] ? ata_bmdma_error_handler+0x0/0x120
 [<c17a86bd>] ? ata_bmdma_interrupt+0xcd/0x1d0
 [<c104b4d7>] ? run_timer_softirq+0x37/0x2c0
 [<c10862d4>] ? handle_IRQ_event+0x44/0x150
 [<c1088483>] ? handle_fasteoi_irq+0x63/0xd0
 [<c10055cd>] ? handle_irq+0x1d/0x30
 [<c198f00c>] ? do_IRQ+0x4c/0xc0
 [<c1003570>] ? common_interrupt+0x30/0x38
 [<c14c0f48>] ? strcmp+0x18/0x40
 [<c106ffc0>] ? find_symbol_in_section+0x30/0xe0
 [<c10706bc>] ? each_symbol_in_section.clone.37+0x4c/0x80
 [<c106ff90>] ? find_symbol_in_section+0x0/0xe0
 [<c1070de5>] ? each_symbol+0x25/0x160
 [<c106ff90>] ? find_symbol_in_section+0x0/0xe0
 [<c198c08e>] ? schedule+0x22e/0x880
 [<c1070f4d>] ? find_symbol+0x2d/0x60
 [<c198d079>] ? mutex_lock+0x19/0x40
 [<c1071758>] ? resolve_symbol.clone.34+0x48/0xa0
 [<c107183c>] ? simplify_symbols+0x8c/0x2c0
 [<c10d2d1d>] ? __vmalloc_area_node+0xbd/0x110
 [<c1072a6b>] ? sys_init_module+0xcdb/0x18e0
 [<c198e74c>] ? syscall_call+0x7/0xb
Code: 01 78 0f 8b 38 83 e9 01 89 3a 83 c2 04 83 f9 ff 75 f1 5f 5d c3 8d b6 00 00 00 00 3d 00 00 01 00 76 11 25 ff ff 00 00 89 d7 89 c2 <f3> 6d 5f 5d c3 8d 76 00 ba 0e a4 b2 c1 e8 36 fe ff ff 5f 5d c3 
EIP: [<c14c4bd8>] ioread32_rep+0x38/0x50 SS:ESP 0068:f6badb68
CR2: 00000000fffb2000
---[ end trace f00610a302d74e4f ]---
Kernel panic - not syncing: Fatal exception in interrupt
Pid: 1179, comm: modprobe Tainted: G      D     2.6.36.2-smp #1
Call Trace:
 [<c198bcac>] ? printk+0x1d/0x1f
 [<c198bb9e>] panic+0x5c/0x14d
 [<c10068ef>] oops_end+0x8f/0x90
 [<c10252dc>] no_context+0xbc/0x150
 [<c10253f5>] __bad_area_nosemaphore+0x85/0x130
 [<c106071b>] ? sched_clock_local+0xdb/0x1d0
 [<c1025730>] ? do_page_fault+0x0/0x3a0
 [<c10254b7>] bad_area_nosemaphore+0x17/0x20
 [<c1025a31>] do_page_fault+0x301/0x3a0
 [<c102fcb3>] ? hrtick_update+0x53/0x60
 [<c1032bdd>] ? enqueue_task_fair+0x14d/0x180
 [<c1025730>] ? do_page_fault+0x0/0x3a0
 [<c198edff>] error_code+0x67/0x6c
 [<c14c4bd8>] ? ioread32_rep+0x38/0x50
 [<c17a6b21>] ata_sff_data_xfer32+0x61/0x110
 [<c17a6917>] ata_pio_sector+0x127/0x160
 [<c17a69b9>] ata_pio_sectors+0x69/0xa0
 [<c17a765a>] ata_sff_hsm_move+0x19a/0x760
 [<c17a7e0e>] __ata_sff_port_intr+0x9e/0x100
 [<c17a7e9e>] ata_bmdma_port_intr+0x2e/0x100
 [<c17a63f0>] ? ata_bmdma_error_handler+0x0/0x120
 [<c17a86bd>] ata_bmdma_interrupt+0xcd/0x1d0
 [<c104b4d7>] ? run_timer_softirq+0x37/0x2c0
 [<c10862d4>] handle_IRQ_event+0x44/0x150
 [<c1088483>] handle_fasteoi_irq+0x63/0xd0
 [<c10055cd>] handle_irq+0x1d/0x30
 [<c198f00c>] do_IRQ+0x4c/0xc0
 [<c1003570>] common_interrupt+0x30/0x38
 [<c14c0f48>] ? strcmp+0x18/0x40
 [<c106ffc0>] find_symbol_in_section+0x30/0xe0
 [<c10706bc>] each_symbol_in_section.clone.37+0x4c/0x80
 [<c106ff90>] ? find_symbol_in_section+0x0/0xe0
 [<c1070de5>] each_symbol+0x25/0x160
 [<c106ff90>] ? find_symbol_in_section+0x0/0xe0
 [<c198c08e>] ? schedule+0x22e/0x880
 [<c1070f4d>] find_symbol+0x2d/0x60
 [<c198d079>] ? mutex_lock+0x19/0x40
 [<c1071758>] resolve_symbol.clone.34+0x48/0xa0
 [<c107183c>] simplify_symbols+0x8c/0x2c0
 [<c10d2d1d>] ? __vmalloc_area_node+0xbd/0x110
 [<c1072a6b>] sys_init_module+0xcdb/0x18e0
 [<c198e74c>] syscall_call+0x7/0xb

aaazen · 12-31-2010, 01:54 AM

For completeness, what do I mean by create my own 2.6.36.2 kernel?

I copied the huge smp configuration from the Slackware current 2.6.35.7 kernel and
used "make oldconfig" and answered every new question with "hit enter", the default.

Attached is my kernel configuration.

(I would have embedded it here but there is a 30k limit on embedding text and the
configuration is over 100k...)

resonance · 12-31-2010, 12:33 PM

Hi all,
I build my own systems gnu/Linux i686, and am now using Linux-2.6.36.2 with Upstart-0.6.7. Up to 2010.12.24, I had udev-164 installed w/no issues. I then upgraded to udev-165 and am seeing similar boot-time kernel panics in udev. It does appear to be a timing/race issue since (1) it doesn't happen on every boot, or on every pc, and by making small changes to the related Upstart conf scripts (eg, adding a 'sleep 1' after loading udevd) I can alter the frequency of occurrence and even which program generates the panic.

Reverting back to udev-164, no issues. Applying a patch based on post #12 appears to work as well. So, in response to post #20, Linux-2.6.36.2 suffers from the issue, and I have also built and installed Linux-2.6.37-rc7, which also suffers from the issue.

On my systems, while the problem most often occurs in udevd at boot, it has also occurred in udevadm, in modprobe, and in fsck (all at early boot time in Upstart conf scripts), so I suspect the Kernel to be at fault.

aaazen · 01-01-2011, 09:54 AM

I have another problem with the 3.6.36.2 kernel.

In the startup dmesg, my PS/2 mouse usually appears like this when it is working:

Code:

input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3

But sometimes it does not work and then it appears like this:

Code:

input: AT Raw Set 2 keyboard as /devices/platform/i8042/serio1/input/input3

Does anyone else have problems like with hardware recognition with mice or other devices?

Old_Fogie · 01-02-2011, 09:51 AM

Thanks for all the bug hunting on this

Does anyone have any recommendations to log/save the boot up messages, a procedure or app?

aaazen · 01-02-2011, 02:07 PM

First of all I want to mention that I still get the same "ioread32_rep" problem with the 2.6.35.10 kernel built using the 2.6.35.7 current Slackware configuration...

Old_Fogie wrote:

Quote:

Thanks for all the bug hunting on this Does anyone have any recommendations to log/save the boot up messages, a procedure or app?

There is a document about this that comes with the kernel:

Documentation/oops-tracing.txt

I took their advice about using another machine running minicom to capture the
console log on startup:

Quote:

(2) Boot with a serial console (see Documentation/serial-console.txt),
run a null modem to a second machine and capture the output there
using your favourite communication program. Minicom works well.

The Documentation/serial-console.txt recommends using the "console" kernel option to setup the serial port on startup.

My lilo.conf looks like this:

image = /boot/vmlinuz
root = /dev/sda5
label = linux-a5
read-only # Partitions should be mounted read-only for checking
append="console=ttyS0,38400 console=tty0"

The traditional baud rate for Linux is 38400 so I use that instead of 9600 which is traditional for BSD systems.

On mincom the line is configured with 38400 baud and no hardware flow control and no software flow control.

I also like to blank out the "modem init strings", etc as they are not needed.

For serial cable hardware, most systems have either a 9-pin or a 25-pin male connector on the back of the box.

The easiest cable is a "null modem" cable which come in a variety of 25-pin and 9-pin combinations, just make sure that both ends of the cable are "female". (if both of the boxes have "male" serial connectors...)

Another handy item is a serial loopback tester.

These typically have a female connector and plug right into the male connector on the back of the box.

When you run minicom, everything you type is automatically "echoed" back. (If the hardware/software is set up correctly.)

A nicer version of the loopback tester has a "male" connector. Then you plug in the female-female cable to the back of the box and put the male tester at the end of the cable. Then both the cable and the serial port are tested.

rworkman · 01-02-2011, 03:55 PM

bootlogd might do it.

hitest · 01-02-2011, 06:09 PM

Last crash, snapped a picture.