Basically what happened was when rtorrent tried to move data from my home directory, jfs, to a partition that contains all media files, xfs, it froze the entire system. Even if I didn't have X running, I could switch to another virtual console and I couldn't do anything with the current console.
Here's kernel.log:
Code:
Mar 16 03:42:10 lucilla kernel: CPU 1
Mar 16 03:42:10 lucilla kernel: Modules linked in: xfs jfs aes_x86_64 aes_generic lrw gf128mul psmouse analog ohci1394 lp k8temp pcspkr ieee1394 ppdev serio_raw gameport usb_storage sg i2c_nforce2 parport_pc parport thermal processor fan button battery ac vboxdrv usblp nvidia(P) i2c_core fuse snd_ice1724 snd_ice17xx_ak4xxx snd_ac97_codec snd_pt2258 snd_i2c snd_ak4xxx_adda snd_ak4114 snd_mpu401 snd_mpu401_uart snd_rawmidi snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd soundcore ac97_bus slhc sky2 joydev evdev hid_microsoft usbhid hid forcedeth rtc_cmos rtc_core rtc_lib ext3 jbd mbcache dm_crypt dm_mod ohci_hcd ehci_hcd sd_mod usbcore sr_mod cdrom sata_sil24 sata_nv ata_generic pata_amd pata_acpi libata scsi_mod
Mar 16 03:42:10 lucilla kernel: Pid: 896, comm: xfs_fsr Tainted: P 2.6.28-ARCH #1
Mar 16 03:42:10 lucilla kernel: RIP: 0010:[<ffffffff80346575>] [<ffffffff80346575>] radix_tree_insert+0x25/0x1f0
Mar 16 03:42:10 lucilla kernel: RSP: 0018:ffff880058537828 EFLAGS: 00010046
Mar 16 03:42:10 lucilla kernel: RAX: 000000008032f0e0 RBX: 000000008032f0e0 RCX: 0000000000000000
Mar 16 03:42:10 lucilla kernel: RDX: 0000000000000000 RSI: ffff88007f9f9a00 RDI: ffff88007ebdb720
Mar 16 03:42:10 lucilla kernel: RBP: ffff880058566348 R08: 0000000000000000 R09: ffff880058566348
Mar 16 03:42:10 lucilla kernel: R10: 0000000100013ba7 R11: ffffffff8033deb0 R12: ffff8800585663b0
Mar 16 03:42:10 lucilla kernel: R13: ffff88007f9f9a00 R14: ffff88007ebdb720 R15: ffff88007f9f9a00
Mar 16 03:42:10 lucilla kernel: FS: 00007ff336cb26f0(0000) GS:ffff88007f805800(0000) knlGS:0000000000000000
Mar 16 03:42:10 lucilla kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 16 03:42:10 lucilla kernel: CR2: 0000000381f60ac0 CR3: 0000000058590000 CR4: 00000000000006e0
Mar 16 03:42:10 lucilla kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 16 03:42:10 lucilla kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 16 03:42:10 lucilla kernel: Process xfs_fsr (pid: 896, threadinfo ffff880058536000, task ffff880062a3ef60)
Mar 16 03:42:10 lucilla kernel: Stack:
Mar 16 03:42:10 lucilla kernel: ffff880058566348 ffff88007ebdb6f8 ffff880058566348 ffff8800585663b0
Mar 16 03:42:10 lucilla kernel: ffff88007f9f9a00 ffff88007ebdb700 ffff88005863cb80 ffffffff8033e1a8
Mar 16 03:42:10 lucilla kernel: 0000001058537898 ffff88007e418000 00000000000c0001 ffffffff8033d7f8
Mar 16 03:42:10 lucilla kernel: Call Trace:
Mar 16 03:42:10 lucilla kernel: [<ffffffff8033e1a8>] ? cfq_set_request+0x2f8/0x400
Mar 16 03:42:10 lucilla kernel: [<ffffffff8033d7f8>] ? cfq_cic_lookup+0x68/0x1c0
Mar 16 03:42:10 lucilla kernel: [<ffffffff8033125f>] ? get_request+0x36f/0x410
Mar 16 03:42:10 lucilla kernel: [<ffffffff80331321>] ? get_request_wait+0x21/0x1b0
Mar 16 03:42:10 lucilla kernel: [<ffffffffa00de554>] ? __split_bio+0x164/0x550 [dm_mod]
Mar 16 03:42:10 lucilla kernel: [<ffffffff8033153f>] ? __make_request+0x8f/0x4d0
Mar 16 03:42:10 lucilla kernel: [<ffffffff8048830e>] ? _spin_lock_irqsave+0x3e/0x50
Mar 16 03:42:10 lucilla kernel: [<ffffffff8032fae7>] ? generic_make_request+0x337/0x450
Mar 16 03:42:10 lucilla kernel: [<ffffffffa00de2a9>] ? dm_get_table+0x39/0x50 [dm_mod]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa00df33c>] ? dm_merge_bvec+0xbc/0x120 [dm_mod]
Mar 16 03:42:10 lucilla kernel: [<ffffffff8032fc96>] ? submit_bio+0x96/0x130
Mar 16 03:42:10 lucilla kernel: [<ffffffff802273f5>] ? default_spin_lock_flags+0x5/0x10
Mar 16 03:42:10 lucilla kernel: [<ffffffff8048830e>] ? _spin_lock_irqsave+0x3e/0x50
Mar 16 03:42:10 lucilla kernel: [<ffffffff802dd42a>] ? dio_bio_submit+0x5a/0x90
Mar 16 03:42:10 lucilla kernel: [<ffffffff802dd4d0>] ? dio_send_cur_page+0x70/0xc0
Mar 16 03:42:10 lucilla kernel: [<ffffffff802dd586>] ? submit_page_section+0x66/0x160
Mar 16 03:42:10 lucilla kernel: [<ffffffff802ddfad>] ? __blockdev_direct_IO+0x77d/0xbf0
Mar 16 03:42:10 lucilla kernel: [<ffffffff80488b7a>] ? error_exit+0x0/0x70
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d8908d>] ? xfs_vm_direct_IO+0x11d/0x140 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d89450>] ? xfs_get_blocks_direct+0x0/0x20 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d891c0>] ? xfs_end_io_direct+0x0/0x70 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffff80280e45>] ? generic_file_direct_write+0xc5/0x230
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d91c47>] ? xfs_write+0x447/0x950 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d65d9c>] ? xfs_iunlock+0x9c/0xd0 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d925cf>] ? xfs_read+0x15f/0x290 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffff802b16e3>] ? do_sync_write+0xe3/0x130
Mar 16 03:42:10 lucilla kernel: [<ffffffff80257350>] ? autoremove_wake_function+0x0/0x30
Mar 16 03:42:10 lucilla kernel: [<ffffffff804887c5>] ? _spin_unlock+0x5/0x30
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d8d840>] ? xfs_file_ioctl+0x60/0x80 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffff802c02ef>] ? vfs_ioctl+0x2f/0xb0
Mar 16 03:42:10 lucilla kernel: [<ffffffff802b21fb>] ? vfs_write+0xcb/0x190
Mar 16 03:42:10 lucilla kernel: [<ffffffff802b23c3>] ? sys_write+0x53/0xa0
Mar 16 03:42:10 lucilla kernel: [<ffffffff8020c50a>] ? system_call_fastpath+0x16/0x1b
Mar 16 03:42:10 lucilla kernel: Code: 84 00 00 00 00 00 41 57 49 89 f7 41 56 49 89 fe 41 55 41 54 55 53 48 83 ec 08 48 89 14 24 83 e2 01 0f 85 b7 01 00 00 8b 1f 89 d8 <48> 3b 34 c5 c0 83 5e 80 77 71 49 8b 4e 08 31 d2 45 31 e4 48 83
Mar 16 03:42:10 lucilla kernel: RIP [<ffffffff80346575>] radix_tree_insert+0x25/0x1f0
Mar 16 03:42:10 lucilla kernel: RSP <ffff880058537828>
Mar 16 03:42:10 lucilla kernel: CR2: 0000000381f60ac0
Mar 16 03:42:10 lucilla kernel: ---[ end trace 10296798ca193fb6 ]---
Mar 16 03:42:10 lucilla kernel: note: xfs_fsr[896] exited with preempt_count 2
Mar 16 03:42:10 lucilla kernel: BUG: scheduling while atomic: xfs_fsr/896/0x00000003
Mar 16 03:42:10 lucilla kernel: Modules linked in: xfs jfs aes_x86_64 aes_generic lrw gf128mul psmouse analog ohci1394 lp k8temp pcspkr ieee1394 ppdev serio_raw gameport usb_storage sg i2c_nforce2 parport_pc parport thermal processor fan button battery ac vboxdrv usblp nvidia(P) i2c_core fuse snd_ice1724 snd_ice17xx_ak4xxx snd_ac97_codec snd_pt2258 snd_i2c snd_ak4xxx_adda snd_ak4114 snd_mpu401 snd_mpu401_uart snd_rawmidi snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd soundcore ac97_bus slhc sky2 joydev evdev hid_microsoft usbhid hid forcedeth rtc_cmos rtc_core rtc_lib ext3 jbd mbcache dm_crypt dm_mod ohci_hcd ehci_hcd sd_mod usbcore sr_mod cdrom sata_sil24 sata_nv ata_generic pata_amd pata_acpi libata scsi_mod
Mar 16 03:42:10 lucilla kernel: Pid: 896, comm: xfs_fsr Tainted: P D 2.6.28-ARCH #1
Mar 16 03:42:10 lucilla kernel: Call Trace:
Mar 16 03:42:10 lucilla kernel: [<ffffffff80485c40>] thread_return+0x107/0x517
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d8875c>] kmem_zone_alloc+0x8c/0xd0 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffff804881a5>] __down_write_nested+0x85/0xc0
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d65f5c>] xfs_ilock+0x9c/0xa0 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d864ea>] xfs_inactive+0x31a/0x4e0 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d92c77>] xfs_fs_clear_inode+0xc7/0x120 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffff802c6cbe>] clear_inode+0x5e/0x110
Mar 16 03:42:10 lucilla kernel: [<ffffffff802c73f6>] generic_delete_inode+0x156/0x170
Mar 16 03:42:10 lucilla kernel: [<ffffffff802c32fc>] d_kill+0x3c/0x70
Mar 16 03:42:10 lucilla kernel: [<ffffffff802c3ba5>] dput+0x95/0x180
Mar 16 03:42:10 lucilla kernel: [<ffffffff802b2df7>] __fput+0x147/0x200
Mar 16 03:42:10 lucilla kernel: [<ffffffff802af54b>] filp_close+0x5b/0x90
Mar 16 03:42:10 lucilla kernel: [<ffffffff80241cb6>] put_files_struct+0x76/0xe0
Mar 16 03:42:10 lucilla kernel: [<ffffffff80243e14>] do_exit+0x774/0x910
Mar 16 03:42:10 lucilla kernel: [<ffffffff8021072f>] show_registers+0x2bf/0x2d0
Mar 16 03:42:10 lucilla kernel: [<ffffffff8020fd42>] oops_end+0xc2/0xd0
Mar 16 03:42:10 lucilla kernel: [<ffffffff8022c22c>] do_page_fault+0x26c/0xbd0
Mar 16 03:42:10 lucilla kernel: [<ffffffff80485b76>] thread_return+0x3d/0x517
Mar 16 03:42:10 lucilla kernel: [<ffffffff8032fae7>] generic_make_request+0x337/0x450
Mar 16 03:42:10 lucilla kernel: [<ffffffff80282125>] mempool_alloc+0x55/0x130
Mar 16 03:42:10 lucilla kernel: [<ffffffffa00de2a9>] dm_get_table+0x39/0x50 [dm_mod]
Mar 16 03:42:10 lucilla kernel: [<ffffffff8048636d>] schedule_timeout+0x8d/0xd0
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d670b1>] xfs_iext_bno_to_ext+0x91/0x180 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffff802acf50>] __slab_alloc+0xc0/0x780
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d484f0>] xfs_bmap_search_multi_extents+0xb0/0x120 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffff80283e98>] __rmqueue_smallest+0x108/0x1b0
Mar 16 03:42:10 lucilla kernel: [<ffffffff80283f70>] __rmqueue+0x30/0x2b0
Mar 16 03:42:10 lucilla kernel: [<ffffffff804887c5>] _spin_unlock+0x5/0x30
Mar 16 03:42:10 lucilla kernel: [<ffffffff8028428a>] rmqueue_bulk+0x9a/0xb0
Mar 16 03:42:10 lucilla kernel: [<ffffffff80488b7a>] error_exit+0x0/0x70
Mar 16 03:42:10 lucilla kernel: [<ffffffff8033deb0>] cfq_set_request+0x0/0x400
Mar 16 03:42:10 lucilla kernel: [<ffffffff80346575>] radix_tree_insert+0x25/0x1f0
Mar 16 03:42:10 lucilla kernel: [<ffffffff802ad9fb>] kmem_cache_alloc+0x8b/0xe0
Mar 16 03:42:10 lucilla kernel: [<ffffffff8033e1a8>] cfq_set_request+0x2f8/0x400
Mar 16 03:42:10 lucilla kernel: [<ffffffff8033d7f8>] cfq_cic_lookup+0x68/0x1c0
Mar 16 03:42:10 lucilla kernel: [<ffffffff8033125f>] get_request+0x36f/0x410
Mar 16 03:42:10 lucilla kernel: [<ffffffff80331321>] get_request_wait+0x21/0x1b0
Mar 16 03:42:10 lucilla kernel: [<ffffffffa00de554>] __split_bio+0x164/0x550 [dm_mod]
Mar 16 03:42:10 lucilla kernel: [<ffffffff8033153f>] __make_request+0x8f/0x4d0
Mar 16 03:42:10 lucilla kernel: [<ffffffff8048830e>] _spin_lock_irqsave+0x3e/0x50
Mar 16 03:42:10 lucilla kernel: [<ffffffff8032fae7>] generic_make_request+0x337/0x450
Mar 16 03:42:10 lucilla kernel: [<ffffffffa00de2a9>] dm_get_table+0x39/0x50 [dm_mod]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa00df33c>] dm_merge_bvec+0xbc/0x120 [dm_mod]
Mar 16 03:42:10 lucilla kernel: [<ffffffff8032fc96>] submit_bio+0x96/0x130
Mar 16 03:42:10 lucilla kernel: [<ffffffff802273f5>] default_spin_lock_flags+0x5/0x10
Mar 16 03:42:10 lucilla kernel: [<ffffffff8048830e>] _spin_lock_irqsave+0x3e/0x50
Mar 16 03:42:10 lucilla kernel: [<ffffffff802dd42a>] dio_bio_submit+0x5a/0x90
Mar 16 03:42:10 lucilla kernel: [<ffffffff802dd4d0>] dio_send_cur_page+0x70/0xc0
Mar 16 03:42:10 lucilla kernel: [<ffffffff802dd586>] submit_page_section+0x66/0x160
Mar 16 03:42:10 lucilla kernel: [<ffffffff802ddfad>] __blockdev_direct_IO+0x77d/0xbf0
Mar 16 03:42:10 lucilla kernel: [<ffffffff80488b7a>] error_exit+0x0/0x70
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d8908d>] xfs_vm_direct_IO+0x11d/0x140 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d89450>] xfs_get_blocks_direct+0x0/0x20 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d891c0>] xfs_end_io_direct+0x0/0x70 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffff80280e45>] generic_file_direct_write+0xc5/0x230
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d91c47>] xfs_write+0x447/0x950 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d65d9c>] xfs_iunlock+0x9c/0xd0 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d925cf>] xfs_read+0x15f/0x290 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffff802b16e3>] do_sync_write+0xe3/0x130
Mar 16 03:42:10 lucilla kernel: [<ffffffff80257350>] autoremove_wake_function+0x0/0x30
Mar 16 03:42:10 lucilla kernel: [<ffffffff804887c5>] _spin_unlock+0x5/0x30
Mar 16 03:42:10 lucilla kernel: [<ffffffffa0d8d840>] xfs_file_ioctl+0x60/0x80 [xfs]
Mar 16 03:42:10 lucilla kernel: [<ffffffff802c02ef>] vfs_ioctl+0x2f/0xb0
Mar 16 03:42:10 lucilla kernel: [<ffffffff802b21fb>] vfs_write+0xcb/0x190
Mar 16 03:42:10 lucilla kernel: [<ffffffff802b23c3>] sys_write+0x53/0xa0
Mar 16 03:42:10 lucilla kernel: [<ffffffff8020c50a>] system_call_fastpath+0x16/0x1b
I'm guessing it's not my hardware, although I may be wrong. Here's how I tested it.
It's two hard drives in lvm2, moving data from /home (jfs) to /data (xfs). hda is 1 TB and hdb is 750 GB. Unless lvm2 leaves some room for expansion after each logical volume, if I extend /home, it should use hdb, since hda should be full. So I just copied a large file until /home was filled. I didn't encounter the crash.
The crash occurs only after I move somewhat large data (178MB crashed, but a few bytes didn't) to the xfs partition, which is definitely on both hard drives:
Code:
$ df -h
Filesystem Size Used Avail Use% Mounted On
/dev/mapper/vga1-data 1.5T 1.5T 79G 95% /data
Of course I would be wrong if lvm2 does indeed provide some room for expansion after each logical volume, in which if I extended /home, it would still be on hda.
---
Edit---
When recreating the crash, I couldn't even switch to a different virtual console.
