A pattern of md5sum failures with Lenovo R61 w/x86_64 kernels...

vulariter · 06-29-2009, 11:12 PM

Well... I just wrote a really long and friendly thread about this... However, thanks to the wonderful world wide web's karma engine, my thorough write-up on my problem has escaped to the ether.

Why are the md5sum's of copied-with-certain-live-cds files are failing on my laptop? I have found that this is not a problem with x86 live cds (for recent most live cds), nor is it a problem with the Ubuntu 7.10 x86_64 live cd (but I'm not sure why).

Any help is greatly appreciated. It seems at this point that many of the x86_64 kernels aren't handling my platform correctly, and thus file are being corrupted, as they are written to disk (and in some cases, temporary or "RAM" disk).

Thanks,
vulariter

P.S. More log output and information is available to those who request it.

Here's the down-low:

I've tested the following kernels (ignore the "odd" and ".log" tags), with mostly x86 success, and predominate x86_64 failure:

4.0K odd-i686-2.4.20-8BOOT.log
28K odd-i686-2.6.18-8.el5.log
28K odd-i686-2.6.18-92.el5.log
88K odd-i686-2.6.22.09-fd10.log
124K odd-i686-2.6.27.24-alt121.log
128K odd-i686-2.6.29.04-std121.log
28K odd-i686-2.6.29.4-167.fc11.i586.log
16K odd-i686-2.6.9-1.667.log
88K odd-x86_64-2.6.22.09-fd10-amd64.log
92K odd-x86_64-2.6.22-14-generic.log
128K odd-x86_64-2.6.27.24-alt121-amd64.log
28K odd-x86_64-2.6.29.4-167.fc11.x86_64.log
172K odd-x86_64-2.6.29-gentoo-r5.log
172K odd-x86_64-2.6.29-gentoo-r5.log.edited

Off the top of my head, that list up there includes the following live CD's:

Fedora 11 (x86 and x86_64)
CentOS 5.0 (x86)
CentOS 5.2 (x86)
Red Hat (not EL, obviously) 9 (x86)
System Rescue (both 32/64 kernels, where bootable) 0.4.1, 1.2.1
Gentoo Live x86_64 (2008/2009'ish)
Gentoo Minimal (2008.0 and "latest", both amd64 and x86)
Ubuntu 7.10 (x86_64)

Here is the script I'm using to do the x86_64 file moving checksum testing on my Lenovo ThinkPad R61i C2D T8100 2.1GHz laptop:

++ BEGIN SCRIPT ++
root@ubuntu:/mnt/backup# cat test.bash
#!/bin/sh

date

uname -a

file /bin/cp

free -m

lspci

lsmod

x86info

fdisk -l

mkdir -p /mnt/satahd

mount /dev/sda5 /mnt/satahd

df -kh

mount

dmesg

cat /var/log/messages

md5sum /mnt/backup/stage3-amd64-20090625.tar.bz2

md5sum /mnt/backup/stage3-amd64-20090625.tar.bz2

cp -af /mnt/backup/stage3-amd64-20090625.tar.bz2 /mnt/backup/copy

md5sum /mnt/backup/copy/stage3-amd64-20090625.tar.bz2

md5sum /mnt/backup/copy/stage3-amd64-20090625.tar.bz2

rsync --archive --checksum /mnt/backup/stage3-amd64-20090625.tar.bz2 /tmp

md5sum /tmp/stage3-amd64-20090625.tar.bz2

md5sum /tmp/stage3-amd64-20090625.tar.bz2

cp -af /mnt/backup/stage3-amd64-20090625.tar.bz2 /tmp

md5sum /tmp/stage3-amd64-20090625.tar.bz2

md5sum /tmp/stage3-amd64-20090625.tar.bz2

cp -af /mnt/backup/stage3-amd64-20090625.tar.bz2 /mnt/satahd

md5sum /mnt/satahd/stage3-amd64-20090625.tar.bz2

md5sum /mnt/satahd/stage3-amd64-20090625.tar.bz2

cp -af /mnt/backup/stage3-amd64-20090625.tar.bz2 /mnt/satahd

md5sum /mnt/satahd/stage3-amd64-20090625.tar.bz2

md5sum /mnt/satahd/stage3-amd64-20090625.tar.bz2

cp -af /mnt/satahd/stage3-amd64-20090625.tar.bz2 /tmp

md5sum /tmp/stage3-amd64-20090625.tar.bz2

md5sum /tmp/stage3-amd64-20090625.tar.bz2

cp -af /tmp/stage3-amd64-20090625.tar.bz2 /mnt/satahd

md5sum /mnt/satahd/stage3-amd64-20090625.tar.bz2

md5sum /mnt/satahd/stage3-amd64-20090625.tar.bz2

file /mnt/backup/stage3-amd64-20090625.tar.bz2

file /tmp/stage3-amd64-20090625.tar.bz2

file /mnt/satahd/stage3-amd64-20090625.tar.bz2

md5sum /mnt/backup/stage3-amd64-20090625.tar.bz2

exit 0

++ END SCRIPT ++

In lieu of a verbose description of the problem's preceding events, here are some logs that tell the story...

Here is the output of that script, using the the following ISO:

http://distfiles.gentoo.org/releases...l-20090625.iso

++ BEGIN LOG ++

+ date
Mon Jun 29 20:49:55 UTC 2009
+ uname -a
Linux livecd 2.6.29-gentoo-r5 #1 SMP Thu Jun 25 12:32:17 UTC 2009 x86_64 Intel(R) Core(TM)2 Duo CPU T8100 @ 2.10GHz GenuineIntel GNU/Linux
+ file /bin/cp
/mnt/backup/test.bash: line 7: file: command not found
+ free -m
total used free shared buffers cached
Mem: 3939 172 3767 0 14 101
-/+ buffers/cache: 56 3883
Swap: 0 0 0
+ lspci
00:00.0 Host bridge: Intel Corporation Mobile PM965/GM965/GL960 Memory Controller Hub (rev 0c)
00:02.0 VGA compatible controller: Intel Corporation Mobile GM965/GL960 Integrated Graphics Controller (rev 0c)
00:02.1 Display controller: Intel Corporation Mobile GM965/GL960 Integrated Graphics Controller (rev 0c)
00:1a.0 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #4 (rev 03)
00:1a.1 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #5 (rev 03)
00:1a.7 USB Controller: Intel Corporation 82801H (ICH8 Family) USB2 EHCI Controller #2 (rev 03)
00:1b.0 Audio device: Intel Corporation 82801H (ICH8 Family) HD Audio Controller (rev 03)
00:1c.0 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 1 (rev 03)
00:1c.1 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 2 (rev 03)
00:1c.2 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 3 (rev 03)
00:1c.3 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 4 (rev 03)
00:1c.4 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 5 (rev 03)
00:1d.0 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #1 (rev 03)
00:1d.1 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #2 (rev 03)
00:1d.2 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #3 (rev 03)
00:1d.7 USB Controller: Intel Corporation 82801H (ICH8 Family) USB2 EHCI Controller #1 (rev 03)
00:1e.0 PCI bridge: Intel Corporation 82801 Mobile PCI Bridge (rev f3)
00:1f.0 ISA bridge: Intel Corporation 82801HEM (ICH8M) LPC Interface Controller (rev 03)
00:1f.1 IDE interface: Intel Corporation 82801HBM/HEM (ICH8M/ICH8M-E) IDE Controller (rev 03)
00:1f.2 SATA controller: Intel Corporation 82801HBM/HEM (ICH8M/ICH8M-E) SATA AHCI Controller (rev 03)
00:1f.3 SMBus: Intel Corporation 82801H (ICH8 Family) SMBus Controller (rev 03)
03:00.0 Network controller: Intel Corporation PRO/Wireless 3945ABG [Golan] Network Connection (rev 02)
04:00.0 Ethernet controller: Broadcom Corporation NetLink BCM5787M Gigabit Ethernet PCI Express (rev 02)
15:00.0 CardBus bridge: Ricoh Co Ltd RL5c476 II (rev ba)
15:00.1 FireWire (IEEE 1394): Ricoh Co Ltd R5C832 IEEE 1394 Controller (rev 04)
15:00.2 SD Host controller: Ricoh Co Ltd R5C822 SD/SDIO/MMC/MS/MSPro Host Adapter (rev 21)
15:00.3 System peripheral: Ricoh Co Ltd R5C843 MMC Host Controller (rev 11)
15:00.4 System peripheral: Ricoh Co Ltd R5C592 Memory Stick Bus Host Adapter (rev 11)
15:00.5 System peripheral: Ricoh Co Ltd xD-Picture Card Controller (rev 11)
+ lsmod
Module Size Used by
video 20124 0
backlight 4944 1 video
output 3256 1 video
ac 3752 0
battery 7624 0
button 7304 0
fan 3960 0
thermal 18808 0
processor 42656 3 thermal
thermal_sys 11600 4 video,fan,thermal,processor
arc4 1944 2
ecb 2968 2
iwl3945 154260 0
rfkill 11748 2 iwl3945
mac80211 125600 1 iwl3945
led_class 4688 1 iwl3945
lib80211 7212 1 iwl3945
cfg80211 19736 2 iwl3945,mac80211
rtc 7912 0
tg3 102636 0
libphy 23192 1 tg3
e1000 114156 0
fuse 53120 0
jfs 152896 0
raid10 19752 0
raid456 120872 0
async_memcpy 2312 1 raid456
async_xor 3800 1 raid456
xor 5384 2 raid456,async_xor
async_tx 3848 3 raid456,async_memcpy,async_xor
raid1 20184 0
raid0 6360 0
dm_bbr 10320 0
dm_snapshot 17592 0
dm_mirror 14016 0
dm_region_hash 12136 1 dm_mirror
dm_log 9724 2 dm_mirror,dm_region_hash
dm_mod 56624 4 dm_bbr,dm_snapshot,dm_mirror,dm_log
scsi_wait_scan 1352 0
sbp2 22340 0
ohci1394 29268 0
ieee1394 86640 2 sbp2,ohci1394
sl811_hcd 10840 0
usbhid 24336 0
ohci_hcd 22180 0
uhci_hcd 21536 0
usb_storage 134880 1
ehci_hcd 33796 0
usbcore 142576 7 sl811_hcd,usbhid,ohci_hcd,uhci_hcd,usb_storage,ehci_hcd
lpfc 261844 0
qla2xxx 204180 0
megaraid_sas 36092 0
megaraid_mbox 29432 0
megaraid_mm 9624 1 megaraid_mbox
megaraid 40392 0
aacraid 68948 0
sx8 15192 0
DAC960 66960 0
cciss 36584 0
3w_9xxx 31256 0
3w_xxxx 23664 0
mptsas 33064 0
scsi_transport_sas 30920 1 mptsas
mptfc 16640 0
scsi_transport_fc 43980 3 lpfc,qla2xxx,mptfc
scsi_tgt 13168 1 scsi_transport_fc
mptspi 17608 0
mptscsih 32872 3 mptsas,mptfc,mptspi
mptbase 78916 4 mptsas,mptfc,mptspi,mptscsih
atp870u 26928 0
dc395x 31364 0
qla1280 116160 0
dmx3191d 11144 0
sym53c8xx 70176 0
gdth 79080 0
advansys 72976 0
initio 17512 0
BusLogic 22928 0
arcmsr 22336 0
aic7xxx 116780 0
aic79xx 134732 0
scsi_transport_spi 24024 5 mptspi,dmx3191d,sym53c8xx,aic7xxx,aic79xx
sg 29216 0
pdc_adma 7852 0
sata_inic162x 10172 0
sata_mv 24996 0
ata_piix 25628 0
ahci 33416 0
sata_qstor 7916 0
sata_vsc 6348 0
sata_uli 5084 0
sata_sis 6236 0
sata_sx4 10844 0
sata_nv 24560 0
sata_via 11132 0
sata_svw 6268 0
sata_sil24 14332 0
sata_sil 10592 0
sata_promise 12716 0
pata_sl82c105 5544 0
pata_cs5530 6504 0
pata_cs5520 6440 0
pata_via 10092 0
pata_jmicron 3912 0
pata_marvell 4504 0
pata_sis 13196 1 sata_sis
pata_netcell 3836 0
pata_sc1200 4648 0
pata_pdc202xx_old 6392 0
pata_triflex 4956 0
pata_atiixp 5592 0
pata_opti 4684 0
pata_amd 13372 0
pata_ali 11928 0
pata_it8213 5452 0
pata_pcmcia 14120 0
pcmcia 35200 1 pata_pcmcia
firmware_class 8520 4 iwl3945,tg3,qla2xxx,pcmcia
pcmcia_core 36276 1 pcmcia
pata_ns87415 5132 0
pata_ns87410 4760 0
pata_serverworks 7880 0
pata_artop 6892 0
pata_it821x 11836 0
pata_optidma 6832 0
pata_hpt3x2n 6744 0
pata_hpt3x3 5340 0
pata_hpt37x 13752 0
pata_hpt366 7144 0
pata_cmd64x 7768 0
pata_efar 5372 0
pata_rz1000 4444 0
pata_sil680 7004 0
pata_radisys 4892 0
pata_pdc2027x 8860 0
pata_mpiix 5004 0
libata 173004 50 pdc_adma,sata_inic162x,sata_mv,ata_piix,ahci,sata_qstor,sata_vsc,sata_uli,sata_sis,sata_sx4,sata_nv, sata_via,sata_svw,sata_sil24,sata_sil,sata_promise,pata_sl82c105,pata_cs5530,pata_cs5520,pata_via,pa ta_jmicron,pata_marvell,pata_sis,pata_netcell,pata_sc1200,pata_pdc202xx_old,pata_triflex,pata_atiixp ,pata_opti,pata_amd,pata_ali,pata_it8213,pata_pcmcia,pata_ns87415,pata_ns87410,pata_serverworks,pata _artop,pata_it821x,pata_optidma,pata_hpt3x2n,pata_hpt3x3,pata_hpt37x,pata_hpt366,pata_cmd64x,pata_ef ar,pata_rz1000,pata_sil680,pata_radisys,pata_pdc2027x,pata_mpiix
+ x86info
/mnt/backup/test.bash: line 15: x86info: command not found
+ fdisk -l

Disk /dev/sda: 320.0 GB, 320072933376 bytes
255 heads, 63 sectors/track, 38913 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00085b4f

Device Boot Start End Blocks Id System
/dev/sda1 * 1 4177 33551248+ 7 HPFS/NTFS
Partition 1 does not end on cylinder boundary.
/dev/sda2 4177 4210 265545 83 Linux
/dev/sda3 4211 5255 8393962+ 82 Linux swap / Solaris
/dev/sda4 5256 38913 270357885 5 Extended
/dev/sda5 5256 6300 8393931 83 Linux
/dev/sda6 6301 10478 33559753+ 83 Linux
/dev/sda7 10479 12568 16787893+ 83 Linux
/dev/sda8 12569 13613 8393931 83 Linux
/dev/sda9 13614 14658 8393931 83 Linux
/dev/sda10 14659 15703 8393931 83 Linux
/dev/sda11 15704 17793 16787893+ 83 Linux
/dev/sda12 17794 38913 169646368+ 7 HPFS/NTFS

Disk /dev/sdb: 4127 MB, 4127195136 bytes
255 heads, 63 sectors/track, 501 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0xbe8eee51

Device Boot Start End Blocks Id System
/dev/sdb1 1 65 522081 b W95 FAT32
+ mount /dev/sda5 /mnt/gentoo
+ df -kh
Filesystem Size Used Avail Use% Mounted on
tmpfs 2.0G 31M 1.9G 2% /
/dev/hda 93M 93M 0 100% /mnt/cdrom
/dev/loop0 64M 64M 0 100% /mnt/livecd
udev 10M 204K 9.9M 2% /dev
tmpfs 2.0G 4.9M 2.0G 1% /mnt/livecd/lib64/firmware
tmpfs 2.0G 0 2.0G 0% /mnt/livecd/usr/portage
/dev/sdb1 509M 318M 192M 63% /mnt/backup
/dev/sda5 7.9G 414M 7.1G 6% /mnt/gentoo
+ mount
tmpfs on / type tmpfs (rw)
/dev/hda on /mnt/cdrom type iso9660 (ro)
/dev/loop0 on /mnt/livecd type squashfs (ro)
proc on /proc type proc (rw,nosuid,nodev,noexec)
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec)
udev on /dev type tmpfs (rw,nosuid,size=10240k,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,gid=5,mode=620)
tmpfs on /mnt/livecd/lib64/firmware type tmpfs (rw)
tmpfs on /mnt/livecd/usr/portage type tmpfs (rw)
usbfs on /proc/bus/usb type usbfs (rw,noexec,nosuid,devmode=0664,devgid=85)
/dev/sdb1 on /mnt/backup type vfat (rw)
/dev/sda5 on /mnt/gentoo type ext3 (rw)
+ dmesg
storage: Status code 0; transferred 13/13
usb-storage: -- transfer complete
usb-storage: Bulk status result = 0
usb-storage: Bulk Status S 0x53425355 T 0x61 R 0 Stat 0x0
usb-storage: scsi cmd done, result=0x0
usb-storage: *** thread sleeping.
usb-storage: queuecommand called
usb-storage: *** thread awakened.
usb-storage: Command READ_10 (10 bytes)
usb-storage: 28 00 00 00 00 3f 00 00 01 00
usb-storage: Bulk Command S 0x43425355 T 0x62 L 512 F 128 Trg 0 LUN 0 CL 10
usb-storage: usb_stor_bulk_transfer_buf: xfer 31 bytes
usb-storage: Status code 0; transferred 31/31
usb-storage: -- transfer complete
usb-storage: Bulk command transfer result=0
usb-storage: usb_stor_bulk_transfer_sglist: xfer 512 bytes, 1 entries

...edited for length

Jun 29 20:49:57 livecd usb-storage: Status code 0; transferred 31/31
Jun 29 20:49:57 livecd usb-storage: -- transfer complete
Jun 29 20:49:57 livecd usb-storage: Bulk command transfer result=0
Jun 29 20:49:57 livecd usb-storage: usb_stor_bulk_transfer_sglist: xfer 62464 bytes, 1 entries
Jun 29 20:49:57 livecd usb-storage: Status code 0; transferred 62464/62464
Jun 29 20:49:57 livecd usb-storage: -- transfer complete
Jun 29 20:49:57 livecd usb-storage: Bulk data transfer result 0x0
Jun 29 20:49:57 livecd usb-storage: Attempting to get CSW...
Jun 29 20:49:57 livecd usb-storage: usb_stor_bulk_transfer_buf: xfer 13 bytes
Jun 29 20:49:57 livecd usb-storage: Status code 0; transferred 13/13
Jun 29 20:49:57 livecd usb-storage: -- transfer complete
Jun 29 20:49:57 livecd usb-storage: Bulk status result = 0
Jun 29 20:49:57 livecd usb-storage: Bulk Status S 0x53425355 T 0x82 R 0 Stat 0x0
Jun 29 20:49:57 livecd usb-storage: scsi cmd done, result=0x0
Jun 29 20:49:57 livecd usb-storage: *** thread sleeping.
+ md5sum /mnt/backup/stage3-amd64-20090625.tar.bz2
985567077fe7d04c6f35fdf32c60bc96 /mnt/backup/stage3-amd64-20090625.tar.bz2
+ md5sum /mnt/backup/stage3-amd64-20090625.tar.bz2
985567077fe7d04c6f35fdf32c60bc96 /mnt/backup/stage3-amd64-20090625.tar.bz2
+ cp -af /mnt/backup/stage3-amd64-20090625.tar.bz2 /mnt/backup/copy
+ md5sum /mnt/backup/copy/stage3-amd64-20090625.tar.bz2
80371dbf23933f96949ceee0c3c417ec /mnt/backup/copy/stage3-amd64-20090625.tar.bz2
+ md5sum /mnt/backup/copy/stage3-amd64-20090625.tar.bz2
80371dbf23933f96949ceee0c3c417ec /mnt/backup/copy/stage3-amd64-20090625.tar.bz2
+ rsync --archive --checksum /mnt/backup/stage3-amd64-20090625.tar.bz2 /tmp
/mnt/backup/test.bash: line 39: rsync: command not found
+ md5sum /tmp/stage3-amd64-20090625.tar.bz2
md5sum: /tmp/stage3-amd64-20090625.tar.bz2: No such file or directory
+ md5sum /tmp/stage3-amd64-20090625.tar.bz2
md5sum: /tmp/stage3-amd64-20090625.tar.bz2: No such file or directory
+ cp -af /mnt/backup/stage3-amd64-20090625.tar.bz2 /tmp
+ md5sum /tmp/stage3-amd64-20090625.tar.bz2
985567077fe7d04c6f35fdf32c60bc96 /tmp/stage3-amd64-20090625.tar.bz2
+ md5sum /tmp/stage3-amd64-20090625.tar.bz2
985567077fe7d04c6f35fdf32c60bc96 /tmp/stage3-amd64-20090625.tar.bz2
+ cp -af /mnt/backup/stage3-amd64-20090625.tar.bz2 /mnt/gentoo
+ md5sum /mnt/gentoo/stage3-amd64-20090625.tar.bz2
259e14e50f1af1ee68e0e17e476f1b48 /mnt/gentoo/stage3-amd64-20090625.tar.bz2
+ md5sum /mnt/gentoo/stage3-amd64-20090625.tar.bz2
259e14e50f1af1ee68e0e17e476f1b48 /mnt/gentoo/stage3-amd64-20090625.tar.bz2
+ cp -af /mnt/backup/stage3-amd64-20090625.tar.bz2 /mnt/gentoo
+ md5sum /mnt/gentoo/stage3-amd64-20090625.tar.bz2
64c7da2eef3e85deaa9aa00c1f6df7ab /mnt/gentoo/stage3-amd64-20090625.tar.bz2
+ md5sum /mnt/gentoo/stage3-amd64-20090625.tar.bz2
64c7da2eef3e85deaa9aa00c1f6df7ab /mnt/gentoo/stage3-amd64-20090625.tar.bz2
+ cp -af /mnt/gentoo/stage3-amd64-20090625.tar.bz2 /tmp
+ md5sum /tmp/stage3-amd64-20090625.tar.bz2
64c7da2eef3e85deaa9aa00c1f6df7ab /tmp/stage3-amd64-20090625.tar.bz2
+ md5sum /tmp/stage3-amd64-20090625.tar.bz2
64c7da2eef3e85deaa9aa00c1f6df7ab /tmp/stage3-amd64-20090625.tar.bz2
+ cp -af /tmp/stage3-amd64-20090625.tar.bz2 /mnt/gentoo
+ md5sum /mnt/gentoo/stage3-amd64-20090625.tar.bz2
0f9c248da27f1b2d330f373adc22b8fd /mnt/gentoo/stage3-amd64-20090625.tar.bz2
+ md5sum /mnt/gentoo/stage3-amd64-20090625.tar.bz2
0f9c248da27f1b2d330f373adc22b8fd /mnt/gentoo/stage3-amd64-20090625.tar.bz2
+ file /mnt/backup/stage3-amd64-20090625.tar.bz2
/mnt/backup/test.bash: line 75: file: command not found
+ file /tmp/stage3-amd64-20090625.tar.bz2
/mnt/backup/test.bash: line 77: file: command not found
+ file /mnt/gentoo/stage3-amd64-20090625.tar.bz2
/mnt/backup/test.bash: line 79: file: command not found
+ md5sum /mnt/backup/stage3-amd64-20090625.tar.bz2
985567077fe7d04c6f35fdf32c60bc96 /mnt/backup/stage3-amd64-20090625.tar.bz2

unSpawn · 06-30-2009, 05:28 PM

Quote:

Originally Posted by vulariter

Well... I just wrote a really long and friendly thread about this... However, thanks to the wonderful world wide web's karma engine, my thorough write-up on my problem has escaped to the ether.

Bummer.

Quote:

Originally Posted by vulariter

Why are the md5sum's of copied-with-certain-live-cds files are failing on my laptop? I have found that this is not a problem with x86 live cds (for recent most live cds), nor is it a problem with the Ubuntu 7.10 x86_64 live cd (but I'm not sure why). Any help is greatly appreciated. It seems at this point that many of the x86_64 kernels aren't handling my platform correctly, and thus file are being corrupted, as they are written to disk (and in some cases, temporary or "RAM" disk).

Your log somehow doesn't corroborate that as it shows all OK hashes?..

Quote:

Originally Posted by vulariter

More log output and information is available to those who request it.

Debatable. Esp. when trying to tackle "odd" problems and in terms of information provided (attached) more is more...

vulariter · 07-03-2009, 01:05 PM

unSpawn,

I appreciate your response, but please look closer.

This block shows the known good file, as it rests on my USB stick. It was downloaded on my desktop box, which has no trouble with file corruption. As you see below, I'm doing two md5sum's to show that md5sum, itself, is okay, and produces consistent results.

+ md5sum /mnt/backup/stage3-amd64-20090625.tar.bz2
985567077fe7d04c6f35fdf32c60bc96 /mnt/backup/stage3-amd64-20090625.tar.bz2
+ md5sum /mnt/backup/stage3-amd64-20090625.tar.bz2
985567077fe7d04c6f35fdf32c60bc96 /mnt/backup/stage3-amd64-20090625.tar.bz2

This next block demonstrates the dismal failure that I'm seeing when I copy the file from its original home on the USB stick to anywhere else. Again, I've done two md5sum's to show the persistence of the calculation, thus proving that the checksum differences are the result of the actual file copying operation, and are not the fault of md5sum. In fact, I've found the same pattern of sum differences with sha1sum. Of note here is the fact that the post-copy checksum does not equal the pre-copy checksum. The pre-copy checksum is that which you can see in the block just above this paragraph.

+ cp -af /mnt/backup/stage3-amd64-20090625.tar.bz2 /mnt/gentoo
+ md5sum /mnt/gentoo/stage3-amd64-20090625.tar.bz2
64c7da2eef3e85deaa9aa00c1f6df7ab /mnt/gentoo/stage3-amd64-20090625.tar.bz2
+ md5sum /mnt/gentoo/stage3-amd64-20090625.tar.bz2
64c7da2eef3e85deaa9aa00c1f6df7ab /mnt/gentoo/stage3-amd64-20090625.tar.bz2

Since I'm on a live CD, this next block shows a rare success in copying the file from USB to RAM disk (/tmp). Some of the live CD's I've tested have spotty success, but only one amd64-based live CD has consistent success, and it's the Ubuntu 7.10 amd64 disc.

+ cp -af /mnt/backup/stage3-amd64-20090625.tar.bz2 /tmp
+ md5sum /tmp/stage3-amd64-20090625.tar.bz2
985567077fe7d04c6f35fdf32c60bc96 /tmp/stage3-amd64-20090625.tar.bz2
+ md5sum /tmp/stage3-amd64-20090625.tar.bz2
985567077fe7d04c6f35fdf32c60bc96 /tmp/stage3-amd64-20090625.tar.bz2

Since my first post, I've tested the latest Ubuntu amd64 distro, which fails the test miserably. I'm convinced that this is a Intel storage or Thinkpad kernel driver issue. Today, I'll be trying to install Gentoo amd64 from the Ubuntu 7.10 amd64 disc, and I'll let you know if the custom Gentoo kernel configuration makes any difference (once I boot into the Gentoo install for the first time).

In any case, thanks for your help and patience.

vulariter

Quakeboy02 · 07-03-2009, 01:24 PM

I've had this sort of thing happen to me exactly once, and I'm still not 100% sure whether it was the SATA card I was using, or the fact that the driver was version 1.0. Given that your machine does work with some distros, I'd say the hardware is probably good. So, that leaves you with a driver version question.

unSpawn · 07-04-2009, 06:06 AM

Quote:

Originally Posted by vulariter

I appreciate your response, but please look closer. This block shows the known good file, as it rests on my USB stick. It was downloaded on my desktop box, which has no trouble with file corruption. As you see below, I'm doing two md5sum's to show that md5sum, itself, is okay, and produces consistent results.

My apologies, it appears I didn't read too well.

Quote:

Originally Posted by vulariter

Since my first post, I've tested the latest Ubuntu amd64 distro, which fails the test miserably. I'm convinced that this is a Intel storage or Thinkpad kernel driver issue. Today, I'll be trying to install Gentoo amd64 from the Ubuntu 7.10 amd64 disc, and I'll let you know if the custom Gentoo kernel configuration makes any difference (once I boot into the Gentoo install for the first time).

I'll wait for the results then. It may help to include the complete kernel versions used.