LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 10-04-2014, 12:03 PM   #1
jozmak
Member
 
Registered: Aug 2005
Posts: 38

Rep: Reputation: 0
Highly mystifying and extremely frustrating experience: MD5SUM changes all the time


Can anyone explain this to me and give me some suggestions how to go about preventing this from happening?

Here are a few examples.

I download an ISO image, I check the md5sum, everything is fine. I reboot the computer, I check the md5sum of the iso it changed. I have to start the downloading the ISO all over again.

Another example: I download the ISO image. I use dd method to copy it into usb stick. The copy fails. I check the md5sum again, the dd copy function changed the MD5SUM code. I have to start downloading the ISO again.

I sometimes use the unebootin to write image to usb. The copy fails, the md5sum changes once again.

These are not occasional occurrences but happening regularly.

The other day I had to download the ISO image five times to be able to make a bootable usb file. Tremendous waste of resources and of course, tremendous source of frustration.

How come a copy function can changes the ISO image files? What can be done to prevent this from happening.

Thanks a lot for all suggestions.
 
Old 10-04-2014, 12:39 PM   #2
bulliver
Senior Member
 
Registered: Nov 2002
Location: Edmonton AB, Canada
Distribution: Gentoo x86_64; Gentoo PPC; FreeBSD; OS X 10.9.4
Posts: 3,760
Blog Entries: 4

Rep: Reputation: 78
What is the exact dd command you are using?
 
Old 10-04-2014, 12:53 PM   #3
yancek
LQ Guru
 
Registered: Apr 2008
Distribution: PCLinux, Slackware
Posts: 6,872

Rep: Reputation: 1249Reputation: 1249Reputation: 1249Reputation: 1249Reputation: 1249Reputation: 1249Reputation: 1249Reputation: 1249Reputation: 1249
It might help if you indicated which iso files you are downloading so someone could check.
 
Old 10-04-2014, 01:07 PM   #4
jozmak
Member
 
Registered: Aug 2005
Posts: 38

Original Poster
Rep: Reputation: 0
Quote:
Originally Posted by bulliver View Post
What is the exact dd command you are using?
This is the cp code I usually use:
Code:
sudo dd if=....iso of=/dev/sdc
 
Old 10-04-2014, 01:09 PM   #5
jozmak
Member
 
Registered: Aug 2005
Posts: 38

Original Poster
Rep: Reputation: 0
Quote:
Originally Posted by yancek View Post
It might help if you indicated which iso files you are downloading so someone could check.
Last time I tried ubuntu-gnome beta because I wanted to help with testing.
 
Old 10-04-2014, 01:27 PM   #6
bulliver
Senior Member
 
Registered: Nov 2002
Location: Edmonton AB, Canada
Distribution: Gentoo x86_64; Gentoo PPC; FreeBSD; OS X 10.9.4
Posts: 3,760
Blog Entries: 4

Rep: Reputation: 78
Well, I dunno. dd or even cp should not be changing the md5sum (that implies changing the contents of the iso). Rebooting certainly shouldn't change it. Something else must be at work there...

As for making a bootable USB stick, there are a few things you can try.

Some BIOSs will balk if the stick isn't formatted FAT32:

Code:
$ sudo mkdosfs -n 'USB-Drive-Name' -I /dev/sdc -F 32
Your BIOS might balk unless you add a MBR sector to your ISO:

Code:
$ isohybrid filename.iso
then:

Code:
$ sudo dd if=filename.iso of=/dev/sdc bs=4k
umount is supposed to take care of this itself, but perhaps even do a sync before unmounting the stick.
 
Old 10-04-2014, 01:51 PM   #7
jozmak
Member
 
Registered: Aug 2005
Posts: 38

Original Poster
Rep: Reputation: 0
Quote:
Originally Posted by bulliver View Post
Well, I dunno. dd or even cp should not be changing the md5sum (that implies changing the contents of the iso). Rebooting certainly shouldn't change it. Something else must be at work there...

As for making a bootable USB stick, there are a few things you can try.

Some BIOSs will balk if the stick isn't formatted FAT32:

Code:
$ sudo mkdosfs -n 'USB-Drive-Name' -I /dev/sdc -F 32
Your BIOS might balk unless you add a MBR sector to your ISO:

Code:
$ isohybrid filename.iso
then:

Code:
$ sudo dd if=filename.iso of=/dev/sdc bs=4k
umount is supposed to take care of this itself, but perhaps even do a sync before unmounting the stick.
Thanks bulliver,

I try these tips.

One question: I have a gpt partitioned harddrive. Do I still have to add the MBR sector you mentioned?
 
Old 10-04-2014, 01:58 PM   #8
jozmak
Member
 
Registered: Aug 2005
Posts: 38

Original Poster
Rep: Reputation: 0
Currently, I'm downloading ubuntu-gnome-beta agian. I try these tips and report back what happened.
 
Old 10-04-2014, 03:19 PM   #9
jozmak
Member
 
Registered: Aug 2005
Posts: 38

Original Poster
Rep: Reputation: 0
It happened again. I downloaded ubuntu-gnome-beta. I checked the sha256sum and everything was fine.

I rebooted the computer and I checked the sha256sum again. It was different.

This is the right sha256sum before reboot.
Code:
mak@debian:~/Downloads$ sha256sum ubuntu-gnome-14.10-beta2-desktop-amd64\(1\).iso 
396f6ace73d817bc6c15b9518b52a49cf10bb008308c7d07af75c3aa7fc2bf53  ubuntu-gnome-14.10-beta2-desktop-amd64(1).iso
mak@debian:~/Downloads$
A this is after reboot:
Code:
mak@debian:~/Downloads$ sha256sum ubuntu-gnome-14.10-beta2-desktop-amd64\(1\).iso 
714dff477cb40a60fd73cb03ab1e08f4db48a65fde29b852ac0d8161c0e8f421  ubuntu-gnome-14.10-beta2-desktop-amd64(1).iso
mak@debian:~/Downloads$
My computer is in pretty good shape. It is about 8 years old.

CPU: AMD Dual Core
Motherboard: Asus
Memory: 6 Gig
Video Card: Nvidia GeForce 8400 GS
Harddrive: 1 SSD and 1 regular hd
 
Old 10-04-2014, 03:32 PM   #10
jefro
Moderator
 
Registered: Mar 2008
Posts: 15,398

Rep: Reputation: 2207Reputation: 2207Reputation: 2207Reputation: 2207Reputation: 2207Reputation: 2207Reputation: 2207Reputation: 2207Reputation: 2207Reputation: 2207Reputation: 2207
Any file should not change for no reason. Virus or malware may cause this. Data problem like bad drive or cpu or memory might be an issue.


I'd download it and change permissions to only root. Hopefully you are not running under root ever. If so then you need to consider malware.

It could be possible that by some oddity you are testing the download in once case as a single file and in the next a mounted fileystem of an iso. Kind of doubt that.

The only other idea I'd have would be some cache issue.


Forget about bios issues. The only thing here is a file seeming to change. There is no other concern at this point.
 
Old 10-04-2014, 03:53 PM   #11
jozmak
Member
 
Registered: Aug 2005
Posts: 38

Original Poster
Rep: Reputation: 0
Quote:
Originally Posted by jefro View Post
Any file should not change for no reason. Virus or malware may cause this. Data problem like bad drive or cpu or memory might be an issue.


I'd download it and change permissions to only root. Hopefully you are not running under root ever. If so then you need to consider malware.

It could be possible that by some oddity you are testing the download in once case as a single file and in the next a mounted fileystem of an iso. Kind of doubt that.

The only other idea I'd have would be some cache issue.


Forget about bios issues. The only thing here is a file seeming to change. There is no other concern at this point.
Thanks jefro,

No, I never ever use it as root.

What can I do now? How to go about troubleshooting it?

Could it be the harddrive. I downloaded on a regular harddrive.

Should I download again on the SSD to see?

Or what else can I do?
 
Old 10-04-2014, 04:02 PM   #12
jozmak
Member
 
Registered: Aug 2005
Posts: 38

Original Poster
Rep: Reputation: 0
Currently, I downloading the iso again on the SSD harddrive to see what happens.

I report back as soon as I finish.
 
Old 10-04-2014, 04:42 PM   #13
jozmak
Member
 
Registered: Aug 2005
Posts: 38

Original Poster
Rep: Reputation: 0
Sadly, I have to say that the same problem exists with the SSD drive as well. It seems that the problem is not the drive because it is unlikely the both mulfunctioning at the same time.

Otherwise, my computer is in perfect shape I've never experienced anything suspicious other then this.

On the regular harddrive I have 8 gpt partitions with 8 different distros installed and all work fine.

What can I do now?

How can I troubleshoot the machine?
 
Old 10-04-2014, 06:17 PM   #14
howzer
LQ Newbie
 
Registered: Apr 2012
Posts: 4

Rep: Reputation: Disabled
I believe that jefro was on the right thank when he mentioned memory as a possible cause. From what I understand, when you do a checksum, the original file is copied into memory for the hash to be created. So, if your memory is bad, you can get a different result every time you do it.

I'd try running memtester or memtest86.
 
Old 10-04-2014, 06:25 PM   #15
howzer
LQ Newbie
 
Registered: Apr 2012
Posts: 4

Rep: Reputation: Disabled
I couldn't put this in my first comment, but I learned this a while back from

http://www.cyberciti.biz/tips/howto-...ory-check.html

Basically, if a small portion of you ram is bad, you probably won't have problems with most tasks, but if you're working with larger files, you're more likely to hit that bad spot, and if the file is the same size as your RAM, you'd be guaranteed to hit it.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Laptop advice for non-frustrating Slack 13.37 (64 bit) experience statguy Slackware 35 12-13-2011 08:31 AM
for, foreach loops mystifying in bash! maryfran Linux - Newbie 4 01-23-2009 11:43 AM
MEPIS takes an extremely long time to install newbiesforever MEPIS 5 11-20-2007 09:27 PM
LXer: Highly Anticipated 'Portland' Ready for Prime Time LXer Syndicated Linux News 0 10-11-2006 11:33 AM
Pinging problem - extremely slow response time stevel Linux - Networking 1 11-02-2001 05:13 AM


All times are GMT -5. The time now is 01:09 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration