LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 05-21-2015, 01:16 AM   #1
rajthampi
Member
 
Registered: May 2008
Location: Kuwait
Distribution: RHEL5, Ubuntu, PSlinuxOS
Posts: 35

Rep: Reputation: 1
Question .tar.gz 111GB extracting fails


Hi guys

We are trying to move Oracle applications database tier archive, that is 111GB (over Linux) to a USB external drive using cp. Though the file successfully gets transferred to the external drive, trying to extract the file from a 2nd machine always fails, saying the archive is corrupt.
We have checked the integrity of the archive using 7-zip, reporting no errors. However totally frustrated as our last few attempts were totally futile.

The interesting part is, if we do scp to transfer the file to 2nd machine, extraction doesn't fail.

Please let us know, how we can successfully move this archive to the 2nd machine which is at a remote location and no possibilities of setting up a FTP for such a huge size file.

Both the source and destination Linux distros are RHEL 5 Enterprise, 64Bit, ext3 file systems.


regards,
 
Old 05-21-2015, 01:48 AM   #2
pan64
LQ Guru
 
Registered: Mar 2012
Location: Hungary
Distribution: debian/ubuntu/suse ...
Posts: 8,536

Rep: Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440
I guess there is a problem with the filesystem on that usb stick.
 
Old 05-21-2015, 02:24 AM   #3
John VV
LQ Muse
 
Registered: Aug 2005
Location: A2 area Mi.
Posts: 16,992

Rep: Reputation: 2448Reputation: 2448Reputation: 2448Reputation: 2448Reputation: 2448Reputation: 2448Reputation: 2448Reputation: 2448Reputation: 2448Reputation: 2448Reputation: 2448
what format was the usb drive ?
the single file is after all over 100 Gig so the default from the manufacture fat32 is not being used

for RHEL 5.11 use ext3 on the usb drive
 
Old 05-21-2015, 05:59 AM   #4
veerain
Senior Member
 
Registered: Mar 2005
Location: Earth bound to Helios
Distribution: Custom
Posts: 2,524

Rep: Reputation: 319Reputation: 319Reputation: 319Reputation: 319
Check the size of usb drive? Is it greater than 111GB?

Run 'badblocks' command to find bad sectors in the usb drive.
 
Old 05-21-2015, 06:11 AM   #5
fatmac
Senior Member
 
Registered: Sep 2011
Location: Surrey/Hants Border, UK
Distribution: BSD & Linux - As long as they are Lightweight
Posts: 1,704

Rep: Reputation: Disabled
There have been problems with 7zip corruptions, suggest you use something like bzip2, (or even tar & gzip).
 
Old 05-21-2015, 06:54 AM   #6
rtmistler
Moderator
 
Registered: Mar 2011
Location: Sutton, MA. USA
Distribution: MINT Debian, Angstrom, SUSE, Ubuntu
Posts: 4,498
Blog Entries: 10

Rep: Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647
Get the md5sum of the file.

After transfer, check that. If correct, then there's nothing wrong with the file.

Check versions of 7zip between the two machines.
 
Old 05-21-2015, 08:21 AM   #7
rajthampi
Member
 
Registered: May 2008
Location: Kuwait
Distribution: RHEL5, Ubuntu, PSlinuxOS
Posts: 35

Original Poster
Rep: Reputation: 1
Quote:
Originally Posted by pan64 View Post
I guess there is a problem with the filesystem on that usb stick.
Sorry for the delayed replies. Was lost in few meetings. I don't think the issues are related to file system. Both the external HDDs I used were formatted using ext3 (as it is the file system used with the source system)
Both the external HDDs are newly bought, checked thoroughly for errors.
Most importantly, I don't have the same issues with the application tier archive, that is just 25GBs in size.

regards,

---------- Post added 05-21-15 at 03:22 PM ----------

Quote:
Originally Posted by John VV View Post
what format was the usb drive ?
the single file is after all over 100 Gig so the default from the manufacture fat32 is not being used

for RHEL 5.11 use ext3 on the usb drive
Hello John

The USB HDD is formatted using ext3 (As the source system)

regards,
 
Old 05-21-2015, 08:23 AM   #8
rajthampi
Member
 
Registered: May 2008
Location: Kuwait
Distribution: RHEL5, Ubuntu, PSlinuxOS
Posts: 35

Original Poster
Rep: Reputation: 1
Quote:
Originally Posted by veerain View Post
Check the size of usb drive? Is it greater than 111GB?

Run 'badblocks' command to find bad sectors in the usb drive.
My 1st HDD is 1TB and 2nd HDD is 2TB, hence size was never the problem.

regards,

---------- Post added 05-21-15 at 03:24 PM ----------

Quote:
Originally Posted by fatmac View Post
There have been problems with 7zip corruptions, suggest you use something like bzip2, (or even tar & gzip).
I am using tar to extract the files. I used to 7-zip to check the integrity of the archive over Windows 8.

regards,
 
Old 05-21-2015, 08:27 AM   #9
rajthampi
Member
 
Registered: May 2008
Location: Kuwait
Distribution: RHEL5, Ubuntu, PSlinuxOS
Posts: 35

Original Poster
Rep: Reputation: 1
Quote:
Originally Posted by rtmistler View Post
Get the md5sum of the file.

After transfer, check that. If correct, then there's nothing wrong with the file.

Check versions of 7zip between the two machines.
The source archive was NOT at all corrupt as I was able to clone from the same archives in the source system. It only gets corrupt once after copied to the external HDD. The most interesting part is 7-Zip never complained about any errors, however failed to extract the files in the mid of extraction processes.

regards,
 
Old 05-21-2015, 08:31 AM   #10
rtmistler
Moderator
 
Registered: Mar 2011
Location: Sutton, MA. USA
Distribution: MINT Debian, Angstrom, SUSE, Ubuntu
Posts: 4,498
Blog Entries: 10

Rep: Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647Reputation: 1647
Quote:
Originally Posted by rajthampi View Post
The source archive was NOT at all corrupt as I was able to clone from the same archives in the source system. It only gets corrupt once after copied to the external HDD. The most interesting part is 7-Zip never complained about any errors, however failed to extract the files in the mid of extraction processes.

regards,
You're "saying" it gets corrupt. My point here is to prove or disprove those statements. Run md5sum on the file copied to that external HDD. If it matches, then the file is fine. If not, then I agree that there's something wrong.

And the other point was also to check the versions of whatever extraction tool you're using.

Last edited by rtmistler; 05-21-2015 at 08:32 AM.
 
Old 05-21-2015, 08:33 AM   #11
pan64
LQ Guru
 
Registered: Mar 2012
Location: Hungary
Distribution: debian/ubuntu/suse ...
Posts: 8,536

Rep: Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440
I still think there is an issue either with that filesystem (I do not mean in general with ext3, but that one on the usb stick). or the underlying hardware. You can try to copy another "big" file (for example a video) and check integrity.
 
Old 05-21-2015, 09:11 AM   #12
rajthampi
Member
 
Registered: May 2008
Location: Kuwait
Distribution: RHEL5, Ubuntu, PSlinuxOS
Posts: 35

Original Poster
Rep: Reputation: 1
Quote:
Originally Posted by rtmistler View Post
You're "saying" it gets corrupt. My point here is to prove or disprove those statements. Run md5sum on the file copied to that external HDD. If it matches, then the file is fine. If not, then I agree that there's something wrong.

And the other point was also to check the versions of whatever extraction tool you're using.
Dear rtmistler

I am copying the file once again to the external HDD now, will post you the md5sum results soon.

regards,
 
Old 05-21-2015, 09:21 AM   #13
rajthampi
Member
 
Registered: May 2008
Location: Kuwait
Distribution: RHEL5, Ubuntu, PSlinuxOS
Posts: 35

Original Poster
Rep: Reputation: 1
Quote:
Originally Posted by pan64 View Post
I still think there is an issue either with that filesystem (I do not mean in general with ext3, but that one on the usb stick). or the underlying hardware. You can try to copy another "big" file (for example a video) and check integrity.
Hello Pan64

This is how I built the external HDD

Connected the new HDD to Red Hat live system
Delete the NTFS partition using fdisk
Created a new partition
mkfs.ext3 to format

As I mentioned with my earlier posts, the files as big as 25GB are extracting without any issues. Please let me know whether I am doing something wrong with the partitioning or formatting part.

regards,
 
Old 05-22-2015, 04:17 AM   #14
rajthampi
Member
 
Registered: May 2008
Location: Kuwait
Distribution: RHEL5, Ubuntu, PSlinuxOS
Posts: 35

Original Poster
Rep: Reputation: 1
Quote:
Originally Posted by rtmistler View Post
You're "saying" it gets corrupt. My point here is to prove or disprove those statements. Run md5sum on the file copied to that external HDD. If it matches, then the file is fine. If not, then I agree that there's something wrong.

And the other point was also to check the versions of whatever extraction tool you're using.
Hello rtmistler

I ran the md5sum against both source and destination files, and the md5sum for both files are the same. However, while going through the tar outputs, I could see that there were multiple errors raised like the quoted below

Quote:
tar: u05/oraprod/PROD/db/apps_st/data/a_txn_data01.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_txn_ind03.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_txn_ind11.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_queue08.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_txn_ind14.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/system09.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/sysaux01.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_txn_data18.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/system02.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/system11.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/temp03.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_txn_data12.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_queue07.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/temp01.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/log03b.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_txn_data07.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/system01.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_txn_ind08.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_txn_data21.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/system03.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_media03.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_media08.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/data/a_media15.dbf: Cannot open: No such file or directory
tar: u05/oraprod/PROD/db/apps_st/archives: Cannot mkdir: No such file or directory
tar: u05/oraprod/PROD/db: Cannot utime: Read-only file system
tar: u05/oraprod/PROD/db: Cannot change mode to rwxr-xr-x: Read-only file system
tar: u05/oraprod/PROD/db: Cannot change ownership to uid 500, gid 300: Read-only file system
tar: u05/oraprod/PROD: Cannot utime: Read-only file system
tar: u05/oraprod/PROD: Cannot change mode to rwxr-xr-x: Read-only file system
tar: u05/oraprod/PROD: Cannot change ownership to uid 500, gid 300: Read-only file system
tar: u05/oraprod/scripts: Cannot mkdir: Read-only file system
tar: u05/oraprod/scripts/appsbkpdaily.log: Cannot open: No such file or directory
tar: u05/oraprod/scripts/appsbkpdaily.sh: Cannot open: No such file or directory
tar: u05/oraprod/scripts/archbkp.sh: Cannot open: No such file or directory
tar: u05/oraprod/scripts/archbkp.err: Cannot open: No such file or directory
tar: u05/oraprod/scripts/archbkp.log: Cannot open: No such file or directory
tar: u05/oraprod/scripts/hotdbkprodpdaily.log: Cannot open: No such file or directory
tar: u05/oraprod/scripts/dbbinariescopy.err: Cannot open: No such file or directory
tar: u05/oraprod/scripts/dbbinariescopy.log: Cannot open: No such file or directory
tar: u05/oraprod/scripts/dbbinariescopy.sh: Cannot open: No such file or directory
tar: u05/oraprod/scripts/archdel.sh: Cannot open: No such file or directory
tar: u05/oraprod/scripts/hotdbkprodpdaily.err: Cannot open: No such file or directory
tar: u05/oraprod/scripts/archdel.log: Cannot open: No such file or directory
tar: u05/oraprod/scripts/dbfilesoscopy.sh: Cannot open: No such file or directory
tar: u05/oraprod/scripts/appsbkpdaily.err: Cannot open: No such file or directory
tar: u05/oraprod/scripts/archdel.err: Cannot open: No such file or directory
tar: u05/oraprod/scripts/hotbkprod.sh.orig: Cannot open: No such file or directory
tar: u05/oraprod/scripts/hotbkprod.sh: Cannot open: No such file or directory
tar: u05/oraprod: Cannot utime: Read-only file system
tar: u05/oraprod: Cannot change mode to rwxr-xr-x: Read-only file system
tar: u05/oraprod: Cannot change ownership to uid 500, gid 300: Read-only file system
tar: Error exit delayed from previous errors
So it looks like, related to read/write errors? The archive at source is created by "oraprod" user belonging to a group "oinstall", at the destination I am trying to extract the archive as "root"

Other than the above, I can't see any other issues.

regards,
 
Old 05-22-2015, 04:29 AM   #15
pan64
LQ Guru
 
Registered: Mar 2012
Location: Hungary
Distribution: debian/ubuntu/suse ...
Posts: 8,536

Rep: Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440Reputation: 2440
probably there are different users (user ids) configured and the user/group who created the tar does not exist on the target host therefore it has no right to create files/dirs.
Tar handles only ids, so you may have the the same username with different ids to make such conflicts.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Extracting tar.xz nownebie Linux - Newbie 4 08-01-2012 09:21 AM
[SOLVED] extracting group of files from a tar.bz that was created with the following tar - lleb Linux - Newbie 1 06-06-2012 04:06 PM
[SOLVED] tar.gz not extracting gardenair Linux - Networking 6 02-03-2011 06:05 AM
a tough question 4 u, problem in extracting tar & tar.gz files p_garg Linux - General 5 11-08-2010 12:02 PM
After extracting a tar...is tar useless? glenn69 Linux - Newbie 6 04-23-2004 10:04 PM


All times are GMT -5. The time now is 10:56 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration