LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 03-21-2019, 11:23 AM   #1
mshmer
LQ Newbie
 
Registered: Mar 2019
Posts: 1

Rep: Reputation: Disabled
Q: Space on HD vs space on Tape


I'm trying to run a tar backup using flexbackup.

DU and DF report about 116G of data.

The tape drive is an LTO-2 drive (tandberg) with 200G uncompressed capacity. The tape has been rewound and erased.

The backup keeps failing with "device out of space" errors. At one point I saw an error where the size of the backup was claimed to be over 215 GB.

I've tried different block sizes and seem to keep getting
the same capacity errors.

The "flexbackup -test-new-tape" declares success.

The backups were working when the machine was configured to run using an older version of Centos. I've since upgraded to Debian 9 (stretch). Since the upgrade I seem to be having issues.

Ideas?
 
Old 03-21-2019, 09:48 PM   #2
Beryllos
Member
 
Registered: Apr 2013
Location: Massachusetts
Distribution: Debian
Posts: 529

Rep: Reputation: 319Reputation: 319Reputation: 319Reputation: 319
Perhaps there are many hard links. These normally don't show up in du and df. However, you can get du to count them. From man du:
Code:
-l, --count-links
       count sizes many times if hard linked
Try that and see.

Is there a way for your backup software to store hard links as links, not copies?

Edit: I noticed you are using tar. After reviewing the manual, I tried tar cf on some hardlinked files, and I see that it stores links, not copies. If I add the --hard-dereference option, then it stores copies. Is your tar command (or flexbackup) doing something like that? I don't have a tape drive, so I can't tell if that makes a difference.

Last edited by Beryllos; 03-21-2019 at 10:03 PM.
 
Old 03-22-2019, 05:04 AM   #3
ehartman
Senior Member
 
Registered: Jul 2007
Location: Delft, The Netherlands
Distribution: Slackware
Posts: 1,674

Rep: Reputation: 888Reputation: 888Reputation: 888Reputation: 888Reputation: 888Reputation: 888Reputation: 888
Quote:
Originally Posted by Beryllos View Post
Perhaps there are many hard links. These normally don't show up in du and df. to count them.
And the same goes for symbolic links, they must not be DEreferenced either (or the file will be stored twice on the tape).
Finally: are there many compressed files in the data to be backup'ed (.gz, .bz2, .xz, .zip, .rar, mp3 or mp4, etc. files)?
If so the hardware compression OF the tape drive will work against you, because trying to compress already compressed data will make it LARGER, not smaller.
I explicitly switch compression ON or OFF with the command:
Code:
mt-st -f $DEVICE compression $COMPRESS
in my backup scripts ($COMPRESS is either 0 or 1, see man mt-st).
Depending on the data, of course.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Tape Backups and How can i find out the Name (label) of the tape in the drive?? helptonewbie Linux - Newbie 2 10-27-2008 07:20 AM
How to backup more than one time on same tape using DLT tape? hocheetiong Linux - Newbie 3 01-30-2008 06:54 AM
bacula - How do I setup up tape daily tape changes neocontrol Linux - Software 3 01-23-2008 09:27 PM
Using a DDS5 tape drive to restore from a DDS3 backup tape. AndrewCAtWayofthebit Linux - Hardware 1 05-14-2006 09:15 AM
Tape incremental backup to different tape tungaw2001 Linux - Software 0 08-13-2003 09:42 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 01:28 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration