-   Linux - Newbie (
-   -   Backup solutions (

devaj 10-20-2009 03:51 PM

Backup solutions
Hi all,UBUNTU user here.I have been trying to find a way to copy my files (ebooks,video tutorials,etc) from the system drive to my 500GB external drive,which right now has only 100GB left,without any duplicates.I would be really thankful if someone could show me the light.

In windows I used to use WhereIsIt,an application used for cataloguing and for marking out duplicates.I used to make catalogues of each drives and used them to search for duplicates comparatively,everything was point and click.In UBUNTU I haven't found anything except fslint but that too does not categories its duplicate searches according to the drives.I am open to learning and have learned a lot since I started my journey with Linux few months ago.

DavidMcCann 10-20-2009 04:44 PM

Have a look at rsync. That will copy new and changed files from a source to a target.

If you use the parameter --delete, it will also remove anything on the target that's not on the source, including any duplicated copies. If you don't want something copied or deleted, use --exclude. If you use --delete, also use --exclude=/lost+found, or rsync will be unable to delete /lost+found on the external drive and abandon deleting all together.

devaj 10-21-2009 06:44 AM

Thank you David for replying.
Well I used the option rsync -r -u -v '/media/SEAGATE/cbt70-270 - Windows XP Pro' /media/disk/ ./media/disk already had the file cbt70-270 albeit with different name,rsync should have had recognised that but it didn't and created the file on /media/disk.Is there something that I am doing wrong.Any help would be appreciated.Thank you.

choogendyk 10-21-2009 07:16 AM

Just as an alternative, to see if it works for you, you could take a look at BackupPC. One of it's principle characteristics is deduplication.

devaj 10-21-2009 08:34 AM

Thank you choogendyk for replying.Well I did look into BackupPC but the setup got me confused as I only wanted to backup my system drive to my external drive not from one computer to other.Didn't found anything on google that could help me out.Sorry if I missed out anything and would appreciate if you could help me out.Thank you.

Can someone please tell me any backup utility that does a scan of the destination drive or directory and if it does not finds any backup files in the destination drive or directory then only does it backup the files.If it finds any backup files on the destination drive or directory it only backs up those files that needs to be updated not the whole file.It should be able to scan the destination drive and folders available in the destination drive.Please I need it urgently any help would be really appreciated.GOD bless

devaj 10-21-2009 03:59 PM


markush 10-21-2009 04:10 PM

Hello devaj,

I'm using the combination of anacron and flexbackup.

flexbackup is a perlscript which performs backups. It can handle full updates as well as differential and incremental backups. I think this is what you're searching for. A differential backup is a backup only of the files which have been changed since the last full backup and an incremental backup is a backup only for the files which have been changed since the last incremental or differential backup.

Anacron is a daemon which starts jobs which are configured in a timetable. One can perform different update-levels. For example: weekly a full update and every day a differential update.


devaj 10-21-2009 04:16 PM

Thank you for replying markush.Would flexbackup scan the destination drive before beginning to copy,even though all the files and directories available on the destination drive were not backed-up by flexbackup.Reply would be appreciated.Thank you.

markush 10-21-2009 04:24 PM

You'll have to understand the meaning of differential and incremental backups. I'd recommend to google for the explanation. An example:
flexbackup does not look for what is on the destination device but for what of the source has changed since the last backup.


devaj 10-22-2009 01:32 AM

Thank you all for your precious time and patience.I haven't yet found what I am looking for but I hope I will someday.The only solution that I can think of as of now is to purchase a new 2 tb hard disk and use the awesome backup utilities available in Linux.Thank you all once again.GOD bless

markush 10-22-2009 01:39 AM


one way to test a directory for duplicate files would be the du-command

du > the_contents_of_my_directory_txt
will create a textfile with alle files/pathes within the directory.
You may then extract the filenames and use the sort-command (for example). Or change "/" to "\t" and sort by the last column.
This will teach you much about using the commandline with linux.


All times are GMT -5. The time now is 07:58 PM.