LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices



Reply
 
Search this Thread
Old 10-20-2009, 04:51 PM   #1
devaj
LQ Newbie
 
Registered: Feb 2009
Posts: 17

Rep: Reputation: 1
Backup solutions


Hi all,UBUNTU user here.I have been trying to find a way to copy my files (ebooks,video tutorials,etc) from the system drive to my 500GB external drive,which right now has only 100GB left,without any duplicates.I would be really thankful if someone could show me the light.

In windows I used to use WhereIsIt,an application used for cataloguing and for marking out duplicates.I used to make catalogues of each drives and used them to search for duplicates comparatively,everything was point and click.In UBUNTU I haven't found anything except fslint but that too does not categories its duplicate searches according to the drives.I am open to learning and have learned a lot since I started my journey with Linux few months ago.

Last edited by devaj; 10-20-2009 at 04:56 PM.
 
Old 10-20-2009, 05:44 PM   #2
DavidMcCann
Senior Member
 
Registered: Jul 2006
Location: London
Distribution: CentOS, Salix
Posts: 3,228

Rep: Reputation: 825Reputation: 825Reputation: 825Reputation: 825Reputation: 825Reputation: 825Reputation: 825
Have a look at rsync. That will copy new and changed files from a source to a target.

If you use the parameter --delete, it will also remove anything on the target that's not on the source, including any duplicated copies. If you don't want something copied or deleted, use --exclude. If you use --delete, also use --exclude=/lost+found, or rsync will be unable to delete /lost+found on the external drive and abandon deleting all together.
 
Old 10-21-2009, 07:44 AM   #3
devaj
LQ Newbie
 
Registered: Feb 2009
Posts: 17

Original Poster
Rep: Reputation: 1
Thank you David for replying.
Well I used the option rsync -r -u -v '/media/SEAGATE/cbt70-270 - Windows XP Pro' /media/disk/ ./media/disk already had the file cbt70-270 albeit with different name,rsync should have had recognised that but it didn't and created the file on /media/disk.Is there something that I am doing wrong.Any help would be appreciated.Thank you.
 
Old 10-21-2009, 08:16 AM   #4
choogendyk
Senior Member
 
Registered: Aug 2007
Location: Massachusetts, USA
Distribution: Solaris 9 & 10, Mac OS X, Ubuntu Server
Posts: 1,189

Rep: Reputation: 105Reputation: 105
Just as an alternative, to see if it works for you, you could take a look at BackupPC. One of it's principle characteristics is deduplication.
 
Old 10-21-2009, 09:34 AM   #5
devaj
LQ Newbie
 
Registered: Feb 2009
Posts: 17

Original Poster
Rep: Reputation: 1
Thank you choogendyk for replying.Well I did look into BackupPC but the setup got me confused as I only wanted to backup my system drive to my external drive not from one computer to other.Didn't found anything on google that could help me out.Sorry if I missed out anything and would appreciate if you could help me out.Thank you.

Can someone please tell me any backup utility that does a scan of the destination drive or directory and if it does not finds any backup files in the destination drive or directory then only does it backup the files.If it finds any backup files on the destination drive or directory it only backs up those files that needs to be updated not the whole file.It should be able to scan the destination drive and folders available in the destination drive.Please I need it urgently any help would be really appreciated.GOD bless

Last edited by devaj; 10-21-2009 at 10:16 AM. Reason: adding request
 
Old 10-21-2009, 04:59 PM   #6
devaj
LQ Newbie
 
Registered: Feb 2009
Posts: 17

Original Poster
Rep: Reputation: 1
bump
 
Old 10-21-2009, 05:10 PM   #7
markush
Senior Member
 
Registered: Apr 2007
Location: Germany
Distribution: Slackware
Posts: 3,974

Rep: Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849
Hello devaj,

I'm using the combination of anacron and flexbackup.

flexbackup is a perlscript which performs backups. It can handle full updates as well as differential and incremental backups. I think this is what you're searching for. A differential backup is a backup only of the files which have been changed since the last full backup and an incremental backup is a backup only for the files which have been changed since the last incremental or differential backup.

Anacron is a daemon which starts jobs which are configured in a timetable. One can perform different update-levels. For example: weekly a full update and every day a differential update.

Markus
 
Old 10-21-2009, 05:16 PM   #8
devaj
LQ Newbie
 
Registered: Feb 2009
Posts: 17

Original Poster
Rep: Reputation: 1
Thank you for replying markush.Would flexbackup scan the destination drive before beginning to copy,even though all the files and directories available on the destination drive were not backed-up by flexbackup.Reply would be appreciated.Thank you.

Last edited by devaj; 10-21-2009 at 05:20 PM.
 
Old 10-21-2009, 05:24 PM   #9
markush
Senior Member
 
Registered: Apr 2007
Location: Germany
Distribution: Slackware
Posts: 3,974

Rep: Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849
You'll have to understand the meaning of differential and incremental backups. I'd recommend to google for the explanation. An example: http://en.wikipedia.org/wiki/Incremental_backup
flexbackup does not look for what is on the destination device but for what of the source has changed since the last backup.

Markus
 
Old 10-22-2009, 02:32 AM   #10
devaj
LQ Newbie
 
Registered: Feb 2009
Posts: 17

Original Poster
Rep: Reputation: 1
Thank you all for your precious time and patience.I haven't yet found what I am looking for but I hope I will someday.The only solution that I can think of as of now is to purchase a new 2 tb hard disk and use the awesome backup utilities available in Linux.Thank you all once again.GOD bless
 
Old 10-22-2009, 02:39 AM   #11
markush
Senior Member
 
Registered: Apr 2007
Location: Germany
Distribution: Slackware
Posts: 3,974

Rep: Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849Reputation: 849
Hi,

one way to test a directory for duplicate files would be the du-command
Code:
du > the_contents_of_my_directory_txt
will create a textfile with alle files/pathes within the directory.
You may then extract the filenames and use the sort-command (for example). Or change "/" to "\t" and sort by the last column.
This will teach you much about using the commandline with linux.

Markus
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Backup Solutions MikeyCarter Linux - Software 8 12-11-2007 08:26 PM
Remote backup solutions 0.o Linux - Enterprise 1 10-21-2007 05:28 PM
Best Backup Solutions? vtel57 Linux - General 6 08-21-2006 08:31 PM
Backup Solutions for Linux Servers lionking_x Linux - General 8 03-27-2006 01:50 PM
Backup solutions? ctroyp Linux - Newbie 2 10-04-2005 12:59 PM


All times are GMT -5. The time now is 06:46 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration