LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices

Reply
 
LinkBack Search this Thread
Old 11-21-2012, 11:48 PM   #1
Aunnix
Member
 
Registered: Aug 2012
Posts: 126

Rep: Reputation: Disabled
Formatting and Mounting questions. Trying to setup periodic internal backups.


Hey All,

I have a few questions about formatting and mounting my hard drives for a backup system that I'm aiming for.. I am running Debian Squeeze, and I have 3 hard drives installed; a 60gb for the OS/pkgs, a 2tb for data storage (we'll call it 2tb A), and (another) 2tb (we'll call 2tb B) for synching/copying the data from 2tb A.

Basically, I will be running a server that setup as a web server and a streaming server. I want to stream my movies, music, pictures, etc. to my TVs, computers, laptops, and other devices. And, I'd like everything from my other computers to be saved directly to the server, which I assume will be saved in the /home directory/partition under / (root)... ?

Well, where ever it is saved, I would like it to be on hard drive 2tb A. Then I plan to setup a script that will automatically mount hard drive 2tb B, sync with 2tb A and copy the data, then unmount. And, it will do this periodically.


Now, my thoughts and questions...

Here is what I'm thinking and am looking for opinions/a direction to take... /home is located/mounted under /. Since this is where all of my data will be saved to/located, I figured I'd mount hard drive 2tb A to /home. Then all of the user(s) stuff will be backed up when 2tb B syncs with A.

**But, if I run an FTP server or something that uses "user profiles" for its setup I don't necessarily need to back up the "user profile." Which is what would happen if I mount 2tb A to the /home directory, correct? Would it be wiser and would I be able to have all my data saved to a completely different directory (something like /alldata) and let the programs access it from there?**

After mounting hard drive 2tb A to /home (or where ever) I thought I'd have 2tb B mount to a created directory called /2TBbackup. Then, with the help of the script(s), it would copy everything from A then unmount itself until the script kicks back in at the next interval. Does this seem correct? Am I on the right track with this?


As for formatting, the files are all located on a NTFS formatted hard drive right now. Once all of the copying testing is done, I plan to transfer everything to 2tb A. What should I format 2tb A as? ext3,4? NTFS as well? If ext3,4... will I have problems tranferring the data from my external NTFS hard drive to 2tb A?

Then, I'd like 2tb B to be NTFS. In case the server goes down/fails or if I just give it up one day, I'd like to be able to just pull 2tb B out of the computer and hook it up externally (or internally) to a Windows PC so I can access all of the data. Is this possible? And, if I do format it as NTFS, will I run into issues with syncing/copying from 2tb A when it mounts itself and does it back up?


Any and all help is appreciated, and sorry for the long post, lol. I wanted to make sure I got everything out there once though... Thanks in advance!
 
Old 11-22-2012, 06:20 AM   #2
Adol
Member
 
Registered: Feb 2011
Location: Osaka, Japan
Distribution: Gentoo, Opensuse
Posts: 240

Rep: Reputation: 4
For the automation I would take a look at cron scripts. It would let you specify when you wanted a task started and done automatically. After the scipt is made it just starts at the specified time.

As for formatting. Linux does have ntfs support but at times it can be kind of spotty(I have lost data before but not sure if it has gotten better). I personally use XFS but ext4 should be very good for what you want to do. The only problem is that it may be difficult to access it from a windows pc(direct access not server access).

Maybe another poster could recommend a good way on how to safely transfer data. I have had a few mishaps when transferring from ntfs to linux formats(a few years ago). The only reliable way I was able to transfer was through my network but that takes a lot of time.
 
Old 11-22-2012, 10:45 PM   #3
Aunnix
Member
 
Registered: Aug 2012
Posts: 126

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by Adol View Post
For the automation I would take a look at cron scripts. It would let you specify when you wanted a task started and done automatically. After the scipt is made it just starts at the specified time.

As for formatting. Linux does have ntfs support but at times it can be kind of spotty(I have lost data before but not sure if it has gotten better). I personally use XFS but ext4 should be very good for what you want to do. The only problem is that it may be difficult to access it from a windows pc(direct access not server access).

Maybe another poster could recommend a good way on how to safely transfer data. I have had a few mishaps when transferring from ntfs to linux formats(a few years ago). The only reliable way I was able to transfer was through my network but that takes a lot of time.

Thanks! Cron is actually what I plan to use. That has been the most widely suggested to me, lol.

As for the formatting/transferring, have you encountered these problems when hooked internally? Or have you experienced this problem with external hard drives hooked up by USB as well?
 
Old 11-22-2012, 11:43 PM   #4
Adol
Member
 
Registered: Feb 2011
Location: Osaka, Japan
Distribution: Gentoo, Opensuse
Posts: 240

Rep: Reputation: 4
Quote:
Originally Posted by Aunnix View Post
Thanks! Cron is actually what I plan to use. That has been the most widely suggested to me, lol.

As for the formatting/transferring, have you encountered these problems when hooked internally? Or have you experienced this problem with external hard drives hooked up by USB as well?
I lost data when my drive was connected externally through usb. I havenít had a chance to try an internal setup while transferring.
 
Old 11-23-2012, 12:12 AM   #5
chrism01
Guru
 
Registered: Aug 2004
Location: Sydney
Distribution: Centos 6.5
Posts: 16,086

Rep: Reputation: 1994Reputation: 1994Reputation: 1994Reputation: 1994Reputation: 1994Reputation: 1994Reputation: 1994Reputation: 1994Reputation: 1994Reputation: 1994Reputation: 1994
NTFS is sufficiently different that such things as ownerships and perms may not be preserved; also Linux Filesystems are case sensitive, unlike NTFS.
You could try mounting as Samba shares.
 
Old 11-23-2012, 01:19 AM   #6
Aunnix
Member
 
Registered: Aug 2012
Posts: 126

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by Adol View Post
I lost data when my drive was connected externally through usb. I havenít had a chance to try an internal setup while transferring.

Ah. Sucks to hear. For both your loss and my ambitions, lol. Thanks.
 
Old 11-23-2012, 01:33 AM   #7
Aunnix
Member
 
Registered: Aug 2012
Posts: 126

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by chrism01 View Post
NTFS is sufficiently different that such things as ownerships and perms may not be preserved; also Linux Filesystems are case sensitive, unlike NTFS.
You could try mounting as Samba shares.

I planned to use something like Samba or Samba itself to do that so that all of my computers can save data directly to the server and not take up space on their local hard drives. I don't know much about it yet, but will this help me if the server happens to fail?

About the permissions and such being preserved... is this likely to happen even if I have the "ntfsprogs" and "ntfs-3g" packages installed?

Last edited by Aunnix; 11-23-2012 at 01:35 AM.
 
Old 11-23-2012, 04:33 AM   #8
vitki
LQ Newbie
 
Registered: Nov 2012
Location: South-Africa
Distribution: Fedora , Centos , Backtrack , Suse
Posts: 12

Rep: Reputation: Disabled
How about rsync?

rsync -gloptrunc $srcdir $dstdir

I think it may even help with the NTFS problems. Have a look, we use it to backup our production hosts. The best thing about it is it only transfers files that has changed and does not use much reasorces.
 
Old 11-23-2012, 04:51 PM   #9
Aunnix
Member
 
Registered: Aug 2012
Posts: 126

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by vitki View Post
How about rsync?

rsync -gloptrunc $srcdir $dstdir

I think it may even help with the NTFS problems. Have a look, we use it to backup our production hosts. The best thing about it is it only transfers files that has changed and does not use much reasorces.

Yeah, I plan to do some research into this and cron. As far as I have been told, I am going to be using rsync to copy the data and have 2TB B match 2TB B. Then cron will be used to schedule 2TB B to mount, use rysnc to sync with 2TB A, then unmount. However, I did not know it could have an affect on what types of files it is transferring. I will look into it very soon to see what I can find out.

Thanks!
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Few questions abbout making backups Micik Linux - Newbie 9 07-01-2009 09:32 AM
Problem with Partitioning/Formatting/Mounting, not sure which. jtmcgee Linux - General 3 05-26-2009 10:44 PM
Formatting and Mounting Left Over Partition Wheat_Thins Linux - Software 5 05-21-2006 11:56 PM
Formatting and mounting hard drives Fear Linux - Hardware 1 01-23-2005 02:37 PM
floppy mounting/formatting drama PLEASE help me thisismadness Linux - Newbie 2 02-29-2004 05:46 PM


All times are GMT -5. The time now is 07:32 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration