Linux - NewbieThis Linux forum is for members that are new to Linux.
Just starting out and have a question?
If it is not in the man pages or the how-to's this is the place!
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
I have just bought a WD 2TB portable hdd - Windows compatible, formatting required for Mac.
I want to back data up from BOTH my linux and my Win machines. The final master copy of the data will be placed on the big linux box.
My question is this: should I just use the default formatting the hdd came with or should I reformat to something else?
Thanks in advance for your assistance.
Echidnagirl
If you plan to back up your data by connecting the HDD directly to each machine, use NTFS, which both Linux and Windows can write to. Or create one partition for Windows (NTFS) and one for Linux (ext4, xfs, zfs, ...). The latter is less flexible.
If you plan to connect the HDD to the big Linux box and back up your data over the network, use ext4, xfs, zfs etc.
I might consider making the first partition a NTFS and use windows shadow copy / virtual hard drive method.
Then second partition make it your distro's default file system.
However I just make it NTFS and use it for both. The backup method you use in both may need to be known in order to save the full information associated with the file.
I usually re-partition them and format them to be entirely ext2/3/4 one of them, typically 4. I find it clears away all the marketing items they've placed on the disk. That's just me.
As some others have mentioned, NTFS...
Depending on which Linux distribution you have, you should have "ntfs-3g.x86_64 : Linux NTFS userspace driver" in your repo.
Distribution: Currently: OpenMandriva. Previously: openSUSE, PCLinuxOS, CentOS, among others over the years.
Posts: 3,881
Rep:
And now this thread has come full circle... the bikeshedding on this forum is unreal...
What's wrong with berndbausch's answer ?
At the end of the day, the job of any filesystem is to organize files, rather than the data on the drive being just one big glob of meaningless data. I don't honestly see the need to complicate what should be a straightforward question. As long as the operating system's concerned can read whatever filesystem the drive is formatted with, who cares ?
I have an external hard drive that come pre-formatted with NTFS; you think I'm going to waste my time creating god only knows how many partitions on it ? Let alone one for each OS concerned ? Nope, what's the point ? I only have Linux on my own machine, but I might want to plug it into a Windows machine, who knows? The point: both Linux (through the NTFS-3G driver) and Windows can read it perfectly fine. What more do you want ? To cuddle up with the drive at night, and marvel at the filesystem it's formatted with ?
berndbausch is good. I just tried to add in a few more ideas and that files on different filesystems may need special handling to preserve extra metadata. Others added their point of views and opinions. All good information I thought.
Distribution: openSUSE, Raspbian, Slackware. Previous: MacOS, Red Hat, Coherent, Consensys SVR4.2, Tru64, Solaris
Posts: 2,803
Rep:
Quote:
Originally Posted by berndbausch
If you plan to back up your data by connecting the HDD directly to each machine, use NTFS, which both Linux and Windows can write to. Or create one partition for Windows (NTFS) and one for Linux (ext4, xfs, zfs, ...). The latter is less flexible.
But making an ext4 (or similar Linux) partition/filesystem means that things that an NTFS filesystem might not understand will get backed up properly. Does NTFS recognize a symbolic link? A Linux/Posix ACL? Some valid Linux filenames would be illegal on an NTFS filesystem.
Distribution: Currently: OpenMandriva. Previously: openSUSE, PCLinuxOS, CentOS, among others over the years.
Posts: 3,881
Rep:
Quote:
Originally Posted by rnturn
But making an ext4 (or similar Linux) partition/filesystem means that things that an NTFS filesystem might not understand will get backed up properly. Does NTFS recognize a symbolic link? A Linux/Posix ACL? Some valid Linux filenames would be illegal on an NTFS filesystem.
In all fairness to berndbausch; he did also suggest a Linux partition, formatted with a Linux-based filesystem in addition to an NTFS formatted partition (you even quoted it) - which would cover things like symlinks and filenames that would be invalid on a NTFS formatted partition. So it doesn't really add any value to the thread when people want to basically just repeat what's already been said anyway...
Almost forgot, I remember when I forgot about the fact some filenames while valid in Linux, aren't for NTFS, and I run "check disk" in Windows; it created a folder in the root of the drive concerned from my research (as I don't remember off the top of my head what the folder was called) called "FOUND.000", and the file with the invalid filename was there completely intact.
Also, it seems NTFS does support ACL's to at least some degree from what I've read of the link below.
Thank you everyone for your advice. I have decided to go with an NTFS format for the 2TB external drive and create a dedicated ext4 usb stick for critial data from my linux box (manuscript materials - I'm a writer - and personal financials). As the family custodian of photos and home videos all of that will be fine on NTFS.
I wasn't aware of the metadata issue - obviously suspected it - but with the extra drive for really important stuff (not sure family would agree) I am ok with shedding metadata for the rest. But thanks for the heads-up, if I need to maintain forensic standards I'll consider partitioning a drive as per your suggestions. Just to be safe. And sure. And I don't trust Windows. It doesn's show does it?
A special note to jsbjsb001: I might curl up with the drive - seems a reasonable thing to do - but only to marvel at the content ( when I started with computers as a kid we used a data disk and program disk 5.25 inch things and had to take out the prog disk and swap with the data one every time I wanted to save something). I'm old enough to truly appreciate a 2 TB! portable disc.
Till next time, I'll just lurk and learn in the background,
echidnagirl
I'm surprised at the number of recommendations for using NTFS without any discussion of the performance penalty imposed using NTFS instead of a native filesystem. The penalty is probably insignificant for email and modest numbers of jpegs, but could be severe if videos and TB or larger disks are involved.
I don't remember just how bad it was when I did test, but it seems might have been quite severe, maybe as bad as comparing USB 2.0 to SATA 3. Some comments on https://vxlabs.com/2019/12/06/wsl2-io-measurements/ suggest my recollection might not be too far off.
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.