LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 01-13-2020, 10:30 AM   #1
echidnagirl
LQ Newbie
 
Registered: Nov 2019
Location: Far North Queensland, Australia
Distribution: Mint 20.3 + Debian 11.5
Posts: 17

Rep: Reputation: Disabled
Question Portable hdd - which format?


I have just bought a WD 2TB portable hdd - Windows compatible, formatting required for Mac.
I want to back data up from BOTH my linux and my Win machines. The final master copy of the data will be placed on the big linux box.
My question is this: should I just use the default formatting the hdd came with or should I reformat to something else?
Thanks in advance for your assistance.
Echidnagirl
 
Old 01-13-2020, 10:46 AM   #2
berndbausch
LQ Addict
 
Registered: Nov 2013
Location: Tokyo
Distribution: Mostly Ubuntu and Centos
Posts: 6,316

Rep: Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002
If you plan to back up your data by connecting the HDD directly to each machine, use NTFS, which both Linux and Windows can write to. Or create one partition for Windows (NTFS) and one for Linux (ext4, xfs, zfs, ...). The latter is less flexible.

If you plan to connect the HDD to the big Linux box and back up your data over the network, use ext4, xfs, zfs etc.
 
2 members found this post helpful.
Old 01-13-2020, 03:39 PM   #3
Tonus
Senior Member
 
Registered: Jan 2007
Location: Paris, France
Distribution: Slackware-15.0
Posts: 1,405
Blog Entries: 3

Rep: Reputation: 513Reputation: 513Reputation: 513Reputation: 513Reputation: 513Reputation: 513
Portable hdd - which format?

Back up from both : I would go with ext4
Connect directly to both : 2 partitions or ntfs

Honestly, just sync data from Windows with a cloud and use rsync for the Linux system.

Then you'll be ready to trash the windows box :-p
 
Old 01-13-2020, 03:44 PM   #4
jefro
Moderator
 
Registered: Mar 2008
Posts: 21,974

Rep: Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623
I might consider making the first partition a NTFS and use windows shadow copy / virtual hard drive method.
Then second partition make it your distro's default file system.

However I just make it NTFS and use it for both. The backup method you use in both may need to be known in order to save the full information associated with the file.
 
1 members found this post helpful.
Old 01-13-2020, 07:30 PM   #5
frankbell
LQ Guru
 
Registered: Jan 2006
Location: Virginia, USA
Distribution: Slackware, Ubuntu MATE, Mageia, and whatever VMs I happen to be playing with
Posts: 19,311
Blog Entries: 28

Rep: Reputation: 6137Reputation: 6137Reputation: 6137Reputation: 6137Reputation: 6137Reputation: 6137Reputation: 6137Reputation: 6137Reputation: 6137Reputation: 6137Reputation: 6137
I usually leave my external USB drives NTFS unless I have a compelling reason to reformat them.
 
2 members found this post helpful.
Old 01-13-2020, 07:36 PM   #6
rtmistler
Moderator
 
Registered: Mar 2011
Location: USA
Distribution: MINT Debian, Angstrom, SUSE, Ubuntu, Debian
Posts: 9,883
Blog Entries: 13

Rep: Reputation: 4930Reputation: 4930Reputation: 4930Reputation: 4930Reputation: 4930Reputation: 4930Reputation: 4930Reputation: 4930Reputation: 4930Reputation: 4930Reputation: 4930
I usually re-partition them and format them to be entirely ext2/3/4 one of them, typically 4. I find it clears away all the marketing items they've placed on the disk. That's just me.
 
1 members found this post helpful.
Old 01-14-2020, 04:36 AM   #7
fatmac
LQ Guru
 
Registered: Sep 2011
Location: Upper Hale, Surrey/Hants Border, UK
Distribution: Mainly Devuan, antiX, & Void, with Tiny Core, Fatdog, & BSD thrown in.
Posts: 5,479

Rep: Reputation: Disabled
A suitable sized NTFS partition for your Windows machine to back up to, the rest ext4.
 
1 members found this post helpful.
Old 01-14-2020, 05:42 AM   #8
dc.901
Senior Member
 
Registered: Aug 2018
Location: Atlanta, GA - USA
Distribution: CentOS/RHEL, openSuSE/SLES, Ubuntu
Posts: 1,005

Rep: Reputation: 370Reputation: 370Reputation: 370Reputation: 370
As some others have mentioned, NTFS...
Depending on which Linux distribution you have, you should have "ntfs-3g.x86_64 : Linux NTFS userspace driver" in your repo.
 
1 members found this post helpful.
Old 01-14-2020, 05:52 AM   #9
jsbjsb001
Senior Member
 
Registered: Mar 2009
Location: Earth, unfortunately...
Distribution: Currently: OpenMandriva. Previously: openSUSE, PCLinuxOS, CentOS, among others over the years.
Posts: 3,881

Rep: Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063
And now this thread has come full circle... the bikeshedding on this forum is unreal...

What's wrong with berndbausch's answer ?

At the end of the day, the job of any filesystem is to organize files, rather than the data on the drive being just one big glob of meaningless data. I don't honestly see the need to complicate what should be a straightforward question. As long as the operating system's concerned can read whatever filesystem the drive is formatted with, who cares ?

I have an external hard drive that come pre-formatted with NTFS; you think I'm going to waste my time creating god only knows how many partitions on it ? Let alone one for each OS concerned ? Nope, what's the point ? I only have Linux on my own machine, but I might want to plug it into a Windows machine, who knows? The point: both Linux (through the NTFS-3G driver) and Windows can read it perfectly fine. What more do you want ? To cuddle up with the drive at night, and marvel at the filesystem it's formatted with ?

...and now I contributed to it
 
1 members found this post helpful.
Old 01-14-2020, 08:48 PM   #10
jefro
Moderator
 
Registered: Mar 2008
Posts: 21,974

Rep: Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623
berndbausch is good. I just tried to add in a few more ideas and that files on different filesystems may need special handling to preserve extra metadata. Others added their point of views and opinions. All good information I thought.
 
1 members found this post helpful.
Old 01-14-2020, 10:11 PM   #11
Geist
Member
 
Registered: Jul 2013
Distribution: Slackware 14 / current
Posts: 442

Rep: Reputation: 196Reputation: 196
I went with NTFS and never looked back. The evil windows scourge is not yet dead, and this particular decision is not very likely to kill it.

That said, my 'portable' thing is just for non essential data, movies, pictures, etc.
 
1 members found this post helpful.
Old 01-15-2020, 12:28 AM   #12
rnturn
Senior Member
 
Registered: Jan 2003
Location: Illinois (SW Chicago 'burbs)
Distribution: openSUSE, Raspbian, Slackware. Previous: MacOS, Red Hat, Coherent, Consensys SVR4.2, Tru64, Solaris
Posts: 2,800

Rep: Reputation: 550Reputation: 550Reputation: 550Reputation: 550Reputation: 550Reputation: 550
Quote:
Originally Posted by berndbausch View Post
If you plan to back up your data by connecting the HDD directly to each machine, use NTFS, which both Linux and Windows can write to. Or create one partition for Windows (NTFS) and one for Linux (ext4, xfs, zfs, ...). The latter is less flexible.
But making an ext4 (or similar Linux) partition/filesystem means that things that an NTFS filesystem might not understand will get backed up properly. Does NTFS recognize a symbolic link? A Linux/Posix ACL? Some valid Linux filenames would be illegal on an NTFS filesystem.
 
1 members found this post helpful.
Old 01-15-2020, 04:47 AM   #13
jsbjsb001
Senior Member
 
Registered: Mar 2009
Location: Earth, unfortunately...
Distribution: Currently: OpenMandriva. Previously: openSUSE, PCLinuxOS, CentOS, among others over the years.
Posts: 3,881

Rep: Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063Reputation: 2063
Quote:
Originally Posted by rnturn View Post
But making an ext4 (or similar Linux) partition/filesystem means that things that an NTFS filesystem might not understand will get backed up properly. Does NTFS recognize a symbolic link? A Linux/Posix ACL? Some valid Linux filenames would be illegal on an NTFS filesystem.
In all fairness to berndbausch; he did also suggest a Linux partition, formatted with a Linux-based filesystem in addition to an NTFS formatted partition (you even quoted it) - which would cover things like symlinks and filenames that would be invalid on a NTFS formatted partition. So it doesn't really add any value to the thread when people want to basically just repeat what's already been said anyway...

Almost forgot, I remember when I forgot about the fact some filenames while valid in Linux, aren't for NTFS, and I run "check disk" in Windows; it created a folder in the root of the drive concerned from my research (as I don't remember off the top of my head what the folder was called) called "FOUND.000", and the file with the invalid filename was there completely intact.

Also, it seems NTFS does support ACL's to at least some degree from what I've read of the link below.

https://jp-andre.pagesperso-orange.fr/ntfssecaudit.html

Last edited by jsbjsb001; 01-15-2020 at 05:34 AM. Reason: additions
 
1 members found this post helpful.
Old 01-15-2020, 11:09 AM   #14
echidnagirl
LQ Newbie
 
Registered: Nov 2019
Location: Far North Queensland, Australia
Distribution: Mint 20.3 + Debian 11.5
Posts: 17

Original Poster
Rep: Reputation: Disabled
Smile NTFS format it is + dedicated Linux usb

Thank you everyone for your advice. I have decided to go with an NTFS format for the 2TB external drive and create a dedicated ext4 usb stick for critial data from my linux box (manuscript materials - I'm a writer - and personal financials). As the family custodian of photos and home videos all of that will be fine on NTFS.
I wasn't aware of the metadata issue - obviously suspected it - but with the extra drive for really important stuff (not sure family would agree) I am ok with shedding metadata for the rest. But thanks for the heads-up, if I need to maintain forensic standards I'll consider partitioning a drive as per your suggestions. Just to be safe. And sure. And I don't trust Windows. It doesn's show does it?
A special note to jsbjsb001: I might curl up with the drive - seems a reasonable thing to do - but only to marvel at the content ( when I started with computers as a kid we used a data disk and program disk 5.25 inch things and had to take out the prog disk and swap with the data one every time I wanted to save something). I'm old enough to truly appreciate a 2 TB! portable disc.
Till next time, I'll just lurk and learn in the background,
echidnagirl
 
Old 02-02-2020, 03:00 AM   #15
mrmazda
LQ Guru
 
Registered: Aug 2016
Location: SE USA
Distribution: openSUSE 24/7; Debian, Knoppix, Mageia, Fedora, others
Posts: 5,799
Blog Entries: 1

Rep: Reputation: 2066Reputation: 2066Reputation: 2066Reputation: 2066Reputation: 2066Reputation: 2066Reputation: 2066Reputation: 2066Reputation: 2066Reputation: 2066Reputation: 2066
I'm surprised at the number of recommendations for using NTFS without any discussion of the performance penalty imposed using NTFS instead of a native filesystem. The penalty is probably insignificant for email and modest numbers of jpegs, but could be severe if videos and TB or larger disks are involved.

I don't remember just how bad it was when I did test, but it seems might have been quite severe, maybe as bad as comparing USB 2.0 to SATA 3. Some comments on https://vxlabs.com/2019/12/06/wsl2-io-measurements/ suggest my recollection might not be too far off.
 
  


Reply

Tags
external-hdd, formatting, portable



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Can't format 4tb portable hdd actinide Linux - Hardware 10 07-06-2017 02:44 PM
Which video format is most portable? ciden Linux - Software 1 02-02-2010 11:51 AM
need a portable linux distro to bring on portable usb hard drive... pippo17 Linux - Distributions 3 10-20-2008 06:41 AM
Installing linux (Ubuntu) in Western digital portable HDD 120 GB which supports FAT32 kishoreinme Linux - Newbie 2 06-14-2008 08:20 PM
how to do a dual boot (Windows on portable HDD) linux on computer HDD izquierdista Linux - General 5 01-28-2006 09:50 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 01:11 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration