LinuxQuestions.org
Help answer threads with 0 replies.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware
User Name
Password
Linux - Hardware This forum is for Hardware issues.
Having trouble installing a piece of hardware? Want to know if that peripheral is compatible with Linux?

Notices


Reply
  Search this Thread
Old 08-23-2011, 03:23 PM   #1
edbgato
LQ Newbie
 
Registered: Aug 2011
Posts: 6

Rep: Reputation: Disabled
Question USB External HDD with Multiple Partitions


Greetings fellow Linux aficionados.

My Situation:
I want to use an external hard drive as a storage medium for backups for four different operating systems: Windows 7, Windows XP, Fedora Core, and CentOS 5.6. These OS's reside on two separate boxes, one of which is a multiple-boot box. It would be really nice if I could use the same physical device for all of my OS's. My heart leans toward a large capacity drive like a 2TB device. A pre-made solution like a Western Digital MyBook or Fantom Drive would seem preferrable, but a custom-built device is not out of the question.

My first consideration is to use a 2TB WD MyBook or similar and reformat it with a filesystem that both Windows and Linux could use without conflicts. But it appears that Windows 7 may be a "problem child" and not be compatible with the other OS's.

My alternative consideration is to format the device with two partitions and format one with NTFS and the other with Ext3. This is where I get a bit confused. I have, in the past, reformatted USB drives with another filesystem without issues. But I never tried to repartition a USB drive. I don't know how Windows nor Linux will react to mounting a multi-partitioned USB drive. Then there is some confusion on my part about the eccentric nature of high-capacity drives. Among the 2TB drives, there are mentions of "advanced formatting" and "alignment programs for XP" that make me reluctant to use anything bigger than 1TB.

Then my consideration of last-resort is to use an external docking station and multiple 1TB drives, but this is the most expensive approach of all.

My Question:
Has anyone managed to successfully put multiple partitions on a USB external hard drive and have it behave in both Windows and Linux?

Pointers and/or suggestions are most welcome.
Thank you for your time and attention to my query.
 
Old 08-23-2011, 04:26 PM   #2
Doc CPU
Senior Member
 
Registered: Jun 2011
Location: Stuttgart, Germany
Distribution: Mint, Debian, Gentoo, Win 2k/XP
Posts: 1,099

Rep: Reputation: 344Reputation: 344Reputation: 344Reputation: 344
Hi there,

Quote:
Originally Posted by edbgato View Post
I want to use an external hard drive as a storage medium for backups for four different operating systems: Windows 7, Windows XP, Fedora Core, and CentOS 5.6. These OS's reside on two separate boxes, one of which is a multiple-boot box. It would be really nice if I could use the same physical device for all of my OS's.
that's not what I would prefer - I'd rather have separate physical media. But that is -to some degree- a matter of personal preference.

Quote:
Originally Posted by edbgato View Post
My heart leans toward a large capacity drive like a 2TB device. A pre-made solution like a Western Digital MyBook or Fantom Drive would seem preferrable, but a custom-built device is not out of the question.
What do you mean, "custom-built"? Are you regarding a combination of an off-the-shelf HDD and a generic USB enclosure "custom-built"? I don't.
But nonetheless, that's not relevant for your question.

Quote:
Originally Posted by edbgato View Post
My first consideration is to use a 2TB WD MyBook or similar and reformat it with a filesystem that both Windows and Linux could use without conflicts. But it appears that Windows 7 may be a "problem child" and not be compatible with the other OS's.
That depends. It depends on your choice of file systems. All the OS's you mentioned can deal with FAT32, which is simple and robust. So that would be a good choice if it weren't for a little stipulation: FAT32 doesn't support files >4GB. If you have files that large (or cannot completely rule out that you may have), FAT32 is not an option for you.
Second, all these systems should be able to deal with NTFS, though there may be some issues here and there with the Linux OS's. After all, NTFS is still closed-source, and all work that the Linux programmers could do so far is based on reverse engineering, guesswork and testing.
Finally, there is Ext2IFS for Windows - that's a file system driver that makes Ext2/Ext3 file systems accessible from Windows. I've used it with XP for some time and that worked fine; I'm not sure, however, if it is compatible with Seven.

Quote:
Originally Posted by edbgato View Post
I have, in the past, reformatted USB drives with another filesystem without issues. But I never tried to repartition a USB drive. I don't know how Windows nor Linux will react to mounting a multi-partitioned USB drive.
That's absolutely no problem. Both Windows *and* Linux will do nicely with USB storage units that have multiple partitions. Windows will assign a drive letter to only the partitions with a file system it recognizes, but that's not a problem; Linux will probably recognize all partitions, so you can mount them as separate file systems (if your distro doesn't auto-mount them to /media/volume-id anyway).

Quote:
Originally Posted by edbgato View Post
Then there is some confusion on my part about the eccentric nature of high-capacity drives. Among the 2TB drives, there are mentions of "advanced formatting" and "alignment programs for XP" that make me reluctant to use anything bigger than 1TB.
Never heard of those issues, but a good friend of mine is using 2GB external drives with XP and Seven, and he never mentioned that there was a problem about that.

Quote:
Originally Posted by edbgato View Post
Then my consideration of last-resort is to use an external docking station and multiple 1TB drives, but this is the most expensive approach of all.
It definitely is. If you go that far, it may be cheaper to "reanimate" an old PC and set it up as a file server with multiple HDDs.

Quote:
Originally Posted by edbgato View Post
Has anyone managed to successfully put multiple partitions on a USB external hard drive and have it behave in both Windows and Linux?
AFAIK that's no problem at all. YMMV.

[X] Doc CPU
 
Old 08-23-2011, 06:10 PM   #3
edbgato
LQ Newbie
 
Registered: Aug 2011
Posts: 6

Original Poster
Rep: Reputation: Disabled
Thanks, Doc, for the response.

In regards to the choice of filesystems:
FAT32 is not an option. Files sizes could easily bust the 4GB limit, especially with disk image files.

NTFS for XP and Linux works well, but Win7, I suspect, may use features not covered by the current NTFS-3G driver. When it comes to Linux compatibilty with anything Microsoft, I don't trust Microsoft to "play nice". Linux is a competitor.

Ext2IFS works well, but Win7 does not want to install it because of a missing digital signature. Win7 can be forced to install it, but I prefer not to do that right now. The Ext2IFS's author is aware of this issue and claims that a fix is "coming soon".


In regards to multi-partitioned mounting:
Good! I can probably put that concern to bed.


In regards to the high-capacity drive issues:
All of this eccentric stuff about high-capacity drives, I got from digesting hard drive specs, especially Samsung drives. Most manufacturers claim to use all sorts of advanced magic tricks to squeeze the last byte out of existing technology. It may not be anything except tech-talk to impress the potential buyer, but if not, can it be an issue with partitioning and/or formatting? My knowledge of modern hardware is limited, but growing.


In regards to reanimating an old pc:
Considering that a good docking station with USB2 and eSATA interfaces costs about $30-35, I doubt a retrofit of my old Dell box with SATA would be cost-effective.
 
Old 08-24-2011, 03:13 AM   #4
Doc CPU
Senior Member
 
Registered: Jun 2011
Location: Stuttgart, Germany
Distribution: Mint, Debian, Gentoo, Win 2k/XP
Posts: 1,099

Rep: Reputation: 344Reputation: 344Reputation: 344Reputation: 344
Hi there again,

Quote:
Originally Posted by edbgato View Post
FAT32 is not an option. Files sizes could easily bust the 4GB limit, especially with disk image files.
yea, I see. That's why I mentioned this limit. I encountered it a few times dealing with MPEG2 video files, but disk images are another issue.

Quote:
Originally Posted by edbgato View Post
NTFS for XP and Linux works well, but Win7, I suspect, may use features not covered by the current NTFS-3G driver. When it comes to Linux compatibilty with anything Microsoft, I don't trust Microsoft to "play nice". Linux is a competitor.
Wait a moment! Maybe you didn't get the idea down to the detail.
Yes, it's true that Seven's NTFS driver is more advanced than that of XP, and has some extra functions and features (though they claim to use the same NTFS spec Version 3.1). But you don't have to use those features, do you? ;-)
Acutally, I'm using an older 250GB HDD that I formatted to NTFS under Windows 2000, and I can use it without trouble with Win 2000, Win XP, Win 7, Ubuntu 9.04 and Ubuntu 10.10. Probably with any other distro using NTFS-3G.

I GUESS: When a partition is NTFS-formatted under Windows, it gets tagged with the Windows version. If you access it with a later version, it will refrain from using its own more advanced features. But again, that's just a guess of mine based on the experience that there's really perfect backwards compatibility.

Quote:
Originally Posted by edbgato View Post
Ext2IFS works well, but Win7 does not want to install it because of a missing digital signature. Win7 can be forced to install it, but I prefer not to do that right now. The Ext2IFS's author is aware of this issue and claims that a fix is "coming soon".
Wanna give it a try? Maybe with Seven installed in a VM? Maybe I'll do that some time, and I expect Ext2IFS to work fine. But then again, I'm not keen on touching that piece of crap (Win7) unless really necessary, and not without protective gloves ...

Quote:
Originally Posted by edbgato View Post
In regards to the high-capacity drive issues:
All of this eccentric stuff about high-capacity drives, I got from digesting hard drive specs, especially Samsung drives.
When I read your mention of these issues, I tried to think of technical limits that might apply. But at that capacity region, there's none that I know of (which doesn't mean anything). The highest limit I know is that some old mainboards (BIOSes, actually) have trouble with drives >128GB (and I mean drives, not partitions).
That very same limit also applied to some old OS's, the latest of which was Windows 98 (98SE overcame the 128GB limit).

Quote:
Originally Posted by edbgato View Post
Most manufacturers claim to use all sorts of advanced magic tricks to squeeze the last byte out of existing technology. It may not be anything except tech-talk to impress the potential buyer, but if not, can it be an issue with partitioning and/or formatting?
AFAIS no. The interaction between OS (or BIOS during the first boot phase) is a matter of requesting sectors to be read or written, and the sectors are referred to by their number. Since the sector size is usually 512 byte, a 1TB drive has about 2^31 sectors, a 2TB drive has 2^32 (roughly). According to SATA and the latest ATA spec, the sector number is exchanged as a 48bit quantity, so we're far from that limit.
However, it's possible that there is an implementation specific limit with some controllers, especially the cheap USB/SATA bridges. I admit that 2^31 or 2^32 rings a bell. Possibly some embedded-system programmers didn't care to *use* more than 32bit ...
But that would be a limit of the controller hardware, not the OS's used to access the drive.

Quote:
Originally Posted by edbgato View Post
Considering that a good docking station with USB2 and eSATA interfaces costs about $30-35, I doubt a retrofit of my old Dell box with SATA would be cost-effective.
Oh, depends on whether the old machine is still working or not. My motto is: If a piece of hardware is still intact and just resting in a quiet corner, why not put it to use again? Of course, spending $100 or more to get an old system up and running would be nonsense. But if it's just a matter of a few hours' work, why not? From a business point of view, that's foolish, too, but in the home and hobby field ...
By the way, I've never seen a USB enclosure that hosts more than one drive at the price you mention. Here in Germany, they would usually start at far beyond 50 Euros - at a very rough guess, that's about $70 and up. The single-drive enclosures typically start at about 20 Euros (~ $30).

[X] Doc CPU
 
Old 08-25-2011, 10:00 PM   #5
edbgato
LQ Newbie
 
Registered: Aug 2011
Posts: 6

Original Poster
Rep: Reputation: Disabled
Thanks again, Doc, for the reply.

I think I allowed myself to become entangled in a lot of hard drive specification details that confused me. After much consideration, I understand that external and internal HDDs are pretty much functionaly equivalent. And drive capacity doesn't matter either except when you break the 2.2TB limit and you must use the GUID Partition Table stuff. So I now know what I will do from the hardware perspective.

However, I am still researching what I will do with drive partitions and the filesystems that will reside on them. I will do some experimentation with NTFS-3G and Ext2IFS as you suggest.

This will be my last post to this thread unless I find something worthy of an update.
 
Old 08-25-2011, 11:29 PM   #6
chickenjoy
Member
 
Registered: Apr 2007
Distribution: centos,rhel, solaris
Posts: 239

Rep: Reputation: 30
how about considering exFAT? its the next version of fat32 without the 4gb limitation.

win7 = already supported
xp = must be sp3 and there is a small 300kb downloadable patch that will allow it to access exFAT.
fedora = a patch is available depending on your version
centos = a patch is available depending on your version


For your needs; I'd recommend a NAS so that:
1. you don't have to unplug and replug the usb external hd between the machines.
2. you can access the data via a web browser and/or access it via a shared folder and/or mount it to look like a local partition.
3. always on; ease of use. you don't have to be physically there to move data around the 4 machines; since all can access it all the time.
 
Old 08-26-2011, 11:40 AM   #7
Doc CPU
Senior Member
 
Registered: Jun 2011
Location: Stuttgart, Germany
Distribution: Mint, Debian, Gentoo, Win 2k/XP
Posts: 1,099

Rep: Reputation: 344Reputation: 344Reputation: 344Reputation: 344
Hi there,

Quote:
Originally Posted by chickenjoy View Post
how about considering exFAT? its the next version of fat32 without the 4gb limitation.

win7 = already supported
xp = must be sp3 and there is a small 300kb downloadable patch that will allow it to access exFAT.
fedora = a patch is available depending on your version
centos = a patch is available depending on your version
I've heard of exFAT, but nothing yet that I could get a grip on. As it appears to me, it's still highly experimental. I wouldn't like to use it on a disk or with a machine that I need for my everyday work. Maybe on a computer set aside for testing.

Quote:
Originally Posted by chickenjoy View Post
For your needs; I'd recommend a NAS
That's pretty close to what I had in mind when I suggested to put an old machine to a new purpose.
My solution, however, is a low-energy PC based on an Intel Atom CPU that needs only about 20W. It has an internal 160GB SATAN drive, an external 1TB USB drive, runs on Gentoo and offers a samba file server, Apache and mySQL, a local mail server, and a lot more services. Plus, I temporarily connect and mount either of two more 1TB drives via USB for backup purposes and store them in a different place otherwise.

I wouldn't call that a typical setup, however. ;-)

[X] Doc CPU
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Slow USB transfer rates (60kb p/s) External HDD --> Internal HDD drfrostbyte Linux - Hardware 4 03-28-2011 01:20 AM
Success: Multiple live distros in a single external HDD with GRUB2 d3249 LinuxQuestions.org Member Success Stories 0 12-31-2010 12:34 AM
External ubuntu install on external USB HDD th3_tr00p3r Linux - Newbie 1 05-11-2008 02:56 PM
Mounting USB external drive with multiple partitions, USB bluetooth mouse xmeson Slackware 7 12-17-2006 09:00 AM
partitions - multiple hdd ricdave Linux - Newbie 4 05-24-2003 06:36 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware

All times are GMT -5. The time now is 01:44 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration