SlackwareThis Forum is for the discussion of Slackware Linux.
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
I just run flash drives like they were regular drives. They almost never really wear out. They suffer size/price so I get a new larger one. They suffer getting left in pants and go through washer. They suffer esd and shock but they almost never just wear out.
I just run flash drives like they were regular drives. They almost never really wear out. They suffer size/price so I get a new larger one. They suffer getting left in pants and go through washer. They suffer esd and shock but they almost never just wear out.
I totally agree. There are certainly a ton of users who are going to relate their stories of how a flash drive died on them, this is the randomness of life. My personal experiences are more along the lines of what jefro says there.
OP I wonder how the original proposed project went?
I also do wonder if anyone has seen or knows of any utilities which would the health of any given flash drive? There's extending the life, but there's also variances in manufacturing and as a result you can take two identical drive models and one is a klunker where the other one lasts for years. With magnetic drives there is an interface; I thought through ACPI, which advanced disk analysis tools can use to assess the amount of usage and time in service; no direct judgements but at least statistics where someone can make their own assessment. Does anything similar exist for flash drives?
Quote:
Originally Posted by nix84
I have a laptop on order and am planning the install of Slackware, Fedora, and Umbuntu on flash drives. I am currently running Slackware 13.37 partitioned as shown here:
The laptop has 2 USB-2 ports, but will probably use 1 port at a time. I will be multi-booting and in order to minimize "sdc" writes, it is currently my plan to put /boot, /usr, and /sbin for each distro on a flash drive and /root, /opt, /var, /home, and /tmp on the hard drive, in separate partitions for each distro.
I am wondering if there might be a better way to configure to leave most of the read only system code on the flash drive. The purpose of this is to improve the life of the flash drives.
Thanks for UR suggestions
As a useful addendum to this thread, I came across this article, which shows the way to convert flash drives from the default proprietary FAT32 format to a fully open UDF format.
alright, but why would one want to do this? True, FAT32 has that file size limit of 4GB. But apart from DVD images, virtual HDDs for a VM or very large video files I haven't yet had a situation where that limit actually mattered. True, FAT32 is proprietary and not officially documented, but yet widely known thanks to diligent reverse engineering of many experts, and is supported by a vast scale of systems from big servers across desktop systems down to the embedded sector - just think of digital cameras or hard disk video recorders or TV units with PVR function on external USB media.
And even if file size did matter, UDF would be about the last thing I'd choose, especially for compatibility reasons. If you're going to use the external media with Linux only, you can safely use ext2/3/4. But if compatibility with Windows machines AND files beyond 4GB are a necessary requirement, UDF is a lottery game. Better even to use NTFS, which is proprietary, but supported by all contemporary Linux distros out of the box.
Incidentally, the only context where I encountered UDF so far is CD packet writing - with all the counter-indications mentioned above. So from my point of view, UDF is a dead birth.
Distribution: Debian Sid AMD64, Raspbian Wheezy, various VMs
Posts: 7,680
Rep:
Just because you don't come across the file size limits of FAT doesn't mean nobody else does. I admit I probably came across it first when "trying to back up DVDs for friends" but now when I'm sometimes backing up VM hard drives, distribution DVDs or just long videos (the file I was copying earlier in this thread is the free Bergensbanen video) I couldn't cope wit ha limit on file size.
I'm not sure that UDF is the answer but my experience with Linux's NTFS support leaves a lot to be desired so I don't feel it is a better choice.
Any reverse engineering of FAT32 is also potentially illegal, you understand, since these wonderful new laws like the "digital millennium copyright act" came into existence. It really is time we stopped giving MS reason to spread FUD and used a different file system.
I'm copying a 23.5GB file to my UDF formatted drive as I type -- it seems it will take an hour or so but if it works with my Windows XP and 8.1 VMs I'll be looking to use it for my backups.
Why, oh why can't manufacturers use this file system to get around MS patent FUD and file size restrictions? I still do not understand why Google haven't stomped all over FAT or why Tomtom decided to pay for FAT rather than use an alternative and tell MS to go away.
This evening I copied just over 22GB to two flash disks. So far Windows (XP up), Slackware and NetBSD have had no problems reading from and writing to these UDF-formatted disks. As you say, why oh why? Here in UDF we have a decent file system which is inter-operable across different operating systems. I am completely new to UDF but for the life of me I can't understand why this thing didn't take off long ago and leave all the others in the dust.
If Pat is reading this, I would like to politely ask for the inclusion of udftools in Slackware. It is a small utility and in my opinion once the benefits of UDF are known then UDF becomes as important a filesystem for portable devices as ext{2,3,4} is for HDDs.
Just because you don't come across the file size limits of FAT ...
oh, mind you - I do, and frequently so with video files (raw MPEG TS recordings from TV).
Quote:
Originally Posted by 273
[...] my experience with Linux's NTFS support leaves a lot to be desired so I don't feel it is a better choice.
NTFS itself leaves a lot to be desired, most of all stability and reliability. Back in the time I used Windows, I usually avoided NTFS, as I've experienced several serious Windows crashes (from NT4.0 up to XP) that left the file system damaged beyond repair. On a FAT (FAT12,16,32) volume, similar accidents would typically corrupt a handfull of files, but on the whole leave the system recoverable. FAT is, let me say, robust and sturdy because of its simplicity.
Quote:
Originally Posted by 273
Any reverse engineering of FAT32 is also potentially illegal
Well, I shouldn't have used the term "reverse engineering", because I meant something slightly different: The available information about the FAT family is sufficient for programmers to implement their own FAT file system driver. And many did; FAT16/FAT32 implementations are available from third-parties in a great variety.
Distribution: Debian Sid AMD64, Raspbian Wheezy, various VMs
Posts: 7,680
Rep:
Quote:
Originally Posted by Doc CPU
Well, I shouldn't have used the term "reverse engineering", because I meant something slightly different: The available information about the FAT family is sufficient for programmers to implement their own FAT file system driver. And many did; FAT16/FAT32 implementations are available from third-parties in a great variety.
[X] Doc CPU
Well, yes, but any FAT implementation is potentially subject to a Microsoft injunction or demand for payment. You only have to look to Tomtom being effectively killed off by Microsoft over it, the Microsoft tax on every Android handset sold in the US and the US legal system's handing over of No-IP to Microsoft to see that anything even vaguely related to Microsoft can and does cause problems to all involved. In these days where the US legal system has declared itself for sale to the highest bidder I find myself not wanting to rely upon any software product a US firm may have even the slightest claim to.
Last edited by 273; 07-03-2014 at 06:49 AM.
Reason: typo'
Why would there be a Microsoft tax on Android devices? Android uses ext4. It can read FAT-formatted cards, but it doesn't use that filesystem otherwise.
Distribution: Debian Sid AMD64, Raspbian Wheezy, various VMs
Posts: 7,680
Rep:
Quote:
Originally Posted by sgosnell
Why would there be a Microsoft tax on Android devices? Android uses ext4. It can read FAT-formatted cards, but it doesn't use that filesystem otherwise.
Splitting hairs I know, but you're not going to "extend the life" of a flash drive, it's life is determined by the statistical amount of write cycles it can sustain; therefore in that - newer is better because as hardware technology improves, the amount of write cycles a re-writeable flash drive can sustain gets better. What you're looking to do is extend the "use period" for your flash drives.
Actually for newer flash chips the possible number of erase cycles for each erase block did take a large hit. But number of erase-cycles multiplied by the number number of erase blocks did increase. Modern SSDs are huge. 16 GB for is two complete overwrites for an ancient 8 GB SSD (with 100k erase cycles) of an early netbook, but nothing for a modern 1 TB SSD (with 3k erase cycles NAND). Conclusion: These newer Flash cells wear down 32 times faster, but there are 128 times more of them, so it doesn't matter.
As a useful addendum to this thread, I came across this article, which shows the way to convert flash drives from the default proprietary FAT32 format to a fully open UDF format. The required udftools program is available on SBo.
In addition to being a fully open standard, UDF can handle files larger than 4GB with ease. I might not need the capability now, but when I do, having it available to me is invaluable.
There are multiple issues with UDF in Linux. The Linux implementation of UDF is bitrot code, so it is only safe for ready-only use. The udftools haven't been updated for decade, too. USB flash drives expect to operated with large blocksizes like 32 KiB (for FAT32). Setting the block size to 512 as proposed on the blog will kill the flash memory with read-modify-write cycles.
The specifications of FAT12, FAT16 and FAT32 are public, patents only cover LFNs ("long file names") and will expire in this decade. The proprietary successor is "Exfat", but even that is better supported by Linux than UDF. The right way to deal with such stuff, is using an alternative LFN solution on top of FAT (like the OS/2 one), making it incompatible with Windows 95. But in the mobile sector (where MS makes most of its FAT license money) Windows becomes irrelevant anyway.
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.