GeneralThis forum is for non-technical general discussion which can include both Linux and non-Linux topics. Have fun!
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
You'll need 1TB of RAM first, otherwise you'll instantly run out of memory. And many filesystems do not support files that big.
Besides, you already can do this on your current machine.
try this:
Code:
dd if=/dev/zero of=1.bin bs=1 count=1 seek=2043G
Works on my ext3 volumes.
This will create one file filled with zeros, with filesize 2043G (either ext3 or dd doesn't support larger files). Works even on floppy drive, as long as you use reiserfs, xfs or ext3.
I had to put this amount of space in perspective for me to realize how much space I am actually discussing, here. I did this before but it didn't really sink in until a second time.
At 12 TB I can put 17,975 DivX Movies sized at 700MB each array.
At 4 TB I can put 5,999 DivX Movies sized 700MB Each on the array.
This would be if I was to use the system as a media server. With that in mind I thought that 12TB for on personal server was to much and figured I could split the array in 3 among 3 servers each having 4 TB. As to which servers I don't know.
As per IsaacKuo suggestions. I am debating on using RAID 1 for my production systems. Possibly to ensure maximum data protection I would put 3 drives in RAID 1 thus having two copies of the Main HDD.
This might be a good practice for a MySQL DB Production Server. However, it is worthy to note the RAID 5 is the most popular of all the RAID levels and I am quite sure that some hosting providers utilize RAID 5 but they are likely marginal traffic servers.
You'll need 1TB of RAM first, otherwise you'll instantly run out of memory. And many filesystems do not support files that big.
Besides, you already can do this on your current machine.
try this:
Code:
dd if=/dev/zero of=1.bin bs=1 count=1 seek=2043G
Works on my ext3 volumes.
This will create one file filled with zeros, with filesize 2043G (either ext3 or dd doesn't support larger files). Works even on floppy drive, as long as you use reiserfs, xfs or ext3.
I guess I read the man page wrong.
Anyway I read that most software used alongwith linux doesnt have filesize issues.
BTW, i dont have any storage issues, I am a simple hobbyist user, not some hardcore sysadmin. I just shift+delete whatever seems useless. But I do care about RAM. Still, I guess 12Tb of RAM would slow down startup greatly on my current 2.0 GHz system.
Still, I guess 12Tb of RAM would slow down startup greatly on my current 2.0 GHz system.
IF you pass "bs=1T" to dd you'll need just one 1TB or RAM, not 12. dd allocates memory when it copies data, and amount of memory is equal to blocksize. Try "dd bs=1M", "dd bs=50M", "dd bs=100M" and see memory usage difference.
Personally, I don't use RAID for anything. I greatly prefer using rsync to maintain backups. If the primary server goes down for any reason, then I just switch to a backup server. I generally don't like RAID1 because any problem caused by a changed or deleted or corrupted file instantly gets duplicated on the mirror.
Well that's certainly true. But there's nothing wrong with using RAID1 and rsyncing often: belt and suspenders!
podcasts and free stuff -games, music etc.
The rest for maybe a server and sell some space.
Or just try to put on it a lot of servers - MUD, radio, etc.
Only 12TB?
With todays laws for Data Retention, it is seriously not enough for one month's worth of data traffic for my corporate network, especially when I am forced by law to keep it for 2 years.
The discussion about the validity of RAID5 is invalid. RAID5 has a solid place in high availability data storage, as do other RAID configurations.
You use what is right for the job - not the personal opinion. :P
i would be able to run approximately a month of daly backups on it on a rotation scheme before running out of space
but the firms requirements that backup drives are removed, cloned, one stored in the fire safe and one sent to secure off site storage might prove problamatic
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.