LinuxQuestions.org
Review your favorite Linux distribution.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > General
User Name
Password
General This forum is for non-technical general discussion which can include both Linux and non-Linux topics. Have fun!

Notices


Reply
  Search this Thread
Old 08-28-2008, 06:30 PM   #31
ErV
Senior Member
 
Registered: Mar 2007
Location: Russia
Distribution: Slackware 12.2
Posts: 1,202
Blog Entries: 3

Rep: Reputation: 62

Quote:
Originally Posted by ciden View Post
I would try this

Code:
# dd if=/dev/zero of=a_big_file bs=1T count=12
You'll need 1TB of RAM first, otherwise you'll instantly run out of memory. And many filesystems do not support files that big.

Besides, you already can do this on your current machine.
try this:
Code:
dd if=/dev/zero of=1.bin bs=1 count=1 seek=2043G
Works on my ext3 volumes.
This will create one file filled with zeros, with filesize 2043G (either ext3 or dd doesn't support larger files). Works even on floppy drive, as long as you use reiserfs, xfs or ext3.

Last edited by ErV; 08-28-2008 at 06:55 PM.
 
Old 08-28-2008, 08:19 PM   #32
richinsc
Member
 
Registered: Mar 2007
Location: Utah
Distribution: Ubuntu Linux (20.04)
Posts: 224

Original Poster
Rep: Reputation: 32
I had to put this amount of space in perspective for me to realize how much space I am actually discussing, here. I did this before but it didn't really sink in until a second time.

At 12 TB I can put 17,975 DivX Movies sized at 700MB each array.
At 4 TB I can put 5,999 DivX Movies sized 700MB Each on the array.

This would be if I was to use the system as a media server. With that in mind I thought that 12TB for on personal server was to much and figured I could split the array in 3 among 3 servers each having 4 TB. As to which servers I don't know.

As per IsaacKuo suggestions. I am debating on using RAID 1 for my production systems. Possibly to ensure maximum data protection I would put 3 drives in RAID 1 thus having two copies of the Main HDD.

This might be a good practice for a MySQL DB Production Server. However, it is worthy to note the RAID 5 is the most popular of all the RAID levels and I am quite sure that some hosting providers utilize RAID 5 but they are likely marginal traffic servers.

There is still much planning to do.
 
Old 08-29-2008, 04:07 AM   #33
jay73
LQ Guru
 
Registered: Nov 2006
Location: Belgium
Distribution: Ubuntu 11.04, Debian testing
Posts: 5,019

Rep: Reputation: 133Reputation: 133
12 Tb eh? Would that be enough to install Windows 7 when it gets released in 2018?
 
Old 08-29-2008, 05:09 AM   #34
crashmeister
Senior Member
 
Registered: Feb 2002
Distribution: t2 - trying to anyway
Posts: 2,541

Rep: Reputation: 47
d/l everything on piratebay (for a historical archive of course).
 
Old 08-29-2008, 08:52 AM   #35
ciden
Member
 
Registered: Dec 2006
Location: New Delhi, India
Distribution: PCLinuxOS 2010
Posts: 246
Blog Entries: 1

Rep: Reputation: 31
Quote:
Originally Posted by ErV View Post
You'll need 1TB of RAM first, otherwise you'll instantly run out of memory. And many filesystems do not support files that big.

Besides, you already can do this on your current machine.
try this:
Code:
dd if=/dev/zero of=1.bin bs=1 count=1 seek=2043G
Works on my ext3 volumes.
This will create one file filled with zeros, with filesize 2043G (either ext3 or dd doesn't support larger files). Works even on floppy drive, as long as you use reiserfs, xfs or ext3.

I guess I read the man page wrong.
Anyway I read that most software used alongwith linux doesnt have filesize issues.

BTW, i dont have any storage issues, I am a simple hobbyist user, not some hardcore sysadmin. I just shift+delete whatever seems useless. But I do care about RAM. Still, I guess 12Tb of RAM would slow down startup greatly on my current 2.0 GHz system.
 
Old 08-29-2008, 08:57 AM   #36
ErV
Senior Member
 
Registered: Mar 2007
Location: Russia
Distribution: Slackware 12.2
Posts: 1,202
Blog Entries: 3

Rep: Reputation: 62
Quote:
Originally Posted by ciden View Post
Still, I guess 12Tb of RAM would slow down startup greatly on my current 2.0 GHz system.
IF you pass "bs=1T" to dd you'll need just one 1TB or RAM, not 12. dd allocates memory when it copies data, and amount of memory is equal to blocksize. Try "dd bs=1M", "dd bs=50M", "dd bs=100M" and see memory usage difference.
 
Old 08-29-2008, 11:44 AM   #37
mostlyharmless
Senior Member
 
Registered: Jan 2008
Distribution: Arch/Manjaro, might try Slackware again
Posts: 1,851
Blog Entries: 14

Rep: Reputation: 284Reputation: 284Reputation: 284
Quote:
Personally, I don't use RAID for anything. I greatly prefer using rsync to maintain backups. If the primary server goes down for any reason, then I just switch to a backup server. I generally don't like RAID1 because any problem caused by a changed or deleted or corrupted file instantly gets duplicated on the mirror.
Well that's certainly true. But there's nothing wrong with using RAID1 and rsyncing often: belt and suspenders!
 
Old 10-14-2008, 10:30 PM   #38
zebra90210
Member
 
Registered: Aug 2003
Location: Chicago suburbs
Distribution: Kubuntu
Posts: 96

Rep: Reputation: 15
Oh, that's easy.. I'd sell it on eBay!
 
Old 10-15-2008, 04:44 PM   #39
loperz7
Member
 
Registered: Sep 2008
Posts: 53

Rep: Reputation: 15
podcasts and free stuff -games, music etc.
The rest for maybe a server and sell some space.
Or just try to put on it a lot of servers - MUD, radio, etc.

Gentoo

Last edited by loperz7; 10-23-2008 at 04:01 AM.
 
Old 10-16-2008, 03:43 AM   #40
Xolo
Member
 
Registered: Jul 2004
Location: The Netherlands
Distribution: Mandrake, Knoppix, Coyote Linux, RedHat
Posts: 354
Blog Entries: 3

Rep: Reputation: 31
Only 12TB?
With todays laws for Data Retention, it is seriously not enough for one month's worth of data traffic for my corporate network, especially when I am forced by law to keep it for 2 years.
The discussion about the validity of RAID5 is invalid. RAID5 has a solid place in high availability data storage, as do other RAID configurations.
You use what is right for the job - not the personal opinion. :P
 
Old 10-17-2008, 04:12 AM   #41
baldy3105
Member
 
Registered: Jan 2003
Location: Cambridgeshire, UK
Distribution: Mint (Desktop), Debian (Server)
Posts: 891

Rep: Reputation: 184Reputation: 184
If you don't already know, why would you buy it?
 
Old 10-19-2008, 12:32 AM   #42
polarbear20000
Member
 
Registered: Oct 2006
Location: Crestview, FL
Distribution: Slackware 13, Debian 8.1
Posts: 105
Blog Entries: 1

Rep: Reputation: 17
Hmmm. . . .

I would multiply the largest prime number by itself six or seven times around, and output the result to disk - in binary notation.

 
Old 10-23-2008, 11:17 AM   #43
dasy2k1
Member
 
Registered: Oct 2005
Location: 127.0.0.1
Distribution: Manjaro
Posts: 963

Rep: Reputation: 36
i would be able to run approximately a month of daly backups on it on a rotation scheme before running out of space
but the firms requirements that backup drives are removed, cloned, one stored in the fire safe and one sent to secure off site storage might prove problamatic

mabie if i put the whole array in the firesafe...
 
Old 10-23-2008, 04:35 PM   #44
sh3llc0de
LQ Newbie
 
Registered: Oct 2008
Location: Cape Town, South Africa
Distribution: Gentoo Linux 2008.0
Posts: 1

Rep: Reputation: 0
Store GNU/Linux Distributions
Lend movies on DVD and rip them to disk
The occasional game(s)

umm... what else?
 
Old 10-23-2008, 05:03 PM   #45
ErV
Senior Member
 
Registered: Mar 2007
Location: Russia
Distribution: Slackware 12.2
Posts: 1,202
Blog Entries: 3

Rep: Reputation: 62
Quote:
Originally Posted by sh3llc0de View Post
Lend movies on DVD and rip them to disk
It's a violation of copyright laws in many countries. Are you sure this is appropriate suggestion for LQ?
 
  


Reply

Tags
debian, music, packages, pictures, vms



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
2 Terabytes and RedHat Enterprise 3 WS 413x Linux - Hardware 3 08-17-2004 04:28 PM

LinuxQuestions.org > Forums > Non-*NIX Forums > General

All times are GMT -5. The time now is 05:13 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration