LinuxQuestions.org
Visit the LQ Articles and Editorials section
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > General
User Name
Password
General This forum is for non-technical general discussion which can include both Linux and non-Linux topics. Have fun!

Notices

Tags used in this thread
Popular LQ Tags , , , , , ,

Reply
 
Thread Tools
Old 08-28-2008, 07:30 PM   #31
ErV
Senior Member
 
Registered: Mar 2007
Location: Russia
Distribution: Slackware 12.2
Posts: 1,268
Blog Entries: 3
Thanked: 29

[Log in to get rid of this advertisement]
Quote:
Originally Posted by ciden View Post
I would try this

Code:
# dd if=/dev/zero of=a_big_file bs=1T count=12
You'll need 1TB of RAM first, otherwise you'll instantly run out of memory. And many filesystems do not support files that big.

Besides, you already can do this on your current machine.
try this:
Code:
dd if=/dev/zero of=1.bin bs=1 count=1 seek=2043G
Works on my ext3 volumes.
This will create one file filled with zeros, with filesize 2043G (either ext3 or dd doesn't support larger files). Works even on floppy drive, as long as you use reiserfs, xfs or ext3.

Last edited by ErV; 08-28-2008 at 07:55 PM..
ErV is offline     Reply With Quote
Old 08-28-2008, 09:19 PM   #32
richinsc
Member
 
Registered: Apr 2007
Location: South Carolina
Distribution: Debian Lenny 5.0r1
Posts: 187
Thanked: 0

Original Poster
I had to put this amount of space in perspective for me to realize how much space I am actually discussing, here. I did this before but it didn't really sink in until a second time.

At 12 TB I can put 17,975 DivX Movies sized at 700MB each array.
At 4 TB I can put 5,999 DivX Movies sized 700MB Each on the array.

This would be if I was to use the system as a media server. With that in mind I thought that 12TB for on personal server was to much and figured I could split the array in 3 among 3 servers each having 4 TB. As to which servers I don't know.

As per IsaacKuo suggestions. I am debating on using RAID 1 for my production systems. Possibly to ensure maximum data protection I would put 3 drives in RAID 1 thus having two copies of the Main HDD.

This might be a good practice for a MySQL DB Production Server. However, it is worthy to note the RAID 5 is the most popular of all the RAID levels and I am quite sure that some hosting providers utilize RAID 5 but they are likely marginal traffic servers.

There is still much planning to do.
richinsc is offline     Reply With Quote
Old 08-29-2008, 05:07 AM   #33
jay73
Senior Member
 
Registered: Nov 2006
Location: Belgium
Distribution: Ubuntu 8.04 / 9.04
Posts: 4,780
Thanked: 89
12 Tb eh? Would that be enough to install Windows 7 when it gets released in 2018?
jay73 is online now     Reply With Quote
Old 08-29-2008, 06:09 AM   #34
crashmeister
Senior Member
 
Registered: Feb 2002
Distribution: t2 - trying to anyway
Posts: 2,541
Thanked: 4
d/l everything on piratebay (for a historical archive of course).
crashmeister is offline     Reply With Quote
Old 08-29-2008, 09:52 AM   #35
ciden
Member
 
Registered: Dec 2006
Location: Punjab, India
Distribution: Debian
Posts: 226
Blog Entries: 1
Thanked: 1
Quote:
Originally Posted by ErV View Post
You'll need 1TB of RAM first, otherwise you'll instantly run out of memory. And many filesystems do not support files that big.

Besides, you already can do this on your current machine.
try this:
Code:
dd if=/dev/zero of=1.bin bs=1 count=1 seek=2043G
Works on my ext3 volumes.
This will create one file filled with zeros, with filesize 2043G (either ext3 or dd doesn't support larger files). Works even on floppy drive, as long as you use reiserfs, xfs or ext3.

I guess I read the man page wrong.
Anyway I read that most software used alongwith linux doesnt have filesize issues.

BTW, i dont have any storage issues, I am a simple hobbyist user, not some hardcore sysadmin. I just shift+delete whatever seems useless. But I do care about RAM. Still, I guess 12Tb of RAM would slow down startup greatly on my current 2.0 GHz system.
ciden is offline     Reply With Quote
Old 08-29-2008, 09:57 AM   #36
ErV
Senior Member
 
Registered: Mar 2007
Location: Russia
Distribution: Slackware 12.2
Posts: 1,268
Blog Entries: 3
Thanked: 29
Quote:
Originally Posted by ciden View Post
Still, I guess 12Tb of RAM would slow down startup greatly on my current 2.0 GHz system.
IF you pass "bs=1T" to dd you'll need just one 1TB or RAM, not 12. dd allocates memory when it copies data, and amount of memory is equal to blocksize. Try "dd bs=1M", "dd bs=50M", "dd bs=100M" and see memory usage difference.
ErV is offline     Reply With Quote
Old 08-29-2008, 12:44 PM   #37
mostlyharmless
Member
 
Registered: Jan 2008
Distribution: Slackware 12.1
Posts: 812
Thanked: 44
Quote:
Personally, I don't use RAID for anything. I greatly prefer using rsync to maintain backups. If the primary server goes down for any reason, then I just switch to a backup server. I generally don't like RAID1 because any problem caused by a changed or deleted or corrupted file instantly gets duplicated on the mirror.
Well that's certainly true. But there's nothing wrong with using RAID1 and rsyncing often: belt and suspenders!
mostlyharmless is offline     Reply With Quote
Old 10-14-2008, 11:30 PM   #38
zebra90210
Member
 
Registered: Aug 2003
Distribution: Mandriva 2008
Posts: 64
Thanked: 0
Oh, that's easy.. I'd sell it on eBay!
zebra90210 is offline     Reply With Quote
Old 10-15-2008, 05:44 PM   #39
loperz7
Member
 
Registered: Sep 2008
Posts: 55
Thanked: 0
podcasts and free stuff -games, music etc.
The rest for maybe a server and sell some space.
Or just try to put on it a lot of servers - MUD, radio, etc.

Gentoo

Last edited by loperz7; 10-23-2008 at 05:01 AM..
loperz7 is offline     Reply With Quote
Old 10-16-2008, 04:43 AM   #40
Xolo
Member
 
Registered: Jul 2004
Location: The Netherlands
Distribution: Mandrake, Knoppix, Coyote Linux, RedHat
Posts: 338
Blog Entries: 3
Thanked: 0
Only 12TB?
With todays laws for Data Retention, it is seriously not enough for one month's worth of data traffic for my corporate network, especially when I am forced by law to keep it for 2 years.
The discussion about the validity of RAID5 is invalid. RAID5 has a solid place in high availability data storage, as do other RAID configurations.
You use what is right for the job - not the personal opinion. :P
Xolo is offline     Reply With Quote
Old 10-17-2008, 05:12 AM   #41
baldy3105
Member
 
Registered: Jan 2003
Location: Cambridgeshire, UK
Distribution: SuSe 9.2 & 10, Gentoo, knoppix, DSL
Posts: 602
Thanked: 3
If you don't already know, why would you buy it?
baldy3105 is offline     Reply With Quote
Old 10-19-2008, 01:32 AM   #42
polarbear20000
Member
 
Registered: Oct 2006
Location: Holt, FL
Distribution: Slackware 12.2, Sabayon 4.0, & various livecds. I get around.
Posts: 97
Blog Entries: 1
Thanked: 2
Hmmm. . . .

I would multiply the largest prime number by itself six or seven times around, and output the result to disk - in binary notation.

polarbear20000 is offline     Reply With Quote
Old 10-23-2008, 12:17 PM   #43
dasy2k1
Member
 
Registered: Oct 2005
Location: 127.0.0.1
Distribution: Ubuntu 9.04 X86_64
Posts: 922
Thanked: 3
i would be able to run approximately a month of daly backups on it on a rotation scheme before running out of space
but the firms requirements that backup drives are removed, cloned, one stored in the fire safe and one sent to secure off site storage might prove problamatic

mabie if i put the whole array in the firesafe...
dasy2k1 is offline     Reply With Quote
Old 10-23-2008, 05:35 PM   #44
sh3llc0de
LQ Newbie
 
Registered: Oct 2008
Location: Cape Town, South Africa
Distribution: Gentoo Linux 2008.0
Posts: 2
Thanked: 0
Store GNU/Linux Distributions
Lend movies on DVD and rip them to disk
The occasional game(s)

umm... what else?
sh3llc0de is offline     Reply With Quote
Old 10-23-2008, 06:03 PM   #45
ErV
Senior Member
 
Registered: Mar 2007
Location: Russia
Distribution: Slackware 12.2
Posts: 1,268
Blog Entries: 3
Thanked: 29
Quote:
Originally Posted by sh3llc0de View Post
Lend movies on DVD and rip them to disk
It's a violation of copyright laws in many countries. Are you sure this is appropriate suggestion for LQ?
ErV is offline     Reply With Quote

Reply

Bookmarks


Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
2 Terabytes and RedHat Enterprise 3 WS 413x Linux - Hardware 3 08-17-2004 05:28 PM


All times are GMT -5. The time now is 07:23 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
RSS2  LQ Podcast
RSS2  LQ Radio
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: @linuxquestions
Open Source Consulting | Domain Registration