LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware
User Name
Password
Linux - Hardware This forum is for Hardware issues.
Having trouble installing a piece of hardware? Want to know if that peripheral is compatible with Linux?

Notices


Reply
  Search this Thread
Old 02-02-2011, 01:35 AM   #31
BoraxMan
Member
 
Registered: Apr 2010
Posts: 103

Rep: Reputation: 11

Oh, and I should mention. Parity files. Use par2 or dvdisaster. This allows you to lose some bits of data without losing the information completely. By adding some additional information during the archival process, you can lose up to a certian percentage of data and be able to 'resurrect' it.
 
Old 02-02-2011, 01:43 AM   #32
Raveolution
Member
 
Registered: Mar 2004
Distribution: Fedora & CentOS
Posts: 213
Blog Entries: 2

Rep: Reputation: 26
Quote:
Originally Posted by BoraxMan View Post
Oh, and I should mention. Parity files. Use par2 or dvdisaster. This allows you to lose some bits of data without losing the information completely. By adding some additional information during the archival process, you can lose up to a certian percentage of data and be able to 'resurrect' it.
This is an absolute necessity. In the last year I have begun to do things this way with my consumer grade stuff; it's better to set aside 10% of your DVD space for parity than lose your data forever. Well, at least you have an increased chance of avoiding the latter. I'm an insurance guy... why wouldn't this be a logical move?
 
Old 02-02-2011, 03:17 AM   #33
business_kid
LQ Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware, Slarm64 & Android
Posts: 16,289

Rep: Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322
/tongue in cheek
@jefro: We're drifting dangerously close to religion pondering the significance of the Mayan calendar.

In fact, no reasonable discussion of the possible reasons for a time capsule can take place fully without discussing the end (Including religious aspects). But let's pretend you (or your kid) survived an event that knocked us back so far we lost all the progress of recent centuries. Without batteries, petrol, or generated power. Today's consumer goods and archive material would be shiny useless junk. Somebody would have to wind a generator onto a watermill, and get close enough to your power supply before anything could be recovered. Even then any PC sent forward in time would fail because of the capacitors.It would be much more likely your cds would be used as frisbees until they smashed off some rock.
 
Old 02-02-2011, 08:34 AM   #34
MTK358
LQ 5k Club
 
Registered: Sep 2009
Posts: 6,443
Blog Entries: 3

Rep: Reputation: 723Reputation: 723Reputation: 723Reputation: 723Reputation: 723Reputation: 723Reputation: 723
Do so many people really believe the world will end in 2012 just because it's a significant date on some old calendar?!?

Quote:
Originally Posted by H_TeXMeX_H View Post
USB stick / flash media = maybe 5-10 years (would discharge and loose all data)
What do you mean "discharge"? Flash memory is not like RAM with a built-in capacitor.

Last edited by MTK358; 02-02-2011 at 08:36 AM.
 
Old 02-02-2011, 10:05 AM   #35
H_TeXMeX_H
LQ Guru
 
Registered: Oct 2005
Location: $RANDOM
Distribution: slackware64
Posts: 12,928
Blog Entries: 2

Rep: Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301
Quote:
Originally Posted by MTK358 View Post
What do you mean "discharge"? Flash memory is not like RAM with a built-in capacitor.
It's not, but they do discharge after a long time, at least that's what the wiki says. I think it's possible, although I've never tested it myself, they usually break before then anyway.
 
Old 02-02-2011, 11:23 AM   #36
onebuck
Moderator
 
Registered: Jan 2005
Location: Central Florida 20 minutes from Disney World
Distribution: SlackwareŽ
Posts: 13,925
Blog Entries: 44

Rep: Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159
Hi,

Quote:
Originally Posted by MTK358 View Post
Do so many people really believe the world will end in 2012 just because it's a significant date on some old calendar?!?
The problem is that everyone misinterpret that the calendar ends in 2012. Loads of people misread into that as a end of the world as we know it. FUD!
Quote:
excerpt from http://www.greatdreams.com/2012.htm
The date December 21st, 2012 A.D. (13.0.0.0.0 in the Long Count), represents an extremely close conjunction of the Winter Solstice Sun with the crossing point of the Galactic Equator (Equator of the Milky Way) and the Ecliptic (path of the Sun), what that ancient Maya recognized as the Sacred Tree. This is an event that has been coming to
resonance very slowly over thousands and thousands of years. It will come to resolution at exactly 11:11 am GMT.
Not a significant date with modern day man unless a conspirator or doomsday believer. The Mayan calendar presented after the final date as winter solstice on the Mayan calendar. Therefore a new beginning after that date by their rituals.

Quote:
excerpt from http://www.greatdreams.com/2012.htm
NOTE: The astronomer Philip Plait has stated very clearly that the Mayan calendar does not end in 2012 at all, that it is like the odometer on your car, as each section of the odometer reaches 9 and then clicks over to 0, the next number to it starts a new cycle, so that when all the numbers again reach 0 all the way across the odometer - the last number will change from 1 to 2 and the new cycle starts all over again.
Look at the calendar.
Quote:
Originally Posted by MTK358 View Post
What do you mean "discharge"? Flash memory is not like RAM with a built-in capacitor.
Cell degradation over time is a problem with modern flash and can be attributed to frequency of writes along with the level. A problem if not managed properly. Throw away device;
Quote:
excerpt from Reliability issues of flash memory cells - Proceedings of the IEEE[PDF]
E. Data Retention

In floating-gate memories, the stored charge can leak away from the floating gate through the gate oxide or through the interpoly dielectrics. This leakage, caused by mobile ions, oxide defects, or other mechanisms, results in a shift of the threshold voltage of the memory cell. The threshold voltage shift can also be caused by the detrapping
of electrons or holes from oxide traps.
Flash is improving but there is a 'life' for retention. The referenced paper is rather dry reading but valid.
 
Old 02-02-2011, 01:54 PM   #37
MTK358
LQ 5k Club
 
Registered: Sep 2009
Posts: 6,443
Blog Entries: 3

Rep: Reputation: 723Reputation: 723Reputation: 723Reputation: 723Reputation: 723Reputation: 723Reputation: 723
So each bit in a flash memory chip is like a little capacitor, and will drain over time?
 
Old 02-02-2011, 05:18 PM   #38
jefro
Moderator
 
Registered: Mar 2008
Posts: 21,979

Rep: Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624
Flash (usb pocket type) can be stated to act like a bunch of caps that would slowly diminish unless powered and that is different and you'd need to supply power until the unit is found and used. It has no physical change that secures it.

I doubt that the Mayan calender has any other interest than hype. Just a statistical oddity. More like the YTK deal. It is a number based worry with no real facts behind it. However you get enough nuts together and one should worry.

My concern is that we did survive the Cuban missile crisis. One hopes that and I believe that any number of humans would survive the predicted effects of any number of issues. I suspect the world would survive corneal flairs that reached and affected the earth. I believe that some power lines would be damaged in the year 2012 but the earth is a big place.

I suggested pressed cd's as they would seem to me to have features that protect against EMF/RFI.
 
Old 02-02-2011, 05:52 PM   #39
onebuck
Moderator
 
Registered: Jan 2005
Location: Central Florida 20 minutes from Disney World
Distribution: SlackwareŽ
Posts: 13,925
Blog Entries: 44

Rep: Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159Reputation: 3159
Hi,

Quote:
Originally Posted by MTK358 View Post
So each bit in a flash memory chip is like a little capacitor, and will drain over time?
Simplistic but the general idea. Gate of the cell is the weak point when power is removed. Longer term without power & previous use of the flash cell will determine retention because of leakage through out the cell at the gate layer;
Quote:
Patent Abstract; A flash memory device, such as a NAND flash, having an array of floating gate transistor memory cells arranged in a first and second addressable blocks. A voltage source to supply programming voltages to control gates of the floating gate transistor memory cells, the voltage source supplies a pre-charge voltage to the control gates of the floating gate transistor memory cells located in the first addressable block when data is programmed in memory cells of the second addressable block.
Simple definition but easily understandable.
HTH!
 
Old 02-02-2011, 11:47 PM   #40
hydraMax
Member
 
Registered: Jul 2010
Location: Skynet
Distribution: Debian + Emacs
Posts: 467

Original Poster
Blog Entries: 60

Rep: Reputation: 51
Quote:
Originally Posted by BoraxMan View Post
Oh, and I should mention. Parity files. Use par2 or dvdisaster. This allows you to lose some bits of data without losing the information completely. By adding some additional information during the archival process, you can lose up to a certian percentage of data and be able to 'resurrect' it.
Parity... that certainly makes a lot of sense in a long-term storage situation like this. Question: Are there any actual /file systems/ that automatically store parity data? (With provided file-system recovery tools?) Quick googling said ext3 could be modified to store parity, but that is all I saw.

On a separate, but related note: With a compact digital storage device in the capsule, we could also store some paper-based material documenting the format of the digital data or any other pertinent details that might aid in future recovery.
 
Old 02-03-2011, 04:12 AM   #41
BoraxMan
Member
 
Registered: Apr 2010
Posts: 103

Rep: Reputation: 11
Quote:
Originally Posted by hydraMax View Post
Parity... that certainly makes a lot of sense in a long-term storage situation like this. Question: Are there any actual /file systems/ that automatically store parity data? (With provided file-system recovery tools?) Quick googling said ext3 could be modified to store parity, but that is all I saw.

On a separate, but related note: With a compact digital storage device in the capsule, we could also store some paper-based material documenting the format of the digital data or any other pertinent details that might aid in future recovery.
Simpler is usually better. The less complex you make it, the more likely the chance of recovery. Sure, parity files aren't as transparent, but really, if you're going to insurance over ease of use, go separate parity files than a filesystem based one.

But if you want to store information, I still think etching into precious metals is the best (though expensive). I would also avoid using a file system (not necessary). A CD burned, with the ISO9660 specification printed or documented with it.


By the way, I don't believe the world will end in 2012. The worst that will happen, is that the Mayan version of Linux will suffer a Y2K like bug. I think there is a patch for that.
 
Old 02-03-2011, 04:51 AM   #42
H_TeXMeX_H
LQ Guru
 
Registered: Oct 2005
Location: $RANDOM
Distribution: slackware64
Posts: 12,928
Blog Entries: 2

Rep: Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301
2012 is BS, just like Y2K. Probably hyped by the media to take eyes off of other things.
 
Old 02-03-2011, 05:40 AM   #43
b0uncer
LQ Guru
 
Registered: Aug 2003
Distribution: CentOS, OS X
Posts: 5,131

Rep: Reputation: Disabled
Quote:
Originally Posted by choogendyk View Post
Librarians who deal with archives and now digital archives have essentially dismissed CD/DVD as an option. Having no good passive options at the moment (storage crystals anyone?), they have determined that the solution is modern day monks, also known as sysadmins -- put everything on RAID arrays and actively maintain them, copying to new systems as needed.
That's probably the only way, to copy the data to be saved over and over again, eternally, making sure that each copy survives long enough to be copied again. Any "static" storage will disintegrate in some way sooner or later, and 'later' doesn't usually mean more than a few hundred to a few thousand years. Small bits of information, such as "this skeleton apparently had two legs" can survive for millions of years if the conditions are good, but even then there is a significant amount of destruction that has already happened. In case of information, as in storing photographs or code or longer texts or such, even a slight data loss may corrupt a lot. Lots of data loss, due to disintegration of the medium it's stored on, means usually that only bits and pieces can be revived, which is not sufficient if lots of information is supposed to be stored. The destruction is due to how things work: natural processes such as chemical reactions and radioactive decay (which not only changes the original medium, but may change other media as well due to energy that is emitted in the reactions) will wreck any static media over time. Not to mention volcanoes, earthquakes, freezing and heating and such. The only way to go for a really long period would be to turn everything needed into information, and then copy that information around to (try to) keep it safe. This is a process that goes against the natural thermodynamic routes, meaning that it tries to preserve order, and therefore it requires energy. This means that when energy is not pumped into the system anymore (for example when people cease to exist and nobody is burning coal or running a nuclear power plant anymore), this method stops working and the information is (after some time) lost, again.

Quote:
Originally Posted by BoraxMan View Post
There isn't one. The problem is that when digital media degrades, information is lost. A clay tablet can wear down, but still be readable. Paper can degrade and still be read, but when a DVD or hard drive degrades, bits of information just disappear.

---(snip)---

All human made objects will when left alone, slowly convert back to their original state. Metal rusts, plastics degrade, dyes fade. It all goes back to dirt. Because gold is a precious metal it doesn't corrode, and it is already at its 'natural state' in an elemental form, therefore not going to be subject to the same ravages of entropy. Think of all the gold jewellery that still exists frorm thousands of years ago, yet iron objects have disappeared.

Ideally, I would literally etch data onto a gold surface, but thats kind of difficult. Next best thing is a gold CD, stored in an airtight container with no moisture and no light.

However, make multiple copies. That I think is most important. The data that I have retained for 15 years, even more, still exists because of multiple copies and transferring it from medium to medium. NEVER put all your digital eggs in the one storage basket. Make multiple copies and store them in different locations. All the books of antiquity exist because of copies and pieced together from copies.
Quite on the same lines. But even though gold is a "precious metal [and so] it doesn't corrode", it doesn't mean it stays like that forever. The processes are simply slower with it, but will happen (due to all real systems having a finite probability of transferring from one state to another, for example at the atomic level). Gold too will be subject to the same "ravages of entropy" as the rest of things, it just lasts a bit longer than some "weaker" subjects. And it's still a game of luck: even though you can find gold pieces (jewellery, so you know it's more or less human made) that has survived for thousands of years, you must understand that not all such things have survived. Some of it has surely been lost, one way or another, and that means you can't rely on gold, or anything else for that matter, in the end. The only thing you can rely on is having a copy available always when one is lost, which again means you'll have to supervise the thing all the time somehow, and keep it fuelled.

Whatever the method, practically the storage place affects the result too. One would have to stick to a place that is stable (i.e. no earthquakes or molten lava flows or such), mostly non-radiative for the period of storage time, dry (moisture typically does bad things), cool (high temperature allows transfer of energy which may modify the surroundings), and so on. But how would you know if it stays like that for thousands or millions of years? The things we've found that are very old have been spared more or less accidentally, not intentionally. The biggest problem might not be the medium, after all, but the place of storage.

Quote:
Originally Posted by onebuck View Post
Hi,



This is constructive to the thread how?Do not post in this manner again, you have been warned.
No offence, but:

So it's "one joke & you're out" atmoshphere nowadays? Where's the sense of humour? I get it when people are warned for saying they're gonna [...] up everyone, but not if something completely harmless is posted. If every post should be "constructive", we could also say every post should be constructive enough (for example "more constructive than not constructive at all" and then "a bit more constructive than that, please"), which means that some people would get kicked out just because they weren't helpful enough. Pointing out, for example, that a time capsule should only last a couple of years if the world is going to end next year is quite constructive in my opinion, because you couldn't possibly prove that the end of the world is not going to happen next year. If you could, you could see the future, which is rather bizarre.
 
Old 02-03-2011, 06:05 AM   #44
Larry Webb
LQ Veteran
 
Registered: Jul 2006
Location: Crystal Beach, Texas
Distribution: Suse for mail +
Posts: 5,100
Blog Entries: 7

Rep: Reputation: 229Reputation: 229Reputation: 229
Quote:
Originally Posted by b0uncer View Post
No offence, but:

So it's "one joke & you're out" atmoshphere nowadays? Where's the sense of humour? I get it when people are warned for saying they're gonna [...] up everyone, but not if something completely harmless is posted. If every post should be "constructive", we could also say every post should be constructive enough (for example "more constructive than not constructive at all" and then "a bit more constructive than that, please"), which means that some people would get kicked out just because they weren't helpful enough. Pointing out, for example, that a time capsule should only last a couple of years if the world is going to end next year is quite constructive in my opinion, because you couldn't possibly prove that the end of the world is not going to happen next year. If you could, you could see the future, which is rather bizarre.

No offence, but:

Do not forget to look at both sides of the mirror. I agree a little humor keeps an interest in a thread but from the other side too much could ruin a thread or be miss taken and offend.
 
Old 02-04-2011, 01:20 AM   #45
BoraxMan
Member
 
Registered: Apr 2010
Posts: 103

Rep: Reputation: 11
Quote:
Originally Posted by b0uncer View Post



Quite on the same lines. But even though gold is a "precious metal [and so] it doesn't corrode", it doesn't mean it stays like that forever. The processes are simply slower with it, but will happen (due to all real systems having a finite probability of transferring from one state to another, for example at the atomic level). Gold too will be subject to the same "ravages of entropy" as the rest of things, it just lasts a bit longer than some "weaker" subjects. And it's still a game of luck: even though you can find gold pieces (jewellery, so you know it's more or less human made) that has survived for thousands of years, you must understand that not all such things have survived. Some of it has surely been lost, one way or another, and that means you can't rely on gold, or anything else for that matter, in the end. The only thing you can rely on is having a copy available always when one is lost, which again means you'll have to supervise the thing all the time somehow, and keep it fuelled.
I'm sure there are other ways, but beyond our technical abilities.

One way could be to invent a time machine. You can SEND the information to whenever you like.

The tragedy of what happened at the library of Alexandria shows that you can't put all your eggs in one basket. Copy, copy, copy.
DNA breaks down fairly quickly, but there are genes circulating millions of year old, because of copies made. A self replicating system, like a cell or nano bot containing a DNA like sequence of the information could do.

But to store information today, I think what I've suggested is perhaps the best for digital. But information as a shelf life. I'd like to keep my photos for as long as possible, but they only need to last long enough to ensure that I can make a copy to pass to kids. I dont need them to last 1 million years, what are they going to do with it?

There probably is a lot of lost information from pre-history, but was it of any use? Probably only a curiosity, nothing more.

Our entire civilisation, given enough time, just wont be important. There will come a time when no one, or nothing will care.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Linux for Home Media and Storage Server ? prixone Linux - General 9 06-12-2010 03:06 AM
writing driver for USB storage media linuxdeveloper29 Linux - Software 4 10-24-2008 12:48 PM
Auto Mount Figured out.... Storage Media evodawg Mandriva 1 08-10-2008 08:40 PM
Sony USB Storage Media USM128DS Ed_999 Slackware 1 02-28-2005 03:54 PM
Storage Media: History Jalalabee General 4 09-04-2003 02:07 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware

All times are GMT -5. The time now is 03:46 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration