LinuxQuestions.org
Help answer threads with 0 replies.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > General
User Name
Password
General This forum is for non-technical general discussion which can include both Linux and non-Linux topics. Have fun!

Notices


Reply
  Search this Thread
Old 05-09-2007, 10:25 PM   #1
SlowCoder
Senior Member
 
Registered: Oct 2004
Location: Southeast, U.S.A.
Distribution: Debian based
Posts: 1,250

Rep: Reputation: 164Reputation: 164
Post your Linux DISASTER Stories!


Just bored tonight ... so I thought I'd start this little thread. Searched but didn't find a similar one on LQ.

So, here's my story:
I have worked in a Windows world for many years, and Linux for only a relatively few.
I needed some files from my Windows 2000 web server, so I created a temporary directory on my Linux desktop, then mounted a share to the Windows server.

After I finished my website updates, I decided I didn't need the directory on my desktop any more. Ok, so ... I'll just delete it. I issued the delete command on the directory and walked away.

A while later I got a call from the boss ... "The website's down! Fire! Fire!" Hmmm ...

I went for a look-see and found that all of my website files had vanished ... ALL 4GB OF THEM!

Was I hacked? Was there a virus? Was there a file system problem? Did I lose a drive?

Thoughts immediately began to fly through my head ... mostly of my ill-fated life.

I sat back down in my office for a think-break, and when I looked at my Linux screen, I noticed that there was a nice ... long ... list of files that said they had been deleted.

I turns out that I forgot to umount my directory before deleting it.

Luckily for me, I was able to restore my site from a recent backup.

What 2 lessons did I learn?
1. Always check your mount status BEFORE deleting a directory.
2. Mount RO any time possible.

Ok, enough from me ... what disaster tales have you to tell?
 
Old 05-09-2007, 10:53 PM   #2
fukawi2
Member
 
Registered: Oct 2006
Location: Melbourne, Australia
Distribution: ArchLinux, ArchServer, Fedora, CentOS
Posts: 449

Rep: Reputation: 34
...and use 'rmdir' to remove a directory, not 'rm -Rf' :P

Worst that I've had is my old boss (who wasn't very good with backups) deleted a whole directory of "Global" data for our company off a Samba server... Did I mention he wasn't very good at backups? Never did manage to restore anything by playing with inodes and all that jazz

The worst I've done is 'rm -Rf /' but I did that on purpose on a development box I was reloading - just so I could post in forums and say I've done it :P

Worst one of my staff has done is fiddle with nsswitch.conf and basically disabled login... The most annoying part was that he went home and I was left to work back and find out what he'd done!! After dropping our ERP server to single user of course. That staff member doesn't have root access anymore...
 
Old 05-09-2007, 10:54 PM   #3
rkelsen
Senior Member
 
Registered: Sep 2004
Distribution: slackware
Posts: 4,462
Blog Entries: 7

Rep: Reputation: 2561Reputation: 2561Reputation: 2561Reputation: 2561Reputation: 2561Reputation: 2561Reputation: 2561Reputation: 2561Reputation: 2561Reputation: 2561Reputation: 2561
Heh... You'll love this story... This one time, I .... No, wait, that wasn't me...

Oh well.
 
Old 05-09-2007, 10:58 PM   #4
masonm
Senior Member
 
Registered: Mar 2003
Location: Following the white rabbit
Distribution: Slackware64 -current
Posts: 2,300

Rep: Reputation: 90
I once misplaced my wireless mouse.
 
Old 05-09-2007, 11:00 PM   #5
polarbear20000
Member
 
Registered: Oct 2006
Location: Crestview, FL
Distribution: Slackware 13, Debian 8.1
Posts: 105
Blog Entries: 1

Rep: Reputation: 17
My turn for self-embarrassment

Okay - I was installing Linux on 2 different systems at the same time: Little and my mom's laptop. I was adjusting partition sizes on Little and installing Mandrake 10.0 on the laptop . . . or so I thought. As it turns out, I did it the other way around and erased the laptop and overwrote Slackware on the other one. I had to scramble to make things right and luckily enough my mom had her own recent backups of the laptop's important data.

I have since learned two things:
1. Computers are better at multitasking than I am.
2. When it comes to installation, one computer at a time.
 
Old 05-10-2007, 03:41 AM   #6
dasy2k1
Member
 
Registered: Oct 2005
Location: 127.0.0.1
Distribution: Manjaro
Posts: 963

Rep: Reputation: 36
i tried to format a disk in my zip drive which had allwasy been sda1,

when i formatted it, it diddnt wiurr
i relised that the USB had fallen out and my pen drive (normally sdb1) had become sda1

so i just wiped out my pen drive....

took me ages to find all teh files again from disorganised random backups on diffenrt computers!
 
Old 05-10-2007, 08:48 AM   #7
tredegar
LQ 5k Club
 
Registered: May 2003
Location: London, UK
Distribution: Fedora38
Posts: 6,147

Rep: Reputation: 435Reputation: 435Reputation: 435Reputation: 435Reputation: 435
Well, it' not quite as bad as the classic rm -Rf / but I needed to chown a load of stuff in my home directory.

chown -R tred:tred /home/tred/* as root went OK. Then I realised all those "hidden" .files hadn't been matched by the "*" and still needed chowning.

So (again as root) I did chown -R tred:tred /home/tred/.*

I thought it was taking rather a l-o-n-g time. So I <CTRL><C>'d it. Then realised that ".*" matches "..". Ooops!
..... It was time for a new distro anyway.
 
Old 05-10-2007, 09:15 AM   #8
Crito
Senior Member
 
Registered: Nov 2003
Location: Knoxville, TN
Distribution: Kubuntu 9.04
Posts: 1,168

Rep: Reputation: 53
I've managed to fsck-up my /home directory twice now. I'm convinced it has something to do with Fedora Core using device labels instead of device names in fstab. Apparently you can give two different partitions the same label, which confuses the !@#$ out of fsck when it runs automatically after a restart/bootup.
 
Old 05-10-2007, 09:27 AM   #9
Seph64
Member
 
Registered: Feb 2003
Distribution: Gentoo, FreeBSD, LFS
Posts: 298
Blog Entries: 21

Rep: Reputation: 30
Trying to install Linux on my Mom's machine. No seriously, it gave me all sorts of problems. First try: Alright something easy to use, Mandrake! No dice, after installation I noticed there was no sound. Turns out I needed a new driver that was in a newer kernel. I remember trying to look for a new one in the official repository for this distribution. Nope, not there. I had to download a vanilla kernel and hope I can get it to boot.

Well it did, but the sound came out all fuzzy.

Second try: SimplyMEPIS, since Mandrake didn't work, I decided to give this a try since I had good experiences with it in the past. Same problem with the audio drivers, but instead of installing a newer kernel I decided to remove this distro from the system in favour of...

Third try: Gentoo Linux, I use this distro all the time, so I figure "If she needs help, she can just ask me." I did a Stage3 install if I remember correctly. After installing the base system, I test the audio with mpg123 (After making sure the drivers are loaded, and the devices are unmuted), same problem with the audio being all fuzzy.

At this point, I thought nothing was wrong. And since I didn't install GRUB to the bootloader yet, it won't effect her since Windows is still installed on the main drive. I turned the machine off, and gone to bed since it was night time.

In the morning I was greeted with, "How come I get no sound?" I thought oh shit, what happened? The drivers for the sound card was installed in Windows correctly, I tried reinstalling the drivers, no dice. Reinstalled the OS, no dice. Stumped, I opened the computer and saw something terrible... The PCI slot where the sound card was in was scorched! I moved the sound card to a different slot to see if it still worked, and thank god, it did. I couldn't explain what caused it, but I knew in my mind that something I did in Linux was the culprit. I decided to format the drive I was using to install Linux on in to a Windows readable File System and stayed away from installing Linux on it ever again. Oh the horror, THE HORROR!
 
Old 05-10-2007, 09:45 AM   #10
Dox Systems - Brian
Member
 
Registered: Nov 2006
Posts: 344

Rep: Reputation: 31
Not me, but someone that once worked for me had a little accident with SuSE OpeneXchange... There was a communication issue of some kind and the owner of the company ended up vacuuming all of his contacts & appointments off of the server, then synching to his Palm and losing everything...

I don't remember anymore how we recovered from that, but it was a DISASTER! :-)
 
Old 05-10-2007, 10:22 AM   #11
Hitboxx
Senior Member
 
Registered: Mar 2006
Location: India
Distribution: Fedora
Posts: 1,562
Blog Entries: 3

Rep: Reputation: 68
Once I corrupted my entire Debian box, will never touch it again.!!
 
Old 05-10-2007, 11:25 AM   #12
Chargh
Member
 
Registered: Apr 2004
Location: Seba Beach Alberta Canada
Distribution: Fedora 16
Posts: 251
Blog Entries: 24

Rep: Reputation: 31
While messing with Yum I kept uninstalling the Gnome session. The first time I did that that I was very confused.
 
Old 05-10-2007, 01:47 PM   #13
alred
Member
 
Registered: Mar 2005
Location: singapore
Distribution: puppy and Ubuntu and ... erh ... redhat(sort of) :( ... + the venerable bsd and solaris ^_^
Posts: 658
Blog Entries: 8

Rep: Reputation: 31
too many of them ... so much so that i forgotton about the detail of each of them ...


//btw ... nowadays home pc are super fast and super big ... so , dont be afraid of disasters ...


.
 
Old 05-10-2007, 03:41 PM   #14
frob23
Senior Member
 
Registered: Jan 2004
Location: Roughly 29.467N / 81.206W
Distribution: OpenBSD, Debian, FreeBSD
Posts: 1,450

Rep: Reputation: 48
I suppose I have a couple but the worse, by far, was not the fault of any person. It was a hard-drive failure on a woman's machine. Naturally, it was a little more complicated than just that:

*) this happened the day her father died (hours after actually)
*) she had been taking pictures of him during his last days and storing them on the computer when the camera was full
*) she had emptied her camera onto the machine the night before so she would have space when she saw him in the morning
*) we did not have a consistent backup regimen at the time -- so she wasn't backing things up

At first, when she called, I thought she had left a floppy in the drive (even though I turn floppy booting off in the bios). But I soon realized what we were dealing with after I drove an hour to take a look at it in person. And when she understood that all of those images might be gone for good she nearly had a complete breakdown. It was too much for her at the time.

I grabbed a spare drive... an ice-cold case of Mountain Dew... and some other supplies and locked myself in a room for the next 6+ hours. By some twist of fate, the drive was still readable... but was failing so badly that the effort to read from it warmed it up too much. The boot area was gone but I had different partitions and her data was on one of the few remaining ones. By booting from another drive and using care, I was able to slowly extract a few images at a time... before needing to reboot because the drive would lock up the machine when it overheated. A fan, blowing directly on the exposed drive and several cans of compressed air (misused) added a little bit more time before starting again... but it was still very slow going.

In the end... I got everything off the drive. All I promised to try for was those pictures. But I got lucky and managed to get her other files too. I did a full reinstall on a new drive and brought all her stuff over. When we booted up the new drive, she nearly sobbed with joy to see that everything was exactly like it was before the drive failure. Right down to her smallest setting. She got very lucky.

Today that system (as well as all the others there) are religiously backed up over the network. It would take the simultaneous failure of at least three drives (hers and two on the RAIDed backup server) to lose any data. They have learned their lesson. That was the worst disaster to come to mind... and it was hell for a day there.

Last edited by frob23; 05-10-2007 at 03:44 PM.
 
Old 05-10-2007, 04:15 PM   #15
cormack
Member
 
Registered: Oct 2005
Location: Scotland, UK
Distribution: Kubuntu 9.10, ubuntu 8.04.2 server
Posts: 156

Rep: Reputation: 30
Nothing this serious so far, but my friend did move my /home/ryan partition to /home/.lol. so everytime i booted i didnt get very far. confusing and i spent a bit of time on it before he told me what he had done. Quite funny really.

Other things include formating the wrong partition, deleting folders with mounted net shares, but thankfully nothing serious.

But it has all taught me well.

Ryan
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
some of my success stories using linux eeyoree LinuxQuestions.org Member Success Stories 1 01-08-2005 11:53 AM
backup / disaster recovery for Linux 1kyle Linux - Software 3 03-06-2004 10:59 AM
Section to post links to news stories? macewan LQ Suggestions & Feedback 3 05-26-2003 09:19 PM
My Linux Stories michaelangel General 31 02-27-2003 12:22 AM
Reliability of Linux Stories contiga General 45 04-01-2002 03:16 PM

LinuxQuestions.org > Forums > Non-*NIX Forums > General

All times are GMT -5. The time now is 03:04 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration