Debian VM going read only

Reefcrazed · 03-28-2016, 09:25 AM

I have three Debian installs on OVH hosting. These VM's are all on the same vSphere 5.5 host. All three Debian installs are identical and only a month ago. Two run just fine but the third is going read only about once a week. These are game servers running the exact same game. I would think if it was the hard drive it would effect all three game servers, not just one.

How do I isolate this down to the problem?

unSpawn · 03-28-2016, 12:27 PM

Uh. Wasn't that CLP / CLE supposed to be good for something? ;-p Isolate the approximate time of the incident, then check the hosts vsphere daemon logs and the machines system and daemon logs for clues first? *If it a 'fsck' fixed VM file system r/o state then you may have run into problems with whatever the host file system backing is on.

Reefcrazed · 03-28-2016, 01:23 PM

The CLP class got my feet wet. Now the majority of any server I install is Linux, built on that CLP class a ton

Well I cannot now say it is that one VM, I went and did a spot check and a second VM went read only. I have a cron job that runs and backs up a few VM's. I am now wondering if they are firing off too close to each other. The drives could become so busy that the latency may make the drives appear to have failed. I noticed a datastore disconnect / connect around 3am when that backup runs.

hydrurga · 03-28-2016, 03:35 PM

Would this be of any help, regarding the prioritisation of your backup task?

http://www.cyberciti.biz/tips/linux-...-priority.html

Also, out of interest, did you use the logs to determine that 3am is in fact the time of least activity?

Reefcrazed · 03-28-2016, 04:01 PM

I dug through those logs and did not see anything. I think I went through messages, syslog earlier. I am wondering if the log is written to after the drive goes read only? That would not make sense but there is a strange absence of anything regarding the drive going read only.

The jobs are staggered now and I am going to check every day for it going read only again, if it does I am going to try to get some info before I reboot the OS.

unSpawn · 03-28-2016, 04:55 PM

And the fsck part escaped your attention?

Reefcrazed · 03-28-2016, 06:36 PM

Escaped my attention? No it did not escape my attention. But having to do a file system check is besides the fact, I want to know the cause of the issue not the aftermath.