I have a problem with some of my files in a linux based cluster machine. These files (txt, pdb etc) were created years back with different programs and they ran successfully with full output and I have backup of those. Recently, when I was browsing through my folders in the cluster, I noticed when I open with vi editor, that some of the files doesn't show the full contents of the file, instead they have noeol message. Some of the files, few minutes back had full contents, now doesn't show full content. It doesn't affect all the files in the folder, but some files in some folders and is spreading to more folders. The last modified date of the files are original date when they were created, same as the backup file, but file size is much reduced compared to the backup. Comparing with the back up, they are same, but the files with the noeol message doesn't have full data, it stops abruptly. I downloaded these files to my PC, and they still do not have the full content. If anybody have any clue about what is going on, I much appreciate it. Thanks

Hmmm...

Well, just from what I am reading here, I would think that the HDD(s) that the files are on are going bad.

At this point, I would recommend grabbing a complete copy of all data that you can, and then run diagnostics on the filesystem *AND* the HDDs.

HTH. Let us know.

Another possibility is the generating program failing eg out of space; this can cause it to fail to write complete lines/files.

Greetings,

@chrism: I can understand that happening with files that are still being written and/or appended to, but would it do that with a file that has not been modified since before the filesystem ran out of space?
It has been my experience that if the filesystem has filled up, you can still copy off existing files that have not been modified since before the filesystem filled in their entirety without issue. It's just where writing and/or modifying is concerned, you will likely get errors and could corrupt the file.

But, along those same lines, a question to helpwithlinux: Are you running the linux box with a swap partition, or a swap file? If you are running with a swap file in the existing partitions, that could also have a major impact on space.

Thanks all for your comments.

My account is in a supercomputer center and I was told that I am only the user with this problem. I guess there is no shortage of space. I have been running jobs successfully, but these problems are with the files which were ran long back and were successful with full output. I am observing this 'missing data' problem when I browse through my folders. The backup of all those files taken years back, have full contents. I do not have any idea how my files got lost data while sitting idle. The missing data problem is increasing with time as more files now doesn't show full contents. The supercomputer tech people couldn't figure out the problem so far.