LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 07-23-2022, 01:05 PM   #16
DoctorWizard
Member
 
Registered: Feb 2019
Location: Orange Park, FL
Distribution: Mint 20.3
Posts: 43

Original Poster
Rep: Reputation: Disabled

Quote:
Please do get back after you are rested and reconfigured: this will nag at me until I know for sure what went south. ;-)
The old videos drive has been swapped out (again) for a new one. The old one has been placed into a USB 3.0 adapter connected to my 'main brain' machine where I've run all sorts of scans and diagnostics and found no problems whatsoever. As for the new one, the original problem still exists but only on one out of four Windows machines I've tested it with, and none of the Linux machines. Of course-- Murphy's Law-- that's the machine I usually want to copy from (the Theater machine). Of note: When that one Windows machine has the copy failure it causes the drive to go offline for everyone, even on the server itself. The problem only occurs on the 'Videos' share, I can copy the same huge files to the other the other three shares without issue on said machine. I have been trying to isolate what is different about that machine and/or that share and so far I'm coming up blank. Every machine of course has different hardware and some of the software varies by machine but nothing that seems even remotely likely to be the culprit. If anything, it should be my main machine with the problem since it is loaded to the hilt with all sorts of software imaginal. I have meticulously dug all through the network settings and everything there is identical except for the IP address. I still suspect some sort of buffer overflow since it only occurs with big files. I will continue to troubleshoot this problem as I get time between other projects because it's nagging me too! The videos share is actually the least important one. I set it up for the enjoyment of all the other household members yet they very rarely use it. I will be sure to post the cause and solution when I figure it out.
Thank you for your help and time!
 
Old 07-23-2022, 03:10 PM   #17
wpeckham
LQ Guru
 
Registered: Apr 2010
Location: Continental USA
Distribution: Debian, Ubuntu, RedHat, DSL, Puppy, CentOS, Knoppix, Mint-DE, Sparky, VSIDO, tinycore, Q4OS,Manjaro
Posts: 5,654

Rep: Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708
Quote:
Originally Posted by DoctorWizard View Post
The old videos drive has been swapped out (again) for a new one. The old one has been placed into a USB 3.0 adapter connected to my 'main brain' machine where I've run all sorts of scans and diagnostics and found no problems whatsoever. As for the new one, the original problem still exists but only on one out of four Windows machines I've tested it with, and none of the Linux machines. Of course-- Murphy's Law-- that's the machine I usually want to copy from (the Theater machine). Of note: When that one Windows machine has the copy failure it causes the drive to go offline for everyone, even on the server itself. The problem only occurs on the 'Videos' share, I can copy the same huge files to the other the other three shares without issue on said machine. I have been trying to isolate what is different about that machine and/or that share and so far I'm coming up blank. Every machine of course has different hardware and some of the software varies by machine but nothing that seems even remotely likely to be the culprit. If anything, it should be my main machine with the problem since it is loaded to the hilt with all sorts of software imaginal. I have meticulously dug all through the network settings and everything there is identical except for the IP address. I still suspect some sort of buffer overflow since it only occurs with big files. I will continue to troubleshoot this problem as I get time between other projects because it's nagging me too! The videos share is actually the least important one. I set it up for the enjoyment of all the other household members yet they very rarely use it. I will be sure to post the cause and solution when I figure it out.
Thank you for your help and time!
Can you boost memory so the OS can allocate more I/O buffers?
It may not help, but I have seen situations where it DID.

I would still look for another (probably non-gui) way to transfer the file. #1 I still think that may be the problem, and #2 even if it is not it may work AROUND the problem.
 
Old 07-24-2022, 03:16 PM   #18
DoctorWizard
Member
 
Registered: Feb 2019
Location: Orange Park, FL
Distribution: Mint 20.3
Posts: 43

Original Poster
Rep: Reputation: Disabled
Quote:
Can you boost memory so the OS can allocate more I/O buffers?
Both machines have plenty of RAM, the Windows machine has 16GB, the server has 48GB ECC so I'm googling trying to find out how I can increase default buffer sizes for TCP and otherwise. So far- have only found info for samba, still looking.
Quote:
I would still look for another (probably non-gui) way to transfer the file. #1 I still think that may be the problem, and #2 even if it is not it may work AROUND the problem.
My workaround for now, is to copy to a different share (misc files share) into a folder named "!Videos_MoveUs!" and then remote into the server and move them from that folder to the appropriate location on the videos drive. So far that is working. I'm a little paranoid since I have yet to figure out why the videos share behaves differently, they all have the same parameters in samba, so I'm also stashing backup copies to a removable drive. But you make an interesting point about GUI, I think I may try it from the Windows Command Prompt instead of File Explorer.
Quote:
My advice would be: #1 never use Windows software and expect it to deal properly with Linux drives or transfers.
That is my goal. I am trying to wean myself off of Windows. I'm getting fed up with Microsoft's recent shenanigans. Problem is I know Windows very well and when something goes wrong I can fix it. Linux, not so much. I also have a ton of licensed Windows software, some it very specialized such as my Christmas light sequencing, and a lot of custom stuff I have written for myself that I really don't think I'll be able to port.

I'm currently running an ffmpeg script to see which videos have become corrupted and which are still OK. With nearly 1000 movies and shorts, and 5000 TV shows totaling 3.5TB I am currently guestimating that script will take 3-4 days to complete based on its progress so far.
 
Old 07-24-2022, 04:46 PM   #19
wpeckham
LQ Guru
 
Registered: Apr 2010
Location: Continental USA
Distribution: Debian, Ubuntu, RedHat, DSL, Puppy, CentOS, Knoppix, Mint-DE, Sparky, VSIDO, tinycore, Q4OS,Manjaro
Posts: 5,654

Rep: Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708Reputation: 2708
I understand the problem. I still have a licensed copy of OS/2 WARP in the original box, and I hate to pitch it. (Good OS! Microsoft should have leveraged that agreement instead of cheating IBM!)

Luckily, most of my old software was in assembler and is no longer needed, or in Pascal and I can port using FreePascal quickly, or rewrite it in V-lang, Rust, or C if I need time and that level of performance.

Let me know if I can help, and there are others here who are very willing to help.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: The EXT4 Data Corruption Issue Has Also Been Fixed in Linux Kernel 3.18.14 LTS LXer Syndicated Linux News 1 05-23-2015 05:02 AM
LXer: Linux Kernel Plagued by an EXT4 Data Corruption Issue, Patch Available LXer Syndicated Linux News 1 05-20-2015 12:47 PM
LXer: Btrfs Still Working To Address Corruption Issue LXer Syndicated Linux News 0 01-23-2013 03:00 PM
corruption issue, please HELP iceman42 Linux - Hardware 3 09-18-2003 09:39 PM
corruption issue, please HELP iceman42 Linux - Software 2 09-18-2003 09:36 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 03:15 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration