LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware
User Name
Password
Linux - Hardware This forum is for Hardware issues.
Having trouble installing a piece of hardware? Want to know if that peripheral is compatible with Linux?

Notices


Reply
  Search this Thread
Old 11-18-2021, 11:37 PM   #16
rclark
Member
 
Registered: Jul 2008
Location: Montana USA
Distribution: KUbuntu, Fedora (KDE), PI OS
Posts: 672

Rep: Reputation: 254Reputation: 254Reputation: 254

Our conversation got me interested again, so set up the share using nfs and did some playing. First repeated the problem. Yep still there. Then instead of rsync used simple cp. Same problem. So not application specific. Next checked into nfs.Ahhhh, I do believe I found the problem. I was using the safe 'sync' option in the exports file for the share. Changed to 'async' and now it flies. The processor usage for all four RPI cores actually can be pegged while receiving large files. Memory usage doesn't go up much at all. The downside of course is power failures that could corrupt the data. But battery backup and proper shutdown should solve that problem if I 'really' want to set the RPI4 up as a server. At least I know what now causes the slooooow down. Thanks for kicking me into gear to check into ths !

BTW, I use the 'sync' option on the tower server and all is well performance wise. The data is on new internal SATA SSDs as of a couple weeks ago. Even with the previous HDD, I didn't notice a significant slow down over nfs. Must be something to do with the USB 3.0 HDD drive or the USB controller on the RPI.

Last edited by rclark; 11-19-2021 at 12:04 AM.
 
Old 11-19-2021, 12:40 AM   #17
HappyTux
Senior Member
 
Registered: Mar 2003
Location: Nova Scotia, Canada
Distribution: Debian AMD64
Posts: 4,170

Rep: Reputation: 244Reputation: 244Reputation: 244
Quote:
Originally Posted by computersavvy View Post
One thing that everyone needs to be aware of when using the inexpensive home HDDs.

Almost all the manufacturers use SMR (shingled magnetic recording) technology on the drives designed for workstations (home and office). They use CMR (cylindrical magnetic recording) technology on the drives for NAS and enterprise use (and those cost more).

The issue with SMR drives is that after they get ~30% filled the write speed slows drastically because it has to move data that is 'shingled' over the space where new data is being written. The more data on the drive the slower the write speeds as a result of needing to move more layers of 'shingles' for each write. Drives using the CMR technology do not suffer this slowdown.

This happens regardless of the app being used to write the data. Rsync is one app where it quickly becomes apparent since the user is often writing a significant amount at a single session.

My advice (and personal practice): Spend the extra and get the NAS or Enterprise drives when a new one is needed.
Even the NAS make little difference with Western Digital they have the WD Red NAS drive a SMR and then the WD Red Plus NAS a CMR. The weasels have put out a list on their website about which is which and it is in the description of the listing on places like amazon and newegg. They like to present it as out of the goodness of their heart but it is because of the law suits brought when people found out about the switch and sued. Oh the 6TB I use is SMR one of the ones in the hidden switch it was supposed to be CMR if they had kept their word on it. Christ I hate the scumbags in the computer industry the place is infested with them and has been since the beginning. I know I was there for all the garbage they have done. And hard drives being my pet peeve. In the start it was binary you got what the label listed for capacity now it is decimal, like my computer computes in decimal!, and the loss now with 10TB drives out there you get to see they have lied their way to an extra TB as the real capacity is 9TiB. That last one now I remember that lie with the abbreviations too.
 
Old 11-19-2021, 09:34 AM   #18
computersavvy
Senior Member
 
Registered: Aug 2016
Posts: 3,345

Rep: Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486
Quote:
Originally Posted by HappyTux View Post
Even the NAS make little difference with Western Digital they have the WD Red NAS drive a SMR and then the WD Red Plus NAS a CMR. The weasels have put out a list on their website about which is which and it is in the description of the listing on places like amazon and newegg. They like to present it as out of the goodness of their heart but it is because of the law suits brought when people found out about the switch and sued. Oh the 6TB I use is SMR one of the ones in the hidden switch it was supposed to be CMR if they had kept their word on it. Christ I hate the scumbags in the computer industry the place is infested with them and has been since the beginning. I know I was there for all the garbage they have done. And hard drives being my pet peeve. In the start it was binary you got what the label listed for capacity now it is decimal, like my computer computes in decimal!, and the loss now with 10TB drives out there you get to see they have lied their way to an extra TB as the real capacity is 9TiB. That last one now I remember that lie with the abbreviations too.
They are not 'lying'. They are using advertising speak, since 10 TB sounds much larger than 9 Tib, even though the byte size is the same. My 3 TB WD drives actually give me 2.7 TiB so I have the same issue.
 
Old 11-19-2021, 11:01 AM   #19
HappyTux
Senior Member
 
Registered: Mar 2003
Location: Nova Scotia, Canada
Distribution: Debian AMD64
Posts: 4,170

Rep: Reputation: 244Reputation: 244Reputation: 244
Quote:
Originally Posted by computersavvy View Post
They are not 'lying'. They are using advertising speak, since 10 TB sounds much larger than 9 Tib, even though the byte size is the same. My 3 TB WD drives actually give me 2.7 TiB so I have the same issue.

Almost all advertising is lying they are paid professionals at it. In legal terms it is called deception or fraud by misrepresentation. Somehow they get pass for it as they have bought the supposed standard bodies to have their scam method accepted as part of the standards. Sort of like the Chinese being part of the UN Human Rights body. They in no way support human rights and are there only to subvert the process.
 
Old 11-19-2021, 01:27 PM   #20
rclark
Member
 
Registered: Jul 2008
Location: Montana USA
Distribution: KUbuntu, Fedora (KDE), PI OS
Posts: 672

Rep: Reputation: 254Reputation: 254Reputation: 254
Actually from what I read, when a manufacture markets the drive to us, they use 1000 bytes per KB (for the layman among us) rather than 1024 bytes per KB as the computer sees it. So a 500G drive is actually 465.66GB. Some space is also taken up by partitioning and formatting and such too.

Last edited by rclark; 11-19-2021 at 01:35 PM.
 
Old 11-19-2021, 03:48 PM   #21
HappyTux
Senior Member
 
Registered: Mar 2003
Location: Nova Scotia, Canada
Distribution: Debian AMD64
Posts: 4,170

Rep: Reputation: 244Reputation: 244Reputation: 244
Quote:
Originally Posted by rclark View Post
Actually from what I read, when a manufacture markets the drive to us, they use 1000 bytes per KB (for the layman among us) rather than 1024 bytes per KB as the computer sees it. So a 500G drive is actually 465.66GB. Some space is also taken up by partitioning and formatting and such too.
Yeah the computer sees the binary it runs on. The 1024 the 1000 is a made up unit for the purpose of lies it is a decimal unit. Just where the hell is my decimal ram, the decimal programming they do not exist a computer is binary for all its workings hard drives included. They hijacked the standards body got their garbage passed into the standard so they could tell their lies. Plain and simple rather than do the decent thing and tell the hard drive manufacturers to stop their garbage they have all just let it continue. Even worse colluded with them in the deception, loaded with scummy weasels the computer business in a nutshell. The amount of things like this I have seen in my many decades of using these things is unbelievable at times. The technology companies have got too powerful, the effects on society are only beginning to be felt and a new dark age of repression is round the corner due to them. As those spineless politicians will do nothing to stop it, they will pass useless laws about anything else but protecting the people they are supposed to serve forget it, some filthy rich ahole might make a few dollars less. Not be able to kill off more people with their actions. After all unlimited growth and wealth accumulation has to preserved who cares how many die in the quest.
 
Old 11-19-2021, 06:28 PM   #22
rclark
Member
 
Registered: Jul 2008
Location: Montana USA
Distribution: KUbuntu, Fedora (KDE), PI OS
Posts: 672

Rep: Reputation: 254Reputation: 254Reputation: 254
For a HappyTux, thou dost not sound very happy .

I've been 'satisfied' with my WD Red drives. Both times I had major problems with server drives over the years was with Seagate drives. So I've stuck with WD ... for now. Knock on wood. Rather than wait to go bad, after 3-4 years I swap out for a new one. With 4TB around $100, it isn't a big deal to do so. Things are a bit different now though as my server has three SSDs and the one backup 4TB HDD. 1 SSD for the OS, and 2 2TB SSDs for data. See how this behaves in the long term! I don't write much, so I 'think' they should last quite awhile. We'll see. No worry as they are fully backed up.

Last edited by rclark; 11-19-2021 at 06:43 PM.
 
Old 11-19-2021, 08:03 PM   #23
computersavvy
Senior Member
 
Registered: Aug 2016
Posts: 3,345

Rep: Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486
Quote:
Originally Posted by HappyTux View Post
Almost all advertising is lying they are paid professionals at it. In legal terms it is called deception or fraud by misrepresentation.
This is from my 3 TB drive using smartctl.
Code:
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.14.17-201.fc34.x86_64] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Blue
Device Model:     WDC WD30EZRZ-00Z5HB0
Serial Number:    WD-WCC4N0EFT5A4
LU WWN Device Id: 5 0014ee 2114ca378
Firmware Version: 80.00A80
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Saying it is 3 TB is NOT a lie. They say it is 3 TB and in fact the byte size is 3 TB.
I cannot help it if the user sees the size in a different unit (TiB) on his system and thinks he got cheated. Educate yourself on what units are used and where they are seen and quit whining that what is said is not what you heard.

Last edited by computersavvy; 11-19-2021 at 08:14 PM.
 
Old 11-19-2021, 08:10 PM   #24
computersavvy
Senior Member
 
Registered: Aug 2016
Posts: 3,345

Rep: Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486Reputation: 1486
Quote:
Originally Posted by rclark View Post
So a 500G drive is actually 465.66GB. Some space is also taken up by partitioning and formatting and such too.
Please be careful and use the units properly.
500 GB (powers of ten) is equal to 465.66 Gib (powers of 2). A little is lost in formatting, partitioning, etc, but saying that a 500 GB drive is actually 465.66 GB is not a correct statement since you used the units incorrectly. Improperly using units is what causes things like this discussion.

Last edited by computersavvy; 11-19-2021 at 08:12 PM.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
How do I make my Seagate 2Tb usb hdd work in Linux? winger9 Linux - Hardware 17 01-23-2018 05:08 PM
Most efficient way to back up, then sync, one 2TB drive to another 2TB drive (ubuntu) eco_bach Linux - Newbie 3 01-09-2017 05:01 PM
New Seagate External 2TB Drive Issues xmrkite Linux - Hardware 7 11-27-2011 09:54 PM
fdisk gives unable to read on brand new Seagate green 2tb drive robulus Linux - Hardware 4 11-02-2011 08:50 AM
Will opensuse 11.x 64bit recognise a seagate barracuda XT SATA 6Gb/s 2TB Hard Drive Glenn D. Linux - Hardware 2 12-22-2010 06:51 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware

All times are GMT -5. The time now is 11:12 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration