LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Networking
User Name
Password
Linux - Networking This forum is for any issue related to networks or networking.
Routing, network cards, OSI, etc. Anything is fair game.

Notices


Reply
  Search this Thread
Old 01-13-2019, 10:23 AM   #1
pgb205
Member
 
Registered: Nov 2007
Posts: 127

Rep: Reputation: 15
NAS Drive performance when writing small files


I am trying to write small files (<100bytes) in large numbers and very quickly to NAS
and getting awful performance. Writing to local disk by comparison is normal.
Not sure if it's something with network adapter settings, or network itself. Maybe my NAS is in some way misconfigured. I'd be grateful even for the suggestions on how to troubleshoot this further.
 
Old 01-13-2019, 05:30 PM   #2
berndbausch
Senior Member
 
Registered: Nov 2013
Location: Tokyo
Distribution: Redhat/Centos, Ubuntu, Raspbian, Fedora
Posts: 2,512

Rep: Reputation: 614Reputation: 614Reputation: 614Reputation: 614Reputation: 614Reputation: 614
I won’t be able to answer you, but a little more information would be helpful so that more knowledgeable people an help. How is this NAS connected (e.g. NFS), what is its brand (self-made?), do you only write or also create those small files?
 
Old 01-13-2019, 08:01 PM   #3
pgb205
Member
 
Registered: Nov 2007
Posts: 127

Original Poster
Rep: Reputation: 15
the nas is connected via smb and the brand is synology. The small files are cache files. I dont yet know i I'd have the same issues reading them. But writing them is the problem I'm trying to resolve now.
I've done a bit more testing and it seems to be a network problem for sure. I'd be curious which nic settings are recommended for smaller files on the network.
 
Old 01-13-2019, 09:27 PM   #4
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 17,358

Rep: Reputation: 2695Reputation: 2695Reputation: 2695Reputation: 2695Reputation: 2695Reputation: 2695Reputation: 2695Reputation: 2695Reputation: 2695Reputation: 2695Reputation: 2695
Why do you infer it's the nic ?. What about SMB/CIFS buffering and locking ?.
Have you looked at the cache options - could be very intrusive for lots of small writes. Especially if only one client is involved and you can wear the risk of not running strict. See mount.cifs manpage - and no doubt copious web blogs.

(caveat - vary rarely used SMB/CIFS)
 
Old 01-13-2019, 09:36 PM   #5
pgb205
Member
 
Registered: Nov 2007
Posts: 127

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by syg00 View Post
Why do you infer it's the nic ?. What about SMB/CIFS buffering and locking ?.
Have you looked at the cache options - could be very intrusive for lots of small writes. Especially if only one client is involved and you can wear the risk of not running strict. See mount.cifs manpage - and no doubt copious web blogs.

(caveat - vary rarely used SMB/CIFS)
ok. that might be helpful. Yes, there is only one client. As a matter of fact they are on their own network directly connected via cat cable.
 
Old 01-14-2019, 07:53 PM   #6
jefro
Moderator
 
Registered: Mar 2008
Posts: 18,693

Rep: Reputation: 2795Reputation: 2795Reputation: 2795Reputation: 2795Reputation: 2795Reputation: 2795Reputation: 2795Reputation: 2795Reputation: 2795Reputation: 2795Reputation: 2795
If this is some older ARM based then you may not get the speed you expect.

Guess you could try ftp maybe.
 
Old 01-14-2019, 10:03 PM   #7
berndbausch
Senior Member
 
Registered: Nov 2013
Location: Tokyo
Distribution: Redhat/Centos, Ubuntu, Raspbian, Fedora
Posts: 2,512

Rep: Reputation: 614Reputation: 614Reputation: 614Reputation: 614Reputation: 614Reputation: 614
Quote:
Originally Posted by pgb205 View Post
the nas is connected via smb and the brand is synology. The small files are cache files. I dont yet know i I'd have the same issues reading them. But writing them is the problem I'm trying to resolve now.
I've done a bit more testing and it seems to be a network problem for sure. I'd be curious which nic settings are recommended for smaller files on the network.
This might be a red herring, but in case those small files don't exist on the NAS prior to writing them, my guess is that the NAS is not that good at creating files. Check the Synology documentation if something can be tweaked in this area. Perhaps it's inherent in SMB? Or you need to defragment the disk (I don't know what filesystem is used in Synology)?

You can try writing a few large files or do the test with existing files to see if the performance is different.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
reliable centos nas server with raid or nas boxes which is better ? Gil@LQ Linux - Server 9 09-10-2015 06:13 AM
Help figuring out: NAS, FreeNas, Linux "NAS", or Linux server JohnLocke Linux - General 24 04-18-2015 11:16 AM
automatically backup folder on Free NAS computer to another Free NAS computer tom treadway Linux - Newbie 1 01-26-2011 08:28 PM
Buffalo NAS - how do we get files on NAS syncing with Windows Sync? bykerbob Linux - Newbie 0 10-21-2008 09:59 PM
Poor performance from NAS drive philipm Linux - Networking 6 01-26-2008 01:23 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Networking

All times are GMT -5. The time now is 06:19 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration