LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware
User Name
Password
Slackware This Forum is for the discussion of Slackware Linux.

Notices


Reply
  Search this Thread
Old 09-30-2011, 08:28 AM   #1
SeRi@lDiE
Member
 
Registered: Jun 2006
Location: /dev/null
Distribution: Slackware 13.1, Slackware 13.37, aptosid, rhel
Posts: 547
Blog Entries: 7

Rep: Reputation: 55
Slow File Transfers (LAN)


I been having issues where I start a transfer over nfs or cifs and it starts ok at about 120MBps over the LAN, than the transfer speeds starts decreasing all the way down to like 1KBps a few seconds pass and it bursts back to 50MBps and it keeps fluctuating the same way with different speeds till its done... Its very annoying!
a simple 700MB iso takes me like 5 min to transfer. Please not that is not a network issue since I can transfer files with my macs just fine.
This issue is isolated to the slackware systems only.
I have two Slackware 13.37 x86_64 systems that do the same thing.

LAN is a GigE network at 1GBps

Any ideas?

TIA!
 
Old 09-30-2011, 11:21 AM   #2
ReaperX7
LQ Guru
 
Registered: Jul 2011
Location: California
Distribution: Slackware64-15.0 Multilib
Posts: 6,554
Blog Entries: 15

Rep: Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097
Check your network device for LAN throughput and make sure the device does not have any preset management tools configured to limit speeds and bandwidth based on usage if the usage gets heavy.

If you do, set the port your workstation and/or the server to EXEMPT or similar control status. Often this is labeled as exempt, disabled, or maximum bandwidth more most switches and routers.

Also, make sure you have the appropriate cabling for your network. Make sure you are using at minimum CAT5e Ethernet rated cables. Avoid using Hubs devices as well, and use Switches instead.

Slackware shouldn't be the problem in this case, and neither should the workstation or the servers.

Last edited by ReaperX7; 09-30-2011 at 11:25 AM.
 
Old 09-30-2011, 12:23 PM   #3
SeRi@lDiE
Member
 
Registered: Jun 2006
Location: /dev/null
Distribution: Slackware 13.1, Slackware 13.37, aptosid, rhel
Posts: 547

Original Poster
Blog Entries: 7

Rep: Reputation: 55
Quote:
Originally Posted by ReaperX7 View Post
Check your network device for LAN throughput and make sure the device does not have any preset management tools configured to limit speeds and bandwidth based on usage if the usage gets heavy.

If you do, set the port your workstation and/or the server to EXEMPT or similar control status. Often this is labeled as exempt, disabled, or maximum bandwidth more most switches and routers.

Also, make sure you have the appropriate cabling for your network. Make sure you are using at minimum CAT5e Ethernet rated cables. Avoid using Hubs devices as well, and use Switches instead.

Slackware shouldn't be the problem in this case, and neither should the workstation or the servers.
Sorry but you are wrong. Slackware is the problem in this case. The LAN or the firewalls are not enforcing QoS or Traffic Shaping. I can not make nothing out of this one. Its only this two machines... I can take them too different areas of the house and they do the same thing.

And to my test it seems at the protocol level:


Client connecting to 10.30.2.52, TCP port 5001
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[ 3] local 10.30.2.51 port 50011 connected with 10.30.2.52 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-10.0 sec 1.10 GBytes 942 Mbits/sec
root@oscuridad:/media#
 
Old 09-30-2011, 12:25 PM   #4
disturbed1
Senior Member
 
Registered: Mar 2005
Location: USA
Distribution: Slackware
Posts: 1,133
Blog Entries: 6

Rep: Reputation: 224Reputation: 224Reputation: 224
Quote:
Originally Posted by SeRi@lDiE View Post

Any ideas?

TIA!
--edit--
duplicate info that SeRi@lDiE posted at the same time

Last edited by disturbed1; 09-30-2011 at 12:28 PM.
 
Old 09-30-2011, 12:27 PM   #5
disturbed1
Senior Member
 
Registered: Mar 2005
Location: USA
Distribution: Slackware
Posts: 1,133
Blog Entries: 6

Rep: Reputation: 224Reputation: 224Reputation: 224
Well you posted when I did. And iperf looks fine. Looks as if the hardware and wiring is just fine.

What do your smb.conf / /etc/exports and mount options look like?

Also, could you run iperf with a longer test, just to make sure there isn't a buffer problem on the NICs. --time 120 instead of the default 10 seconds?

Last edited by disturbed1; 09-30-2011 at 12:32 PM.
 
Old 09-30-2011, 01:14 PM   #6
SeRi@lDiE
Member
 
Registered: Jun 2006
Location: /dev/null
Distribution: Slackware 13.1, Slackware 13.37, aptosid, rhel
Posts: 547

Original Poster
Blog Entries: 7

Rep: Reputation: 55
Quote:
Originally Posted by disturbed1 View Post
Well you posted when I did. And iperf looks fine. Looks as if the hardware and wiring is just fine.

What do your smb.conf / /etc/exports and mount options look like?

Also, could you run iperf with a longer test, just to make sure there isn't a buffer problem on the NICs. --time 120 instead of the default 10 seconds?
disturbed1,

Thanks for the help. I will post the results in a bit. I have my hands tide with a RHEL5 install.
 
Old 09-30-2011, 01:20 PM   #7
SeRi@lDiE
Member
 
Registered: Jun 2006
Location: /dev/null
Distribution: Slackware 13.1, Slackware 13.37, aptosid, rhel
Posts: 547

Original Poster
Blog Entries: 7

Rep: Reputation: 55
disturbed1,

Results:

Code:
root@oscuridad:/media# iperf -c 10.30.2.52 --time 120
------------------------------------------------------------
Client connecting to 10.30.2.52, TCP port 5001
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.30.2.51 port 47956 connected with 10.30.2.52 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-120.0 sec  13.2 GBytes   941 Mbits/sec
root@oscuridad:/media#
Pretty consistent if you ask me

Code:
nfs:

root@externo:~# cat /etc/exports 
# See exports(5) for a description.
# This file contains a list of all directories exported to other computers.
# It is used by rpc.nfsd and rpc.mountd.
/mnt/backup/    10.30.2.0/24(rw,no_root_squash)
root@externo:~# 

cifs:

[ global ]
interfaces = egiga0
unix charset = UTF8
workgroup = ROOT
netbios name = nas-node
server string = DNS-323
hosts allow = 
hosts deny = 
security = USER
encrypt passwords = yes
max log size = 0
socket options = TCP_NODELAY SO_RCVBUF=65536 SO_SNDBUF=65536
max xmit = 65535
create mask = 0777
directory mask  = 0777
force create mode = 0777
force directory mode = 0777
load printers = Yes
printcap name = /usr/local/LPRng/etc/printcap
min print space = 2000
max print jobs = 1000
printing = lprng
print command = /usr/local/LPRng/bin/lpr -P%p -r %s 
lpq command = /usr/local/LPRng/bin/lpq -P%p
lprm command = /usr/local/LPRng/bin/lprm -P%p %j
lppause command = /usr/local/LPRng/sbin/lpc hold %p %j
lpresume command = /usr/local/LPRng/sbin/lpc release %p %j
queuepause command = /usr/local/LPRng/sbin/lpc -P%p stop
queueresume command = /usr/local/LPRng/sbin/lpc -P%p start
use sendfile =yes


[ web_page ]
comment = Enter Our Web Page Setting
path = /mnt/web_page
valid users = 
read only = yes
guest ok = yes

[printers]
path = /mnt/HD_a2/.lpd
guest ok = Yes
printable = Yes
use client driver = Yes
browseable = No

[ BT ]
comment = 
path = /mnt/HD_a2/BT
valid users = 
read only = no
guest ok = yes
oplocks = no
map archive = no

[ Volume_1 ]
comment = 
path = /mnt/HD_a2
valid users = nUll
read only = no
guest ok = no
oplocks = no
map archive = no

root@nas-node:~#
 
Old 09-30-2011, 01:57 PM   #8
disturbed1
Senior Member
 
Registered: Mar 2005
Location: USA
Distribution: Slackware
Posts: 1,133
Blog Entries: 6

Rep: Reputation: 224Reputation: 224Reputation: 224
Like the iperf. To me appears to rule any questions on the hardware and wires. Some Intel NICS have known eeprom issues, that are never seen with short bursts of traffic. I'm sure Intel is not the only NIC that has a similar issue.

Considering I don't have any transfer issues, I'll point out some of the differences I see.

My smb.conf does not have any socket options. I do recall reading different docs that stated different send and receive buffers to tune performance. Changing these values never yielded better performance, and in some cases hurt performance.
Quote:
SO_SNDBUF and SO_RCVBUF
The send and receive buffers can often be the reset to a value higher than that of the operating system. This yields a marginal increase of speed (until it reaches a point of diminishing returns).
http://oreilly.com/openbook/samba/book/appb_02.html

You can modify /etc/rc.d/rc.nfs in an attempt to squeeze more performance out of NFS.

This is my setting
Code:
# Start 8 nfsd servers by default (an old Sun standard):
  if [ -x /usr/sbin/rpc.nfsd ]; then
    echo "  /usr/sbin/rpc.nfsd 8"
    /usr/sbin/rpc.nfsd -U 32
  fi
I launch 32 NFS servers, -U specifies TCP instead of UDP.

copy ~1400M file from disturbed1 to backend
Code:
keith@disturbed1:~$ mount | grep Share
backend:/mnt/Share on /mnt/Share type nfs (rw,noatime,intr,tcp,ac,addr=192.168.1.111)
//backend/Share on /mnt/tmp type cifs (rw,mand)
keith@disturbed1:~$ ls -la test.bin 
-rw-r--r-- 1 keith users 1468006400 Sep 30 14:49 test.bin

keith@disturbed1:~$ scp test.bin keith@backend:/mnt/Share/
keith@backend's password: 
test.bin                                                                                                                            100% 1400MB  66.7MB/s   00:21    

NFS
keith@disturbed1:~$ dd if=/mnt/Share/test.bin of=/dev/null 
2867200+0 records in
2867200+0 records out
1468006400 bytes (1.5 GB) copied, 18.0938 s, 81.1 MB/s

CIFS
keith@disturbed1:~$ dd if=/mnt/tmp/test.bin of=/dev/null 
2867200+0 records in
2867200+0 records out
1468006400 bytes (1.5 GB) copied, 1.44791 s, 1.0 GB/s <---- :D file caching 

( a few syncs, flushes, mount/unmounts)
keith@disturbed1:~$ dd if=/mnt/tmp/test.bin of=/mnt/media/test.bin
2867200+0 records in
2867200+0 records out
1468006400 bytes (1.5 GB) copied, 13.3679 s, 110 MB/s
----
System info -
disturbed1 = 1090t x6 Slackware64 -current with Kernel 3.0.3 RTL 8168 onboard nic.
backend = e8500 core2duo Slackware64 13.37 with Kernel 2.6.38.4 RTL 8168 onboard nic.
7200 SATA drives.

Last edited by disturbed1; 09-30-2011 at 02:05 PM.
 
Old 09-30-2011, 06:52 PM   #9
ReaperX7
LQ Guru
 
Registered: Jul 2011
Location: California
Distribution: Slackware64-15.0 Multilib
Posts: 6,554
Blog Entries: 15

Rep: Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097Reputation: 2097
You said QoS isn't working eh...

Have you tried AlienBOB's Easy Firewall Generator to setup for QoS packet scheduling via IPTables/IPChains?

There should also be an administration tool if you use webmin.

I also found this:

Code:
http://www.lartc.org/howto/
 
0 members found this post helpful.
Old 09-30-2011, 08:25 PM   #10
allend
LQ 5k Club
 
Registered: Oct 2003
Location: Melbourne
Distribution: Slackware64-15.0
Posts: 6,350

Rep: Reputation: 2739Reputation: 2739Reputation: 2739Reputation: 2739Reputation: 2739Reputation: 2739Reputation: 2739Reputation: 2739Reputation: 2739Reputation: 2739Reputation: 2739
Are you trying to write to an NTFS file system when you do the transfers?
Quote:
root@nas-node:~#
suggests you are attempting to write to some NAS device
I get the impression that the LAN configuration is all OK. The problem comes with writing the transferred data. I have seen slowing write performance when writing large files to NTFS file systems.
 
Old 09-30-2011, 11:18 PM   #11
SeRi@lDiE
Member
 
Registered: Jun 2006
Location: /dev/null
Distribution: Slackware 13.1, Slackware 13.37, aptosid, rhel
Posts: 547

Original Poster
Blog Entries: 7

Rep: Reputation: 55
Quote:
Originally Posted by allend View Post
Are you trying to write to an NTFS file system when you do the transfers?
suggests you are attempting to write to some NAS device
I get the impression that the LAN configuration is all OK. The problem comes with writing the transferred data. I have seen slowing write performance when writing large files to NTFS file systems.
Yes one is a NAS and two are slackware. All systems are Ext3.

Last edited by SeRi@lDiE; 10-01-2011 at 07:13 AM.
 
Old 09-30-2011, 11:29 PM   #12
SeRi@lDiE
Member
 
Registered: Jun 2006
Location: /dev/null
Distribution: Slackware 13.1, Slackware 13.37, aptosid, rhel
Posts: 547

Original Poster
Blog Entries: 7

Rep: Reputation: 55
Quote:
Originally Posted by ReaperX7 View Post
You said QoS isn't working eh...

Have you tried AlienBOB's Easy Firewall Generator to setup for QoS packet scheduling via IPTables/IPChains?

There should also be an administration tool if you use webmin.

I also found this:

Code:
http://www.lartc.org/howto/

What? Please stay on topic. I never said that they are not working nether I want them to work. I was stating that They are not "set".

Thanks for the help though.
 
Old 10-02-2011, 10:51 AM   #13
SeRi@lDiE
Member
 
Registered: Jun 2006
Location: /dev/null
Distribution: Slackware 13.1, Slackware 13.37, aptosid, rhel
Posts: 547

Original Poster
Blog Entries: 7

Rep: Reputation: 55
Any body?
 
Old 10-02-2011, 01:33 PM   #14
Richard Cranium
Senior Member
 
Registered: Apr 2009
Location: McKinney, Texas
Distribution: Slackware64 15.0
Posts: 3,858

Rep: Reputation: 2225Reputation: 2225Reputation: 2225Reputation: 2225Reputation: 2225Reputation: 2225Reputation: 2225Reputation: 2225Reputation: 2225Reputation: 2225Reputation: 2225
Quote:
Originally Posted by SeRi@lDiE View Post
The LAN or the firewalls are not enforcing QoS or Traffic Shaping.
What makes you so sure? The fact that your Macs are doing a better job is not proof.
 
Old 10-02-2011, 02:41 PM   #15
Slackovado
Member
 
Registered: Mar 2005
Location: BC, Canada
Distribution: Slackware 14.2 x64
Posts: 308

Rep: Reputation: 70
Quote:
Originally Posted by SeRi@lDiE View Post
I been having issues where I start a transfer over nfs or cifs and it starts ok at about 120MBps over the LAN, than the transfer speeds starts decreasing all the way down to like 1KBps a few seconds pass and it bursts back to 50MBps and it keeps fluctuating the same way with different speeds till its done... Its very annoying!
a simple 700MB iso takes me like 5 min to transfer. Please not that is not a network issue since I can transfer files with my macs just fine.
This issue is isolated to the slackware systems only.
I have two Slackware 13.37 x86_64 systems that do the same thing.

LAN is a GigE network at 1GBps

Any ideas?

TIA!
Are you writing to a D-Link dns323 nas enclosure?
If so then both reads and writes to that thing are somewhere between 8-20 Mb/s.
On my Gb lan I can't get more than about 12Mb/s speed out of the dns323 with transfers from/to both Slackware and Win7 systems.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
File transfers are slow and take 100% of CPU stringZ Linux - Software 3 12-07-2008 07:35 AM
Slow transfers between clients in 100mbps lan. beadyallen Linux - Networking 3 03-03-2008 06:11 PM
transfers between LAN machines is slow - I've got ethereal output! akshunj Linux - Networking 10 09-16-2006 12:18 AM
Slow network file transfers purelithium Linux - Networking 4 02-14-2006 05:28 PM
lan file transfers crash my box hank43 Linux - Networking 1 03-01-2004 07:36 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware

All times are GMT -5. The time now is 09:39 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration