LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Networking
User Name
Password
Linux - Networking This forum is for any issue related to networks or networking.
Routing, network cards, OSI, etc. Anything is fair game.

Notices


Reply
  Search this Thread
Old 08-16-2011, 12:43 PM   #1
bweaver
Member
 
Registered: Nov 2010
Posts: 44

Rep: Reputation: 0
Debian box running virtual machines blows up under large NFS network load


I am running Debian Squeeze with Xen 4.0. I am running a stress test. I have created 2 virtual machines, each with 512 Mb of memory. I have made one of the vms an NFS server, sharing out a large file (4.6 Gb). The other virtual machine is an NFS client. The stress test consists of passing that big file back and forth via an mv command executed on the client, which moves the file back and forth from the nfs share directory to a local directory. The virtual machines are stored on a remote SAN connected to by ISCSI and formatted in ocfs2.

It is true I have had better luck with some nics than others, but now I have one that does not drop packets.

And yet,

about 1 out of 2 times I attempt to mv the file from the local directory of the nfs client vm to the nfs share, the box running the vms reboots. It leaves no logs, and seldom even any messages on the screen. It just blanks out and the next thing I know I it is rebooting.

I have tried manipulating the size of the MTU, with out positive success.

I have noticed that all--or nearly all--the reboots occur when I attempt to mv the file BACK INTO the nfs shared directory.

Any ideas why the host machine is rebooting, and how this could be fixed? Could changing the size of the ring buffer make a difference? I read about this on a couple of web pages.
 
Old 08-22-2011, 08:08 AM   #2
bweaver
Member
 
Registered: Nov 2010
Posts: 44

Original Poster
Rep: Reputation: 0
update--possible fixes

On the Xen users forum a guy called explained that he had had problems with several nics other than Intels under large sustained network loads. Apparently other nics will interrupt the CPU often, or otherwise interrupt packet transfer when packet numbers exceed 60-70,000.

Apparently, Intel nics offer better throttle control, via RxIntDelay and other params available on the e1000e module and not available for other nics. I have tried Realtek and Broadcom nics without success. These do not offer parameters to tune of the kind made available by Intel.

Therefore, solution may consist of:

1. installing Intel nics. Ideally Pro/1000s such as we have mounted on the functioning machine, but possibly other Intels that allow for tuning.

2. if necessary, replacing not only the nics but also the server that interracts with them, in favour of an intel model.

3. investigate possible workarounds to hardware replacement, including tuning of Linux buffer parameters in /etc/systctl.conf

Any perspectives you all might have on these are welcome!
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
How to assign Debian running on virtual box a static ip? peterson.julia Linux - Newbie 5 01-12-2010 05:38 PM
Running virtual pc files in a virtual machine in linux ... preferably virtual box biharibong Linux - Software 4 01-21-2009 01:04 PM
Networking Conflict Between Virtual Box Network Bridge & OpenSSH Server, Debian Etch TeddyB Linux - Server 4 11-19-2008 05:25 AM
Converting a Dual Boot Box and Network Into Virtual Machines Woodsman Slackware 2 04-18-2008 10:28 PM
How to use virtual memory to load large data? wudt Programming 5 10-18-2006 12:00 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Networking

All times are GMT -5. The time now is 12:35 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration