LinuxQuestions.org
Visit the LQ Articles and Editorials section
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Red Hat
User Name
Password
Red Hat This forum is for the discussion of Red Hat Linux.

Notices

Reply
 
Search this Thread
Old 05-10-2007, 08:21 AM   #1
PhillipHuang
Member
 
Registered: Aug 2006
Location: Shen Zhen
Distribution: Ubuntu 10.04
Posts: 198

Rep: Reputation: 33
df halt when mount large NFS share


Hi folks,

I meet something interesting: After mount a large share(Perhaps is 3TB) through NFSv3, executing "df" in client will be halt while the OS does not crash.

NFS server is CentOS4.4, and client is RHEL4.2. The mounting process is successful with health network environment.

This strange issue has been taken place for serval times, I think if it is caused by the client "df" version, perhaps the df in RHEL4.2 can not recognize large share(as above 3TB), but I'm not sure.

Please give me some hints.

Regards,
Phillip
 
Old 05-14-2007, 04:50 PM   #2
twantrd
Senior Member
 
Registered: Nov 2002
Location: CA
Distribution: redhat 7.3
Posts: 1,438

Rep: Reputation: 52
I'm using RHEL 4.4 here and I have no problems using 'df' for faily large filesystems. I mounted a 70T filesystem and it's outputting just fine.

My mount version = mount-2.12a
My df version = 5.2.1

My mount options are: rw,tcp,hard,nfsvers=3,intr,bg.

-twantrd
 
Old 05-16-2007, 12:37 AM   #3
PhillipHuang
Member
 
Registered: Aug 2006
Location: Shen Zhen
Distribution: Ubuntu 10.04
Posts: 198

Original Poster
Rep: Reputation: 33
twantrd,

Thanks for you reply.
As your comment, it seems it is not related with df/mount version.I would investigate more deeply and update my result later.

Regards,
Phillip
 
Old 05-16-2007, 09:01 PM   #4
PhillipHuang
Member
 
Registered: Aug 2006
Location: Shen Zhen
Distribution: Ubuntu 10.04
Posts: 198

Original Poster
Rep: Reputation: 33
Update,

Replace the 100Mb/s switch with new 1Gb/s Cisco product, I mount 10T share smoothly,however it still takes about 1 minute to complete "df" operation.

Hence,here comes a new question. Some customers are using 100Mb/s switches and have no plan to buy 1Gb/s switches in recent days, What should I do to help them to execute "df" in their 100Mb/s networking? Or just suggest them to update to faster devices?

Thanks in advanced.

Regards,
Phillip
 
Old 05-17-2007, 02:11 AM   #5
systemnotes
LQ Newbie
 
Registered: Apr 2007
Distribution: RHEL
Posts: 29

Rep: Reputation: 15
This could be caused by several things.

Firewall rules
autofs
nfs using udp instead of tcp
Different MTU sizes set in /etc/sysconfig/network-scripts/ifcfg-eth0
network driver, e.g. IBM blades with tg3 driver instead of broadcomm
bad switches

etc...

Does it work locally, but not remotely?

How are they mounting the directory?

If they don't need to run df on the nfs exported directory, they can use the "-l" switch to show local only. e.g. df -lh
 
Old 05-17-2007, 03:04 AM   #6
PhillipHuang
Member
 
Registered: Aug 2006
Location: Shen Zhen
Distribution: Ubuntu 10.04
Posts: 198

Original Poster
Rep: Reputation: 33
iptables/Firewall is off,
Not use autofs.

Yes, df works well locally,either 100Mb/s or 1Gb/s networking environment.

The architecture is: four CentOS4.4 act as cluster node, and mount the underlying storage device with gfs option. The outside clients access the NFS share exported in nodes(mount node1:/share client_directory),and all the mount operating use the default options.

The 'mount' time seems to be reasonable, about 5 seconds, but when issue 'df' in 100Mb/s networking, it will hang.

Last edited by PhillipHuang; 05-17-2007 at 03:07 AM.
 
Old 05-18-2007, 02:39 AM   #7
twantrd
Senior Member
 
Registered: Nov 2002
Location: CA
Distribution: redhat 7.3
Posts: 1,438

Rep: Reputation: 52
Perhaps you need to mess around with wsize and rsize values when you run the mount command. Also, mounting it over tcp doesn't hurt. You don't see collisions on the interfaces of the linux servers do you? Are they also at 100Mb full duplex? Do you see any packet errors on the ports of the switches that they are connected to?

-twantrd
 
Old 05-19-2007, 09:46 PM   #8
PhillipHuang
Member
 
Registered: Aug 2006
Location: Shen Zhen
Distribution: Ubuntu 10.04
Posts: 198

Original Poster
Rep: Reputation: 33
Hello twantrd,

Thanks for you review.

I was working in customer fieldground in last friday, and found perhaps underlying reason is related to client's 'mount' version. The NFS server(cluster node) is mount-2.12p, while the client is fairly old, mount-2.11y. When I test in another linux box integrated mount-2.12p, the mount process is very fast, and 'df' does not hang,however, it still takes about 10 seconds to display large shares.

The customer would never upgrade the existing mount in their own Linux system, because it is on their risk. I have to consider to make the node's version lower to adapte the customer.

I will do more test to verify my opinion, and update here.

Regards,
Phillip

Last edited by PhillipHuang; 05-19-2007 at 09:48 PM.
 
Old 10-26-2007, 03:57 AM   #9
PhillipHuang
Member
 
Registered: Aug 2006
Location: Shen Zhen
Distribution: Ubuntu 10.04
Posts: 198

Original Poster
Rep: Reputation: 33
Update here.

When mount 15TB share, and then use "df" to see tha capacity. It still needs 3-5 minutes.

-Phillip
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
fstab entry does not mount nfs share nanbudh Linux - Networking 13 06-07-2012 02:05 PM
NFS mount of smb mount of windows share: permission denied problem :( Bagatur Linux - Networking 4 07-07-2009 11:34 AM
NFS large file v3 force? sirmonkey Debian 1 04-17-2007 08:49 PM
i can mount a nfs share from solaris into linux, but can't write to it fabmejia Linux - Enterprise 9 03-05-2007 09:37 PM
how to mount a nfs mount from linux client to AIX nfs server dennyqian AIX 8 09-22-2006 03:34 AM


All times are GMT -5. The time now is 10:30 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration