hi,

I am using RHEL 5.7 , problem which i am facing is when i use
du -sh <directory path> command it hangs without showing me the size to that particular directory. Kindly assist me how i diagnose that why its not running and not taking size of this particular directory. Is there any locks on directory which resist me to run this command?

[root@racnode1 grid]# du -sh /u01/app/11.2.0/grid





Thanks

probably you only need to wait a bit longer. Or even longer.

pan64 is correct. The command is likely not hanging; it's busy.

Try running du with and without the "s" argument and compare the times it needs to run.

Hi ,

Thanks for your reply, i have executed below command and it shows me the size of some directories after than it stuck again, it seems that it stuck on some particular directories.

du /u01/app/11.2.0/grid

4372 /u01/app/11.2.0/grid/evm
23940 /u01/app/11.2.0/grid/rdbms/lib
44520 /u01/app/11.2.0/grid/rdbms/mesg
20 /u01/app/11.2.0/grid/rdbms/install/rdbms
40 /u01/app/11.2.0/grid/rdbms/install/sbs
84 /u01/app/11.2.0/grid/rdbms/install

if you want to be sure execute: strace du -sh path > result_file
and you will see how it works.

command is not working on that particular server.

[root@racnode2 ~]# strace du -sh /u01/app/11.2.0/grid >/tmp/out.log
-bash: strace: command not found


Regards
M

so install it.

root@racnode1 ~]# yum install strace*
Loaded plugins: rhnplugin, security
There was an error communicating with RHN.
RHN Satellite or RHN Classic support will be disabled.
Error communicating with server. The message was:
Temporary failure in name resolution
Setting up Install Process
No package strace-4.5* available.
Nothing to do

Hi there,

Is this directory and all its subdirectories on local/directly attached storage? If there is a subdirectory mounted via NFS/NAS, that may play a role.

If everything is on the same storage, the most likely reason for the long delay in getting the result for the next directory is a very large number of files in the directory. Do you know whether that might be the case for any of these subdirectories?

I'm inclined to agree with pan64's original recommendation: simply wait even longer ;-)

Hi again,

You can always try and build it from source - https://sourceforge.net/projects/strace/.

hi,

This directory is on local file system under / sub-directories basically contains oracle software installation binaries. Total size is 6.4 GB , Same directory structure install on another machine when i use du -sh command it shows me result with few seconds but on that particular server it hangs seems to me some process stuck which resist this command to execute.
Actually i am trying to execute a nodeadd oracle script which will copy this folder and move to the new server . But that script hangs for several hours when i check du -sh command on that folder it also hangs. so i feel some thing wrong on os side which is not allowing me this operation.

Thanks

strace is a standard package with RHEL5.7. So you either don't have a RH Satellite for package management or you don't have an active subscription too or both. You other option would be to setup a local repo, however you will need the DVD or ISO for that.

Since you state that all files are local, how about giving us a breakdown from /? Why so fixated on using that command, lets try something else?


Also if you run either top or ps aux, show us the output here and please use the code tags so it is easier to read.

Or if you are stating that this is Oracle, you could use the lsof command and look at standard Oracle ports:

One other thing that will hang du is a bind mount that creates loops. This could have been done by accident.

Code:

[root@racnode1 ~]# df -haT
Filesystem Type Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
ext3 116G 98G 12G 90% /
proc proc 0 0 0 - /proc
sysfs sysfs 0 0 0 - /sys
devpts devpts 0 0 0 - /dev/pts
/dev/cciss/c0d0p1
ext3 99M 36M 59M 39% /boot
tmpfs tmpfs 13G 4.2G 8.9G 33% /dev/shm
shmfs tmpfs 13G 4.2G 8.9G 33% /dev/shm
none binfmt_misc 0 0 0 - /proc/sys/fs/binfmt_misc
sunrpc rpc_pipefs 0 0 0 - /var/lib/nfs/rpc_pipefs
oracleasmfs
oracleasmfs 0 0 0 - /dev/oracleasm
none tmpfs 7.7G 104K 7.7G 1% /var/lib/xenstored

[root@racnode1 ~]# lsof -i:1521
COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME
oracle 344 oracle 16u IPv4 221617201 TCP racnode1-vip:ncube-lm->racnode1-vip:30888 (ESTABLISHED)
oracle 398 oracle 16u IPv4 221617348 TCP racnode1-vip:ncube-lm->racnode1-vip:30892 (ESTABLISHED)
oracle 401 oracle 16u IPv4 221617374 TCP racnode1-vip:ncube-lm->racnode1-vip:30894 (ESTABLISHED)
extract 1284 oracle 12u IPv4 602390135 TCP racnode1:35956->racnode1:ncube-lm (ESTABLISHED)
extract 1284 oracle 15u IPv4 602394266 TCP racnode1:35957->racnode1:ncube-lm (ESTABLISHED)
extract 1284 oracle 17u IPv4 602394291 TCP racnode1:35958->racnode1:ncube-lm (ESTABLISHED)
extract 1284 oracle 19u IPv4 602394324 TCP racnode1:35959->racnode1:ncube-lm (ESTABLISHED)
extract 1284 oracle 21u IPv4 602394348 TCP racnode1:35960->racnode1:ncube-lm (ESTABLISHED)
oracle 1289 oracle 16u IPv4 602390136 TCP racnode1:ncube-lm->racnode1:35956 (ESTABLISHED)
oracle 1292 oracle 16u IPv4 602394267 TCP racnode1:ncube-lm->racnode1:35957 (ESTABLISHED)
oracle 1294 grid 16u IPv4 602394292 TCP racnode1:ncube-lm->racnode1:35958 (ESTABLISHED)
oracle 1296 oracle 16u IPv4 602394325 TCP racnode1:ncube-lm->racnode1:35959 (ESTABLISHED)
oracle 1298 grid 16u IPv4 602394349 TCP racnode1:ncube-lm->racnode1:35960 (ESTABLISHED)
oracle 2060 oracle 16u IPv4 568739593 TCP racnode1-vip:ncube-lm->10.168.20.143:45847 (ESTABLISHED)
oracle 2064 oracle 16u IPv4 568739644 TCP racnode1-vip:ncube-lm->10.168.20.141:41045 (ESTABLISHED)
oracle 2066 oracle 16u IPv4 568739665 TCP racnode1-vip:ncube-lm->10.168.20.141:41047 (ESTABLISHED)
oracle 2068 oracle 18u IPv4 568739674 TCP racnode1-vip:ncube-lm->10.168.20.140:60591 (ESTABLISHED)
oracle 2070 oracle 16u IPv4 568739707 TCP racnode1-vip:ncube-lm->10.168.20.140:60593 (ESTABLISHED)
oracle 2115 oracle 16u IPv4 568740044 TCP racnode1-vip:ncube-lm->10.168.20.143:45851 (ESTABLISHED)
oracle 2131 oracle 16u IPv4 407792239 TCP racnode1-vip:ncube-lm->racnode1-vip:18874 (ESTABLISHED)
oracle 2176 oracle 16u IPv4 568740759 TCP racnode1-vip:ncube-lm->10.168.20.140:60595 (ESTABLISHED)
oracle 3334 oracle 16u IPv4 556305583 TCP racnode1-vip:ncube-lm->10.168.20.141:52542 (ESTABLISHED)
oracle 3336 oracle 16u IPv4 556305605 TCP racnode1-vip:ncube-lm->10.168.20.141:52546 (ESTABLISHED)
oracle 3338 oracle 16u IPv4 556305627 TCP racnode1-vip:ncube-lm->10.168.20.141:52550 (ESTABLISHED)
oracle 5178 oracle 16u IPv4 563109872 TCP racnode1-vip:ncube-lm->10.168.20.203:23307 (ESTABLISHED)
oracle 6122 oracle 16u IPv4 605346713 TCP racnode1:ncube-lm->10.168.20.122:48868 (ESTABLISHED)
oracle 6752 grid 28u IPv4 23966 TCP racnode1:12339->etisldb-scan:ncube-lm (ESTABLISHED)
oracle 6752 grid 30u IPv4 24670 TCP racnode1-vip:14558->racnode1-vip:ncube-lm (ESTABLISHED)
tnslsnr 7207 grid 13u IPv4 22330 TCP racnode1:ncube-lm (LISTEN)
tnslsnr 7207 grid 14u IPv4 22331 TCP racnode1-vip:ncube-lm (LISTEN)
tnslsnr 7207 grid 15u IPv4 23339 TCP racnode1-vip:ncube-lm->racnode1-vip:14554 (ESTABLISHED)
tnslsnr 7207 grid 17u IPv4 24671 TCP racnode1-vip:ncube-lm->racnode1-vip:14558 (ESTABLISHED)
oracle 7349 oracle 27u IPv4 221615981 TCP etisldb-scan:22973->etisldb-scan:ncube-lm (ESTABLISHED)
oracle 7349 oracle 28u IPv4 23338 TCP racnode1-vip:14554->racnode1-vip:ncube-lm (ESTABLISHED)
oracle 8293 oracle 16u IPv4 538201569 TCP racnode1-vip:ncube-lm->10.168.20.90:34315 (ESTABLISHED)
oracle 8355 oracle 16u IPv4 538202189 TCP racnode1-vip:ncube-lm->10.168.20.90:34330 (ESTABLISHED)
emagent 9121 oracle 10u IPv4 568741508 TCP racnode1:14991->racnode2-vip:ncube-lm (ESTABLISHED)
emagent 9121 oracle 14u IPv4 579392929 TCP racnode1:10474->racnode2-vip:ncube-lm (ESTABLISHED)
oracle 9500 oracle 16u IPv4 518945644 TCP racnode1-vip:ncube-lm->10.168.20.184:40378 (ESTABLISHED)
oracle 9502 oracle 16u IPv4 518945669 TCP racnode1-vip:ncube-lm->10.168.20.184:40380 (ESTABLISHED)
oracle 9504 oracle 16u IPv4 518945691 TCP racnode1-vip:ncube-lm->10.168.20.184:40384 (ESTABLISHED)
oracle 9912 oracle 16u IPv4 557948946 TCP racnode1-vip:ncube-lm->10.168.20.92:56531 (ESTABLISHED)
oracle 11576 oracle 16u IPv4 538020813 TCP racnode1-vip:ncube-lm->10.168.20.140:53803 (ESTABLISHED)
oracle 11578 oracle 16u IPv4 538020835 TCP racnode1-vip:ncube-lm->10.168.20.140:53807 (ESTABLISHED)
oracle 14607 oracle 16u IPv4 543813258 TCP racnode1-vip:ncube-lm->10.168.20.71:49149 (ESTABLISHED)
oracle 14609 oracle 16u IPv4 543813286 TCP racnode1-vip:ncube-lm->10.168.20.71:49153 (ESTABLISHED)
oracle 14611 oracle 16u IPv4 543813308 TCP racnode1-vip:ncube-lm->10.168.20.71:49157 (ESTABLISHED)
oracle 16161 oracle 16u IPv4 538045076 TCP racnode1-vip:ncube-lm->10.168.20.17:48383 (ESTABLISHED)
oracle 16163 oracle 16u IPv4 538045104 TCP racnode1-vip:ncube-lm->10.168.20.17:48387 (ESTABLISHED)
oracle 16701 oracle 16u IPv4 605409072 TCP racnode1:ncube-lm->10.168.20.122:58451 (ESTABLISHED)
oracle 16703 oracle 16u IPv4 605409099 TCP racnode1:ncube-lm->10.168.20.122:58455 (ESTABLISHED)
oracle 16705 oracle 16u IPv4 605409154 TCP racnode1:ncube-lm->10.168.20.122:58459 (ESTABLISHED)
oracle 16708 oracle 16u IPv4 605409185 TCP racnode1:ncube-lm->10.168.20.122:58463 (ESTABLISHED)
oracle 20059 oracle 16u IPv4 375824697 TCP racnode1-vip:ncube-lm->racnode1-vip:20407 (ESTABLISHED)
extract 25805 oracle 19u IPv4 597320335 TCP racnode1:gserver->racnode1:ncube-lm (ESTABLISHED)
extract 25805 oracle 24u IPv4 597320386 TCP racnode1:26265->racnode1:ncube-lm (ESTABLISHED)
oracle 25812 grid 16u IPv4 597320336 TCP racnode1:ncube-lm->racnode1:gserver (ESTABLISHED)
oracle 25815 grid 16u IPv4 597320387 TCP racnode1:ncube-lm->racnode1:26265 (ESTABLISHED)
extract 27825 oracle 19u IPv4 570834414 TCP racnode1:15359->racnode1:ncube-lm (ESTABLISHED)
extract 27825 oracle 24u IPv4 570834469 TCP racnode1:15360->racnode1:ncube-lm (ESTABLISHED)
oracle 27832 grid 16u IPv4 570834415 TCP racnode1:ncube-lm->racnode1:15359 (ESTABLISHED)
oracle 27835 grid 16u IPv4 570834470 TCP racnode1:ncube-lm->racnode1:15360 (ESTABLISHED)
replicat 28973 oracle 12u IPv4 548866230 TCP racnode1:50947->racnode1:ncube-lm (ESTABLISHED)
oracle 28978 oracle 16u IPv4 548866231 TCP racnode1:ncube-lm->racnode1:50947 (ESTABLISHED)
oracle 30491 oracle 16u IPv4 777287 TCP racnode1-vip:ncube-lm->10.168.20.166:39967 (ESTABLISHED)
oracle 30493 oracle 16u IPv4 777307 TCP racnode1-vip:ncube-lm->10.168.20.166:39969 (ESTABLISHED)
oracle 30495 oracle 16u IPv4 777327 TCP racnode1-vip:ncube-lm->10.168.20.166:39971 (ESTABLISHED)
oracle 30497 oracle 16u IPv4 777347 TCP racnode1-vip:ncube-lm->10.168.20.166:39973 (ESTABLISHED)
oracle 30499 oracle 16u IPv4 777367 TCP racnode1-vip:ncube-lm->10.168.20.166:39975 (ESTABLISHED)
extract 32291 oracle 19u IPv4 604740674 TCP racnode1:52751->racnode1:ncube-lm (ESTABLISHED)
extract 32291 oracle 24u IPv4 604740719 TCP racnode1:52752->racnode1:ncube-lm (ESTABLISHED)
oracle 32299 grid 16u IPv4 604740675 TCP racnode1:ncube-lm->racnode1:52751 (ESTABLISHED)
oracle 32302 grid 16u IPv4 604740720 TCP racnode1:ncube-lm->racnode1:52752 (ESTABLISHED)
oracle 32343 oracle 16u IPv4 312581400 TCP racnode1-vip:ncube-lm->racnode1-vip:24402 (ESTABLISHED)
tnslsnr 32378 grid 16u IPv4 221615623 TCP etisldb-scan:ncube-lm (LISTEN)
tnslsnr 32378 grid 17u IPv4 223051493 TCP etisldb-scan:ncube-lm->racnode2:42313 (ESTABLISHED)
tnslsnr 32378 grid 18u IPv4 221615982 TCP etisldb-scan:ncube-lm->etisldb-scan:22973 (ESTABLISHED)
tnslsnr 32378 grid 19u IPv4 568740943 TCP etisldb-scan:ncube-lm->racnode2:50894 (ESTABLISHED)
tnslsnr 32378 grid 20u IPv4 312216963 TCP etisldb-scan:ncube-lm->10.168.20.244:45990 (ESTABLISHED)
oracle 32626 oracle 16u IPv4 557896221 TCP racnode1-vip:ncube-lm->10.168.20.139:44123 (ESTABLISHED)
oracle 32628 oracle 16u IPv4 557896242 TCP racnode1-vip:ncube-lm->10.168.20.139:44125 (ESTABLISHED)
oracle 32630 oracle 16u IPv4 557896263 TCP racnode1-vip:ncube-lm->10.168.20.139:44127 (ESTABLISHED)
oracle 32632 oracle 16u IPv4 557896284 TCP racnode1-vip:ncube-lm->10.168.20.139:44129 (ESTABLISHED)
java 32720 oracle 16u IPv6 568741771 TCP racnode1:14999->racnode2-vip:ncube-lm (ESTABLISHED)
java 32720 oracle 21u IPv6 221617200 TCP racnode1-vip:30888->racnode1-vip:ncube-lm (ESTABLISHED)
java 32720 oracle 24u IPv6 221617373 TCP racnode1-vip:30894->racnode1-vip:ncube-lm (ESTABLISHED)
java 32720 oracle 25u IPv6 221617347 TCP racnode1-vip:30892->racnode1-vip:ncube-lm (ESTABLISHED)
java 32720 oracle 29u IPv6 571432398 TCP racnode1:64201->racnode2-vip:ncube-lm (ESTABLISHED)
java 32720 oracle 30u IPv6 312581399 TCP racnode1-vip:24402->racnode1-vip:ncube-lm (ESTABLISHED)
java 32720 oracle 32u IPv6 571432556 TCP racnode1:64204->racnode2-vip:ncube-lm (ESTABLISHED)
java 32720 oracle 34u IPv6 375824696 TCP racnode1-vip:20407->racnode1-vip:ncube-lm (ESTABLISHED)
java 32720 oracle 46u IPv6 407792238 TCP racnode1-vip:18874->racnode1-vip:ncube-lm (ESTABLISHED)

[root@racnode1 ~]# lsof -i:1158

COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME
java 32720 oracle 19u IPv6 221617083 TCP *:dbcontrol-oms (LISTEN)

[root@racnode1 ~]# TOP

top - 09:44:04 up 356 days, 14:29, 3 users, load average: 0.02, 0.12, 0.15
Tasks: 432 total, 1 running, 431 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.1%us, 0.1%sy, 0.0%ni, 99.8%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 16015360k total, 15773492k used, 241868k free, 577632k buffers
Swap: 18481144k total, 2438968k used, 16042176k free, 4736412k cached



PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
11576 oracle 15 0 6555m 3.0g 3.0g S 0.7 19.4 38:06.76 oracle
26280 root 15 0 13024 1376 828 R 0.7 0.0 0:00.11 top
2064 oracle 15 0 6553m 494m 490m S 0.3 3.2 16:35.37 oracle
6443 root 18 0 781m 22m 11m S 0.3 0.1 32:11.80 orarootagent.bi
1 root 15 0 10368 692 580 S 0.0 0.0 7:59.29 init
2 root RT -5 0 0 0 S 0.0 0.0 1:50.06 migration/0
3 root 34 19 0 0 0 S 0.0 0.0 0:11.55 ksoftirqd/0
4 root RT -5 0 0 0 S 0.0 0.0 0:00.00 watchdog/0
5 root RT -5 0 0 0 S 0.0 0.0 1:22.67 migration/1
6 root 34 19 0 0 0 S 0.0 0.0 0:08.76 ksoftirqd/1
7 root RT -5 0 0 0 S 0.0 0.0 0:00.00 watchdog/1
8 root RT -5 0 0 0 S 0.0 0.0 1:15.20 migration/2
9 root 34 19 0 0 0 S 0.0 0.0 0:07.31 ksoftirqd/2
10 root RT -5 0 0 0 S 0.0 0.0 0:00.00 watchdog/2
11 root RT -5 0 0 0 S 0.0 0.0 1:18.16 migration/3
12 root 34 19 0 0 0 S 0.0 0.0 0:07.40 ksoftirqd/3
13 root RT -5 0 0 0 S 0.0 0.0 0:00.01 watchdog/3
14 root RT -5 0 0 0 S 0.0 0.0 1:35.22 migration/4
15 root 34 19 0 0 0 S 0.0 0.0 0:09.38 ksoftirqd/4
16 root RT -5 0 0 0 S 0.0 0.0 0:00.00 watchdog/4
17 root RT -5 0 0 0 S 0.0 0.0 1:22.54 migration/5
18 root 34 19 0 0 0 S 0.0 0.0 0:07.90 ksoftirqd/5
19 root RT -5 0 0 0 S 0.0 0.0 0:00.00 watchdog/5
20 root RT -5 0 0 0 S 0.0 0.0 1:22.61 migration/6
21 root 34 19 0 0 0 S 0.0 0.0 0:07.70 ksoftirqd/6
22 root RT -5 0 0 0 S 0.0 0.0 0:00.00 watchdog/6
23 root RT -5 0 0 0 S 0.0 0.0 1:19.10 migration/7
24 root 34 19 0 0 0 S 0.0 0.0 0:07.12 ksoftirqd/7
25 root RT -5 0 0 0 S 0.0 0.0 0:00.01 watchdog/7
26 root 10 -5 0 0 0 S 0.0 0.0 0:16.80 events/0
27 root 10 -5 0 0 0 S 0.0 0.0 0:00.60 events/1
28 root 10 -5 0 0 0 S 0.0 0.0 0:00.51 events/2

what will say: ls -lR /u01/app/11.2.0/grid | wc -l
probably it will take time too, in that case please tell us how long does it take.
also what will respond the command mount?