LinuxQuestions.org
Visit Jeremy's Blog.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Enterprise Linux Forums > Linux - Enterprise
Reload this Page RHEL3 U2 system: Treminal hangs with commands like ps and top
User Name
Password
Linux - Enterprise This forum is for all items relating to using Linux in the Enterprise.

Notices


Reply
  Search this Thread
Old 02-13-2008, 06:26 AM   #1
p_test
Member
 
Registered: Aug 2004
Location: Jaipur(Rajasthan), INDIA
Posts: 35

Rep: Reputation: 15
RHEL3 U2 system: Treminal hangs with commands like ps and top

Machine : RHEL3 U2
OS : RHEL3 U2 ( 2.4.21-15.ELsmp )
The terminal hangs when given any command, ps and top are 2 examples,
the terminal will not work any more, you have to get a new terminal.
We have rebooted the system many times.

Look at the last line of strace... How to check the file name which is associated with the file descriptor ( 4 ) on the read system call..

Below is the strace output :
Quite a lot, but cant put in pieces...

Do let me know, if any more info is required

Thanks
Anurag

execve("/usr/bin/top", ["top"], [/* 26 vars */]) = 0
uname({sys="Linux", node="Myhost", ...}) = 0
brk(0) = 0x510000
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2a9556b000
open("/etc/ld.so.preload", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=101287, ...}) = 0
mmap(NULL, 101287, PROT_READ, MAP_PRIVATE, 3, 0) = 0x2a9556c000
close(3) = 0
open("/lib64/libproc.so.2.0.13", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\2005\0\0"..., 640) = 640
fstat(3, {st_mode=S_IFREG|0755, st_size=49472, ...}) = 0
mmap(NULL, 1107472, PROT_READ|PROT_EXEC, MAP_PRIVATE, 3, 0) = 0x2a9566b000
mprotect(0x2a95676000, 1062416, PROT_NONE) = 0
mmap(0x2a9576b000, 49152, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x2a9576b000
mmap(0x2a95777000, 9744, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x2a95777000
close(3) = 0
open("/usr/lib64/libncurses.so.5", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\0\373\1"..., 640) = 640
fstat(3, {st_mode=S_IFREG|0755, st_size=999596, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2a95585000
mmap(NULL, 1415576, PROT_READ|PROT_EXEC, MAP_PRIVATE, 3, 0) = 0x2a9577a000
mprotect(0x2a957c5000, 1108376, PROT_NONE) = 0
mmap(0x2a9587a000, 368640, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x2a9587a000
close(3) = 0
open("/lib64/tls/libc.so.6", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0`\322\1\0"..., 640) = 640
fstat(3, {st_mode=S_IFREG|0755, st_size=1668832, ...}) = 0
mmap(NULL, 2375528, PROT_READ|PROT_EXEC, MAP_PRIVATE, 3, 0) = 0x2a958d4000
mprotect(0x2a95a0f000, 1085288, PROT_NONE) = 0
mmap(0x2a95ad4000, 262144, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED, 3, 0x100000) = 0x2a95ad4000
mmap(0x2a95b14000, 16232, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x2a95b14000
close(3) = 0
open("/usr/lib64/libgpm.so.1", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200#\0\0"..., 640) = 640
fstat(3, {st_mode=S_IFREG|0755, st_size=23872, ...}) = 0
mmap(NULL, 1071504, PROT_READ|PROT_EXEC, MAP_PRIVATE, 3, 0) = 0x2a95b18000
mprotect(0x2a95b1d000, 1051024, PROT_NONE) = 0
mmap(0x2a95c18000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x2a95c18000
close(3) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2a95586000
arch_prctl(0x1002, 0x2a95586660) = 0
munmap(0x2a9556c000, 101287) = 0
uname({sys="Linux", node="Myhost", ...}) = 0
brk(0) = 0x510000
brk(0x531000) = 0x531000
brk(0) = 0x531000
open("/usr/lib/locale/locale-archive", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=32148976, ...}) = 0
mmap(NULL, 32148976, PROT_READ, MAP_PRIVATE, 3, 0) = 0x2a95c1e000
close(3) = 0
open("/etc/mtab", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=5346, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2a9556c000
read(3, "/dev/hda1 / ext3 rw 0 0\nnone /pr"..., 4096) = 4096
close(3) = 0
munmap(0x2a9556c000, 4096) = 0
open("/proc/stat", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2a9556c000
read(3, "cpu 4206018 21173 3377353 54236"..., 4096) = 829
read(3, "", 4096) = 0
close(3) = 0
munmap(0x2a9556c000, 4096) = 0
open("/etc/toprc", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/root/.toprc", O_RDONLY) = -1 ENOENT (No such file or directory)
getuid() = 0
ioctl(1, SNDCTL_TMR_TIMEBASE or TCGETS, {B38400 opost isig icanon echo ...}) = 0
open("/usr/lib64/gconv/gconv-modules.cache", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=21438, ...}) = 0
mmap(NULL, 21438, PROT_READ, MAP_SHARED, 3, 0) = 0x2a9556c000
close(3) = 0
access("/root/.terminfo/x/xterm", R_OK) = -1 ENOENT (No such file or directory)
access("/usr/share/terminfo/x/xterm", R_OK) = 0
open("/usr/share/terminfo/x/xterm", O_RDONLY) = 3
read(3, "\32\1\34\0\35\0\17\0i\1\273\3", 12) = 12
read(3, "xterm|X11 terminal emulator\0", 28) = 28
read(3, "\0\1\0\0\1\0\0\0\1\0\0\0\0\1\1\0\0\0\0\0\0\0\1\0\0\0\0"..., 29) = 29
read(3, "\0", 1) = 1
read(3, "P\0\10\0\30\0\377\377\377\377\377\377\377\377\377\377\377"..., 30) = 30
read(3, "\0\0\4\0\6\0\10\0\31\0\36\0&\0*\0.\0\377\3779\0J\0L\0P"..., 722) = 722
read(3, "\33[Z\0\7\0\r\0\33[%i%p1%d;%p2%dr\0\33[3g\0\33["..., 955) = 955
read(3, "", 1) = 0
read(3, "", 10) = 0
close(3) = 0
ioctl(1, SNDCTL_TMR_TIMEBASE or TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, SNDCTL_TMR_TIMEBASE or TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, SNDCTL_TMR_TIMEBASE or TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TIOCGWINSZ, {ws_row=35, ws_col=157, ws_xpixel=0, ws_ypixel=0}) = 0
ioctl(0, SNDCTL_TMR_TIMEBASE or TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(0, SNDCTL_TMR_CONTINUE or TCSETSF, {B38400 opost isig -icanon -echo ...}) = 0
ioctl(0, SNDCTL_TMR_TIMEBASE or TCGETS, {B38400 opost isig -icanon -echo ...}) = 0
ioctl(1, TIOCGWINSZ, {ws_row=35, ws_col=157, ws_xpixel=0, ws_ypixel=0}) = 0
fstat(1, {st_mode=S_IFCHR|0620, st_rdev=makedev(136, 9), ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2a95572000
rt_sigaction(SIGHUP, {0x402bb0, [], 0x4000000}, NULL, 8) = 0
rt_sigaction(SIGINT, {0x402bb0, [], 0x4000000}, NULL, 8) = 0
rt_sigaction(SIGQUIT, {0x402bb0, [], 0x4000000}, NULL, 8) = 0
rt_sigaction(SIGTSTP, {0x402c30, [], SA_RESTART|0x4000000}, NULL, 8) = 0
rt_sigaction(SIGWINCH, {0x402cc0, [], SA_RESTART|0x4000000}, NULL, 8) = 0
rt_sigaction(SIGCONT, {0x402cc0, [], SA_RESTART|0x4000000}, NULL, 8) = 0
open("/proc", O_RDONLY|O_NONBLOCK|O_DIRECTORY) = 3
fstat(3, {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
fcntl(3, F_SETFD, FD_CLOEXEC) = 0
getdents64(3, /* 36 entries */, 1024) = 1016
getdents64(3, /* 29 entries */, 1024) = 752
stat("/proc/1", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/1/stat", O_RDONLY) = 4
read(4, "1 (init) S 0 0 0 0 -1 256 14678 "..., 1023) = 250
close(4) = 0
open("/proc/1/statm", O_RDONLY) = 4
read(4, "131 119 112 7 109 3 5\n", 1023) = 22
close(4) = 0
socket(PF_UNIX, SOCK_STREAM, 0) = 4
connect(4, {sa_family=AF_UNIX, path="/var/run/.nscd_socket"}, 110) = -1 ECONNREFUSED (Connection refused)
close(4) = 0
open("/etc/nsswitch.conf", O_RDONLY) = 4
fstat(4, {st_mode=S_IFREG|0644, st_size=1707, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2a95573000
read(4, "#\n# /etc/nsswitch.conf\n#\n# An ex"..., 4096) = 1707
read(4, "", 4096) = 0
close(4) = 0
munmap(0x2a95573000, 4096) = 0
open("/etc/ld.so.cache", O_RDONLY) = 4
fstat(4, {st_mode=S_IFREG|0644, st_size=101287, ...}) = 0
mmap(NULL, 101287, PROT_READ, MAP_PRIVATE, 4, 0) = 0x2a95587000
close(4) = 0
open("/lib64/libnss_files.so.2", O_RDONLY) = 4
read(4, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200%\0\0"..., 640) = 640
fstat(4, {st_mode=S_IFREG|0755, st_size=59296, ...}) = 0
mmap(NULL, 1096200, PROT_READ|PROT_EXEC, MAP_PRIVATE, 4, 0) = 0x2a97ac7000
mprotect(0x2a97ad3000, 1047048, PROT_NONE) = 0
mmap(0x2a97bc7000, 49152, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED, 4, 0) = 0x2a97bc7000
close(4) = 0
munmap(0x2a95587000, 101287) = 0
open("/etc/passwd", O_RDONLY) = 4
fcntl(4, F_GETFD) = 0
fcntl(4, F_SETFD, FD_CLOEXEC) = 0
fstat(4, {st_mode=S_IFREG|0444, st_size=1706, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2a95573000
read(4, "root:x:0:0:root:/root:/bin/bash\n"..., 4096) = 1706
close(4) = 0
munmap(0x2a95573000, 4096) = 0
socket(PF_UNIX, SOCK_STREAM, 0) = 4
connect(4, {sa_family=AF_UNIX, path="/var/run/.nscd_socket"}, 110) = -1 ECONNREFUSED (Connection refused)
close(4) = 0
open("/etc/group", O_RDONLY) = 4
fcntl(4, F_GETFD) = 0
fcntl(4, F_SETFD, FD_CLOEXEC) = 0
fstat(4, {st_mode=S_IFREG|0775, st_size=801, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2a95573000
read(4, "root:x:0:root\nbin:x:1:root,bin,d"..., 4096) = 801
close(4) = 0
munmap(0x2a95573000, 4096) = 0
open("/proc/1/cmdline", O_RDONLY) = 4
read(4, "init\0", 2047) = 5
close(4) = 0
open("/proc/1/wchan", O_RDONLY) = -1 ENOENT (No such file or directory)
stat("/proc/2", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/2/stat", O_RDONLY) = 4
read(4, "2 (migration/0) S 0 1 1 0 -1 320"..., 1023) = 159
close(4) = 0
open("/proc/2/statm", O_RDONLY) = 4
read(4, "0 0 0 0 0 0 0\n", 1023) = 14
close(4) = 0
open("/proc/2/cmdline", O_RDONLY) = 4
read(4, "", 2047) = 0
close(4) = 0
open("/proc/2/wchan", O_RDONLY) = -1 ENOENT (No such file or directory)
stat("/proc/3", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/3/stat", O_RDONLY) = 4
read(4, "3 (migration/1) S 0 1 1 0 -1 320"..., 1023) = 159
close(4) = 0
open("/proc/3/statm", O_RDONLY) = 4
read(4, "0 0 0 0 0 0 0\n", 1023) = 14
close(4) = 0
open("/proc/3/cmdline", O_RDONLY) = 4
read(4, "", 2047) = 0
close(4) = 0
open("/proc/3/wchan", O_RDONLY) = -1 ENOENT (No such file or directory)
stat("/proc/4", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/4/stat", O_RDONLY) = 4
read(4, "4 (keventd) S 1 1 1 0 -1 64 0 47"..., 1023) = 171
close(4) = 0
open("/proc/4/statm", O_RDONLY) = 4
read(4, "0 0 0 0 0 0 0\n", 1023) = 14
close(4) = 0
open("/proc/4/cmdline", O_RDONLY) = 4
read(4, "", 2047) = 0
close(4) = 0
open("/proc/4/wchan", O_RDONLY) = -1 ENOENT (No such file or directory)
stat("/proc/5", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/5/stat", O_RDONLY) = 4
read(4, "5 (ksoftirqd/0) S 1 1 1 0 -1 64 "..., 1023) = 156
close(4) = 0
open("/proc/5/statm", O_RDONLY) = 4
read(4, "0 0 0 0 0 0 0\n", 1023) = 14
close(4) = 0
open("/proc/5/cmdline", O_RDONLY) = 4
read(4, "", 2047) = 0
close(4) = 0
open("/proc/5/wchan", O_RDONLY) = -1 ENOENT (No such file or directory)
stat("/proc/6", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/6/stat", O_RDONLY) = 4
read(4, "6 (ksoftirqd/1) S 1 1 1 0 -1 64 "..., 1023) = 156
close(4) = 0
open("/proc/6/statm", O_RDONLY) = 4
read(4, "0 0 0 0 0 0 0\n", 1023) = 14
close(4) = 0
open("/proc/6/cmdline", O_RDONLY) = 4
read(4, "", 2047) = 0
close(4) = 0
open("/proc/6/wchan", O_RDONLY) = -1 ENOENT (No such file or directory)
stat("/proc/9", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/9/stat", O_RDONLY) = 4
read(4, "9 (bdflush) S 1 1 1 0 -1 64 0 0 "..., 1023) = 150
close(4) = 0
open("/proc/9/statm", O_RDONLY) = 4
read(4, "0 0 0 0 0 0 0\n", 1023) = 14
close(4) = 0
open("/proc/9/cmdline", O_RDONLY) = 4
read(4, "", 2047) = 0
close(4) = 0
open("/proc/9/wchan", O_RDONLY) = -1 ENOENT (No such file or directory)
stat("/proc/7", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/7/stat", O_RDONLY) = 4
read(4, "7 (kswapd) D 1 1 1 0 -1 2112 0 0"..., 1023) = 164
close(4) = 0
open("/proc/7/statm", O_RDONLY) = 4
read(4, "0 0 0 0 0 0 0\n", 1023) = 14
close(4) = 0
open("/proc/7/cmdline", O_RDONLY) = 4
read(4, "", 2047) = 0
close(4) = 0
open("/proc/7/wchan", O_RDONLY) = -1 ENOENT (No such file or directory)
stat("/proc/8", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/8/stat", O_RDONLY) = 4
read(4, "8 (kscand) S 1 1 1 0 -1 64 0 0 0"..., 1023) = 160

-------------------Output truncated--------------------------------

open("/proc/1507/wchan", O_RDONLY) = -1 ENOENT (No such file or = 0
open("/proc/11643/wchan", O_RDONLY) = -1 ENOENT (No such file or directory)
stat("/proc/12077", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/12077/stat", O_RDONLY) = 4
read(4, "12077 (getLinuxHardwar) S 11642 "..., 1023) = 239
close(4) = 0
open("/proc/12077/statm", O_RDONLY) = 4
read(4, "191 83 82 0 82 1 0\n", 1023) = 19
close(4) = 0
open("/proc/12077/cmdline", O_RDONLY) = 4
read(4, "/usr/local/bin/perl\0-w\0/proj/lin"..., 2047) = 79
close(4) = 0
open("/proc/12077/wchan", O_RDONLY) = -1 ENOENT (No such file or directory)
stat("/proc/12297", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
open("/proc/12297/stat", O_RDONLY) = 4
read(4,
 
Old 02-13-2008, 07:12 AM   #2
unSpawn
Moderator
 
Registered: May 2001
Posts: 29,415
Blog Entries: 55

Rep: Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600
AFAIK the broken off "read" at the bottom should display the contents of whatever item the previous "open" call encountered. What does 'lsof -w -n -p 12297' return (provided the process still has that PID)?
 
Old 02-15-2008, 07:24 AM   #3
p_test
Member
 
Registered: Aug 2004
Location: Jaipur(Rajasthan), INDIA
Posts: 35

Original Poster
Rep: Reputation: 15
Thanks for the reply "unSpawn"

I tried to run lsof an the pid, but it did not work. Even lsof was not behaving properly.
Moreover, i would have loved to work on this problem till it was resolved.
But to address the criticality, we were forced to upgrade to rhel3 u6.

The problem is not visible here....

Thanks once again

Regards
Anurag
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
top and ps commands show incorrect pids joepgjm Linux - Newbie 3 04-25-2007 11:23 AM
Dynamically Adding New HD to a running RHEL3 system fng2006 Linux - Enterprise 2 09-21-2006 07:18 AM
Add a notice of the top 20 commands to check your unix system on the front page t3gah LQ Suggestions & Feedback 1 03-21-2005 08:23 AM
What do you think are the top ten UNIX/LINUX commands marigb Linux - Newbie 24 05-17-2004 02:17 AM
poll: What do you think are Unix/Linux top ten most used commands marigb Linux - Newbie 0 05-11-2004 11:23 AM

LinuxQuestions.org > Forums > Enterprise Linux Forums > Linux - Enterprise

All times are GMT -5. The time now is 07:36 PM.

Contact Us - Advertising Info - Rules - Privacy - LQ Merchandise - Donations - Contributing Member - LQ Sitemap -
Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration