LinuxQuestions.org
View the Most Wanted LQ Wiki articles.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices



Reply
 
Search this Thread
Old 02-13-2004, 08:21 AM   #1
rmang
LQ Newbie
 
Registered: Jan 2004
Posts: 12

Rep: Reputation: 0
kernel 2.2 vs. 2.4 - large # of files


I have noticed that with kernel 2.2.x on a RH 6.2 OS, if a directory contains 20,000 files or more, a directory listing takes 1-2 minutes to complete, commands such as tar say too many files, and the system deals with the files in the directory slowly. My question is:

- Will upgrading the kernel to 2.4.x overcome this limitation and speed up commands and the handling of directories with 1000's of files? Or is this because of the ext2 filesystem that the directories bog down?

Just trying to figure out a way to improve performance without having to upgrade the entire OS. Thanks.

Rob
 
Old 02-13-2004, 09:15 AM   #2
Guttorm
Senior Member
 
Registered: Dec 2003
Location: Trondheim, Norway
Distribution: Debian and Ubuntu
Posts: 1,159

Rep: Reputation: 258Reputation: 258Reputation: 258
Hi

I think it's ext2 that slows things down. Reiserfs addresses this problem, I suggest giving it a try.

Why tar says "too many files", I don't know. But RedHat 6.2 is old, if your hardware supports it, I suggest upgrading to a newer distro.
 
Old 02-13-2004, 09:20 AM   #3
rmang
LQ Newbie
 
Registered: Jan 2004
Posts: 12

Original Poster
Rep: Reputation: 0
Thanks for the reply. Due to legacy software and a production environment, we're trying to squeeze as much out of the current OS as possible. I thought that the 2.2 kernel did not have large directory support for large number of files, whereas 2.4 did. I could easily be wrong though.

Also, if anyone can confirm that ext2 is the actual piece of the puzzle that is the problem, that would be helpful as well.

Rob
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
moving large files mnauta Linux - General 2 04-27-2004 08:47 AM
Compress large files deweirdt Linux - Software 1 02-11-2004 08:18 AM
Large Number of files? mikeshn Linux - Security 2 01-10-2004 07:11 AM
How to backup large files( > 2G or 4G)? myunicom Linux - General 4 09-24-2003 09:17 PM
Large data files on CD dema Linux - Newbie 1 01-26-2002 11:30 PM


All times are GMT -5. The time now is 10:23 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration