Welcome to the most active Linux Forum on the web.
Go Back > Forums > Linux Forums > Linux - General
User Name
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.


  Search this Thread
Old 02-13-2004, 07:21 AM   #1
LQ Newbie
Registered: Jan 2004
Posts: 12

Rep: Reputation: 0
kernel 2.2 vs. 2.4 - large # of files

I have noticed that with kernel 2.2.x on a RH 6.2 OS, if a directory contains 20,000 files or more, a directory listing takes 1-2 minutes to complete, commands such as tar say too many files, and the system deals with the files in the directory slowly. My question is:

- Will upgrading the kernel to 2.4.x overcome this limitation and speed up commands and the handling of directories with 1000's of files? Or is this because of the ext2 filesystem that the directories bog down?

Just trying to figure out a way to improve performance without having to upgrade the entire OS. Thanks.

Old 02-13-2004, 08:15 AM   #2
Senior Member
Registered: Dec 2003
Location: Trondheim, Norway
Distribution: Debian and Ubuntu
Posts: 1,293

Rep: Reputation: 335Reputation: 335Reputation: 335Reputation: 335

I think it's ext2 that slows things down. Reiserfs addresses this problem, I suggest giving it a try.

Why tar says "too many files", I don't know. But RedHat 6.2 is old, if your hardware supports it, I suggest upgrading to a newer distro.
Old 02-13-2004, 08:20 AM   #3
LQ Newbie
Registered: Jan 2004
Posts: 12

Original Poster
Rep: Reputation: 0
Thanks for the reply. Due to legacy software and a production environment, we're trying to squeeze as much out of the current OS as possible. I thought that the 2.2 kernel did not have large directory support for large number of files, whereas 2.4 did. I could easily be wrong though.

Also, if anyone can confirm that ext2 is the actual piece of the puzzle that is the problem, that would be helpful as well.



Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
moving large files mnauta Linux - General 2 04-27-2004 07:47 AM
Compress large files deweirdt Linux - Software 1 02-11-2004 07:18 AM
Large Number of files? mikeshn Linux - Security 2 01-10-2004 06:11 AM
How to backup large files( > 2G or 4G)? myunicom Linux - General 4 09-24-2003 08:17 PM
Large data files on CD dema Linux - Newbie 1 01-26-2002 10:30 PM > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 04:47 AM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration