LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 12-13-2013, 02:35 PM   #1
danielbmartin
Senior Member
 
Registered: Apr 2010
Location: Apex, NC, USA
Distribution: Mint 17.3
Posts: 1,895

Rep: Reputation: 661Reputation: 661Reputation: 661Reputation: 661Reputation: 661Reputation: 661
Sudden slowness


Ubuntu 10.04 LTS

My folder LQfiles contains ~2500 files. Just today using those files has become markedly slow.
Launching a File Browser on LQfiles takes ~2 minutes whereas it formerly took 10 seconds.
Launching an edit session on one of the files is instant. Editing runs at normal speed.
Saving the changed file under the same name ("save") is instant.
Saving the changed file under a different name ("save as") takes ~10 seconds whereas it formerly was instant.
Closing the File Browser takes ~15 seconds whereas it formerly was instant.

My hard drive is only 10% full. This slowness developed today.

Have I come to a Knee In The Curve phenomenon? What to do?

Daniel B. Martin

Last edited by danielbmartin; 12-14-2013 at 01:24 PM. Reason: Correct, clarify, and expand the symptom report
 
Old 12-13-2013, 06:15 PM   #2
TobiSGD
Moderator
 
Registered: Dec 2009
Location: Germany
Distribution: Whatever fits the task best
Posts: 17,148
Blog Entries: 2

Rep: Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886
Symptoms like that occur when there are hardware problems with a disk. Assuming that that folder resides in a partition on the disk sda, what is the output of
Code:
sudo smartctl -a /dev/sda
Please use code-tags to post that output.
 
1 members found this post helpful.
Old 12-13-2013, 06:53 PM   #3
ondoho
LQ Addict
 
Registered: Dec 2013
Posts: 19,872
Blog Entries: 12

Rep: Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053
if you launch an edit session on one of those files without opening the file manager first, e.g. from command line with absolute path:
Code:
gedit /path/to/file.txt
does it also take too long?

it could be your filemanager is having problems with processing all those files, or just one of them. did you say 2500files in 1 (one) directory?
 
1 members found this post helpful.
Old 12-14-2013, 12:35 PM   #4
danielbmartin
Senior Member
 
Registered: Apr 2010
Location: Apex, NC, USA
Distribution: Mint 17.3
Posts: 1,895

Original Poster
Rep: Reputation: 661Reputation: 661Reputation: 661Reputation: 661Reputation: 661Reputation: 661
Thank you, TobiSGD and and ondoho for your interest in this thread.

I am a recreational programmer, entirely self-taught in the Linux realm. Consequently there are great gaps in my knowledge. Much of what I know has been picked up by reading Linux Questions forums, hence the name LQfiles. I don't know enough to answer the questions directly but hope this narrative will be useful.

I have many small bash scripts with names of this form ...
/home/daniel/Desktop/LQfiles/dbm***.bin
... where *** is a numeric.
Most operate on an input file with a name of this form ...
/home/daniel/Desktop/LQfiles/dbm***inp.txt
... and generate an output file with a name of this form ...
/home/daniel/Desktop/LQfiles/dbm***out.txt

The majority of these files contain fewer than 50 lines.

The folder /home/daniel/Desktop/LQfiles contains 2,476 items, totalling 2.4 GB. It contains no other folders, only files.

gedit /path/to/file.txt opens an edit session instantly, same as it does from the file manager.
Saving the edited file works instantly unless I change the name by doing a Save As. In that case it takes ~10 seconds.

Is there some practical limit to the number of files which reside in any one folder? If need be, I could restructure LQfiles to contain only folders, with each folder containing a subset of the present-day LQfiles.

Daniel B. Martin
 
Old 12-14-2013, 12:59 PM   #5
ondoho
LQ Addict
 
Registered: Dec 2013
Posts: 19,872
Blog Entries: 12

Rep: Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053
Quote:
Originally Posted by danielbmartin View Post
I am a recreational programmer, entirely self-taught in the Linux realm.
so am i.
Quote:
gedit /path/to/file.txt opens an edit session instantly, same as it does from the file manager.
you said differently in your first post. which is it to be?
Quote:
Is there some practical limit to the number of files which reside in any one folder?
i don't know. there probably is.
Quote:
If need be, I could restructure LQfiles to contain only folders, with each folder containing a subset of the present-day LQfiles.
i think it would be wise to do so and see if that changes the problem.
it's a nice challenge to make a shell script for that ;-)
and while you're at it, maybe you find some corrupt files which are causing problems.
 
1 members found this post helpful.
Old 12-14-2013, 01:26 PM   #6
danielbmartin
Senior Member
 
Registered: Apr 2010
Location: Apex, NC, USA
Distribution: Mint 17.3
Posts: 1,895

Original Poster
Rep: Reputation: 661Reputation: 661Reputation: 661Reputation: 661Reputation: 661Reputation: 661
Quote:
Originally Posted by ondoho View Post
you said differently in your first post.
You are correct; I contradicted myself. The Original Post has been edited to correct, clarify, and expand the symptom report.
 
Old 12-15-2013, 10:14 AM   #7
TobiSGD
Moderator
 
Registered: Dec 2009
Location: Germany
Distribution: Whatever fits the task best
Posts: 17,148
Blog Entries: 2

Rep: Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886Reputation: 4886
There should be only hard limits how many folders a file-system can handle (dependent on the filesystem in use), but not a "if you go across this number it will become slow" limit. I have never seen such behavior before and I have no clue what could cause it.
 
Old 12-15-2013, 06:07 PM   #8
ondoho
LQ Addict
 
Registered: Dec 2013
Posts: 19,872
Blog Entries: 12

Rep: Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053
Quote:
Originally Posted by TobiSGD View Post
There should be only hard limits how many folders a file-system can handle (dependent on the filesystem in use), but not a "if you go across this number it will become slow" limit. I have never seen such behavior before and I have no clue what could cause it.
i thought maybe the thumbnailer is eating up resources.
 
Old 12-15-2013, 08:23 PM   #9
danielbmartin
Senior Member
 
Registered: Apr 2010
Location: Apex, NC, USA
Distribution: Mint 17.3
Posts: 1,895

Original Poster
Rep: Reputation: 661Reputation: 661Reputation: 661Reputation: 661Reputation: 661Reputation: 661
Quote:
Originally Posted by ondoho View Post
i thought maybe the thumbnailer is eating up resources.
I always use List View so the thumbnailer overhead is not (or should not) be a factor.

Daniel B. Martin
 
Old 12-15-2013, 08:26 PM   #10
danielbmartin
Senior Member
 
Registered: Apr 2010
Location: Apex, NC, USA
Distribution: Mint 17.3
Posts: 1,895

Original Poster
Rep: Reputation: 661Reputation: 661Reputation: 661Reputation: 661Reputation: 661Reputation: 661
I created seven subdirectories. They are:
LQ2 which contains all files with names starting with dbm2.
LQ3 which contains all files with names starting with dbm3.
LQ4 which contains all files with names starting with dbm4.
...
LQ8 which contains all files with names starting with dbm8.

LQfiles now contains those seven LQn folders and 329 files.
Launching a File Browser on LQfiles takes ~11 seconds.

I don't know if this should be considered a solution or a workaround.
Either way, the outcome is satisfactory so we can mark this thread SOLVED.

Daniel B. Martin
 
  


Reply

Tags
performance


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Sudden and Unusual slowness, esp. Firefox, on my Centos5.7 desktop using KDE desktop aletta Linux - Newbie 3 02-02-2012 10:15 PM
[SOLVED] LQ: Slowness etc. anon237 LQ Suggestions & Feedback 37 12-01-2011 01:21 PM
network slowness rehan999 Linux - Networking 0 06-29-2008 05:23 AM
Gnome slowness spattersongt Linux - Desktop 3 10-29-2007 12:25 PM
slowness Britten Ubuntu 3 11-27-2005 04:15 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 11:13 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration