LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 01-02-2011, 03:46 PM   #16
markush
Senior Member
 
Registered: Apr 2007
Location: Germany
Distribution: Slackware
Posts: 3,979

Rep: Reputation: Disabled

Quote:
Originally Posted by EdGr View Post
An easy solution would be to create a number of subdirectories, say alphabetically by name. Each subdirectory would have much fewer files.
Yes, that was my first thought as well. Divide the files like formerly in a filing cabinet.

As an example
Code:
for i in A B C D E; do mkdir $i; done
will create directories A, B, C, D and E within the current directory.
Quote:
It would be great for Linux if there was a way to overcome the problem.
the Linux-commandline is that much powerful, it will solve your problem. For example you may expand the formerly example
Code:
for i in A B C D E; do mkdir $i; mv A* $i; done
this will (after creating the directory) move all documentes whose name start with an "A" into the directory A. The examples are executed on the commandline, if you write a little script for this purpose it will become a little more convenient.

I'd recommend to read here: http://tldp.org/HOWTO/Bash-Prog-Intro-HOWTO.html or more advanced here http://tldp.org/LDP/abs/html/.

Note that you can post your problem/requirements in the Programming forum of LQ: http://www.linuxquestions.org/questions/programming-9/ you will get much help there.

Markus
 
Click here to see the post LQ members have rated as the most helpful post in this thread.
Old 01-03-2011, 12:44 PM   #17
joham34
Member
 
Registered: Oct 2009
Location: Greece
Distribution: ubuntu 14.04
Posts: 79

Original Poster
Rep: Reputation: 4
Well thanks a lot for your answers
In fact it is not a serious problem , mainly I was concerned why windows can manage my archive faster than linux since linux is faster
Ill try what you recommend and propably I will be ok.
 
Old 01-03-2011, 05:00 PM   #18
w1k0
Senior Member
 
Registered: May 2008
Location: Poland
Distribution: Slackware, Mint
Posts: 1,252

Rep: Reputation: 205Reputation: 205Reputation: 205
joham34,

It looks like the graphical tools such as Thunar and Nautilus cause the problems you described. I suggest you to use instead of them Midnight Commander file manager.

To install it run Terminal and use the command:

sudo apt-get install mc

You said you use OpenOffice.org but you didn’t specified the format of the files. To display the contents of SXW or ODT files you have to install odt2txt. To display the contents of DOC files you have to install docview. The best option is to install both of them:

sudo apt-get install odt2txt docview

To run Midnight Commander in Terminal window use the command:

mc

When you highlight the file name and press F3 key Midnight Commander displays the content of the selected file.

Thanks to odt2txt and docview you’ll be able to inspect your files fast before opening them with OpenOffice.org.

I’m also pretty sure Midnight Commander will open your huge directories much faster than Thunar or Nautilus.

Report here the results of that experiment, please.
 
Old 01-04-2011, 07:28 AM   #19
devnull10
Member
 
Registered: Jan 2010
Location: Lancashire
Distribution: Slackware Stable
Posts: 553

Rep: Reputation: 116Reputation: 116
Quote:
may be it is the only Linux real weakness I have encountered so far.
I wouldn't say that at all, I'd just say it's a weakness in the method and software that you are chosing to browse your files. As mentioned above, the command line is king.
 
Old 01-04-2011, 08:07 AM   #20
imagine_me2
Member
 
Registered: Nov 2009
Location: Kolkata, India
Distribution: Fedora 11
Posts: 136

Rep: Reputation: 22
Its the same with me. Dirs with large no. of files takes considerably more time to open in Linux than it does on windows(eg /usr/bin or windows/system32). But instead of finding a solution i have learnt to live with it.I would suggest the using command line with tools like find and grep or semi-graphical tools like midnight commander.
 
Old 01-04-2011, 08:11 AM   #21
djsmiley2k
Member
 
Registered: Feb 2005
Location: Coventry, UK
Distribution: Home: Gentoo x86/amd64, Debian ppc. Work: Ubuntu, SuSe, CentOS
Posts: 343
Blog Entries: 1

Rep: Reputation: 72
Maybe windows is doing read-aheads when you open the parent dir and generating all the listed file names ready for "if" you happen to go into that directory?
 
Old 01-04-2011, 10:03 AM   #22
joham34
Member
 
Registered: Oct 2009
Location: Greece
Distribution: ubuntu 14.04
Posts: 79

Original Poster
Rep: Reputation: 4
Quote:
Originally Posted by w1k0 View Post
joham34,

It looks like the graphical tools such as Thunar and Nautilus cause the problems you described. I suggest you to use instead of them Midnight Commander file manager.

To install it run Terminal and use the command:

sudo apt-get install mc

You said you use OpenOffice.org but you didn’t specified the format of the files. To display the contents of SXW or ODT files you have to install odt2txt. To display the contents of DOC files you have to install docview. The best option is to install both of them:

sudo apt-get install odt2txt docview

To run Midnight Commander in Terminal window use the command:

mc

When you highlight the file name and press F3 key Midnight Commander displays the content of the selected file.

Thanks to odt2txt and docview you’ll be able to inspect your files fast before opening them with OpenOffice.org.

I’m also pretty sure Midnight Commander will open your huge directories much faster than Thunar or Nautilus.

Report here the results of that experiment, please.
I installed Midnight Commander which is pretty fast as you said . It needs about 10 secs to browse the archive for the first time , then ( as opposed to nautilus) , if I close and reopen it , it opens it instantly . I try to learn to work with it as I havent managed yet to figure out how can i find a file. Say , I have named some patients adding eg the word "complication" in their filename So the filename looks like: Surname_name_birthdate_complication
Sometimes I need to find all patients who had the "complication" and so I search for "complication" and e.g nautilus will display all my "complication" files.
Ill try to figure out if I can use it that way and let you know
By the way , with Thunar the first opening is slow but the second very fast. The same is true for the gnome search tool .
Also, when I first open my archive with ls , browsing is very fast with Thunar but lingers somewhat with nautilus. SO I guess the list created is stored in memory and browsers utilize it somehow

Last edited by joham34; 01-04-2011 at 10:18 AM.
 
Old 01-04-2011, 10:53 AM   #23
joham34
Member
 
Registered: Oct 2009
Location: Greece
Distribution: ubuntu 14.04
Posts: 79

Original Poster
Rep: Reputation: 4
Quote:
Originally Posted by djsmiley2k View Post
Maybe windows is doing read-aheads when you open the parent dir and generating all the listed file names ready for "if" you happen to go into that directory?
I also considered this possibility so I put my flash drive on a winXP system after the login . It listed the files immediately although the flash was not there while booting. I believe something else is going on , may be linux searches for more informations while browsing
The explanation EdGR gave earlier in this thread :
"Windows determines the file type by looking at the three-letter extension in the file name. That takes very little time.
Linux doesn't have an absolutely standardized convention for file name extensions, and file names often don't have extensions at all. As a result, Linux file managers and the 'file' program must read part of the file contents to determine the file type. For this reason, Thunar can take a while to open a folder containing thousands of files.
Ed "
sounds reasonable
Command line is a fantastic tool and I am struggling to get to learn use it , am very excited about it but sometimes you need graphical tools as in my case.
 
Old 01-04-2011, 11:19 AM   #24
djsmiley2k
Member
 
Registered: Feb 2005
Location: Coventry, UK
Distribution: Home: Gentoo x86/amd64, Debian ppc. Work: Ubuntu, SuSe, CentOS
Posts: 343
Blog Entries: 1

Rep: Reputation: 72
Ah fair enough.

I'd investigate if you can tell thunar to just show the files at first (I'm going to try this myself when I get home but I'm tempted to just move off thunar altogether) and do the fancy stuff with previews etc once it had loaded the number of files/directories.
 
Old 01-04-2011, 11:47 AM   #25
fair_is_fair
Member
 
Registered: May 2005
Posts: 516

Rep: Reputation: 52
Check out OSCAR

I was in a doctor's office last year and much to my surprise was a ubuntu screen saver running on the computer monitor. The whole clinic was running networked ubuntu computers using software from OSCAR.

http://www.oscarcanada.org/
 
Old 01-04-2011, 03:04 PM   #26
joham34
Member
 
Registered: Oct 2009
Location: Greece
Distribution: ubuntu 14.04
Posts: 79

Original Poster
Rep: Reputation: 4
Quote:
Originally Posted by fair_is_fair View Post
I was in a doctor's office last year and much to my surprise was a ubuntu screen saver running on the computer monitor. The whole clinic was running networked ubuntu computers using software from OSCAR.

http://www.oscarcanada.org/
I was using windows but 2 years ago my pc got a virus despite the antivirus and the fact I was visiting only medical sites. I lost a part of my archives, big trouble. Well since then I use linux and I really love it. I wish I had time to learn command line better but am trying to in my little spare time. Linux is solid, fast, absolutely configurable and have managed to do my jobs much better than with Windows.Most important, for me, I love the Linux philosophy. Unfortunately some medical devices dont have linux drivers but I solved the problem with virtualbox.
Recently I bought a laptop and at least in Greece laptops come with Windows preloaded by the law! I got very angry and formatted the hard disc immediately although I had paid for it.

Last edited by joham34; 01-05-2011 at 01:28 AM.
 
Old 01-08-2011, 08:22 AM   #27
joham34
Member
 
Registered: Oct 2009
Location: Greece
Distribution: ubuntu 14.04
Posts: 79

Original Poster
Rep: Reputation: 4
Quote:
Originally Posted by w1k0 View Post
joham34,

It looks like the graphical tools such as Thunar and Nautilus cause the problems you described. I suggest you to use instead of them Midnight Commander file manager.

To install it run Terminal and use the command:

sudo apt-get install mc

You said you use OpenOffice.org but you didn’t specified the format of the files. To display the contents of SXW or ODT files you have to install odt2txt. To display the contents of DOC files you have to install docview. The best option is to install both of them:

sudo apt-get install odt2txt docview

To run Midnight Commander in Terminal window use the command:

mc

When you highlight the file name and press F3 key Midnight Commander displays the content of the selected file.

Thanks to odt2txt and docview you’ll be able to inspect your files fast before opening them with OpenOffice.org.

I’m also pretty sure Midnight Commander will open your huge directories much faster than Thunar or Nautilus.

Report here the results of that experiment, please.
Dear W1k0 , I performed various experiments and here are the conclusions :
1) All 3 browsers (Thunar, Nautilus and Midnighth Conqueror) needed 18 secs to open the archive (flash formatted to FAT32) for the first time after pluqing the flash in. Then, reopening was somewhat slower for nautilus but in general much faster that first time
2) Here are the times for first browsing in various flash drive formats ( I did the experiment with the same drive)
FΑΤ32 18 secs , NTFS 5 secs , EXT3 3 secs, EXT4 3 secs.
So , I am wondering whether I should format to EXT3 or EXT 4 ( any suggestion? ) which shortens dramatically the browsing time.
(Interestingly when copying my archive from my NTFS formatted flash to the hard disc (same dual boot PC), the transfer rate was somewhat higher for linux vs Win 7 although NTFS is developed from MS)
So, it appears that the problem was mainly due to the FAT32 format of my flash drive. I did the test in another pc, similar results too. With NTFS format, linux works 3,5 times faster and with both EXT3-EXT4 ,6 times faster, it is peculiar that I didnt find it while googling my issue.
Thanks for your support.

Last edited by joham34; 01-08-2011 at 01:26 PM.
 
Old 01-08-2011, 10:51 AM   #28
NeverThere
LQ Newbie
 
Registered: Jan 2011
Posts: 7

Rep: Reputation: 0
I suppose you mean that the 'single' Windows default file manager 'Windows Explorer' is currently faster than your Linux setup, which could be 'any number' of software combination possibilities?

Is is Microsoft's only sanctioned file manager, so I suppose it's performance would be a priority.
 
Old 01-08-2011, 01:24 PM   #29
w1k0
Senior Member
 
Registered: May 2008
Location: Poland
Distribution: Slackware, Mint
Posts: 1,252

Rep: Reputation: 205Reputation: 205Reputation: 205
Quote:
Originally Posted by joham34 View Post
I try to learn to work with it as I havent managed yet to figure out how can i find a file. Say , I have named some patients adding eg the word "complication" in their filename So the filename looks like: Surname_name_birthdate_complication
Sometimes I need to find all patients who had the "complication" and so I search for "complication" and e.g nautilus will display all my "complication" files.
You mentioned you create your files as OpenOffice documents. So I assume you store them in ODT or DOC format. In such case your file can use “Surname_name_birthdate_complication.odt” or “Surname_name_birthdate_complication.doc” name.

To find all files concerning the particular “complication” with Midnight Commander do the following steps:

1. Go to the directory at the top of your records collection.
2. Press “Esc” key and then “?” key. (On my US keyboard to type “?” I have to press “Shift” and “/” keys).
3. In “File name:” field type “*complication*”. (First star is for the text before the word “complication” and the second star for the text after that word).
4. Assure “Content:” field is empty.
5. Press “Enter”.

In result Midnight Commander will display the list of all files including the word “complication” in their names.

You can browse that list using “↑” and “↓” keys as well as “PgUp” and “PgDn” keys.

I assume you installed odt2txt and docview programs.

In such case after highlighting the selected file you can display it’s contents after pressing “F3” key once or twice.

To go back to the list of the files press “F3” key once.

After you find the file you searched for press “Enter” to go to it.

***

Tip:

When you want to use command line press “Ctrl” and “o” keys to hide Midnight Commander’s window. To show it anew press “Ctrl” and “o” keys once again.
 
Old 01-08-2011, 01:31 PM   #30
w1k0
Senior Member
 
Registered: May 2008
Location: Poland
Distribution: Slackware, Mint
Posts: 1,252

Rep: Reputation: 205Reputation: 205Reputation: 205
Quote:
Originally Posted by joham34 View Post
( I did the experiment with the same drive)
FΑΤ32 18 secs , NTFS 5 secs , EXT3 3 secs, EXT4 3 secs.
So , I am wondering whether I should format to EXT3 or EXT 4 ( any suggestion? ) which shortens dramatically the browsing time.
Assuming you’d like to access those files using Linux as well as Windows use EXT3 file system and install in Windows freeware Linux reader.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Is it me or Linux is slower than Windows... LegendBreath Linux - Software 22 05-25-2005 11:10 AM
Why Linux is slower than Windows Almazick General 20 09-24-2004 07:13 PM
Internet Slower in Linux than Windows njbrain Linux - Networking 18 04-29-2004 02:12 PM
Linux slower than Windows? fedivh Linux - General 22 12-23-2003 12:31 AM
Linux slower than Windows NT plisken Linux - Networking 5 04-07-2002 07:26 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 06:01 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration