LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware
User Name
Password
Slackware This Forum is for the discussion of Slackware Linux.

Notices


Reply
  Search this Thread
Old 10-12-2015, 08:56 AM   #1
kikinovak
MLED Founder
 
Registered: Jun 2011
Location: Montpezat (South France)
Distribution: CentOS, OpenSUSE
Posts: 3,453

Rep: Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154
Recoll and CPU consumption


Hi,

I recently discovered the Recoll desktop search engine, which works rather nice. I'm running it on my workstation, and I think it's an excellent choice for finding a needle in a haystack.

Unfortunately it's quite resource hungry. This morning I installed it on a client's desktop, a rather modest Thinkcentre, and she complains that the machine is rather slow since. I checked with "top", and indeed, the 'recollindex' process eats 90% of CPU.

Any suggestions?

Niki
 
Old 10-12-2015, 09:33 AM   #2
Toutatis
Member
 
Registered: Feb 2013
Posts: 412

Rep: Reputation: Disabled
I have had a problem with recoll in the past. It came from postscript files. In some of them the program used to extract text (pstotext) hangs, or takes a very long time. This problem has been solved by adding an option in recoll.conf

filtermaxseconds 60

According to the manual: "Maximum handler execution time, after which it is aborted. Some postscript programs just loop..."
 
Old 10-12-2015, 10:51 AM   #3
kikinovak
MLED Founder
 
Registered: Jun 2011
Location: Montpezat (South France)
Distribution: CentOS, OpenSUSE
Posts: 3,453

Original Poster
Rep: Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154Reputation: 2154
Quote:
Originally Posted by Toutatis View Post
I have had a problem with recoll in the past. It came from postscript files. In some of them the program used to extract text (pstotext) hangs, or takes a very long time. This problem has been solved by adding an option in recoll.conf

filtermaxseconds 60

According to the manual: "Maximum handler execution time, after which it is aborted. Some postscript programs just loop..."
Thanks for that info. I'll give this a try.

More generally, I wonder if something can be done with 'nice'. More precisely, is there a way to permanently assign a low priority to a process (the 'recollindex' process here), so it's only working when all other processes are more or less idle?
 
Old 10-12-2015, 11:26 AM   #4
ml4711
Member
 
Registered: Aug 2012
Location: Ryomgård, Danmark
Distribution: Slackware64
Posts: 146

Rep: Reputation: 103Reputation: 103
It should be possible to put recollindex out of search path, and then
make a wrapper around it, where you call recollindex with the nice value you like

The script recollindex

Code:
!#/bin/bash
nice -n 19 /some/where/hidden/recollindex $@
It might work
 
1 members found this post helpful.
Old 10-12-2015, 11:55 AM   #5
1337_powerslacker
Member
 
Registered: Nov 2009
Location: Kansas, USA
Distribution: Slackware64-15.0
Posts: 862
Blog Entries: 9

Rep: Reputation: 592Reputation: 592Reputation: 592Reputation: 592Reputation: 592Reputation: 592
Quote:
Originally Posted by kikinovak View Post
Hi,

I recently discovered the Recoll desktop search engine, which works rather nice. I'm running it on my workstation, and I think it's an excellent choice for finding a needle in a haystack.
Thanks for letting me know about this engine. Should make searching a lot easier.
 
Old 10-13-2015, 11:52 AM   #6
medoc
LQ Newbie
 
Registered: Dec 2010
Posts: 18

Rep: Reputation: 7
Quote:
Originally Posted by ml4711 View Post
It should be possible to put recollindex out of search path, and then
make a wrapper around it, where you call recollindex with the nice value you like

The script recollindex

Code:
!#/bin/bash
nice -n 19 /some/where/hidden/recollindex $@
It might work
Nope, it won't. recollindex itself lowers its own CPU and IO priority as much as feasible. And even with a low (high) nice value, if there is nothing else which wants to run, it will take all the CPU.

After initial indexing, recollindex should sit idle (except that there are file updates). It is not at all normal that it consumes so much CPU, but it can happen in some cases for a number of reasons (maybe you found a bug).

One thing to do would be check with 'top' if it is recollindex itself which is busy or an external filter (like the postscript filter mentionned above).

The best approach would probably be to set up the debug log and take a look at what the indexer is doing, this should give a good indication. At level 3, it will only list errors and indexed file names (you can set the log from the GUI index configuration section).

There is some information about investigating indexer issues on the Faqs and HowTos pages:
https://bitbucket.org/medoc/recoll/wiki/FaqsAndHowTos

And if you can't find what's happening, you should open an issue on the tracker: https://bitbucket.org/medoc/recoll/issues

Meanwhile, maybe you should switch to periodic/batch indexing to avoid upsetting the user.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
CPU consumption on idle? WiseDraco Slackware 4 04-25-2013 08:29 AM
cpu load and memory consumption veena hosur Programming 1 03-01-2013 02:03 AM
CPU consumption - %usr and %sys ?? gomes1333 Linux - General 6 04-03-2010 05:13 AM
CPU Consumption yusufs Linux - Newbie 5 11-12-2007 12:17 AM
limit CPU consumption eantoranz Linux - Security 3 07-19-2005 08:32 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware

All times are GMT -5. The time now is 01:26 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration