LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 08-13-2018, 04:38 AM   #1
kaz2100
Senior Member
 
Registered: Apr 2005
Location: Penguin land, with apple, no gates
Distribution: SlackWare > Debian testing woody(32) sarge etch lenny squeeze(+64) wheezy .. bullseye bookworm
Posts: 1,833

Rep: Reputation: 108Reputation: 108
tesseract-4 (pdfsandwich) and high load average/CPU load


Hya,

I'd appreciate expert opinion.

System: Core i3 (quad core), debian amd64 buster

While preparing search-able pdf file, with pdfsandwich and tesseract-4, load average goes as high as 16 with all cpu's have 100% load. Only one thread of pdfsandwich.

I know with -nthreads option, I can restrict tesseract threads. But still load average goes insanely high. (8 with two threads, with all 4 CPU's 100% load)

I somewhat worry whether context switch (or whatever) is wasting resources. It is slower than old system (with tesseract-3)

Is there any easy thread/load control? This is a computation node in my cluster, it usually runs headless.

Any opinion or comment will be appreciated.

cheers
 
Old 08-13-2018, 05:12 AM   #2
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,128

Rep: Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121Reputation: 4121
A quick search found this - might be worth reading.
 
Old 08-13-2018, 09:02 PM   #3
kaz2100
Senior Member
 
Registered: Apr 2005
Location: Penguin land, with apple, no gates
Distribution: SlackWare > Debian testing woody(32) sarge etch lenny squeeze(+64) wheezy .. bullseye bookworm
Posts: 1,833

Original Poster
Rep: Reputation: 108Reputation: 108
Hya

syg00: Thanks, the trick in that link works. (env OMP_THREAD_LIMIT=1) I may need further optimization, but it runs within acceptable time, (20 sec, used to be almost an hour)

cheers
 
  


Reply

Tags
job, load, multicore, tesseract



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Very High Load Average despite 90% CPU idle Rohit_4739 Linux - Server 3 09-10-2015 07:53 PM
High load average, low CPU usage watanesachin Linux - Newbie 4 06-10-2015 10:13 AM
load average and cpu usage too high, why could i do? v_fone Linux - Newbie 5 07-02-2009 03:17 AM
high load average, low cpu usage ! jimmyjiang Red Hat 8 02-08-2008 12:28 AM
RH8 Load Average High - No CPU Utilization jj91709 Red Hat 2 08-29-2004 12:28 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 09:12 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration