LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Programming (https://www.linuxquestions.org/questions/programming-9/)
-   -   running multi-builds with bash shell script (https://www.linuxquestions.org/questions/programming-9/running-multi-builds-with-bash-shell-script-902631/)

vreader 09-12-2011 01:11 PM

running multi-builds with bash shell script
 
hi all,
I am trying to optimize a build script I have by running multiple builds at the same time.
Here's what I have:
I currently have a shell script written to build several libraries sequentially and there are no dependencies between them, so I wish to reduce the build time. I am logging all the build output (including warings, errors, etc...) and I wish to keep the same output.

I wanted to see if I can do something along the lines of multi-threading (or any other method) to run these builds in parallel and then concatenate the build outputs when done without going to a different scripting language.

The question I am trying to ask for help here about is what can I do to get these builds run in parallel rather than in a sequence?

your help is greatly appreciated...
vreader

lithos 09-12-2011 01:42 PM

Since I'm just guessing what are you doing (I dont know about build scripts) I will try to put you in the direction of
bash running commands in parallel
and hopefully you will find what you need.

There's many possibilities, like:
1. <># command &
2. <># nohup command
3. running a "SCREEN" and inside multiple 'screen's also running your script
etc...


good luck

vreader 09-12-2011 01:57 PM

thanks lithos.

For example - I wish to build the following sourcecode libraries (libxml2, libxslt, etc...)

I will build each of them by executing "./configure" and "make" (I do not need to "make install" - I am interested in some files they compile and build).

What I currently do is untar the source code for libxml2 then run "./configure" then "make clean" then "make"
once its done, I will do the same for libxslt, so on and so forth with some other libraries...

What I wanted is to figure out a way to basically run both at the same time instead of waiting for one to complete before I proceed to the next.

Hope this clears what I am attempting to do a bit more...

This is part of a bigger project so I cannot run from commandline the "command &" but I will look into the other two suggestions.


All times are GMT -5. The time now is 05:44 AM.