I need to run an application (written in C++) a few thousand times for a research project. The application takes a fair amount of data in the memory (currently connects to a local mySQL server) and does some CPU intensive calculations on it.
I work at a small university and in the holidays the computer rooms are completely at my disposal altough I am not allowed to touch the hard drive (windows machines) so I'm looking for a diskless solution. Obviously the OpenMosix project comes to mind but I fear it will not give me any performance gain. Reading the data (from file or mySQL) to the memory takes about as much time as doing the calculations so it will not be very efficient to let every process redo this work. It seams that threads cannot be moved around in an OpenMosix cluster so that's not a solution.
Is clustering an option in this case or will it not be very efficient given the large amount of data that is necessary? Should I look into other clustering solutions like Beowolf or would it suffer from the same problems?
thank you for your advice
In order to run cluster programs, be it pvm or mpi, your c++ program need to be able to
1) execute in parallel
2) if can execute in parallel, then u have to modify your codes and link to the appropriate pvm or mpi libraries.
3) finally, setup your pvm or mpi clusters and execute your programs.
Hope it help.