I'm stuck on what to do. (mysql related)
 

Hello guys

I'm working currently on a very low budget (as in 0 bucks) project that involves huge chunks of data on dbf.... basically the dept got out of luck on the money this year (working for the government on a third world country...)

So i got myself a 4 of PC's... put centos minimal on it and setup a ndbcluster; made performance test... got happy with it until i loaded one db that need to be on that cluster is 937 mb of data and found out that it is just too big for the hardware available.

so i'm thinking what to do
I'm thinking on master-master replication... or master-master to slave replication...

anywhow... this is the hardware that i have

2pcs with 512 MB ram
AMD Athlon(tm) 64 Processor 3800+
38.6 GB Hdd.

1 pc with 1024 MB ram
AMD Athlon(tm) 64 Processor 3800+
38.6 GB Hdd.

1 pc with 4GB ram
Intel(R) Core(TM) i3-2100 CPU @ 3.10GHz
1TB hdd (this one was supposed to be the main storage node.


all are running centos6 minimal.

anyways, I'll like to call on your ideas to see what/how i can pull of something usable with some load balance (no need of ha but highly appreciated)

(please avoid the hate and heat on the very lacking hardware... it is what i have and if i keep on waiting until a server gets here the problem will keep on growing)

I don't see why you cant just run the mysql server on your i3 box. That is plenty of resources for hosting a MySQL database if it is optimized properly. Can you tell us a little bit about the performance issues you actually ran into? You say this 937MB database was "too big for the hardware", what do you mean by that?

Unless you are getting a whole lot of unique queries across many, many tables you shouldn't see any performance issues with this.

I agree; run the DB on the biggest (4GB RAM) box and maybe do master-slave to the next one (1GB RAM).
900MB is not a big DB for them to handle.

The cluster issue (I think) was due to each storage node (at least) must have the same amt of dedicated RAM, so you would have been limited to 512MB if using all 4.
I might be wrong about that, but I believe it was true in the early versions when the entire thing had to be in RAM.
The later version is disk backed, but its probably still true.
Check over at the mysql home forums https://forums.mysql.com/ and/or main docs http://dev.mysql.com/doc/refman/5.1/en/

If you can get any money at all or go through old PCs being thrown out etc, try to add more RAM to the other boxes.

the 900 MB dump is just a sample of the actual data... and yes, i've installed 5.5 on that i3 box with 4gb ram.

this has to do with country statistics records. The software was done i don't know when... written in foxpro and using dbf as data storage. I'm trying to pass everything to SQL type database and then develop something better to handle data, but; as usual with government projects... no money at the end of the day unless someone big is really interested (which is not atm)


I pop the question as I am wondering what to do with the other boxes... the original idea is to have some kind of load balance and ha... nevertheless I'll be getting more old pc's to get this done so i'll try adding more ram etc to all nodes when possible as I will have every single pc that is too old to run winxp collected.