LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 07-05-2012, 04:48 PM   #1
kernel-P4N1C
Member
 
Registered: Nov 2007
Location: Panama city, Republic of Panmaa
Posts: 167

Rep: Reputation: 18
I'm stuck on what to do. (mysql related)


Hello guys

I'm working currently on a very low budget (as in 0 bucks) project that involves huge chunks of data on dbf.... basically the dept got out of luck on the money this year (working for the government on a third world country...)

So i got myself a 4 of PC's... put centos minimal on it and setup a ndbcluster; made performance test... got happy with it until i loaded one db that need to be on that cluster is 937 mb of data and found out that it is just too big for the hardware available.

so i'm thinking what to do
I'm thinking on master-master replication... or master-master to slave replication...

anywhow... this is the hardware that i have

2pcs with 512 MB ram
AMD Athlon(tm) 64 Processor 3800+
38.6 GB Hdd.

1 pc with 1024 MB ram
AMD Athlon(tm) 64 Processor 3800+
38.6 GB Hdd.

1 pc with 4GB ram
Intel(R) Core(TM) i3-2100 CPU @ 3.10GHz
1TB hdd
(this one was supposed to be the main storage node.


all are running centos6 minimal.

anyways, I'll like to call on your ideas to see what/how i can pull of something usable with some load balance (no need of ha but highly appreciated)

(please avoid the hate and heat on the very lacking hardware... it is what i have and if i keep on waiting until a server gets here the problem will keep on growing)
 
Old 07-05-2012, 06:41 PM   #2
Kustom42
Senior Member
 
Registered: Mar 2012
Distribution: Red Hat
Posts: 1,604

Rep: Reputation: 415Reputation: 415Reputation: 415Reputation: 415Reputation: 415
I don't see why you cant just run the mysql server on your i3 box. That is plenty of resources for hosting a MySQL database if it is optimized properly. Can you tell us a little bit about the performance issues you actually ran into? You say this 937MB database was "too big for the hardware", what do you mean by that?

Unless you are getting a whole lot of unique queries across many, many tables you shouldn't see any performance issues with this.
 
Old 07-05-2012, 09:24 PM   #3
chrism01
LQ Guru
 
Registered: Aug 2004
Location: Sydney
Distribution: Rocky 9.2
Posts: 18,358

Rep: Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751Reputation: 2751
I agree; run the DB on the biggest (4GB RAM) box and maybe do master-slave to the next one (1GB RAM).
900MB is not a big DB for them to handle.

The cluster issue (I think) was due to each storage node (at least) must have the same amt of dedicated RAM, so you would have been limited to 512MB if using all 4.
I might be wrong about that, but I believe it was true in the early versions when the entire thing had to be in RAM.
The later version is disk backed, but its probably still true.
Check over at the mysql home forums https://forums.mysql.com/ and/or main docs http://dev.mysql.com/doc/refman/5.1/en/

If you can get any money at all or go through old PCs being thrown out etc, try to add more RAM to the other boxes.
 
Old 07-06-2012, 10:08 AM   #4
kernel-P4N1C
Member
 
Registered: Nov 2007
Location: Panama city, Republic of Panmaa
Posts: 167

Original Poster
Rep: Reputation: 18
the 900 MB dump is just a sample of the actual data... and yes, i've installed 5.5 on that i3 box with 4gb ram.

this has to do with country statistics records. The software was done i don't know when... written in foxpro and using dbf as data storage. I'm trying to pass everything to SQL type database and then develop something better to handle data, but; as usual with government projects... no money at the end of the day unless someone big is really interested (which is not atm)


I pop the question as I am wondering what to do with the other boxes... the original idea is to have some kind of load balance and ha... nevertheless I'll be getting more old pc's to get this done so i'll try adding more ram etc to all nodes when possible as I will have every single pc that is too old to run winxp collected.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Stuck with MySQL swaping on CentOS taara Linux - General 4 12-27-2011 06:41 AM
stuck with error related to libpangocairo-1.0.so installing Firefox3 on 64bit SuSE lxnbie Linux - Server 5 03-26-2011 10:03 AM
removing mysql-server and all things related townie Linux - Server 4 12-23-2008 11:32 PM
MySql stuck stephencassidy Programming 3 03-30-2007 04:58 AM
php make error (mysql related) oluckboy Red Hat 1 07-06-2005 10:53 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 12:00 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration