This blog is about the development of my various Linux based web sites, starting with raspberrywebserver.com, Banoffee Pi Server and Linux Web Servers.
Scaling out my Banana Pi server cluster
I've updated Pyplate to support multiple sites on a single server. Each site has its own Pyplate CMS directory, its own web root directory and its own set of tables in the database. The tables for each site are prefixed with the domain name of the site (with '_' replacing '.').
The database is stored on a MySQL database cluster using master/slave replication, so the tables for each site are accessible from each database server node.
I've dropped the idea of using Gluster. The nodes I would have used to run Gluster would probably be more useful if I used them as web servers
instead. Instead of using Gluster, I'm going to carry on using rsync to sync all the web server nodes. This isn't an efficient use of disk
space, but I'm working with quite a small data set, so it's not a problem.
By replicating Pyplate multi-site across several nodes, I now have a crude mass blogging platform where any web server node can serve any page
from any of the sites hosted on the cluster.
I've set up Ganglia monitoring on each node. That seems to work quite well except for one node where I'm having a hard time figuring out why it
isn't visible in the Ganglia UI. I'll try using different ports for that cluster.
On the load balancer, there was a virtual host for each site. I don't want to have to set up a new virtual host every time I add a new site, so
I created a generic one. This virtual host forwards all traffic (apart from traffic for raspberrywebserver.com) to nodes in the web server
cluster.
I've moved pyplate.com to the new cluster. It was hosted on a PC, which I can now use for other things. Pyplate.com had a forum which I have removed because it was a security risk, and it din't get used that much. I've replaced it with a blog about Pyplate related stuff.
I'm working on setting up new sites on the cluster. I've just published Linux Web Servers, a web site with tutorials and information on using web servers on the Linux OS. I've started with a few articles about Apache, and I also plan to cover Nginx.
New sites have to be added to the cluster using command line tools, so it's not very user friendly at the moment. If I clean up the user interface, I could use my cluster as a public mass blogging system where other people can log in and host their own site on my cluster. In order for that to work, I probably will need to use Gluster, and I'll need to use more powerful servers than Banana Pis.
The database is stored on a MySQL database cluster using master/slave replication, so the tables for each site are accessible from each database server node.
I've dropped the idea of using Gluster. The nodes I would have used to run Gluster would probably be more useful if I used them as web servers
instead. Instead of using Gluster, I'm going to carry on using rsync to sync all the web server nodes. This isn't an efficient use of disk
space, but I'm working with quite a small data set, so it's not a problem.
By replicating Pyplate multi-site across several nodes, I now have a crude mass blogging platform where any web server node can serve any page
from any of the sites hosted on the cluster.
I've set up Ganglia monitoring on each node. That seems to work quite well except for one node where I'm having a hard time figuring out why it
isn't visible in the Ganglia UI. I'll try using different ports for that cluster.
On the load balancer, there was a virtual host for each site. I don't want to have to set up a new virtual host every time I add a new site, so
I created a generic one. This virtual host forwards all traffic (apart from traffic for raspberrywebserver.com) to nodes in the web server
cluster.
I've moved pyplate.com to the new cluster. It was hosted on a PC, which I can now use for other things. Pyplate.com had a forum which I have removed because it was a security risk, and it din't get used that much. I've replaced it with a blog about Pyplate related stuff.
I'm working on setting up new sites on the cluster. I've just published Linux Web Servers, a web site with tutorials and information on using web servers on the Linux OS. I've started with a few articles about Apache, and I also plan to cover Nginx.
New sites have to be added to the cluster using command line tools, so it's not very user friendly at the moment. If I clean up the user interface, I could use my cluster as a public mass blogging system where other people can log in and host their own site on my cluster. In order for that to work, I probably will need to use Gluster, and I'll need to use more powerful servers than Banana Pis.
Total Comments 0
