LinuxQuestions.org
Did you know LQ has a Linux Hardware Compatibility List?
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices



Reply
 
Search this Thread
Old 08-05-2009, 09:31 AM   #1
markotitel
Member
 
Registered: Feb 2009
Location: Titel - Serbia
Posts: 166

Rep: Reputation: 18
What software for high traffic video serving web site


Hi, I have may I say complicated task to solve end implement.

I need to setup a server far not that big, 10 servers maybe 15. This farm will server video content to clients similiar to youtube site (I know not very original ).

I must have in mind these things:

- Load balancing
- Server failover
- Security
- Performance
- Backups


For the loadbalancing I thought HAProxy.
For the Server Failover. DRBD.

three other things I dont have nothing special in mind.

Can you help me a little bit on that.

And what do you think about hardware?

The setup MUST serve 600 - 700 requests per second.

Thank You

Ah, forgot to mention web serving of video content is written in MYSQL/PHP combination.

Last edited by markotitel; 08-05-2009 at 09:36 AM.
 
Old 08-05-2009, 10:30 AM   #2
HostColor
LQ Newbie
 
Registered: Aug 2009
Distribution: CentOS
Posts: 5

Rep: Reputation: 0
You might consider using nginx web server to address load balancing and performance. Also keep in mind DRBD is intended for block level replication (middle layer). You might find more appropriate using either shared storage or high level mirroring/replication (like rsync for example).

Security is quite a wide subject: from physical security, proper system setup, firewalling, all the way up to application level security, so there's no turn key solution.

For backups you might take a look at Bacula - a nice peace of open source software for network backups.

Hope this helps.

Last edited by HostColor; 08-05-2009 at 10:31 AM.
 
Old 08-05-2009, 11:24 AM   #3
sigey
LQ Newbie
 
Registered: Feb 2009
Posts: 13

Rep: Reputation: 1
linux virtual server is pretty good at loadbalancing, i used this and it worked awesomely. Managed few webservers and squids.
 
Old 08-06-2009, 04:06 AM   #4
markotitel
Member
 
Registered: Feb 2009
Location: Titel - Serbia
Posts: 166

Original Poster
Rep: Reputation: 18
Thanks for Your answers. I thought a little about back up. Which configuration to use for backup? How to set hard drives, which RAID? Or no raid?

What about hardware part, which servers do you suggest, with one thing in mind, keep it cheap and simple .
 
Old 08-06-2009, 12:27 PM   #5
HostColor
LQ Newbie
 
Registered: Aug 2009
Distribution: CentOS
Posts: 5

Rep: Reputation: 0
RAID level depends entirely on your requirements: RAID10 for more intensive loads and RAID5/6 for more storage. As for manufacturers, we've got good experience with LSI and Adaptec SAS controllers (NO Adaptec HostRAID!). Also spend some time reading on stripe sizes, as it's quite important for the performance.

For server manufacturers you could check out Dell and Supermicro, as they both provide mainboards with integrated LSI (1078 if i recall correctly) controllers. I'm sure HP and IBM also have good configurations, but I don't have experience with recent models.
 
  


Reply

Tags
farm, loadbalancing, server


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: For video vendor, Web site is an open and closed case LXer Syndicated Linux News 0 03-17-2007 06:46 AM
Linux web site verification software? jantman Programming 1 10-20-2006 11:52 AM
LXer: Keep your Web site online with a High Availability Linux Apache cluster LXer Syndicated Linux News 0 10-02-2006 06:54 PM
Web site design software soujrnr Linux - Software 1 07-09-2004 07:16 PM
PHP Software for my web site BrettPower Linux - Software 1 03-04-2004 06:56 PM


All times are GMT -5. The time now is 11:47 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration