Hi all,

I've to setup a new social network: i'm the phase about choosing a scalable filesystem where to store photos (about 500KB), videos (from 1 to 3 MB) audio (about 500K-1MB) and avatars for the users...
I've googled for a while, looking at AFS (that seems being used with a lot of clients when i'll have just the application searching the content), HDFS (that seems optimized for large files). Do you have any notice about other social networks use for storing media content? have you any suggestion about what can be used?

Thanks

Hi there

I'd suggest you have a look at Lustre or GFS

http://en.wikipedia.org/wiki/Global_File_System
http://wiki.lustre.org/index.php/Main_Page

I have worked with Lustre before and it was pretty solid and straight forward.

Hi Luca,
thank you for your answer...but i don't think that gfs would be a great choose due to scaling-out issues, would be quite heavy to add servers to the gfs while other are using it.
About Lustre, could you tell me what use did you of it? Was it user for a web application or for storing users data?

No idea whether it'd meet your needs, but I've been very happy with OCFS2. (Then again, I'm administrating the backend for a data warehouse, not a social network!)

At least check it out, though. I will try to answer questions that I can speak to.

In both cases I worked with Lustre it was used for data within a HPC cluster, so yes you could say it's kind of user data.

But if that 'user' is the one the webserver is running on, I don't think that'll be much of a difference.