Searching through massive amounts of Data

sxa · 02-27-2009, 04:59 PM

Good evening,

The company that I work for has massive amounts on our file server and that amount continues to grow. What we are looking for is a search appliance that will make it easier to search all documents on the file server and also search the content of those documents. I don't really like the idea of everyone using an app like X1 and searching the share drives that way on their individual PC. I would like a search appliance. Any suggestions?

TB0ne · 02-27-2009, 06:11 PM

Quote:

Originally Posted by Freakygeek55

Good evening,

The company that I work for has massive amounts on our file server and that amount continues to grow. What we are looking for is a search appliance that will make it easier to search all documents on the file server and also search the content of those documents. I don't really like the idea of everyone using an app like X1 and searching the share drives that way on their individual PC. I would like a search appliance. Any suggestions?

Google makes one, specifically for such a task.

You don't say anything about your environment, so it's hard to give any solutions. What kind of servers? What kind of data? What kind of workstations? How many users???

sxa · 02-27-2009, 07:52 PM

The servers we have are all CentOS 5.2. We have about 50 users who would need to access the information. There is a mix of Mac OS and Windows XP workstations.

jschiwal · 02-27-2009, 09:40 PM

Beagle will search the contents of documents. Kerry Beagle search is a google like interface. It is based on a Windows project which in turn is based on the Linux/Unix Apache project "Lucene".

jschiwal · 02-27-2009, 09:40 PM

Beagle will search the contents of documents. Kerry Beagle search is a google like interface. It is based on a Windows project which in turn is based on the Linux/Unix Apache project "Lucene".

Tinkster · 02-27-2009, 10:42 PM

Quote:

Originally Posted by Freakygeek55

Good evening,

The company that I work for has massive amounts on our file server and that amount continues to grow. What we are looking for is a search appliance that will make it easier to search all documents on the file server and also search the content of those documents. I don't really like the idea of everyone using an app like X1 and searching the share drives that way on their individual PC. I would like a search appliance. Any suggestions?

You could look at namazu or htdig for such tasks,
and use a web-interface for the searches

Cheers,
Tink