LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 10-25-2010, 07:20 AM   #1
Mark1986
Member
 
Registered: Aug 2008
Location: Netherlands
Distribution: Xubuntu
Posts: 87

Rep: Reputation: 11
Open source and Data Vault modelling


Hi all,

Recently, I started downloading data from a website that shows houses for sale. My goal is to create a website on which people can find out about the pricing over the course of time and the length of time a house remains available.

I have created a MySQL database, which is currently being fed each night. At this point, I have enough data records to start analyzing and mining this data.

Now I have come to the part of starting a datawarehouse. I love to use a data modelling tool, like the one from MySQL. Yet, I have a hard time finding some documentation over data modelling a data vault datawarehouse using open source tools.

Pentaho looks promising, but I need to keep this low-budget. So low-budget it needs to be free. MySQL Workbench has a moddelling tool as well. Yet it does not support a data vault scheme.

Has anyone any experience in setting up a datawarehouse? Or in particular a data vault datawarehouse using open source tools?

If you have, could you please point me out to some pitfalls and other best-practices?

Yours sincerely,


Mark

P.S. Couldn't really find a forum where to post this. So I hope I put this in the right forum. Correct me if I'm wrong.
 
Old 10-26-2010, 12:16 PM   #2
Quipu
LQ Newbie
 
Registered: Oct 2010
Location: Oirschot, NL
Posts: 3

Rep: Reputation: 1
Hi Mark,

Our product called Quipu generates a data vault datamodel for you datawarehouse. Quipu also generates the required DDL statements and loadcode to bring your source data into the datavault.

Cannot post a url here, so you need to do a search on google on "quipu open source datavault datawarehousemanagement"
Good luck!

Jeroen
 
1 members found this post helpful.
Old 10-26-2010, 12:20 PM   #3
Quipu
LQ Newbie
 
Registered: Oct 2010
Location: Oirschot, NL
Posts: 3

Rep: Reputation: 1
Website

Www.datawarehousemanagement.org
 
Old 10-27-2010, 02:37 AM   #4
Mark1986
Member
 
Registered: Aug 2008
Location: Netherlands
Distribution: Xubuntu
Posts: 87

Original Poster
Rep: Reputation: 11
I found that already, thank you though. In fact, I am a Business Intelligence professional in the Netherlands (even close near your company).

Good to finally see an active open source company going out to the public.

Edit: just registered with your website. Will try your product this week or maybe next week.

Last edited by Mark1986; 10-27-2010 at 02:39 AM. Reason: Registration to website
 
Old 10-27-2010, 02:50 AM   #5
Quipu
LQ Newbie
 
Registered: Oct 2010
Location: Oirschot, NL
Posts: 3

Rep: Reputation: 1
Hi Mark,

Just noticed your registration on our site indeed! Someren and Oirschot are close, it's a small world...
FYI: Quipu backend runs on Ubuntu on JVM. Connects perfectly to MySQL db (using JDBC), for both source and target (datawarehouse) db. Also, Quipu repository can be set up in MySQL.
We have a customer integrating Pentaho Kettle with Quipu, linking to our repository where Quipu generated code is being scheduled and executed using Kettle.
 
Old 10-27-2010, 03:31 AM   #6
Mark1986
Member
 
Registered: Aug 2008
Location: Netherlands
Distribution: Xubuntu
Posts: 87

Original Poster
Rep: Reputation: 11
That sounds great.

At the moment, I am working with Informatica Powercenter. Just ETL, no reporting yet. I have only had some courses in reporting (Business Objects, WebFOCUS, and such). Would love to try some reporting using your product to set up the datawarehouse.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Best (open-source) data recovery software? kg_250 Linux - Software 1 01-23-2010 08:08 PM
LXer: Open Source Invading Oracle Data Centers LXer Syndicated Linux News 0 10-24-2007 10:40 AM
LXer: Mapping the Future of Open Source Data LXer Syndicated Linux News 0 11-17-2006 07:21 PM
LXer: Enterprise Data Protection Goes Open Source LXer Syndicated Linux News 0 06-03-2006 06:54 PM
LXer: Board to evolve open-source modelling LXer Syndicated Linux News 0 05-19-2006 12:33 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 07:15 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration