Hi all,

Recently, I started downloading data from a website that shows houses for sale. My goal is to create a website on which people can find out about the pricing over the course of time and the length of time a house remains available.

I have created a MySQL database, which is currently being fed each night. At this point, I have enough data records to start analyzing and mining this data.

Now I have come to the part of starting a datawarehouse. I love to use a data modelling tool, like the one from MySQL. Yet, I have a hard time finding some documentation over data modelling a data vault datawarehouse using open source tools.

Pentaho looks promising, but I need to keep this low-budget. So low-budget it needs to be free. MySQL Workbench has a moddelling tool as well. Yet it does not support a data vault scheme.

Has anyone any experience in setting up a datawarehouse? Or in particular a data vault datawarehouse using open source tools?

If you have, could you please point me out to some pitfalls and other best-practices?

Yours sincerely,


Mark

P.S. Couldn't really find a forum where to post this. So I hope I put this in the right forum. Correct me if I'm wrong.

Hi Mark,

Our product called Quipu generates a data vault datamodel for you datawarehouse. Quipu also generates the required DDL statements and loadcode to bring your source data into the datavault.

Cannot post a url here, so you need to do a search on google on "quipu open source datavault datawarehousemanagement"
Good luck!

Jeroen

1 members found this post helpful.

I found that already, thank you though. In fact, I am a Business Intelligence professional in the Netherlands (even close near your company).

Good to finally see an active open source company going out to the public.

Edit: just registered with your website. Will try your product this week or maybe next week.

Hi Mark,

Just noticed your registration on our site indeed! Someren and Oirschot are close, it's a small world...
FYI: Quipu backend runs on Ubuntu on JVM. Connects perfectly to MySQL db (using JDBC), for both source and target (datawarehouse) db. Also, Quipu repository can be set up in MySQL.
We have a customer integrating Pentaho Kettle with Quipu, linking to our repository where Quipu generated code is being scheduled and executed using Kettle.

That sounds great.

At the moment, I am working with Informatica Powercenter. Just ETL, no reporting yet. I have only had some courses in reporting (Business Objects, WebFOCUS, and such). Would love to try some reporting using your product to set up the datawarehouse.