Realtime Data Warehouses

In a little over two weeks I will be giving my Real Time Data Warehousing talk at Collaborate 10 in Las Vegas. I will cover a variety of techniques and not just change data capture. However, in my opinion, CDC plays a major part in the practical implementation of a realtime data warehouse. It is not the whole story as CDC is about data propagation; we still need an ETL component to consume those changes and publish them to the reporting layer of the DW. Depending on what needs to be done with the data (such as processing slowly changing dimensions and building aggregations) this step can add significantly to the latency of the event to publish process. I will cover this in my talk - and here on the Rittman Mead blog after Collaborate has finished.

No talk including Oracle CDC would be complete without mention of GoldenGate; Mark has recently blogged about consuming GoldenGate captured data with ODI. For those that don't know, GoldenGate is an Oracle acquired company that specialised in data replication that is very fast, able to handle large data volumes and able to support heterogeneous source and target platforms both in terms of database and operating system. One combination I aim to try in a few weeks time is pushing change from an Oracle database into an Oracle TimesTen in-memory database.