Rittman Mead Blog - Oracle Data Integrator (ODI)

Using Streams with ODI12c for Oracle-to-Oracle Change Data Capture

Although Oracle GoldenGate replaced Oracle Streams a couple of years ago as the recommended data replication and change data capture technology for Oracle databases, many customers still on Oracle Database 11gR2 or earlier still use Streams for Oracle-to-Oracle change data capture as it works and compared to GoldenGate doesn’t

Technical

Options for Enabling ODI11g+12c Standalone Agents for High-Availability (or ... Why JEE Agents are the Best Option)

A few years ago we posted some articles on the blog around Oracle Data Integrator ETL restartability and resilience [https://www.rittmanmead.com/blog/2013/01/odi-11g-in-the-enterprise-part-5-etl-resilience-and-high-availability/] , and making ODI’s agents highly-availabile [https://www.rittmanmead.com/blog/2012/11/clustering-odi11g-for-high-availability-part-1-introduction-and-architecture/] . The context around those posts was a large data

Big Data

Rittman Mead at ODTUG KScope'15, Hollywood Florida

ODTUG KScope’15 [http://kscope15.com] is running in Hollywood, Florida next week and Rittman Mead are running a number of sessions during the week on OBIEE, Essbase, ODI and Big Data. I’ve personally been attending ODTUG KScope (or “Kaleidoscope”, as it used to be known) for many years

Big Data

Presentation Slides and Photos from the Rittman Mead BI Forum 2015, Brighton and Atlanta

It’s now the Saturday after the two Rittman Mead BI Forum 2015 [http://www.rittmanmead.com/biforum2015/] events, last week in Atlanta, GA and the week before in Brighton, UK. Both events were a great success and I’d like to say thanks to the speakers, attendees, our friends

Big Data

So What's the Real Point of ODI12c for Big Data Generating Pig and Spark Mappings?

Oracle ODI12c for Big Data [https://www.oracle.com/middleware/data-integration/enterprise-edition-big-data/index.html] came out the other week, and my colleague Jérôme Françoisse put together an introductory post on the new features [https://www.rittmanmead.com/blog/2015/04/odi12c-advanced-big-data-option-overview-install/] shortly after, covering ODI’s new ability to generate

Technical

Last Chance to Register for the Brighton Rittman Mead BI Forum 2015!

It’s just a week to go until the start of the Brighton Rittman Mead BI Forum 2015 [http://www.rittmanmead.com/biforum2015/], with the optional one-day masterclass starting on Wednesday, May 6th at 10am and the event opening with a reception and Oracle keynote later in the evening. Spaces

Technical

BI Forum 2015 Preview -- OBIEE Regression Testing, and Data Discovery with the ELK stack

I’m pleased to be presenting at both of the Rittman Mead BI Forums [https://www.rittmanmead.com/blog/biforum2015/] this year; in Brighton it’ll be my fourth time, whilst Atlanta will be my first, and my first trip to the city too. I’ve heard great things about

Technical

Data Integration Tips: ODI 12.1.3 - Convert to Flow

The many who have already upgraded Oracle Data Integrator from the 11g version to 12c probably know about this great feature called “convert to flow". If not, well…here you go! First, a little background on why I think this is an excellent bit of functionality. The ODI Upgrade

Big Data

Oracle Data Integrator Enterprise Edition Advanced Big Data Option Part 1- Overview and 12.1.3.0.1 install

Oracle recently announced Oracle Data Integrator Enterprise Edition Advanced Big Data Options [https://www.oracle.com/middleware/data-integration/enterprise-edition-big-data/index.html] as part of the new 12.1.3.0.1 release of ODI. It includes various great new functionalities to work on an Hadoop ecosystem. Let's have

Technical

Analysing ODI performance with Flame Graphs

Flame Graphs [http://www.brendangregg.com/flamegraphs.html] are a visualisation that I learnt about through the excellent Linux systems performance work of Brendan Gregg [http://www.brendangregg.com/], and saw Luca Canali [https://twitter.com/lucacanalidb] talk about recently at UKOUG Tech 14 [http://tech14.ukoug.org/default.asp?

Technical

An Introduction to Analysing ODI Runtime Data Through Elasticsearch and Kibana 4

An important part of working with ODI is analysing the performance when it runs, and identifying steps that might be inefficient as well as variations in runtime against a baseline trend. The Operator tool in ODI itself is great for digging down into individual sessions and load plan executions, but

Big Data

Rittman Mead BI Forum 2015 Now Open for Registration!

I’m very pleased to announce that the Rittman Mead BI Forum 2015, running in Brighton and Atlanta in May 2015, is now open for registration [http://www.rittmanmead.com/biforum2015/]. Back for its seventh successful year, the Rittman Mead BI Forum once again will be showcasing the best speakers

Technical

Data Integration Tips: ODI - Use Scenarios in packages

Here is another question I often hear during ODI Bootcamp [http://www.rittmanmead.com/training/training-trn405-oracle-data-integrator-12c-bootcamp/] or I often read in the ODI Space on OTN [https://community.oracle.com/community/business_intelligence/system_management_and_integration/data_integrator/] : In a package, should I directly use mappings (or interfaces prior

Technical

Endeca Information Discovery Integration with Oracle BI Apps 11.1.1.8.1

One of the new features that made its way into Oracle BI Apps 11.1.1.8.1 [https://blogs.oracle.com/proactivesupportEPM/entry/biapps_111181_whatsnew], and that completely passed me by at the time, was integration with Oracle Endeca Information Discovery 3.1 [http://www.oracle.com/us/

Technical

Data Integration Tips: ODI - One Data Server with several Physical Schemas

Yes, I'm hijacking the "Data Integration Tips" series [http://www.rittmanmead.com/tag/data-integration-tips/] of my colleague Michael Rainey [http://www.rittmanmead.com/author/michael-rainey/] (@mRainey [https://twitter.com/mRainey]) and I have no shame! DISCLAIMER This tip is intended for newcomers in the ODI world

Technical

OBIEE and ODI on Hadoop : Next-Generation Initiatives To Improve Hive Performance

The other week I posted a three-part series (part 1 [https://www.rittmanmead.com/blog/2014/12/going-beyond-mapreduce-for-hadoop-etl-pt-1-why-mapreduce-is-only-for-batch-processing/] , part 2 [https://www.rittmanmead.com/blog/2014/12/going-beyond-mapreduce-for-hadoop-etl-pt-2-introducing-apache-yarn-and-apache-tez/] and part 3 [https://www.rittmanmead.com/blog/2014/12/going-beyond-mapreduce-for-hadoop-etl-pt-3-introducing-apache-spark/] ) on going beyond MapReduce for Hadoop-based ETL, where I l

Technical

Rittman Mead BI Forum 2015 Call for Papers Now Open!

I’m very pleased to announce that the Call for Papers for the Rittman Mead BI Forum 2015 [https://docs.google.com/a/rittmanmead.com/forms/d/18XWPmrzr3te55rloDJyB8vFP9j8AUNKKryvOToGHBlA/viewform] is now open, with abstract submissions open to January 18th 2015. As in previous years the BI Forum will run over

Technical

Going Beyond MapReduce for Hadoop ETL Pt.1 : Why MapReduce Is Only for Batch Processing

Over the previous few months I’ve been looking at the various ways you can load data into Hadoop, process it and then report on it using Oracle tools [https://www.rittmanmead.com/blog/2013/11/why-odi-dw-and-obiee-developers-should-be-interested-in-hadoop/] . We’ve looked at Apache Hive and how it provides a SQL layer

Technical

Adding Oracle Big Data SQL to ODI12c to Enhance Hive Data Transformations

An updated version of the Oracle BigDataLite VM [http://www.oracle.com/technetwork/database/bigdata-appliance/oracle-bigdatalite-2104726.html] came out a couple of weeks ago, and as well as updating the core Cloudera CDH software to the latest release it also included Oracle Big Data SQL [http://www.oracle.com/us/

Technical

News and Updates from Oracle Openworld 2014

It’s the Saturday after Oracle Openworld 2014 [http://www.oracle.com/openworld], and I’m now home from San Francisco and back in the UK. It’s been a great week as usual, with lots of product announcements and updates to the BI, DW and Big Data products we

Technical

EPM and BI Meetup at Next Week's Openworld (and details of our Oracle DI Speakeasy)

Just a short note to help publicise the Oracle Openworld 2014 EPM and BI Meetup [http://www.meetup.com/Oracle-Open-World-Essbase-EPM-meetup/events/205491072/] that’s running next week, organised by Cameron Lackpour and Tim Tow from the ODTUG board. This is an excellent opportunity for EPM and BI developers and customers

Technical

GoldenGate and Oracle Data Integrator - A Perfect Match in 12c... Part 4: Start Journalizing!

In this post, the finale of the four-part series "GoldenGate and Oracle Data Integrator - A Perfect Match in 12c", I'll walk through the setup of the ODI Models and start journalizing in "online" mode. This will utilize our customized JKM to build the

Technical

GoldenGate and Oracle Data Integrator - A Perfect Match in 12c... Part 3: Setup Journalizing

After a short vacation, some exciting news [https://twitter.com/oracleace/status/476771642883203073], and a busy few weeks (including KScope14 in Seattle, WA [https://www.rittmanmead.com/blog/2014/06/rittman-mead-at-odtug-kscope14-seattle/]), it's time to get the "GoldenGate and Oracle Data Integrator - A Perfect Match in 12c&

Technical

Introducing the Updated Oracle / Rittman Mead Information Management Reference Architecture Pt1. - Information Architecture and the "Data Factory"

One of the things at Rittman Mead that we’re really interested in, is the architecture of “information management” systems and how these change over time as thinking, and product capabilities, evolve. In fact we often collaborate with the Enterprise Architecture team within Oracle, giving input into the architecture designs

Technical

GoldenGate and Oracle Data Integrator - A Perfect Match in 12c... Part 2: Journalizing Knowledge Module

This is the second post in a blog series on the integration between Oracle Data Integrator (ODI) 12c and GoldenGate 12c. Thefirst post [https://www.rittmanmead.com/blog/2014/05/goldengate-odi-perfect-match-12c-1/] focused on the latest, yet-to-be-released, Oracle Information Management Reference Architecture and some high-level features new to the 12c versions