elasticsearch Streaming data from Oracle using Oracle GoldenGate and Kafka Connect This article was also posted on the Confluent blog [http://www.confluent.io/blog/streaming-data-oracle-using-oracle-goldengate-kafka-connect/] , head over there for more great Kafka-related content! -------------------------------------------------------------------------------- Kafka Connect [http://docs.confluent.io/3.0.0/connect/index.html] is part of the Confluent Platform [http://www.confluent.io/product], providing a set
Oracle GoldenGate Using logdump to Troubleshoot the Oracle GoldenGate for Big Data Kafka Handler Oracle GoldenGate [http://www.oracle.com/technetwork/middleware/goldengate/overview/index.html] for Big Data (OGG BD) supports sending transactions as messages to Kafka topics, both through the native Oracle handler [http://docs.oracle.com/goldengate/bd1221/gg-bd/GADBD/GUID-2561CA12-9BAC-454B-A2E3-2D36C5C60EE5.htm#GADBD449] as well as a connector into Confluent'
Big Data Rittman Mead at Collaborate 16: Data Integration Focus It’s that time of year again when Oracle technologists from around the world gather in Las Vegas, Nevada, to teach, learn, and, of course, network with their peers. TheCollaborate 16 [http://collaborate.ioug.org/]conference, running for 10 years now, has been a collaboration, if you will, between the
Technical Kickstart Your 2016 with Rittman Mead's Data Integration Training Happy Holidays and a Happy New Year to all! As you begin your 2016 this January, it’s time to start planning your team's data integration training. Look no further than Rittman Mead’s Oracle Data Integrator training course! We offer a 4 day Oracle Data Integrator 12c
Big Data Oracle GoldenGate, MySQL and Flume Back in September Mark blogged about Oracle GoldenGate (OGG) and HDFS [https://www.rittmanmead.com/blog/2014/09/using-oracle-goldengate-for-trickle-feeding-rdbms-transactions-into-hive-and-hdfs] . In this short followup post I'm going to look at configuring the OGG Big Data Adapter for Flume, to trickle feed blog posts and comments from our site to
Technical Using Oracle GoldenGate for Trickle-Feeding RDBMS Transactions into Hive and HDFS A few months ago I wrote a post on the blog around using Apache Flume to trickle-feed log data into HDFS and Hive [https://www.rittmanmead.com/blog/2014/05/trickle-feeding-webserver-log-files-to-hdfs-using-apache-flume/] , using the Rittman Mead website as the source for the log entries. Flume is a good technology to use
Technical GoldenGate and Oracle Data Integrator - A Perfect Match in 12c... Part 4: Start Journalizing! In this post, the finale of the four-part series "GoldenGate and Oracle Data Integrator - A Perfect Match in 12c", I'll walk through the setup of the ODI Models and start journalizing in "online" mode. This will utilize our customized JKM to build the
Technical GoldenGate and Oracle Data Integrator - A Perfect Match in 12c... Part 3: Setup Journalizing After a short vacation, some exciting news [https://twitter.com/oracleace/status/476771642883203073], and a busy few weeks (including KScope14 in Seattle, WA [https://www.rittmanmead.com/blog/2014/06/rittman-mead-at-odtug-kscope14-seattle/]), it's time to get the "GoldenGate and Oracle Data Integrator - A Perfect Match in 12c&
Technical Data Integration Tips: GoldenGate on RAC - Action Script for Windows I want to briefly interrupt my blog series on GoldenGate and ODI - A Perfect Match in 12c... [https://www.rittmanmead.com/blog/2014/05/goldengate-odi-perfect-match-12c-1/] to provide another Data Integration Tip that was found during a recent client engagement. I was tasked with installing GoldenGate 11g into a 2-node
Technical GoldenGate and Oracle Data Integrator - A Perfect Match in 12c... Part 2: Journalizing Knowledge Module This is the second post in a blog series on the integration between Oracle Data Integrator (ODI) 12c and GoldenGate 12c. Thefirst post [https://www.rittmanmead.com/blog/2014/05/goldengate-odi-perfect-match-12c-1/] focused on the latest, yet-to-be-released, Oracle Information Management Reference Architecture and some high-level features new to the 12c versions
Technical How We Deliver Agile OBIEE Projects - Introducing ExtremeBI Most OBIEE projects that we see are delivered through some sort of “waterfall” method, where requirements are defined up-front, there’s several stages of development, one or more major releases at the end, and any revision to requirements takes the form of a change request. These work well where requirements
Technical GoldenGate and Oracle Data Integrator - A Perfect Match in 12c... Part 1: Getting Started Over the years, I've blogged quite a bit about integration between Oracle Data Integrator and GoldenGate, and how to make it all work with the Oracle Reference Architecture. With the release of the 12c versions of ODI [https://www.rittmanmead.com/blog/2013/10/oracle-data-integrator-12c-release-part-1/] and GoldenGate [https:
Oracle BI Suite EE Rittman Mead BI Forum 2014 Abstract Scoring Now Live - For 1 Week Only! The call for papers for the Rittman Mead BI Forum 2014 closed at the end of January, and we’ve had some excellent submissions on topics ranging from OBIEE, Visualizations and data discovery through to in-memory analytics, big data and data integration. As always, we’re now opening up the
Technical Thoughts on ETL in the Cloud In a few week’s time I’m presenting at the BIWA Summit 2014 [http://www.biwasummit.com] on running OBIEE in the Cloud, with the idea being that I’ll go through the various options for deploying OBIEE in public clouds, including Amazon EC2 and Oracle’s own cloud
Oracle BI Suite EE Rittman Mead BI Forum 2014 Call for Papers Now Open! It’s that time of year again when we start planning out next year’s BI Forum, which like this year’s event will be running in May 2014 in Brighton and Atlanta. This will be our sixth annual event, and as with previous year’s the most important part
Technical Oracle BI Apps 11.1.1.7.1 – GoldenGate Integration - Part 4: Initial Load and Replication This is the final post in my series on Oracle BI Apps 11.1.1.7.1 and GoldenGate Integration. If you have been following along up to this point, we have the Source Dependent Data Store schema setup and ready to accept data from the OLTP source via replication,
Technical Oracle BI Apps 11.1.1.7.1 – GoldenGate Integration - Part 3: SDS and Parameter File Setup This is the third post in the four part series on Oracle BI Applications 11.1.1.7.1 and Oracle GoldenGate 11g. Last time, we made it through the initial setup of GoldenGate and created the necessary schemas for the Source Dependent Data Store (SDS) and GoldenGate on the
Technical Oracle GoldenGate 12c - New Release, New Features The latest release of Oracle's data replication tool, GoldenGate 12c, has many improvements. The release coincided with the Oracle Data Integrator 12c release [https://www.rittmanmead.com/blog/2013/10/oracle-data-integrator-12c-release-part-1/] - and I wasn't about to let my colleague Jérôme Françoisse [https://twitter.com/JeromeFr]
Technical Oracle BI Apps 11.1.1.7.1 – GoldenGate Integration - Part 2: Setup and Configuration In my previous post, I introduced the steps necessary for integrating Oracle BI Applications 11.1.1.7.1 and GoldenGate (OGG). Now, I'm going to dive into the details and describe how to complete the setup and configuration of GoldenGate and the Source Dependent Data Store schema.
Technical Oracle BI Apps 11.1.1.7.1 – GoldenGate Integration - Part 1: Introduction The release of Oracle Business Intelligence Applications 11.1.1.7.1 [http://www.oracle.com/technetwork/middleware/bi-applications/overview/default-458073.html] includes a major change in components, with Oracle Data Integrator replacing Informatica as the ETL application. The next logical step was to integrate Oracle’s data replication tool,
Oracle BI Suite EE Oracle Openworld 2013 : Reflections on Product Announcements and Strategy I'm sitting writing this at my desk back home, with a steaming mug of tea next to me and the kids pleased to see me after having been away for eight days (or at least my wifepleased to hand them over to me after looking after them for
Oracle BI Suite EE Oracle Openworld 2013 Day 2: Exalytics, TimesTen and Essbase Futures Monday's almost over at Oracle Openworld 2013 in San Francisco, and it started for me today with a presentation on Enterprise Manager 12c and the BI Management Pack, alongside Henrik Blixt (PM for the BI Management Pack) andDhananjay Papde [http://dhananjaypapde.blogspot.co.uk], author of a book
Technical Diving Deeper into BI Apps 11.1.1.7.1 use of ODI11g for Data Loading A few months ago I posted a series of articles on the new BI Apps 11.1.1.7.1 release [http://www.rittmanmead.com/biapps11g/], which used ODI11g in the background to perform data loads, rather than Informatica PowerCenter. Since then, I've collaborated with Accenture's
Technical GoldenGate and Oracle Data Integrator - A Perfect Match... Part 3: Real-time ETL Challenges I've finally had the chance to sit down and properly closeout this series on GoldenGate and Oracle Data Integrator. Since the last post, I’ve actually presented this topic on three different occasions. Once at each of the Rittman Mead BI Forums [https://www.rittmanmead.com/blog/2013/
Technical Previewing the BI Forum 2013 Data Integration Masterclass I guess it's a British thing to not blow our own trumpet (does that translate the same over in the US?), but something I'm particularly proud about with the upcoming Rittman Mead BI Forum 2013 events [http://www.rittmanmead.com/biforum2013] is our Oracle Data Integration
