Rittman Mead Blog

End-to-End ODI12c ETL on Oracle Big Data Appliance Pt.2 : Hive Table Joins, Aggregation and Loading

In this series of posts, I’m going to be looking at an end-to-end ETL process on Oracle Big Data Appliance, using Hadoop technologies to do the data manipulation and Oracle Data Integrator 12c to orchestrate the process. Over the five posts, I’ll be landing web server log data

Technical

Rittman Mead at the Oracle Virtual Technology Summit 2014 - "The Architecture of Analytics: Big Time Big Data and Business Intelligence"

I’m pleased to announce that I’ll be presenting at the Oracle Technology Network (OTN) Virtual Technology Summit [http://event.on24.com/r.htm?e=796788&s=1&k=4A8AB16195363690B31C6F19FED113DF&partnerref=americasace] , an online event running over three days in early July. I’m speaking as

Technical

Rittman Mead Announce New Partnerships with Cloudera and Amazon Web Services

To complement our strategic partnership with Oracle Corporation, Rittman Mead are very pleased to announce two new technology partnerships to complement our Oracle-based services; with Cloudera [http://www.cloudera.com/content/cloudera/en/home.html], the industry-leading Hadoop software vendor, and with Amazon Web Services [http://aws.amazon.com], the

Technical

Trickle-Feeding Log Data into the HBase NoSQL Database using Flume

The other day I posted an article on the blog around using Flume to transport Apache web log entries from our website into Hadoop [https://www.rittmanmead.com/blog/2014/05/trickle-feeding-webserver-log-files-to-hdfs-using-apache-flume/] , with the final destination for the entries being an HDFS file - with the HDFS file essentially mirroring

Technical

List of our Recent "Getting Started" Hadoop Articles

We’ve published a number of “getting started with Hadoop” articles over the past few months, but these aren’t always easy to find on the blog. I’ve therefore compiled a list of the more recent ones, which you’ll find below: * OBIEE, ODI and Hadoop Part 1: So

Technical

Trickle-Feeding Log Files to HDFS using Apache Flume

In some previous articles on the blog I’ve analysed Apache webserver log files sitting on a Hadoop cluster using Hive [https://www.rittmanmead.com/blog/2014/04/simple-data-manipulation-and-reporting-using-hive-impala-and-cdh5/] , Pig [https://www.rittmanmead.com/blog/2014/05/simple-hadoop-dataflows-using-apache-pig-and-cdh4-6/] and most recently, Apache Spark [https://www.rittmanmead.com/blog/2014/05/

Technical

Exploring Apache Spark on the New BigDataLite 3.0 VM

The latest version of Oracle’s BigDataLite VirtualBox VM [http://www.oracle.com/technetwork/database/bigdata-appliance/oracle-bigdatalite-2104726.html] went up on OTN last week, and amongst other things it includes the latest CDH5.0 version of Cloudera Distribution including Hadoop [http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Release-Notes/

Technical

RM BI Forum 2014 Brighton is a Wrap - Now on to Atlanta!

I’m writing this sitting in my hotel room in Atlanta, having flown over from the UK on Saturday following the end of the Rittman Mead BI Forum 2014 [http://www.rittmanmead.com/biforum2014] in Brighton. I think it’s probably true to say that this year was our best

Technical

More Details on the Lars George Cloudera Hadoop Masterclass - RM BI Forum 2014, Brighton & Atlanta

It’s just over a week until the first of the two Rittman Mead BI Forum 2014 [http://www.rittmanmead.com/biforum2014/] events take place in Brighton and Atlanta, and one of the highlights of the events for me will be Cloudera’s Lars George’s Hadoop Masterclass. Hadoop and

Technical

Rittman Mead BI Forum 2014 Registration Now Open - Don't Miss Out!

Just a quick reminder to say that registration for the Rittman Mead BI Forum 2014 [http://www.rittmanmead.com/biforum2014] is now open, with the speaker and presentation list now up on the event website. As with previous years, the BI Forum runs in Brighton on the first week, and

Technical

Using Oracle R Enterprise to Analyze Large In-Database Datasets

The other week I posted an article on the blog about Oracle R Advanced Analytics for Hadoop [https://www.rittmanmead.com/blog/2014/03/running-r-on-hadoop-using-oracle-r-advanced-analytics-for-hadoop/] , part of Oracle’s Big Data Connectors [http://www.oracle.com/technetwork/database/database-technologies/bdc/big-data-connectors/overview/index.html] and used for running certain types

Technical

Using Sqoop for Loading Oracle Data into Hadoop on the BigDataLite VM

This is old-hat for most Hadoop veterans, but I’ve been meaning to note it on the blog for a while, for anyone who’s first encounter with Hadoop is Oracle’s BigDataLite VM [https://www.rittmanmead.com/blog/2014/01/oracle-bigdatalite-vm-now-available-for-download-on-otn/] . Most people looking to bring external data into

Technical

Running R on Hadoop using Oracle R Advanced Analytics for Hadoop

When most people think about analytics and Hadoop, they tend to think of technologies such as Hive, Pig and Impala as the main tools a data analyst uses. When you talk to data analysts and data scientists though, they’ll usually tell you that their primary tool when working on

Oracle BI Suite EE

Rittman Mead BI Forum 2014 Now Open for Registration!

I’m very pleased to announce that the Rittman Mead BI Forum 2014 running in Brighton and Atlanta, May 2014, is now open for registration [http://www.rittmanmead.com/biforum2014/]. Keeping the format as before - a single stream at each event, world-class speakers and expert-level presentations, and a strictly-limited

Oracle BI Suite EE

Rittman Mead BI Forum 2014 Abstract Scoring Now Live - For 1 Week Only!

The call for papers for the Rittman Mead BI Forum 2014 closed at the end of January, and we’ve had some excellent submissions on topics ranging from OBIEE, Visualizations and data discovery through to in-memory analytics, big data and data integration. As always, we’re now opening up the

Oracle BI Suite EE

Testing Oracle Direct Connector for HDFS as an Alternative to Hive ODBC for OBIEE11g

In a post on the blog a couple of weeks ago, I looked at loading up a set of flight delays data into Apache Hadoop, then analysing it using Apache Hive, Cloudera Impala and OBIEE [https://www.rittmanmead.com/blog/2014/01/obiee-11-1-1-7-cloudera-hadoop-hiveimpala-part-2-load-data-into-hivehcatalog-analyze-using-impala/] . In this scenario, OBIEE connects to the

Oracle BI Suite EE

Rittman Mead BI Forum 2014 Call for Papers Closing Soon - And News on This Year's Masterclass

Its a couple of days to go until the call for papers for the Rittman Mead BI Forum 2014 closes [https://docs.google.com/a/rittmanmead.com/spreadsheet/viewform?formkey=dEdBdDNJb0JUTVBrNTJhaS00MmFjRXc6MA] , with suggested topics this year including OBIEE (of course), Essbase, Endeca, Big Data, Visualizations, In-Memory analysis and data integration.

Technical

Looking at the ODI12c Hadoop Demos in the New Oracle BigDataLite VM

In a post earlier today on the blog I took a look at the new Oracle BigDataLite virtual machine [http://www.rittmanmead.com/blog/2014/01/oracle-bigdatalite-vm-now-available-for-download-on-otn/] that’s now downloadable from OTN, and walked-through some of the Cloudera Hadoop tools that come with the VM. At the end of

Oracle BI Suite EE

OBIEE 11.1.1.7, Cloudera Hadoop & Hive/Impala Part 2 : Load Data into Hive Tables, Analyze using Hive & Impala

In yesterday’s post on analyzing Hadoop data using Cloudera CDH4, Amazon EC2 and OBIEE 11.1.1.7 [https://www.rittmanmead.com/blog/2014/01/obiee-11-1-1-7-cloudera-hadoop-hiveimpala-part-1-install-and-set-up-an-ec2-hadoop-cluster/] , I went through the setup process for Cloudera Manager Standard and then used it to set up a four-node Hadoop cluster in Amazon

Oracle BI Suite EE

OBIEE 11.1.1.7, Cloudera Hadoop & Hive/Impala Part 1 : Install and Set-up an EC2 Hadoop Cluster

I’ve been over in San Francisco this last week for BIWA Summit 2014 [http://www.rittmanmead.com/blog/2014/01/rittman-mead-at-biwa-summit-2014-san-francisco/] , and one of the things I demo’d during the week was OBIEE 11.1.1.7 connecting to a Hadoop cluster running on Amazon EC2, and analysing

Oracle BI Suite EE

Rittman Mead BI Forum 2014 Call for Papers Now Open!

It’s that time of year again when we start planning out next year’s BI Forum, which like this year’s event will be running in May 2014 in Brighton and Atlanta. This will be our sixth annual event, and as with previous year’s the most important part

Oracle BI Suite EE

Why ODI, DW and OBIEE Developers Should Be Interested in Hadoop

Over the past few months I’ve been posting a number of articles about Hadoop, and how you can connect to it from ODI and OBIEE. From an ODI perspective, I covered Hadoop as one of a number of new data sources ODI11g could connect to [https://www.rittmanmead.com/

Oracle BI Suite EE

Creating a Multi-Node Hadoop/Impala Cluster as a Datasource for OBIEE 11.1.1.7

The other day I posted an article on the blog about connecting OBIEE 11.1.1.7 to Cloudera Impala [http://www.rittmanmead.com/blog/2013/11/connecting-obiee-11-1-1-7-to-cloudera-impala/] , a new “in-memory” SQL engine for Hadoop that’s much faster than Hive for interactive queries. In this example, I connected OBIEE

Oracle BI Suite EE

Connecting OBIEE 11.1.1.7 to Cloudera Impala

A few months ago I posted a series of articles about connecting OBIEE 11.1.1.7 [http://www.rittmanmead.com/blog/2013/04/obiee-odi-and-hadoop-part-1-so-what-is-hadoop-mapreduce-and-hive] , Exalytics [http://www.rittmanmead.com/blog/2013/07/accelerating-hadoophive-obiee-queries-using-exalytics-and-the-summary-advisor/] and ODI [http://www.rittmanmead.com/blog/2013/04/obiee-odi-and-hadoop-part-3-a-closer-look-at-hive-hfds-and-cloudera-chd3/] to Apache Hadoop through Hive [http:

Oracle BI Suite EE

Accelerating Hadoop/Hive OBIEE Queries Using Exalytics and the Summary Advisor

A few weeks ago I blogged about the new Hadoop/Hive support in OBIEE 11.1.1.7 [https://www.rittmanmead.com/blog/2013/04/obiee-odi-and-hadoop-part-2-connecting-obiee-11-1-1-7-to-hadoop-data-sources/] , and how it enables users to query "big data" sources with no need to know Hadoop or MapReduce. As this feature is