Robin Moffatt

property graph

Property Graph in Oracle 12.2

The latest release of Oracle (12.2) includes support for Property Graph, previously available only as part of the Big Data Spatial and Graph tool. Unlike the latter, in which data is held in a NoSQL store (Oracle NoSQL, or Apache HBase), it is now possible to use the Oracle

Conferences

Rittman Mead at BIWA Summit 2017

I'm excited to be attending my first ever BIWA Summit [http://www.biwasummit.org/sessions/] next week (which will take me to Oracle HQ at Redwood Shores for the first time too!). This three day conference is one of the major dates in the conference calendar for all

Spark Streaming

Data Processing and Enrichment in Spark Streaming with Python and Kafka

In my previous blog post [https://www.rittmanmead.com/blog/2017/01/getting-started-with-spark-streaming-with-python-and-kafka/] I introduced Spark Streaming and how it can be used to process 'unbounded' datasets. The example I did was a very basic one - simple counts of inbound tweets and grouping by user. All very

spark

Getting Started with Spark Streaming, Python, and Kafka

Last month I wrote a series of articles [https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-5/] in which I looked at the use of Spark for performing data transformation and manipulation. This was in the context of replatforming an existing Oracle-based ETL and datawarehouse solution onto cheaper and more elastic

odi

ETL Offload with Spark and Amazon EMR - Part 5 - Summary

This is the final article in a series documenting an exercise that we undertook for a client recently. Currently running an Oracle-based datawarehouse platform, the client asked for our help in understanding what a future ETL and reporting platform could look like, given the current landscape of tools available. You

ETL Offload with Spark and Amazon EMR - Part 4 - Analysing the Data

We recently did a project we did for a client, exploring the benefits of Spark-based ETL processing running on Amazon's Elastic Map Reduce (EMR) Hadoop platform. The proof of concept we ran was on a very simple requirement, taking inbound files from a third party, joining to them

emr

ETL Offload with Spark and Amazon EMR - Part 3 - Running pySpark on EMR

In the previous articles (here [https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-1], and here [https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-2-code-development-with-notebooks-and-docker/] ) I gave the background to a project we did for a client, exploring the benefits of Spark-based ETL processing running on Amazon's Elastic Map Reduce

spark

ETL Offload with Spark and Amazon EMR - Part 2 - Code development with Notebooks and Docker

In the previous article [https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-1/] I gave the background to a project we did for a client, exploring the benefits of Spark-based ETL processing running on Amazon's Elastic Map Reduce (EMR) Hadoop platform. The proof of concept we ran was on

obiee

ETL Offload with Spark and Amazon EMR - Part 1 - Introduction

We recently undertook a two-week Proof of Concept exercise for a client, evaluating whether their existing ETL processing could be done faster and more cheaply using Spark. They were also interested in whether something like Redshift [http://docs.aws.amazon.com/redshift/latest/mgmt/welcome.html] would provide a suitable

sdlc

Source Control and Automated Code Deployment Options for OBIEE

It's Monday morning. I've arrived at a customer site to help them - ironically enough - with automating their OBIEE code management. But, on arrival, I'm told that the OBIEE team can't meet with me because someone did a release on the

enhanced usage tracking

Enhanced Usage Tracking for OBIEE - Now Available as Open Source!

Introduction OBIEE provides Usage Tracking [https://docs.oracle.com/middleware/12212/biee/BIESG/GUID-9F8FCB4B-EA17-4302-813A-BEF84F295A6A.htm#BIESG211] as part of the core product functionality. It writes directly to a database table every Logical Query that hits the BI Server, including details of who ran it, when, and information about how it

Rittman Mead Life

The Rittman Mead Open Source Project

We have a strong innovation spirit at Rittman Mead, with all staff encouraged to use technology to its best advantage in order to do things with the software that haven't been done before. Some of these projects may may be 'scratching the itch' of a repeated

jq

Using SQL to Query JSON Files with Apache Drill

I wrote recently about what Apache Drill is [https://www.rittmanmead.com/blog/2016/08/an-introduction-to-apache-drill/], and how to use it with OBIEE [https://www.rittmanmead.com/blog/2016/08/using-apache-drill-with-obiee-12c/]. In this post I wanted to demonstrate its great power in action for a requirement that came up recently.

DVD

Connecting Oracle Data Visualization Desktop to Google Analytics and Google Drive

To use Data Visualisation Desktop (DVD) with data from Google Analytics or Google Drive, you need to set up the necessary credentials on Google so that DVD can connect to it. You can see a YouTube of this process on this blog here [http://oracledataviz.blogspot.co.uk/2016/10/

odi

OBIEE, Big Data Discovery, and ODI security updates - October 2016

Oracle release their "Critical Patch Update" (CPU) notices every quarter, bundling together details of vulnerabilities and associated patches across their entire product line. October's was released yesterday [http://www.oracle.com/technetwork/security-advisory/cpuoct2016-2881722.html], with a few entries of note in the analytics & DI

elasticsearch

Streaming data from Oracle using Oracle GoldenGate and Kafka Connect

This article was also posted on the Confluent blog [http://www.confluent.io/blog/streaming-data-oracle-using-oracle-goldengate-kafka-connect/] , head over there for more great Kafka-related content! -------------------------------------------------------------------------------- Kafka Connect [http://docs.confluent.io/3.0.0/connect/index.html] is part of the Confluent Platform [http://www.confluent.io/product], providing a set

obiee

OTN Appreciation Day : OBIEE's BI Server

Oracle Technology Network [http://www.oracle.com/technetwork/index.html] (OTN) is one you'll be familiar with if you do anything with Oracle software, from downloading the installers [http://www.oracle.com/technetwork/indexes/downloads/index.html], reading the documentation [http://www.oracle.com/technetwork/indexes/documentation/index.

Conferences

POUG

I've just attended my first user group in Poland, the very-excellent POUG [http://poug.org/en/]. This was the first international version of the conference, having been run previously just within Poland. Based on these two days, I would say it was a resounding success! There was a

obiee

All You Ever Wanted to Know About OBIEE Performance…but were too afraid to ask

At the Polish Oracle Users Group (POUG) conference [http://poug.org/en/timeline/] this week I'm presenting one of my favourite talks, [Still] No Silver Bullets - OBIEE Performance in the Real World [https://speakerdeck.com/rmoff/still-no-silver-bullets-obiee-12c-performance-in-the-real-world] . This presentation is based on the shared experiences of myself

Oracle GoldenGate

Using logdump to Troubleshoot the Oracle GoldenGate for Big Data Kafka Handler

Oracle GoldenGate [http://www.oracle.com/technetwork/middleware/goldengate/overview/index.html] for Big Data (OGG BD) supports sending transactions as messages to Kafka topics, both through the native Oracle handler [http://docs.oracle.com/goldengate/bd1221/gg-bd/GADBD/GUID-2561CA12-9BAC-454B-A2E3-2D36C5C60EE5.htm#GADBD449] as well as a connector into Confluent'

odbc

How To Poke Around OBIEE on Linux with strace (Working with Unsupported ODBC Sources in OBIEE 12c)

OBIEE 12c (and 11g and 10g before it) supports three primary ways [https://docs.oracle.com/middleware/1221/biee/BIEMG/deploy_rpd.htm#BIEMG1465] of connecting to data sources: 1. Native Gateway [https://docs.oracle.com/middleware/1221/biee/BIEMG/deploy_rpd.htm#BIEMG1179] , such as OCI for Oracle. This

apache drill

Using Apache Drill with OBIEE 12c

Apache Drill [https://drill.apache.org/] enables querying with SQL against a multitude of datasources [https://drill.apache.org/docs/connect-a-data-source/] including things like JSON files, Parquet and Avro, Hive tables, RDBMS and more. MapR have released an ODBC driver [https://drill.apache.org/docs/installing-the-driver-on-linux/#step-1:-download-the-mapr-drill-odbc-driver] for it,

hdfs

An Introduction to Apache Drill

Apache Drill [https://drill.apache.org/] is an engine that can connect to many different data sources, and provide a SQL interface to them. It's not just a wanna-be SQL interface that trips over at anything complex - it's a hugely functional one [https://drill.apache.

Technical

Stream Analytics and Processing with Kafka and Oracle Stream Analytics

In my previous post [http://www.rittmanmead.com/2016/07/introduction-oracle-stream-analytics/] I looked the latest release of Oracle Stream Analytics (OSA), and saw how it provided a graphical interface to "Fast Data". Users can analyse streaming data as it arrives based on conditions and rules. They can also

Technical

An Introduction to Oracle Stream Analytics

Oracle Stream Analytics (OSA) is a graphical tool that provides “Business Insight into Fast Data”. In layman terms, that translates into an intuitive web-based interface for exploring, analysing, and manipulating streaming data sources in realtime. These sources can include REST, JMS queues, as well as Kafka. The inclusion of Kafka