emr ETL Offload with Spark and Amazon EMR - Part 3 - Running pySpark on EMR In the previous articles (here [https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-1], and here [https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-2-code-development-with-notebooks-and-docker/] ) I gave the background to a project we did for a client, exploring the benefits of Spark-based ETL processing running on Amazon's Elastic Map Reduce
spark ETL Offload with Spark and Amazon EMR - Part 2 - Code development with Notebooks and Docker In the previous article [https://www.rittmanmead.com/blog/2016/12/etl-offload-with-spark-and-amazon-emr-part-1/] I gave the background to a project we did for a client, exploring the benefits of Spark-based ETL processing running on Amazon's Elastic Map Reduce (EMR) Hadoop platform. The proof of concept we ran was on
obiee ETL Offload with Spark and Amazon EMR - Part 1 - Introduction We recently undertook a two-week Proof of Concept exercise for a client, evaluating whether their existing ETL processing could be done faster and more cheaply using Spark. They were also interested in whether something like Redshift [http://docs.aws.amazon.com/redshift/latest/mgmt/welcome.html] would provide a suitable
sdlc Source Control and Automated Code Deployment Options for OBIEE It's Monday morning. I've arrived at a customer site to help them - ironically enough - with automating their OBIEE code management. But, on arrival, I'm told that the OBIEE team can't meet with me because someone did a release on the
obiee The Visual Plugin Pack for OBIEE Last week we announced the Rittman Mead Open Source project [https://www.rittmanmead.com/blog/2016/12/the-rittman-mead-open-source-project/], and released into open source: * the excellent Insights [https://www.rittmanmead.com/blog/2016/12/insights-an-open-source-visualisation-platform-for-obiee/] project, a javascript API/framework for building a new frontend for OBIEE, written by Minesh Patel
enhanced usage tracking Enhanced Usage Tracking for OBIEE - Now Available as Open Source! Introduction OBIEE provides Usage Tracking [https://docs.oracle.com/middleware/12212/biee/BIESG/GUID-9F8FCB4B-EA17-4302-813A-BEF84F295A6A.htm#BIESG211] as part of the core product functionality. It writes directly to a database table every Logical Query that hits the BI Server, including details of who ran it, when, and information about how it
open source Insights - An Open-Source Visualisation Platform for OBIEE On and off over the last year, I have spent some time developing a customisable framework for building visualisations and dashboards, using OBIEE as the back-end. The result is Insights, a JavaScript web application that offers a modern alternative to OBIEE Answers. As of today, we have officially open sourced
Rittman Mead Life The Rittman Mead Open Source Project We have a strong innovation spirit at Rittman Mead, with all staff encouraged to use technology to its best advantage in order to do things with the software that haven't been done before. Some of these projects may may be 'scratching the itch' of a repeated
An Oracle DVD story of... DVDs Have you ever wondered what the trend in movie releases has been for the past few decades? Comparing the number of Sci-Fi releases vs. Romantic Comedy releases? Me too, which is why I've taken my first look Oracle Data Visualization Desktop (DVD) to spot trends between these movie
OBIEE12c Introducing On Demand Training from Rittman Mead Rittman Mead is happy to announce that its much anticipated On Demand Training [https://www.rittmanmead.com/on-demand-training/] (ODT) service is live, giving people the opportunity to receive expertly written & delivered self-paced training courses that can be accessed online anywhere, at anytime. We have been delivering technical & end-user
Rittman Mead Work-Life Balance at Rittman Mead Rittman Mead has always had a long standing commitment to giving back, not only to the technology industry, but to local and global communities as well. Recently, Rittman Mead employees have been encouraged to take up to 40 paid hours to participate in community service opportunities [https://www.rittmanmead.com/
UKOUG Rittman Mead at UKOUG Tech 16 This year as always Rittman Mead is coming to UKOUG Tech 16 [http://tech16.ukoug.org/] with a strong presence and a great line up of sessions covering OBIEE, ODI, Kafka, advanced visualisation and more. And yes, there will be Cloud! Here is the details of the Rittman Mead sessions
How to Use Versioning in ODI 12c How many times have you been working on a project and something goes wrong, or the power shuts off, or you go on vacation and someone has messed with your code or somehow your work is lost? Well, now you have an alternative to safe proof your project work. Versioning
obiee Catalog Validation: Why, What, When, Where and How? One of the features everybody "loved" about OBIEE 11g were the Global Unique Identifiers [http://docs.oracle.com/cd/E23943_01/bi.1111/e10543/privileges.htm#BIESC721] (GUIDs), used to recognize users and groups based on an identifier that could be different from the username. The original aim
obiee Common OBIEE Implementation Mistakes That Impact Performance I've recently performed several assessments to help our clients diagnose and fix their OBIEE performance problems. They often share similar design or implementation issues, and I thought it would be useful to present them here as a handy reference: * No software monitoring * Randomly changing configuration settings * Data transformation
odi12c Oracle Data Integrator 12c: Getting Started - Developer's Quickstart I’ve decided that it’s time for a refresher on Oracle Data Integrator 12c. This week in the “[Oracle Data Integrator 12c: Getting Started]( http://ritt.md/odi12c-getting-started" target="_blank)” series: getting a quick start on mapping development. Several objects must be created before a single bit
odi12c Oracle Data Integrator 12c: Getting Started - Installation and Configuration I’ve decided that it’s time for a refresher on Oracle Data Integrator 12c. This week, I’m continuing the “[Oracle Data Integrator 12c: Getting Started]( http://ritt.md/odi12c-getting-started" target="_blank)” series with the next topic: Installation and Configuration. I don’t plan to dig into
ODVD Oracle Data Visualization Desktop: Star Schemas and Multiple Fact Sources Once added to a project, columns I specified with my custom SQL query now shows up as one source. Now that I have a custom data source with only the data I want to explore, I can easily create an analysis without having to sift through multiple data sources. ** A
Creating Security Profiles in ODI 12c As a newcomer to ODI I enjoy hearing from the more seasoned veterans about common situations they encounter on projects. One of these recurring situations (especially if the company has a very small dev team) is the lack of security. I will not discuss how Oracle improved security by usingpublic/
DVD Combining Google Analytics and JSON data through Apache Drill in Oracle Data Visualization Desktop I've been talking a lot about Oracle's Data Visualization Desktop (DVD) recently, explaining DVD 12.2.2.0 new features [https://www.rittmanmead.com/blog/2016/10/data-visualisation-desktop-12-2-2-0-new-features-2/] and the details of Data Flow [https://www.rittmanmead.com/blog/2016/10/data-visualisation-desktop-data-loading-2/] component via a fantasy
training Whatever next? The battle to keep up with changes in technology I’ve been managing Rittman Mead’s Training services in the UK & Europe for over a year now, working closely with my colleagues in the US to ensure we continue to coherently deliver expert instructor led educational courses to the very highest standards. One thing I’ve noticed is
jq Using SQL to Query JSON Files with Apache Drill I wrote recently about what Apache Drill is [https://www.rittmanmead.com/blog/2016/08/an-introduction-to-apache-drill/], and how to use it with OBIEE [https://www.rittmanmead.com/blog/2016/08/using-apache-drill-with-obiee-12c/]. In this post I wanted to demonstrate its great power in action for a requirement that came up recently.
DVD Connecting Oracle Data Visualization Desktop to Google Analytics and Google Drive To use Data Visualisation Desktop (DVD) with data from Google Analytics or Google Drive, you need to set up the necessary credentials on Google so that DVD can connect to it. You can see a YouTube of this process on this blog here [http://oracledataviz.blogspot.co.uk/2016/10/
OBIEE12c Performing a 12c Upgrade with a New Install Software updates often include new features, and while useful, these new features are often the only driving factors in upgrading software. There's no harm in wanting to play around with the shiny new toy but many software updates also include much more significant changes, such as resolving bugs
OOW16 Oracle OpenWorld 2016 - Data Integration Recap I know it's been about a month since Oracle OpenWorld 2016 concluded, but I wanted to give a brief recap on a few things that I thought were interesting in the data integration space. During the week prior to OpenWorld, I had the privilege to attend the Oracle
