Tagged

Big Data

A collection of 112 posts

Oracle GoldenGate

Using logdump to Troubleshoot the Oracle GoldenGate for Big Data Kafka Handler

Oracle GoldenGate [http://www.oracle.com/technetwork/middleware/goldengate/overview/index.html] for Big Data (OGG BD) supports sending transactions as messages to Kafka topics, both through the native Oracle handler [http://docs.oracle.com/goldengate/bd1221/gg-bd/GADBD/GUID-2561CA12-9BAC-454B-A2E3-2D36C5C60EE5.htm#GADBD449] as well as a connector into Confluent'

Using SparkSQL and Pandas to Import Data into Hive and Big Data Discovery
Big Data

Using SparkSQL and Pandas to Import Data into Hive and Big Data Discovery

Big Data Discovery [https://www.oracle.com/big-data/big-data-discovery/index.html] (BDD) is a great tool for exploring, transforming, and visualising data stored in your organisation’s Data Reservoir. I presented a workshop on it at a recent conference [https://speakerdeck.com/rmoff/unlock-the-value-in-your-big-data-reservoir-using-oracle-big-data-discovery-and-oracle-big-data-spatial-and-graph] , and got an interesting question from

Oracle OpenWorld 2015 Roundup Part 2 : Data Integration, and Big Data (in the Cloud...)
Big Data

Oracle OpenWorld 2015 Roundup Part 2 : Data Integration, and Big Data (in the Cloud...)

In yesterdays part one of our three-part Oracle Openworld 2015 round-up [https://www.rittmanmead.com/blog/2015/11/oracle-openworld-2015-roundup-part-1-obiee12c-and-data-visualisation-cloud-service/] , we looked at the launch of OBIEE12c just before Openworld itself, and the new Data Visualisation Cloud Service that Thomas Kurian demo’d in his mid-week keynote. In part two we’

Forays into Kafka - Logstash transport / centralisation
Big Data

Forays into Kafka - Logstash transport / centralisation

The holy trinity of Elasticsearch, Logstash, and Kibana (ELK) are a powerful trio of tools for data discovery [https://www.rittmanmead.com/blog/2015/04/using-the-elk-stack-to-analyse-donors-choose-data/] and systems diagnostics [https://www.rittmanmead.com/blog/2014/10/monitoring-obiee-with-elasticsearch-logstash-and-kibana/] . In a nutshell, they enable you to easily search through your log files,