Analytics and Data Summit 2018: Serverless and Machine Learning + Open Source Big Data in the Cloud

The year has just started and here is the first “good news” yet: My presentation about “Serverless Architectures and Machine Learning” was accepted for the Analytics and Data Summit 2018 (former BIWA conference). The presentation will include a live demo with Fn Project.

In addition to that I will give another presentation together with Edelweiss Kammermann about Open Source Big Data (with Hadoop, Hive, Spark and Kafka live demos) in the Cloud. IMHO, two fabulous topics – I am looking forward to see you there!

What’s hot? Tech Trends That Made a Real Difference in 2017

At Java One 2017 I had the pleasure to be interviewed in a podcast with industry legends such as Chris Richardson, Lucas Jellema and others:

“In order to get a sense of what’s happening on the street, we gathered a group of highly respected software developers, recognized leaders in the community, crammed them into a tiny hotel room in San Francisco (they were in town to present sessions at JavaOne and Oracle OpenWorld), tossed in a couple of microphones, and asked them to talk about the technologies that actually had an impact on their work over the past year. The resulting conversation is lively, wide-ranging, often funny, and insightful from start to finish. Listen for yourself.”

For those who care, this was last year’s interview about “The Role of the Cloud Architect”.

Java One 2017: Open Source Big Data in the Cloud (Hadoop, Hive, Spark, Kafka)

It’s true. I always said “presenting at Java One is like playing in champions league”. Last month I had the great pleasure to present at the Java One 2017 conference in San Francisco together with Edelweiss Kammermann about Open Source Big Data used in the cloud. The presentation included 4 live demos about Apache Hadoop with Map Reduce, Apache Hive, Apache Spark and Kafka all using Oracle Big Data Cloud Service – Compute Edition (aka BDCS-CE) and the Oracle Event Hub Service. The presentation was recorded – so you can enjoy from anywhere in the world.

For your convenience the slides are available on slideshare:

Access Oracle Event Hub Kafka from External Kafka Client or Tool

Access Oracle Event Hub from external Tool or Command-Line Client

Oracle Event Hub provides a managed Kafka PaaS solution. To access it from an on-premises client you have to make sure to enable the ports to Event Hub Zookeeper and the Kafka broker.

Access to Kafka Broker

First lets enable access to Kafka broker. To do so, check the OPC Event Hub service for the connect string.

Create Event Hub Broker Access Rule

Then create a new access rule. Warning: In general you should not allow public access to access your Event Hub service! This is just for demo purposes to make the tool work. In case of doubt create a rule with your own IP address and talk your friendly security officer first of all.

The creation of the rule might take a few seconds:

Create Zookeeper Access Rule

Once the rule for the Kafka broker is created, we need to create a rule for Zookeeper which is using port 2181:

Explore Kafka Tool (or other)

Now lets start our Kafka tool (for demonstration purpose) only, configure the connection details for the Zookeeper IP and port, and then try to connect to Oracle Event Hub Service:

Voila, it is working 🙂 You can explore your topics or even create new ones. Note that  Oracle Event Hub uses a special naming convention for topics.

Feedback: Big Data Training: Hadoop, Spark, Kafka, Cassandra, Oracle and the Cloud

Guys, thanks for attending my DOAG training day about Cloudera/Hadoop and Oracle Big data. I am pleased about your amazing feedback!

Statistics about Big Data Training Day

About the course

Attendees had the following opinion about the course when asked right after the training

  • 100% of those who answered would recommend the course
  • 100% of all found it interesting
  • 81% found that content matched their experience
  • 86% were happy or very happy with the course (these are the 2 highest grades possible)
  • 0% were unhappy
  • Everyone  except one person (that is 20 people) found the level of difficulty okay.
  • Everyone except one person found that they were engaged enough

About myself

The following is what attendees mentioned as feedback about myself (there were no explicit questions about Edelweiss, so she is not included unfortunately). Multiple answers were possible, answers weren’t mandatory. This basically tells that someone making a cross at e.g. informative sincerely means it.

  • 86% found me interesting
  • 40% entertaining 🙂
  • 90% informative
  • 71% demonstrative and clear