Consuming Data Streams

There are different ways to consume data from the Data Streams:

• Setting up an application (see section Consuming Data From the Stream Program-controlled)

• Using the command line interface tool from Kafka (see section Consuming Data from the Stream with the Kafka Binary Distribution).

Both alternatives require to set up proper JAAS (Java Authentication and Authorization Service) configuration. In this documentation, we describe the necessary steps in detail. For a better understanding, we provide examples for Java and Scala.

Mapp will only provide support for the officially maintained Apache Kafka APIs (http://kafka.apache.org/documentation/#api).

Requirements

Configuration Properties for the Kafka Clients

Consuming Data From the Stream Program-controlled

Consuming Data from the Stream with the Kafka Binary Distribution