Source

Confluent

Fully managed Kafka service and enterprise stream processing platform

Confluent is a fully managed Kafka service and enterprise stream processing platform. It offers real-time data streaming via AWS, Google Cloud, Azure, or serverless infrastructure.

How to get data flowing

This integration is facilitated through Cribl Stream’s Kafka Source and Destination.

Kafka as Source and Stream as a destination

  • Configure Kafka brokers and topics via Confluent Platform or Confluent Cloud.

  • Configure Stream to read data from Kafka via Sources > Kafka.

  • Specify the Kafka brokers, topics, and optional settings (TLS and SASL authentication parameters).

  • Enable the Confluent Schema Registry, and specify its URL and optional TLS parameters.

  • Stream will start fetching data as KDS streams become available.

Kafka as Destination and Stream as a source

  • Configure Stream to send data to Kafka via Destinations > Kafka.

  • Specify the Kafka brokers and topic to write to, along with other settings (record data format, compression and backpressure behavior, and optional TLS and SASL authentication parameters).

  • Enable the Confluent Schema Registry, and specify its URL and optional schema ID and TLS parameters.

  • Stream will start sending data as it becomes available.

Cribl, the Data Engine for IT and Security, empowers organizations to transform their data strategy. Customers use Cribl’s suite of products to collect, process, route, and analyze all IT and security data, delivering the flexibility, choice, and control required to adapt to their ever-changing needs.

We offer free training, certifications, and a free tier across our products. Our community Slack features Cribl engineers, partners, and customers who can answer your questions as you get started and continue to build and evolve. We also offer a variety of hands-on-Sandboxes for those interested in how companies globally leverage our products for their data challenges.