Confluent is a fully managed Kafka service and enterprise stream processing platform. It offers real-time data streaming via AWS, Google Cloud, Azure, or serverless infrastructure.
How to get data flowing
This integration is facilitated through Cribl Stream’s Kafka Source and Destination.
Kafka as Source and Stream as a destination
Configure Kafka brokers and topics via Confluent Platform or Confluent Cloud.
Configure Stream to read data from Kafka via Sources > Kafka.
Specify the Kafka brokers, topics, and optional settings (TLS and SASL authentication parameters).
Enable the Confluent Schema Registry, and specify its URL and optional TLS parameters.
Stream will start fetching data as KDS streams become available.
Kafka as Destination and Stream as a source
Configure Stream to send data to Kafka via Destinations > Kafka.
Specify the Kafka brokers and topic to write to, along with other settings (record data format, compression and backpressure behavior, and optional TLS and SASL authentication parameters).
Enable the Confluent Schema Registry, and specify its URL and optional schema ID and TLS parameters.
Stream will start sending data as it becomes available.