Apache Kafka is an open-source, distributed event streaming platform widely used for high-performance data pipelines, streaming analytics, metrics collection and monitoring, log aggregation, data integration, and mission-critical applications. As a durable message broker, Kafka enables applications to process, persist, and reprocess streamed data.
How to get data flowing
This is a built-in integration between Cribl Stream and Kafka.
Kafka as Destination and LogStream as a source
Configure Stream to send data to Kafka via Destinations > Kafka.
Specify the Kafka brokers and topic to write to, along with other settings (record data format, compression and backpressure behavior, and optional Confluent Schema Registry, TLS certificate, and SASL authentication parameters).
Stream will start sending data as it becomes available.