Cribl

Destination

Google Cloud Pub/Sub

Asynchronously integrate streaming data sources and destinations, with low (100-ms) latency

Google Cloud Pub/Sub is a low-latency, asynchronous communication service for streaming analytics and data integration pipelines. You can use Pub/Sub as messaging-oriented middleware between event producers (publishers) and consumers (subscribers), or as a queue to parallelize tasks.

How to get data flowing

This is a built-in integration between Cribl Stream and Pub/Sub topics.

  • Configure a Pub/Sub topic to receive events from LogStream. (Or create a new topic within LogStream’s UI.)

  • Configure Stream to send out events via Destinations > Google Cloud > Pub/Sub.

  • Specify (or create) the Pub/Sub Topic ID to send events to.

  • Specify the delivery order and region, backpressure behavior, authentication method and credentials, optional system fields to add to events, and optional batch, task, and concurrent-request limits.

  • Stream will start sending data as it becomes available.

View Documentation

Cribl, the Data Engine for IT and Security, empowers organizations to transform their data strategy. Customers use Cribl’s suite of products to collect, process, route, and analyze all IT and security data, delivering the flexibility, choice, and control required to adapt to their ever-changing needs.

We offer free training, certifications, and a free tier across our products. Our community Slack features Cribl engineers, partners, and customers who can answer your questions as you get started and continue to build and evolve. We also offer a variety of hands-on-Sandboxes for those interested in how companies globally leverage our products for their data challenges.