x
D-373_lake background_1920x1080

New Hybrid Worker Group Support in Cribl Lake

August 15, 2024

Cribl Lake is simple, it’s storage, it’s simplified storage to keep large volumes of IT and security data for long retention periods. And now it’s even easier for you to start using Cribl Lake.

In addition to Cribl-managed Cloud Worker Groups, cloud customers can now use self-managed Hybrid Worker Groups to send data directly to Cribl Lake. This means all your worker groups, whether hybrid or cloud, can write data to Cribl Lake — all coordinated by your Cribl.Cloud Leader. Hybrid Workers, including our newly managed Azure Workers, can access and write data to datasets and also replay data from Cribl Lake.

Data is stored in open formats in Cribl Lake, making it easy to access, replay, search, and run analysis on. It’s easy, intuitive, scalable, and flexible — and integrates seamlessly with the rest of Cribl’s products, making your data processing and management so much easier.

Key Benefits

1. Unified Data Management: By enabling Hybrid Worker Groups to send data directly to Cribl Lake, we’ve streamlined the data ingestion process. Meaning you can collect, process, store, route, and analyze data all in one place.

2. Compliance: Hybrid Worker Groups deployed in your own environment allow for strict compliance requirements to be fulfilled, and enable all traffic to be audited.

3. Cost Optimization: With Hybrid Worker Groups in your environment, you can control factors like instance or server types to optimize costs. Use committed use discounts, reserved instances, and savings plans to reduce and optimize costs even further.

4. Choice, Control, and Flexibility: Cribl continues to empower you and your teams with the ability to mix and match workloads, write data into Cribl Lake, replay data as needed, and more. This flexibility is essential for organizations looking to tailor data strategies to specific needs for ultimate choice and control.

How it Works

The integration of customer-managed Hybrid Worker Groups with Cribl Lake is designed with security and ease of use in mind. Here’s a high-level overview:

  • Simple Setup: Setting up Hybrid Worker Groups to interact with Cribl Lake follows the same process as setting up Cloud Worker Groups. The only difference is that you’ll now see a Cribl Lake destination tile available for selection.
  • Seamless Workflow: The familiar workflow for getting data into Cribl Lake remains unchanged:

Step 1: Create the Dataset

Step 2: Add a Cribl Lake Destination, which maps to a new Dataset.

Step 3: Add a QuickConnect or Data Route which maps one or more sources to the Lake Destination (i.e. Dataset).

When creating the Dataset, you specify your retention policy, data format (JSON or Parquet), and any acceleration fields. This makes the initial start of using Hybrid Worker Groups with Cribl Lake smooth and hassle-free.

  • Secure by Design: Hybrid Worker Groups use temporary, limited-privilege credentials, eliminating the need to store security keys on the worker groups themselves. This ensures that sensitive keys are not stored on the Hybrid Worker Groups.

Cribl is dedicated to providing our customers with the choice, control, and flexibility needed to effectively manage their data. The ability to write data from Hybrid Worker Groups to Cribl Lake, and replay data back, is a testament to our commitment to enhancing your data management capabilities. Use this new feature to streamline your workflows, optimize resources, and stay ahead in the ever-evolving landscape of data processing and management.

New to Cribl? Sign up for a free trial today and try the Cribl Lake Sandbox!

 


 

Cribl, the Data Engine for IT and Security, empowers organizations to transform their data strategy. Customers use Cribl’s suite of products to collect, process, route, and analyze all IT and security data, delivering the flexibility, choice, and control required to adapt to their ever-changing needs.

We offer free training, certifications, and a free tier across our products. Our community Slack features Cribl engineers, partners, and customers who can answer your questions as you get started and continue to build and evolve. We also offer a variety of hands-on Sandboxes for those interested in how companies globally leverage our products for their data challenges.

.
Blog
Feature Image

How the Cribl SRE Team Uses Cribl Edge to Collect Metrics

Read More
.
Blog
Feature Image

Tackle Application Infrastructure Sprawl with Cribl Edge: Kubernetes Data Collection Made Easy

Read More
.
Blog
Feature Image

Continuing Our OpenTelemetry Story With New Versions, Logs, Batching, and More Metrics

Read More
pattern

Try Your Own Cribl Sandbox

Experience a full version of Cribl Stream and Cribl Edge in the cloud with pre-made sources and destinations.

box

So you're rockin' Internet Explorer!

Classic choice. Sadly, our website is designed for all modern supported browsers like Edge, Chrome, Firefox, and Safari

Got one of those handy?