Cribl Lake is simple, it’s storage, it’s simplified storage to keep large volumes of IT and security data for long retention periods. And now it’s even easier for you to start using Cribl Lake.
In addition to Cribl-managed Cloud Worker Groups, cloud customers can now use self-managed Hybrid Worker Groups to send data directly to Cribl Lake. This means all your worker groups, whether hybrid or cloud, can write data to Cribl Lake — all coordinated by your Cribl.Cloud Leader. Hybrid Workers, including our newly managed Azure Workers, can access and write data to datasets and also replay data from Cribl Lake.
Data is stored in open formats in Cribl Lake, making it easy to access, replay, search, and run analysis on. It’s easy, intuitive, scalable, and flexible — and integrates seamlessly with the rest of Cribl’s products, making your data processing and management so much easier.
Key Benefits
1. Unified Data Management: By enabling Hybrid Worker Groups to send data directly to Cribl Lake, we’ve streamlined the data ingestion process. Meaning you can collect, process, store, route, and analyze data all in one place.
2. Compliance: Hybrid Worker Groups deployed in your own environment allow for strict compliance requirements to be fulfilled, and enable all traffic to be audited.
3. Cost Optimization: With Hybrid Worker Groups in your environment, you can control factors like instance or server types to optimize costs. Use committed use discounts, reserved instances, and savings plans to reduce and optimize costs even further.
4. Choice, Control, and Flexibility: Cribl continues to empower you and your teams with the ability to mix and match workloads, write data into Cribl Lake, replay data as needed, and more. This flexibility is essential for organizations looking to tailor data strategies to specific needs for ultimate choice and control.
How it Works
The integration of customer-managed Hybrid Worker Groups with Cribl Lake is designed with security and ease of use in mind. Here’s a high-level overview:
Simple Setup: Setting up Hybrid Worker Groups to interact with Cribl Lake follows the same process as setting up Cloud Worker Groups. The only difference is that you’ll now see a Cribl Lake destination tile available for selection.
Seamless Workflow: The familiar workflow for getting data into Cribl Lake remains unchanged:
Step 1: Create the Dataset
Step 2: Add a Cribl Lake Destination, which maps to a new Dataset.
Step 3: Add a QuickConnect or Data Route which maps one or more sources to the Lake Destination (i.e. Dataset).
When creating the Dataset, you specify your retention policy, data format (JSON or Parquet), and any acceleration fields. This makes the initial start of using Hybrid Worker Groups with Cribl Lake smooth and hassle-free.
Secure by Design: Hybrid Worker Groups use temporary, limited-privilege credentials, eliminating the need to store security keys on the worker groups themselves. This ensures that sensitive keys are not stored on the Hybrid Worker Groups.
Cribl is dedicated to providing our customers with the choice, control, and flexibility needed to effectively manage their data. The ability to write data from Hybrid Worker Groups to Cribl Lake, and replay data back, is a testament to our commitment to enhancing your data management capabilities. Use this new feature to streamline your workflows, optimize resources, and stay ahead in the ever-evolving landscape of data processing and management.
New to Cribl? Sign up for a free trial today and try the Cribl Lake Sandbox!