June 2, 2021
Since the inception of Cribl LogStream, we’ve had a freely accessible product. LogStream has always been available as a download or a Docker container. Since we launched version 2.0, I’ve often said LogStream is the easiest distributed system to setup I’ve ever encountered. Set up a leader node, set up one or more worker nodes, point them at the leader, and you’re good to go. If you’re running Kubernetes, we provide easy-to-use Helm charts for getting up and running quickly.
Providing a generous, 1TB/Day entitlement in free, customer-managed software has been game changing for our users and customers, enabling them to get value out of LogStream before they have to engage in any sales cycle. We have numerous successful free users moving hundreds of gigabytes of data per day who have never talked to us. In our minds, the only way to improve upon free Cribl software is to offer a free Cribl service.
As a service, Cribl can offer customers a new way to buy. At Cribl, we believe in offering excellent software for a transparent, easy-to-understand price. With Cloud, we can directly align our pricing with consumption, allowing customers to pay for exactly what they consume.
Today, I’m pleased to announce the general availability of Cribl.Cloud, the easiest way to get data into your log and metric tools. Cribl.Cloud’s first service, LogStream Cloud, is the same product you’ve come to know and love in your customer-managed environments, now available as a service. LogStream Standard Cloud is our first offering with a single hosted worker group, available in AWS US West (Oregon). LogStream Standard Cloud is available on a completely metered model of $.15/GB in and $.15/GB out.
LogStream Cloud is based on LogStream 3.0, which we announced just two weeks ago. LogStream 3.0 makes it even easier to get started in the cloud, and using our new Packs functionality, easily move configurations back to your customer-managed environment. LogStream Cloud sign up takes just seconds, and you can be up and running in just minutes.
Get started today! The rest of this post will go into more detail about some use cases for LogStream Cloud and LogStream 3.0, a quick hint at the future, and pricing.
We’re excited to be partnering with great companies like Splunk, DataDog, AWS, Elasticsearch, Influxdata, and Grafana. All of their cloud services provide huge benefits to their customers, but most of them by design provide limited protocol support for ingestion. Most provide a handful of ingestion APIs which are fronted by on-premises agents which serve as gateways to their cloud services. Initially, this doesn’t sound too burdensome, until the customer realizes they’ve now taken on management of a customer managed ingestion service they have to monitor, upgrade, and take care of in order to on-board data sources like Syslog, Webhooks, or Kafka. Each cloud tends to work with only its own agent, requiring a second agent to try out a second destination. Collecting data from APIs, even on the Internet, often requires a second service to do data collection. This is where an observability pipeline comes in.
LogStream Cloud is a cloud-hosted observability pipeline. LogStream Cloud makes it simple to onboard any type of data, from a Simple HTTP Post, to agents like the Splunk Universal Forwarder or Fluent Bit, to event streaming sources like Kafka or Kinesis, to metrics protocols like Statsd or Prometheus Remote Write to protocols like Syslog or SNMP Traps. LogStream provides a rich, no-code, data-first graphical interface for easily onboarding data of any type, reshaping or enriching as needed, and forwarding on to any destination like Splunk Cloud, Elastic Cloud, AWS Elasticsearch Service, DataDog, Influx Cloud, or Grafana Cloud.
Today’s cloud offering is the equivalent of our on-prem Standard offering. The primary difference with Standard versus Enterprise is the ability to manage multiple worker groups. In today’s product, LogStream Cloud customers can manage a single hosted worker group. Each customer is completely isolated from all other customers, but the compute is running inside our cloud accounts.
Customers have a strong economic incentive to push processing as close to where the data is emitted as possible. Egress charges make a material difference to solution costs, generally running at least $.02/GB to move data even between availability zones. Customers, especially higher volume customers, wish to have LogStream Workers running in their own environment, in their own cloud accounts, possibly even on-premises. Today, we can offer this in our customer-managed solution but not in our cloud service.
Soon, we will begin offering LogStream Cloud Enterprise. Enterprise separates the data plane from the control plane, with the control plane running on our infrastructure and the data plane running wherever the customer would like. Enterprise will offer the ability to manage multiple Worker Groups, with some of those worker groups being inside a customer’s infrastructure. Pricing is still being determined. If this sounds interesting, please contact your account manager or Contact Sales.
In the meantime, Cribl.Cloud is also a great place to get started proving LogStream can work for you, on our free tier. Using our new Packs feature in LogStream 3.0 and LogStream Cloud, it’s easy to set up configurations that can be moved trivially from Cloud to a customer managed environment at any time.
Cribl.Cloud offers a new way to consume Cribl as services. LogStream Cloud Standard offers a simple charging model that’s directly aligned to consumption. In LogStream Cloud, we charge by Gigabytes going in and going out. This directly aligns to resource consumption on our end. Each byte coming in has to be read from the wire and deserialized, then processed, then serialized and sent out to one or more destinations. Additional destinations have significant compute and cloud egress charges, so we charge for each output.
Cribl has always strived to make LogStream an incredibly affordable product. In each of our accounts, after a successful POC, we help provide a clear business case for the value we’re delivering with LogStream. With a metered billing model, we no longer have to guess at what annualized consumption will look like. We can go month-to-month for an initial deal, or we can sell an annualized commitment and simply bill for overages at the end of the billing term.
For more information, please see our pricing page or Contact Sales for more information.
Offering Cribl products as cloud services is foundational for the next phase of Cribl’s growth. LogStream Cloud is the easiest way to get data into all your favorite observability and security services. It’s available for free, up to 1 TB/Day, now! Go to Cribl.Cloud to sign up. If you have any questions, please join our community at https://cribl.io/community, or ping us through the Intercom widget in the product. We’re happy to help, any time!