The Cribl blog covers Observability, Big Data Analytics, Data Streams Processing... and anything else we feel like writing about!
Several years ago, I decided to move something really important to me to the Cloud: my music. Like many of you back in the day, I’m sure, I had several of those huge binders with the plastic sleeves inside, and they were filled to the brim with CDs. Eventually though, I got frustrated with my collection.
A common meme relating to tech projects is “Cheap, fast, good – pick 2.” The idea is that you can often achieve two of these, but because of tradeoffs among these dynamics, you can rarely achieve all three. For example, if you choose good and fast, it will probably cost you a lot more, and […]
Have you ever spent a day picking through firewall logs, looking for the useful bits to help diagnose a reported issue? Firewall logs provide a rich data set, but in and of themselves, they’re a bit hard to read and understand, which makes them even harder to get insights from. Not to mention they are […]
Seinfeld taught us a lot of valuable and hilarious lessons about life, but little did we know then, that they were actually talking about data pipelines. “The Yada Yada” was one of the most memorable Seinfeld episodes I have ever watched. If you’re not familiar, the gist of the story is George’s new girlfriend likes to say “yada yada yada” to shorten her stories. Unfortunately for George, she sometimes "shortens" some of the most important parts of the story.
You Kids! Get Off My Lawn! At the risk of sounding all “back in my day,” I’ve been working with AWS services since probably about 2009, at first in testing and development, and later in many production environments. Back then, AWS recommended that companies should use multiple accounts for their environments, but the only real […]
I have always been fascinated by new technology and none more so than electric cars. The idea of never going to a gas station again seemed like a dream. I thought it would be great to own a car that was nearly maintenance free. The environmental advantages of an electric car also intrigued me. I’m […]
Video conferencing usage, especially on Zoom, has exploded in the last few months, and companies small and large are using it extensively to enable and connect their now mostly-remote employees. And, as with any other critical technology, especially when interconnecting infrastructure, it’s important that administrators get real-time visibility and insights into it, such as: Average […]
With the advent of data collection, new logging data workflows become possible. If your retention requirements are served by archiving data off to a cheap storage mechanism like S3 or Glacier, you can drastically reduce what’s in your logstore to just what you need for normal troubleshooting, or even only metrics, using data collection to […]
According to a 2018 study by the Ponemon Institute, the average time from the occurrence of a security breach to detection is 197 days (with the entertainment industry on the high side – 287 days, and the Energy sector at the low end – 150), but with stories like the Marriott breach (occurred in 2014, […]
In my last post, I focused on a specific use case for routing observability data: separating retention from analysis. That’s just one of the many tools that become available to you by inserting a routing mechanism into your observability pipeline, and in this post, I’m going to take a look at a number of […]