A Low Code Approach to Getting Your Logs and Metrics into New Relic with Cribl LogStream

Carley Rosato
Written by Carley Rosato

November 18, 2021

Coming from an IT Operations background, I relied heavily on logs and metrics generated by the various platforms I supported to gain insights into the global deployments. The data points were often transformed into dashboards and alerts, allowing the team to effectively monitor the environments and remediate any issues that occurred in a timely manner.

Cribl LogStream’s integration with New Relic One facilitates this solution. By sending LogStream Metrics and Worker Node Logs through the platform and having them land in New Relic One, an Organization’s Operations team has the ability to monitor the LogStream environment outside the direct infrastructure. In addition, the partnership between Cribl and New Relic has led to the development of an Instant Observability LogStream Metrics dashboard that can be installed in an existing New Relic One environment via a Quickstart link. This dashboard extends the capabilities of the Monitoring console available in LogStream today.

In this blog, we’ll not only configure LogStream to send metrics to New Relic, but also launch the Quickstart dashboard and review the available metrics within the New Relic One platform.

Send LogStream Metrics to New Relic One

To begin generating the LogStream Metrics, navigate to Sources → Cribl Internal and toggle the Enabled switch to On for the CriblMetrics input.

Next, we’ll configure the New Relic One Destination by navigating to DestinationsNew Relic Ingest: Logs & Metrics. Select + Add New and configure the inputs specific to your New Relic One environment.

You must use an INGEST API Key from New Relic and can either copy an existing or generate a new key within the New Relic interface by navigating to Settings → API Keys → Create a Key

After both the source and destination are defined, create the Route to send the LogStream Metrics to the New Relic One environment and Commit & Deploy the configurations.

Review LogStream Metrics within New Relic One

Once you’ve confirmed that data is flowing through your LogStream environment and into New Relic One, you can explore the metrics within the system.

On the New Relic landing page, select Browse Data → Metrics from the horizontal navigation bar. This will generate a page that looks similar to the screenshot below. This view gives end-users the ability to search the various LogStream metrics and review the dimensions the data can be filtered and split by.

Launch the Quickstart Cribl LogStream Dashboard

By installing the Cribl LogStream quickstart dashboard available in New Relic’s Instant Observability marketplace, teams can quickly begin monitoring their LogStream deployment and create alerts specific to their environment.

Navigate to the Cribl LogStream Instant Observability (I/O) landing page and log in. Clicking the green +Install Quickstart button will redirect you to a page within your New Relic One instance to confirm and begin your quickstart installation.

Once installed, you’ll see the LogStream Metrics dashboard available in your list of configured dashboards.

Drilling into the dashboard, you can view graphics and summary metrics similar to what exists on the Monitoring tab in LogStream. In addition to the total Events and Bytes In/Out on the landing page, there are additional tabs outlining the volume of data being sent from the Sources to the Destinations and streaming through the various Routes and Pipelines. End-Users can also review reduction metrics associated with the Pipelines configured in their environment or use the filter feature for troubleshooting, by narrowing the scope (individual worker process, etc) of the presented data.

To enhance monitoring capabilities further, end users can configure custom alert conditions within New Relic One to trigger notification channels such as email, PagerDuty, Slack, and VictorOps. These alerts can be created in the Policies section of the Alerts & AI page and may include thresholds for specific Sources and Destinations or throughput restrictions for individual Worker Processes.

Cribl LogStream gives you the freedom to choose your platform monitoring solution. And the initial setup is as easy as enabling the default metrics and sending them to your existing system of analysis. Feel free to explore the metrics dashboard we’ve configured for New Relic as inspiration and know we’re always available to help on our Community Slack!

The fastest way to get started with Cribl LogStream is to sign-up at Cribl.Cloud. You can process up to 1 TB of throughput per day at no cost. Sign-up and start using LogStream within a few minutes.

Questions about our technology? We’d love to chat with you.