Enriching via lookups is very powerful, but as your enrichment data set grows, CSV files become inadequate. In Cribl Stream 2.4, we’ve introduced a Redis function, which provides a more scalable way to do lookups.
Redis is a powerful in-memory caching system. In Stream 2.4, you will be able to
PUT data into a Redis cache and
GET data from it. This feature combined with the ability to collect data from REST APIs, allows users to create very large lookup databases (much larger and more flexible than CSV files). Customers can then enrich log data with far less manual and time-consuming effort.
This video explains more details about the Redis function and talks about potential use cases for it.