🎶She's a Lake... House!🎶
Coming to you live from Cribl Lake, it's Saturday night! 🎉
Cribl's New Lakehouse
Lakehouse adds a next-generation lakehouse architecture to Cribl Lake that automates the complex management of diverse telemetry data types across flexible storage tiers. By integrating advanced routing, enrichment, and shaping capabilities, it empowers teams to gain faster insights and make smarter decisions—all in a single, streamlined workflow.
Fluff and stuff aside, Lakehouse is a game-changer. Lakehouse enables data caching on top of Cribl Lake and it's kind of a big deal. It's fast, even faster than Dominic.
Cribl Lake provides a wildly simple interface for deploying and managing tiered data storage at scale. Lakehouse builds on that by adding a caching layer for more performant Searching and Alerting and Dashboarding (oh my!). Let's check it out.
Check it out!
- If you're still in Edge from the previous page, click
Products > Lakehouses
at the top-left of the page - Click
Add Lakehouse
in the middle of the page- Optional: Read the little blue blurb about Lakehouse that reiterates what I just said
- Fill out the ID as
sbx_lakehouse
- Click
Save
You're done bud.
Seriously, that's it. You've just provisioned a Lakehouse in Cribl Lake. See what I mean? Wicked easy. Elfaba would be proud. Let's see what it takes to Search it.
A Lakehouse can take up to five whole minutes to provision! While you wait, why not watch a video of a cat playing the piano? a Lakehouse Demo given by the illustrious Perry!
And since that is only a two minute video, here is a three minute video (I promise it's not a Rick Roll).
Aaannd we're back! Let's add a Dataset to our Lakehouse and then Search it.
- On the left-hand side, click
Datasets
- Click into the
cribl_logs
Dataset - In the
Lakehouse
dropdown, selectsbx_lakehouse
- Click
Save
Easy peasy. Lemon squeezy. Now let's go back Search it rq!
Search It (Again)
Now that we've seen how to configure our Lakehouse, let's see how to interact with it: Cribl Search.
- From the product switcher (
Products
) at the upper left, clickSearch
- In the
Available Datasets
on the left side, hover overcribl_logs
and click theSearch Now
button
Uh, cool? Not much feels different. And that's kind of the point -- it's the same interface and same feel as before, but now you're searching data in your Lakehouse, kind of. If you look at the top right under the Search box, you'll see a tiny house icon with a yellow dot. When you hover over it, it will say
cribl_logs: The timeframe of your search exceeds the range of data stored in Lakehouse (earliest cached events: 2069-04-20T10:23:09.028Z)
Or something like that, but with a real time. Unfortunately caching only starts from time of configuration. We can compensate for that by changing the search window, though.
At the top right, click 1 hour ago
and change it to 60 seconds ago
in the resulting dropdown
This should automatically re-run the search and you'll see the little house icon now has a green dot! Even if you have no data yet...
I wish I could show you more, but that's it for now. We'll have to wait for more data to come in before we can do anything else. But the idea is there right? A caching layer on top of your long-term cost-effective storage that enables teams to more quickly search for data that isn't in their analysis tools at the moment. It's awesome!
You know what else is awesome? Cribl.Cloud is free up to 1TB of ingest! So you can play around with Lakehouse and your own data to see how it all works. And if you have any questions, feel free to email perrysrealemail@cribl.io. I'm sure he won't mind. 😉