Gain total data clarity with Data Insights

Data engineering isn’t for the faint of heart.

We’re always asked to explain rising costs (even when nothing seems to have changed). 

Just when we think we have a handle on things, a P0 issue crops up.

Then there are the queries—always the queries—bogging down our warehouse performance and making everything run slower.

With data flowing between dozens of sources, pinpointing the exact cause of issues stemming from any of the many root causes can feel like searching for a needle in a haystack while blindfolded. It’s hard to identify issues you don’t know about when you’re working in the dark.

Catch issues before they spiral

That’s why we launched the Data Insights dashboard: to make it easy to query and visualize data trends over time. It works behind the scenes to show you high-level performance, usage, and cost information about what’s going on in your data warehouse.

Now, you can answer questions like:

• Which users are reading this table? 
• What queries or models are costing us the most money?
• How often are stakeholders using this table, if at all?
• How much does this table cost us every week, month, etc?
• Why do we have redundant columns?

A diagnostic tool for your warehouse

The Data Insights dashboard is like a diagnostic tool for your data. It parses, filters, and analyzes all of the queries run in your warehouse, so you can:

1. Automatically identify performance and cost issues
2. View aggregated metrics around query cost and performance
3. Drill down into any dimension like a specific role, user, or table

Automatically identify performance and cost issues

Get a fine-grained understanding of each query’s performance and cost. Enrich each query’s properties and make it easier to query for specific information (without all the `JOIN`s). 

Once it’s enriched, it’s easy to investigate what caused a sudden change: just click on and drag any of the charts to view the queries that ran during that time period.

View historic and related query metrics 

View how run and queue time has changed over the past 30 days. Look back to see if there’s been a drastic change in the number of rows inserted or updated each time the query is run. 

Or see how your total credits have changed over time on a user-by-user basis. If a query stands out, click on it to view historic behavior and identify what caused the change.

All of this information can then be used to take action—whether it's adjusting warehouse sizes for certain workloads, refining your queries using inefficient joins, or stopping queries that run often without changing the underlying data.

Get started with Data Insights in < 1 minute

You can get started with Data Insights right now. Just connect your data warehouse and we’ll prevent your next data incident automatically.

Want to get started with Metaplane for the first time? You can create an account for free or pick a time to learn more about data observability best practices from the team.