In Data We Trust

Want to build a better data org? Join the In Data We Trust newsletter. We distill insights from working with hundreds of leading data teams into practical bite-size strategies. Get it for free, in your inbox, weekly.
Thank you! You have been subscribed.
Error: something went wrong.

Top Articles

Articles by Category

Changelog
New feature: Chrome Extension
Learn more about the first data observability chrome extension
March 18, 2024
·
4
min read
Changelog
Integration update: support for Hive Metastore on Databricks
Metaplane expands support for Databricks
March 11, 2024
·
4
min read
Data Quality
How to manage tags for objects in Snowflake
Without a solid data management strategy, you're crossing your fingers and hoping that nothing goes wrong. Here's your first step toward a sound data governance strategy: using tags properly in Snowflake.
March 7, 2024
·
6
min read
Changelog
New integration: Segment
Learn more about Metaplane's newest integration with Segment
March 7, 2024
·
5
min read
Announcements
Announcing Metaplane’s $13.8M Series A
We're excited to announce our $13.8M Series A funding. Last year, over 100 companies trusted Metaplane. Here are our plans to help 10,000 companies ensure trust in the data that powers their business.
March 5, 2024
·
7
min read
Data Observability
3 ways to improve data sampling efficiency in Snowflake
Using conditional statements before you start sampling ensures you’re only working with the data that matters. Learn how to make your Snowflake data sampling queries more efficient with these 2 different conditional statements.
February 28, 2024
·
5
min read
Changelog
Announcing our Airflow Integration: Observability into DAGs
Metaplane now integrates with Airflow to provide observability into your DAG
February 12, 2024
·
2
min read
Data Quality
Three ways to track schema drift in Snowflake
Schema drift can result in missing or inconsistent data, undermining the accuracy of your Snowflake queries and reports if unaddressed. Here are 3 ways to track schema drift in Snowflake.
February 6, 2024
·
6
min read
Data Observability
Detecting table insert misses with adaptive flatline alerts
Adaptive flatline alerts are designed to strike a delicate balance with anomaly detection, so you get timely warnings for irregular patterns of data ingestion without being overwhelmed by false alarms. Here's the framework for setting them up.
February 1, 2024
·
4
min read
Changelog
New integration: Jira
Automatically route data quality incidents to Jira issue tracking with the new Metaplane × Jira integration
January 30, 2024
·
4
min read
Data Quality
Machine Learning should be data-centric, not model-centric. Here’s why.
Until recently, ML model creation focused more on the architecture of the model itself, rather than the data feeding it. Here's why that's a problem.
January 12, 2024
·
7
min read
Changelog
New integration: Census
Learn what you get from integrating Census via Metaplane.
January 4, 2024
·
4
min read
Data Observability
4 numeric distribution metrics to track in Snowflake (and how to track them)
Numeric distribution metrics are key to proactively monitoring business patterns. Here's what they are, which ones you need to be tracking, and how to track them in Snowflake.
January 3, 2024
·
9
min read
Announcements
Metaplane is proud to be part of the Snowflake Horizon partner ecosystem
Learn what benefits you get from Metaplane’s inclusion in the Snowflake Horizon Partner Ecosystem
December 21, 2023
·
3
min read
Changelog
New integration: Hightouch
Learn what you get from integrating Hightouch with Metaplane.
December 19, 2023
·
5
min read
Changelog
Announcing Azure & AWS PrivateLink support
Learn about our latest connection method
December 11, 2023
·
2
min read
Data Quality
How to maintain data integrity
Best practices for maintaining a few aspects of data integrity.
December 4, 2023
·
6
min read
Data Observability
Mistakes to avoid when implementing data observability software
Ready to improve data quality to increase trust in your data? Use our experience to avoid common pitfalls!
December 1, 2023
·
6
min read
Data Culture
Forecasting 2023 Data Engineering Trends in 2024
Confused by all of terms you see on your LinkedIn Feed? Are these terms new concepts altogether or are they just new ways about thinking of established concepts? Come on in - this blog post is for you.
November 16, 2023
·
7
min read
Data Culture
Snowflake table types explained
Learn more about how to determine which table type to use in Snowflake based on your use case.
November 15, 2023
·
7
min read
Changelog
Custom dashboards in Metaplane
You can now create custom dashboards in Metaplane to monitor the data health of different segments of your data stack.
October 5, 2023
·
4
min read
Data Culture
Pointers for successful data lake and warehouse migrations
Learn about how you can use Metaplane along with Fivetran for your next warehouse migration.
October 4, 2023
·
4
min read
Changelog
Data CI/CD for dbt Core
Metaplane's latest release for our dbt core integration allows users to avoid unintentional mistakes caused by updates to your models.
September 26, 2023
·
4
min read
Changelog
New Metaplane Dashboards and Menu
Learn more about how Metaplane's new dashboard makes it easier than ever to manage data quality from one place.
September 21, 2023
·
6
min read
Data Culture
Data Quality is a Team Sport: Applying the RACI framework
Learn more about how different teams can get in on improving data quality across the company.
September 20, 2023
·
5
min read
Changelog
Import Historical Data Backfill
Read more about Metaplane's latest feature that eliminates the training period for your machine learning based monitors.
September 19, 2023
·
3
min read
Announcements
Metaplane Recognized as G2 Leader in Data Observability: How We Got Here and What's Next
A letter about what our latest G2 awards means to me and how Metaplane will use our reviews and feedback to move forward.
September 14, 2023
·
5
min read
Changelog
Snowflake Spend Monitoring in Metaplane
Read more about Metaplane's newest feature for Snowflake users who are trying to get the most out of their data stack.
September 13, 2023
·
3
min read
Data Observability
Deep Dive: Data Observability and Transactional Databases
Transactional databases are an important part of the modern data stack—and they shouldn't be left out of your data observability journey. Metaplane's deep integrations with transactional databases can help.
August 30, 2023
·
4
min read
Data Quality
Data Quality Considerations for Data Stack Additions
Learn about common data quality mishaps when implementing new tools for your data stack.
August 17, 2023
·
6
min read
Data Culture
Comparing Snowflake Dynamic Tables with dbt
Learn about how to use Snowflake Dynamic Tables in conjunction with dbt to accelerate your modeling efforts.
August 11, 2023
·
4
min read
Announcements
Launching Today: The Next Evolution in Data Observability
Metaplane's data observability platform introduces its newest evolution in data quality monitoring, including smart monitor suggestions and the ability to monitor everything, from Snowflake spend to dbt jobs and everything in between.
August 8, 2023
·
5
min read
Changelog
Metaplane’s New Monitoring Platform: Product Deep-Dive
We've overhauled the monitoring platform from the UI to under the hood.
August 8, 2023
·
5
min read
Announcements
Data Quality Reimagined: Metaplane’s Commitment to Supporting Snowflake Data Metric Functions
Metaplane is committed to supporting Snowflake's upcoming Data Metric Functions. This integration will use DMFs as primitives under the hood that provide centralized, secure, and potentially more economical data quality monitoring. By leveraging these functions within Metaplane's platform, users can expect an even more comprehensive data observability solution that empowers them to achieve exceptional data quality in the Snowflake Data Cloud.
June 28, 2023
·
4
min read
Announcements
Metaplane Achieves Snowflake Premier Partner Status
Metaplane announces Snowflake Premier Technology Partner status - learn what this means for you
June 27, 2023
·
3
min read
Data Quality
What is Data Relevance? Definition, Examples, and Best Practices
Learn more about data relevance and how it can improve your data quality.
May 29, 2023
·
5
min read
Data Quality
What is Data Security? Definition, Examples, and Best Practices
Learn more about how data security plays a role in your data quality practices.
May 29, 2023
·
5
min read
Data Quality
What is Data Reliability? Definition, Examples, and Best Practices
Learn more about how data reliability plays a role in your data quality practices.
May 29, 2023
·
5
min read
Data Quality
What is Data Usability? Definition, Examples, and Best Practices
Learn what data usability is and what role it has to play in improving data quality across your data stack.
May 29, 2023
·
5
min read
Data Quality
What is Data Validity? Definition, Examples, and Best Practices
Learn more about how valid data can play a part in your data quality strategy.
May 29, 2023
·
5
min read
Data Quality
What is Data Completeness? Definition, Examples, and Best Practices
Data completeness is one of the ten dimensions of data quality. In this post, you'll learn what it means, why it matters, and how it's measured.
May 28, 2023
·
2
min read
Data Quality
What Is Data Accuracy? Definition, Examples, and Best Practices
Data accuracy is one of the ten dimensions of data quality. In this post, you'll learn what it means, why it matters, and how it's measured.
May 28, 2023
·
3
min read
Data Quality
What is Data Freshness? Definition, Examples, and Best Practices
Data freshness is one of the ten dimensions of data quality. In this post, you'll learn what it means, why it matters, and how it's measured.
May 28, 2023
·
3
min read
Data Quality
What is Data Consistency? Definition, Examples, and Best Practices
Data consistency is one of the ten dimensions of data quality. In this post, you'll learn what it means, why it matters, and how it's measured.
May 26, 2023
·
2
min read
Data Quality
A Framework to Understand How Poor Data Quality Hurts Business Performance
How does data quality impact business performance? In the best case, poor data quality creates more work for your data team. In the worst case, it costs you time, frustrates stakeholders, jeopardizes revenue, and damages customer sentiment.
May 25, 2023
·
6
min read
Data Culture
Data Mesh vs. Data Fabric: Key Differences and Which to Choose in 2023
How to choose the right data architecture: Weighing the pros and cons of Data Mesh and Data Fabric.
May 25, 2023
·
6
min read
Data Culture
Data modernization initiative: 4 tips to get you started
Your business is evolving, and so is business tech. Data modernization makes sure the tools you use to collect and analyze data keep up.
May 25, 2023
·
5
min read
Data Quality
Data Monitoring v Data Observability
Learn more about how data quality tests, data monitoring, and data observability differ, while still improving data quality in their own ways.
May 25, 2023
·
5
min read
Data Observability
What Data Observability Is, What It’s Not, and Why it Matters
Data observability is arguably the hottest concept in the data space today, but few have a clear sense of what it means. This blog post offers a definition of data observability, differentiates it from related concepts, and emphasizes why it's important.
May 24, 2023
·
8
min read
Data Quality
Concepts and Practices to Ensure Data Quality
There are a multitude of potential data quality issues, and equally many ways to improve. This post describes two guidelines, three concepts, and four best practices to preserve trust in data.
May 24, 2023
·
10
min read
Data Culture
What are Data Products?
Explore the evolving world of data products (or data as a product), their impact on decision-making, how they're integrated into businesses, and what the implications of this new phrase is.
May 24, 2023
·
4
min read
Data Culture
5 Things to Know About Microsoft Fabric
Understanding Microsoft Fabric: From OneLake's unique data storage to flexible compute setups.
May 24, 2023
·
5
min read
Data Observability
Machine Learning Observability vs Data Observability
Learn more about an up and coming space, machine learning monitoring, and how the use cases and functions differ from data observability.
May 24, 2023
·
5
min read
Data Quality
Best Data Catalogs: An Evaluation Guide
Data catalogs are being adopted to improve data quality and help analytics and data engineering teams better understand what's available to use. Read on if you're currently evaluating data catalogs!
May 24, 2023
·
5
min read
Data Quality
Benefits of Data Lineage for Better Data Quality
Learn how you can use data lineage, provided by data observability tools, to improve data quality across your modern data stack.
May 24, 2023
·
5
min read
Data Culture
Data Mesh vs. Data Lake: Key Differences and Which to Choose in 2023
A detailed guide comparing Data Mesh and Data Lake architectures, and factors to consider when choosing.
May 24, 2023
·
5
min read
Data Observability
How to Evaluate Data Observability Tools
A framework for data practitioners to evaluate data observability and quality monitoring tools.
May 23, 2023
·
6
min read
Data Observability
Data Observability vs. Software Observability
Overview of the similarities and differences between the established field of Software Observability and the emerging category of Data Observability.
May 23, 2023
·
12
min read
Data Culture
The Future of Business Intelligence: 5 Transformative Shifts in the Data Landscape
Business intelligence is evolving, and it's happening right now. Discover the 5 transformative shifts set to redefine the future of BI.
May 23, 2023
·
5
min read
Data Observability
Backfilling Data in 2023: Best Practices
Discover how to effectively backfill data in 2023, manage complex challenges, and uphold high data accuracy standards.
May 23, 2023
·
5
min read
Data Culture
Data Reliability Engineering: A Guide to Ensuring Data Quality in the Modern Data Stack
Read this post to understand if you should formally assign or hire a member of your team to focus on data reliability.
May 23, 2023
·
4
min read
Data Culture
Stale Data Leads to Bad Business Decisions
Using stale data for decision-making can have dire consequences. In this blog post, we explore the risks and emphasize the significance of accurate data.
May 23, 2023
·
4
min read
Data Culture
Data Contracts: Bridging the Gap Between Business and Data
Discover the significance of data contracts as a bridge between business and data in our blog post. Uncover their definition, key elements, benefits, and effective implementation tips.
May 23, 2023
·
5
min read
Data Culture
The Future of Data Analytics and Data Science
Discover the key trends shaping data analytics and data science: automation, the rise of machine learning and LLMs, and the democratization of data.
May 23, 2023
·
5
min read
Data Culture
What are Data Product Managers?
Learn more about Data Product Managers, their origin, impact on businesses, and traits to develop to make it a career.
May 23, 2023
·
5
min read
Data Culture
The Role of Data Observability in Data Governance Policies
With countries focused on creating new data governance policies to protect users - it's more important than ever to learn about how data observability can help you avoid heavy regulatory fines.
May 23, 2023
·
5
min read
Data Culture
What is a Data Mesh? Definition, Examples, and Best Practices
Get an in-depth understanding of the Data Mesh architecture, its real-world applications, and the keys to its successful adoption.
May 23, 2023
·
5
min read
Data Quality
Data Quality Metrics for Data Warehouses (or: KPIs for KPIs)
A framework of data quality metrics, a shortlist of metrics, and a process for identifying which metrics your team should use.
May 22, 2023
·
15
min read
Data Observability
How To Justify Investing in Data Observability
The four most common reasons for how data leaders justified an investment into data observability, spanning concrete to intangible (but still critical) reasons.
May 20, 2023
·
6
min read
Data Observability
Monte Carlo Data and Methods: Exploiting Randomness for Problem Solving
May 20, 2023
·
7
min read
Data Observability
DevOps and DataOps Demystified: Guide to Similarities and Differences
Explore the key differences between DevOps and DataOps methodologies and learn how implementing both can drive better business outcomes for data-driven organizations.
May 18, 2023
·
6
min read
Data Quality
How to Use Machine Learning for Robust Data Quality Checks
Learn how machine learning can help make your data quality checks more robust, empowering data and analytics engineers to make reliable and accurate data-driven decisions
May 16, 2023
·
6
min read
Data Observability
Prioritizing Data Observability: Why Now?
Five important reasons for why you should consider making data quality a priority now, instead of waiting until it becomes an issue.
May 15, 2023
·
5
min read
Data Culture
Decision Guide to Choosing a Data Integration Tool
How to make the right choice in a market bursting with options
May 15, 2023
·
6
min read
Data Observability
The Origins, Purpose, and Practice of Data Observability
Data observability is an emerging technology that solves an age-old problem: understanding the state of data systems to increase awareness and trust.
May 15, 2023
·
9
min read
Data Quality
The Definitive Guide to Snowflake Data Lineage
Learn how to extract and use data lineage in Snowflake to optimize your data pipelines and improve data engineering workflows.
May 15, 2023
·
15
min read
Data Quality
Stay Fresh: Two Ways to Track Update Times for Snowflake Tables and Views
Discover how to ensure your data is fresh and up-to-date in Snowflake with two essential tools: the MAX function and the LAST_ALTERED column.
May 14, 2023
·
3
min read
Data Quality
Stay Fresh: Four Ways to Track Update Times for BigQuery Tables and Views
Master Data Freshness in Google BigQuery: Keep your insights up-to-date and your decisions data-driven with our guide to monitoring table and view updates in BigQuery.
May 14, 2023
·
4
min read
Data Quality
Three Ways to Retrieve Row Counts in Redshift Tables and Views
Understand your data better in Amazon Redshift with accurate row counts. Discover how using COUNT functions and system statistics can optimize your data management.
May 12, 2023
·
5
min read
Data Quality
Three Ways to Retrieve Row Counts for Snowflake Tables and Views
Explore various methods to obtain row counts in Snowflake, from simple SQL queries to leveraging table statistics, for performance optimization and data analysis.
May 12, 2023
·
4
min read
Data Quality
Four Efficient Techniques to Retrieve Row Counts in BigQuery Tables and Views
A comprehensive guide on retrieving row counts in tables and views for Google BigQuery. We detail practical methods, discuss their trade-offs, and provide useful code snippets.
May 12, 2023
·
4
min read
Data Observability
The Four Pillars of Data Observability
How much data do we need to reconstruct a useful picture of our data? That’s the question we attempt to answer in this article. The groupings of questions we need to answer in order to describe our data are the “pillars” that underlie data observability in 2023.
May 10, 2023
·
5
min read
Data Quality
How to Set Up Data Quality Tests
Data engineers use unit testing for data quality today, but quality assurance needs more. In this post, we offer best practices for robust data quality standards.
May 10, 2023
·
4
min read
Data Quality
The Root Causes of Data Quality Issues
Understand 5 common sources of data quality issues: input errors, infrastructure failures, incorrect transformations, invalid assumptions, and ontological misalignment. Learn to combat these with smart strategies to turn data into your strongest asset.
May 3, 2023
·
7
min read
Data Observability
Data Observability in 10 years
Predicting the future of data observability: 10 years from now, automation and generic metadata will be key in incident management and data management.
April 27, 2023
·
7
min read
Changelog
Introducing WHERE Clause for Monitors
Metaplane adds WHERE clauses to monitor configurations, enabling targeted data segment monitoring. Useful for adapting to business changes or focusing on specific areas, like pricing updates or new service launches.
April 26, 2023
·
3
min read
Data Observability
Data Observability Defined
Data observability is vital for ensuring high-quality data and informed decision-making. We cover its benefits, challenges, and how it impacts businesses.
April 20, 2023
·
4
min read
Changelog
Introducing Monitors as Code
You can now manage your Metaplane monitors alongside your other model configuration options in dbt.
April 18, 2023
·
1
min read
Changelog
A Redesign of Metaplane's Incidents
We've redesigned incidents from the ground up to help you identify the root cause with confidence and communicate with stakeholders with ease.
April 13, 2023
·
5
min read
Changelog
Metaplane Daily Slack Update
Metaplane's new Daily Update Slack message helps turn down the noise by putting all of our less-timely updates into a single, convenient spot.
April 4, 2023
·
2
min read
Changelog
Introducing Suggested Monitors
Metaplane now provides helpful suggestions to help you ensure that all your most important tables and columns are monitored.
March 30, 2023
·
3
min read
Changelog
A New Way to Manage your Monitors
Metaplane has built a new way to manage your monitors, including improved filtering, bulk actions, and increased visibility into the status of your monitors.
March 28, 2023
·
2
min read
Data Observability
Column-Level Lineage: An Adventure in SQL Parsing
A deep dive into the technologies we used to build Metaplane's new column-level lineage map, and the lessons we learned about SQL parsing along the way.
March 22, 2023
·
6
min read
Changelog
Metaplane’s New Column-Level Lineage Map
Metaplane's new lineage visualization helps you prevent downstream issues, identify root causes, and spread data awareness across your organization.
March 16, 2023
·
5
min read
Changelog
Introducing Metaplane's Public API
We built Metaplane for data engineers, and we’re always on the lookout for ways we can help you make your monitoring more robust, more flexible, and more powerful. That’s why we’re thrilled to announce our first public API.
March 1, 2023
·
2
min read
Changelog
Introducing Partition Monitors: find data quality issues in segments of your data
Easily monitor specific data segments with Metaplane's new partition monitors to identify root causes of data quality issues in seconds.
February 9, 2023
·
4
min read
Changelog
Microsoft Power BI Integration
Metaplane now supports Microsoft Power BI. When you connect Metaplane to Power BI, our platform automatically ingests metadata about workspaces, reports, and dashboards and builds table level lineage.
February 2, 2023
·
1
min read
Changelog
Announcing Data Test Previews in Pull Requests
Data Test Previews gives busy data teams a hand by automatically testing any changes made to their data in a development branch.
January 24, 2023
·
4
min read
Announcements
The Next Stage of Metaplane
We've raised $8.4M in funds to bring data observability to every data team.
January 10, 2023
·
10
min read
Data Observability
Great Expectations and Metaplane
Great Expectations is suited for catching known issues by testing binary criteria on critical tables. Metaplane is suited for catching unknown issues by testing scalar criteria on a wide range of assets.
January 3, 2023
·
3
min read
Ensure trust in data

Start monitoring your data in minutes.

Connect your warehouse and start generating a baseline in less than 10 minutes. Start for free, no credit-card required.