Data Observability

Stale Data Explained: Why It Kills Data-Driven Organizations

Dashboards that don’t refresh, machine learning applications that don’t learn, and other consequences of stale data.

How Best Egg Implemented a Reliable Data Mesh with Data Observability 

See how the fast growing fintech marketplace has matured their data stack and driven increased levels of data quality, trust,…

How BlaBlaCar Built a Practical Data Mesh to Support Self-Service Analytics at Scale

See how BlaBlaCar reduced incidents and time to insights by enabling self service analytics and implementing data mesh.

Rise of the MLOps Engineer And 4 Critical ML Model Monitoring Techniques  

MLOps engineers are automating ML model monitoring to quickly detect problems like pipeline issues, model drift, feature drift and more.

How Data Enablement Drives Sustainable Value at Upside

Upside leverages a model that emphasizes upfront investments in data enablement to create self-sustaining “data gardens.” Here’s how.

How Mercari Operationalizes Data Reliability Engineering at Scale

6 best practices from Mercari’s data reliability engineering team for ensuring high quality data..

5 Ways to Use Column Level Data Lineage

Dive deep into use cases and explore the connections between column and table-level lineage. Read on to master the art…

Introducing Table Health Dashboard, a Better Way to Track Data Quality Coverage at Scale 

Monte Carlo’s Table Health Dashboard gives data teams visibility into the reliability and monitoring coverage of their most critical data…

Modern Data Quality Management: A Proven 6 Step Guide

This 6 step data quality management framework has helped hundreds of organizations achieve higher quality data across their modern data…

How Achieves Data Reliability at Scale with Monte Carlo

Learn how gained visibility into data across domains, scaled data quality checks, and achieved reliability at scale.

IMPACT 2022: The Data Observability Summit Videos Are Now Available On Demand

Missed IMPACT? Don't worry! All our 2022 sessions—including keynotes with Nate Silver, Jay Kreps, and more—are now available on demand.

The 31 Flavors of Data Lineage And Why Vanilla Doesn’t Cut It

4 critical reasons why your data observability solution needs to have data lineage.

How PepsiCo Achieved Data Quality at Scale with Monte Carlo

Learn how the data team at PepsiCo uses data observability through Monte Carlo to discover data incidents faster.

How Blend Scales the Impact of Reliable Data with dbt Cloud and Monte Carlo

Discover how Blend’s data team leverages Monte Carlo and dbt Cloud to reduce compute costs and deliver more reliable data…

Freshly’s Journey to Building Their 5-Layer Data Platform Architecture

How Freshly, a leading meal delivery service, built a more reliable data platform architecture with Snowflake, Fivetran, dbt, Looker, and…

Find and Solve Databricks Data Quality Issues with Monte Carlo

Monte Carlo “Sample Rows” and “Reproduce Anomalies” functionality gives the ability to sample impacted rows of an incident and reproduce…

How Collaborative Imaging Delivers Healthier Data Products with Monte Carlo

In healthcare, bad data can have severe implications. Here's how Collaborative Imaging uses Monte Carlo to drive data health at…

Our Top 5 Most Popular Data Engineering Articles In 2022

Data mesh, data observability, data contracts, data platforms and our other most popular data engineering articles.

Barr Moses: My Top 5 Articles of 2022

Covering 2023 predictions, data self-service, KPIs, big data egos, underestimating data issues and other issues that are top of mind…

Using Data Observability For Third-Party Data Validation

Third-party data validation and ingestion at scale is not easy. Here is one way to solve this challenge.

From Concept to Reality: Migrating to Data Mesh at BairesDev with Databricks and Monte Carlo

Migrating to data mesh? Learn how BairesDev, a leading Brazilian software development company, got started on this epic data journey.

How ELT Schedules Can Improve Root Cause Analysis For Data Engineers

Why Bayesian networks hold more promise segmentation analysis.

How BlaBlaCar Reduced Data Incident Time to Resolution by 100+ Hours Per Quarter with Monte Carlo

As part of their data mesh migration, the carpooling company’s data engineering team unlocked unprecedented levels of productivity through decentralization,…

How To Implement Data Mesh: Top Tips From 4 Data Leaders

Four data leaders from leading organizations give their practical advice on how to implement data mesh.

How SeatGeek Reduced Data Incidents to Zero with Data Observability

In this video, SeatGeek's Brian London and Kyle Shannon share how data observability helped their data team reduce data incidents…

Announcing Monte Carlo’s Data Reliability Dashboard, a Better Way Understand the Health of Your Data

Data Reliability Dashboard gives data engineers the tools necessary to measure data uptime, drive operational improvements, and scale reliability.

5 Steps To A Successful Data Warehouse Migration

Real lessons from recent data warehouse migrations like Qubole to AWS EMR andMySQL to AWS Redshift.

Monitoring for the dbt Semantic Layer and Beyond

Let’s talk about the dbt Semantic Layer as well as anomaly detection, resolution, and prevention across the data most important…

Why Data Cleaning is Failing Your ML Models – And What To Do About It

When it comes to achieving model accuracy, data cleaning alone is insufficient. Here’s why.

The Significance of O’Reilly’s Data Quality Fundamentals

O'Reilly Data Quality Fundamentals' is the publishing house’s first-ever book on data observability.

How Dr. Squatch Keeps Data Clean & Fresh with Monte Carlo

Data observability helps the groundbreaking men’s personal care product company maintain excellent data hygiene.

Big Data (Quality), Small Data Team: How Prefect Saved 20 Hours Per Week with Data Observability

Learn how Dylan Hughes and Prefect’s lean data team kept data reliability high and costs low with Monte Carlo.

How to Make Data Anomaly Resolution Less Cartoonish

Fixing broken data doesn’t have to be a game of whack-a-mole. Here’s how to speed up your data incident resolution…

New Feature Recap: Data Lakehouse Support, Anomalous Row Distribution Monitors, and More! 

Highlighting Monte Carlo's latest product releases, including data lakehouse support, and anomalous row distribution monitors.

You Can’t Out-Architect Bad Data

Even with the most well-designed data platforms, systems will break. Without some measure of observability, you’re playing with fire.

Data Quality Monitoring – You’re Doing It Wrong

Monitoring just your “important” data only gets you so far. Here’s a better approach.

5 Steps to Operationalizing Data Observability with Monte Carlo

Driving early value with your new data observability platform doesn't have to be difficult. We share 5 tips for driving…

A Data Engineer’s Guide to Building Reliable Systems

Over the years, I’ve helped companies of all sizes build and maintain data systems—from my days as a data engineer…

The Future of Big Data Analytics & Data Science: 5 Trends of Tomorrow

What does the future of big data analytics hold? Will our analytical tools scale fast enough to provide real business…

Data Observability First, Data Catalog Second. Here’s Why.

You can’t realize the full value of a data catalog without observability. Here’s why.

How To Create Data Trust Within Your Organization

How to build data trust by preventing data incidents before they happen with the data uptime metric.

Data Engineers Spend Two Days Per Week Firefighting Bad Data, Data Quality Survey Says

Check out the results from our 2022 data quality survey and benchmark your data quality practices against 300 of your…

Data Contracts and 4 Other Ways to Overcome Schema Changes

There are virtually an unlimited number of ways data can break.  It could be a bad JOIN statement, an untriggered…

Snowflake Data Mesh: Ensure Reliable Data with Data Observability

Here’s how Snowflake and Monte Carlo are working together to help data teams realize the potential of the data mesh…

Monte Carlo Achieves Snowflake Premier Partner Status to Help Companies Accelerate the Adoption of Reliable Data 

With over 70 mutual customers, Monte Carlo becomes the first data observability provider to achieve Snowflake Premier Partner status.

Snowflake Observability and 4 Reasons Data Teams Should Invest In It

Snowflake is a gamechanger for your data strategy. With the right approach to Snowflake observability, you can unlock its full…

Building An External Data Product Is Different. Trust Me. (but read this anyway)

Developing an external data product is different, and let's face it harder, than serving internal customers. We dive into 5…

Building Spark Lineage For Data Lakes

Spark lineage has been a blindspot for the data engineering industry so we set off to engineer a solution. Here's…

How Monte Carlo and Snowflake Gave Vimeo a “Get Out Of Jail Free” Card For Data Fire Drills

See how Snowflake and Monte Carlo helped Vimeo achieve world-class data reliability on a massive scale.

The Ultimate Guide To Data Lineage

Data lineage is a must-have feature of the modern data stack, yet we're struggling to derive value from it. Here's…

DataOps Explained: How To Not Screw It Up

DataOps merges data engineering and data science teams to support an organization’s data needs, in a similar way to how…

5 Ways to Improve Data Quality with the New Monte Carlo Data Quality Trends Dashboard

The new Monte Carlo Dashboard incorporates data and visualization to provide actionable insights to users across data teams.

You Have More Data Quality Issues Than You Think 

On average, companies experience one data issue for every 15 tables in their warehouse. Here are 8 reasons why and…

The Cost of Bad Data Has Gone Up. Here Are 8 Reasons Why.

The rising cost of bad data and poor data quality has nothing to do with inflation and everything to do…

Data Observability Doesn’t Just Create Savings – It Drives Revenue, Too

If you think the benefits of data observability stop at cost cutting or avoiding bad outcomes, you’re only looking at…

Treat Your Data Like An Engineering Problem: An Interview with Snowflake Director of Product Management Chris Child

Snowflake Director of Product Management Chris Child talks about the role of data observability solutions in the modern data stack…

What is Data Observability? 5 Key Pillars To Know

Data observability improves data quality with features like data monitoring, lineage, automated root cause analysis, and data health insights to…

Data Observability for Developers: Announcing Monte Carlo’s Python SDK

Our Python SDK gives data engineers programmatic access to Monte Carlo to augment our platform’s lineage, cataloging, and monitoring functionalities.

10 Quick Tips for Getting Started with Monte Carlo

Getting started with Monte Carlo and data observability? Here's how to use 10 of our most popular features.

Data Observability vs. Data Testing: Everything You Need to Know

You already test your data. Do you need observability, too?…

Stop Treating Your Data Engineer Like A Data Catalog

How to build a data certification program so everyone knows what to expect and what data to trust.

The Non-Engineer’s Guide to Bad Data

According to a recent study by HFS, 75 percent of executives don’t trust their data. Here’s why and what data-reliant…

Now Available: O’Reilly Data Quality Fundamentals, Chapter 3

Available today, Chapter 3 of O'Reilly's Data Quality Fundamentals outlines the tools and techniques necessary to build more resilient data…

Monte Carlo Announces dbt Core Integration to Help Companies Ship Reliable Data Faster

When it comes to achieving reliable data, Monte Carlo, the leading data observability platform and dbt, the data build tool,…

Data Observability: How Clearcover Increased Quality Coverage for ELT by 70 Percent

Learn how the data engineering team at Clearcover increased data quality coverage across their stack by 70 percent with Monte…

Reflections on tech, trust, and data adoption

A few quick thoughts on why trust, and not technology, is stopping today's leader's from driving adoption and impact with…

How to Achieve More Trustworthy Data Pipelines with the Prefect Integration for Monte Carlo

With Monte Carlo and Prefect’s strategic partnership and integration, data engineering teams can seamlessly manage the reliability of their data…

Monte Carlo Named to First-Ever Intelligent Apps Top 40 List

Monte Carlo was recognized as one of the first-ever companies named to the Intelligent Applications 40 list.

IMPACT 2021: The Data Observability Summit Videos Are Now Available On Demand

Missed IMPACT? Have no fear! Full recordings of our keynotes, panels, and fireside chats with Bob Muglia, DJ Patil, Zhamak…

How The Farmer’s Dog Achieves Self-Serve Data Observability with Monte Carlo

How the data team at The Farmer's Dog, a fresh dog food company, achieves reliable data pipelines with automated, end-to-end…

Monte Carlo Launches Insights to Help Data Teams Understand What Data Matters Most to Your Business

Monte Carlo Insights is the first solution on the market to offer customers operational analytics about their data environment.

Unicorns, data mesh, category creation, and more reasons to attend IMPACT: The Data Observability Summit

Five reasons why you should attend IMPACT, the world's first Data Observability summit on Wednesday, November 3, 2021.

Data Observability 101: Everything You Need to Know to Get Started

What is data observability and does it make sense for your stack? Here’s your go-to guide to starting on the…

The Future of Data Engineering as a Data Engineer

Is the data engineer still the "worst seat at the table?" Maxime Beauchemin, creator of Apache Airflow, weighs in on…

Announcing O’Reilly’s Data Quality Fundamentals

Available today, Data Quality Fundamental's press release chapters dive into how some of the best teams are architecting for data…

Monitors as Code: A New Way to Deploy Custom Data Quality Monitors From Your CI/CD Workflow

Monte Carlo releases Monitors as Code, allowing data engineers to easily configure new data quality monitors as part of their…

Data Observability: Five Quick Ways to Improve the Reliability of Your Data

Five common data observability use cases and how they can help your team improve data quality at scale and trust…

Bob Muglia, former Snowflake CEO, to Speak at IMPACT, the World’s First Data Observability Summit

Muglia will join the first Chief Data Scientist of the U.S., the founder of the data mesh, and the creator…

Data Anomaly Detection: Why Your Data Team Is Just Not That Into It

Delivering reliable data products doesn't have to be so painful. Introducing a more proactive approach to detecting data anomalies: the…

Reverse ETL and Data Observability: Solving Data’s “Last Mile” Problem

How Reverse ETL and Data Observability can help teams go the extra mile when it comes to trusting your data…

What is a Data Incident Commander?

How data teams can build more resilient incident workflows with DevOps best practices.

How Vimeo Achieved End-to-End Visibility in Snowflake and Looker with Monte Carlo

Learn why the the data engineering team at Vimeo chose to partner with Monte Carlo for data observability.

The Ultimate Data Observability Checklist

Here are the 5 things every data observability strategy needs to help companies achieve end-to-end data trust.

Getting Started: Automatic Detection and Alerting for Data Incidents with Monte Carlo

Here’s how data teams get up and running with Monte Carlo to automatically detect and alert on data incidents with…

Data Quality Solutions: Build or Buy? 4 Things To Know

Investing in a data quality solution? Here's everything you need to know.

Announcing Monte Carlo’s Incident IQ, a Root Cause Analysis Workflow for Data Teams

How to get started with Incident IQ, Monte Carlo's all-in-one solution for troubleshooting and preventing broken data pipelines.

The Ultimate Guide to Data Quality

What is data quality and why does it matter?…

Monte Carlo and PagerDuty Integration Brings DevOps to Data Pipelines with End-to-End Data Observability

Monte Carlo's PagerDuty integration helps data engineering teams achieve greater visibility into the end-to-end health of their data pipelines.

Beyond Monitoring: The Rise of ML Observability

Modern data and machine learning systems need both monitoring and observability. Here’s why.

How to Extract Snowflake Data Observability Metrics Using SQL in 5 Steps

Monitor the health of your Snowflake data pipelines with these 7 queries to extract Snowflake data observability metrics.

How to Conduct Data Incident Management for Data Teams

Conduct data incident management with 4 simple steps to identify, root cause, and fix data quality issues at scale.

The Right Way to Measure ROI on Data Quality

Introducing a better approach for measuring the cost of bad data to your business.

The Data Engineer & Scientist’s Guide To Root Cause Analysis for Data Quality Issues

Introducing a five-step engineering root cause analysis approach used by some of the best data engineering and data science teams…

5 Reasons Data Discovery Platforms Are Best For Data Lakes

Here are 5 reasons why using a data discovery platform is a better alternative to data catalogs to ensure your…

5 Things Every Data Engineer Needs to Know About Data Observability

With data observability, data engineers can think more strategically about tackling the "good pipelines, bad data" problem.

Data Observability in Practice: Data Monitoring at Scale with SQL and Machine Learning

How to make your own data observability monitors from scratch and leverage basic principles of machine learning to apply them…

The Ultimate Data Observability Checklist

For most teams, data observability is more than just setting up a bunch of pipeline tests and hoping for the…

The New Rules of Data Quality

Unit testing your data only gets you so far. Here’s a better way to manage data quality at scale.

Data Observability: How to Build Your Own Data Anomaly Detectors Using SQL

How to use metadata to understand the root cause of data anomalies and take your data quality testing to the…

Why You Need to Set SLAs for Your Data Pipelines

How to set expectations around data quality and reliability for your company…

Data Observability in Practice Using SQL

A step-by-step tutorial for creating your own data quality monitors to catch freshness and distribution anomalies in your data pipelines.

Data Pipeline Monitoring- 5 Strategies To Stop Bad Data

Your data broke. Now what? Here's how some of the best data teams prevent data downtime and, in the process,…

3 Reasons You Can’t Rely on Testing Data Pipelines to Find Quality Issues

Why aren't we treating data as the dynamic, ever-evolving entity it is? Here's why a hybrid approach to testing data…

How to Improve Data Engineering Workflows with End-to-End Data Observability

With data observability, data teams can now identify and prevent inaccurate, missing, or erroneous data from breaking your analytics dashboards,…

Incident Prevention for Data Teams: Introducing the 5 Pillars of Data Observability

The five pillars of data observability are: Freshness, Distribution, Volume, Schema, Lineage…

Metadata is Useless  — Unless You Have a Use Case

Here's why having metadata and lineage without a clear business application is worse than having no metadata at all.

The Data Downtime Before Christmas

What happens when a freshness anomaly threatens to ruin Christmas? Turns out, even Santa Claus and his elves aren’t…

Data Catalogs Are Dead; Long Live Data Discovery

Data catalogs aren't cutting it any more when it comes to metadata management and data governance. Here's how data discovery…

A Summer at Monte Carlo: Improving Data Pipeline Observability at Scale

How I spent my summer internship on Monte Carlo’s software engineering team…

Bringing Reliable Data and AI to the Cloud: A Q&A with Databricks’ Matei Zaharia

An interview with Apache Spark creator Matei Zaharia on all things AI, the cloud, and data reliability…

Demystifying Data Observability

3 practical examples on how to get started with data observability…

Data Observability: How to Fix Your Broken Data Pipelines

In 2020, data is the new software. While software needs to be highly available, data needs to be highly reliable.

How to Solve the “You’re Using THAT Table?!” Problem

How to keep track of your data warehouse's most critical table and reports…

Data Observability Tools: Data Engineering’s Next Frontier

To keep pace with data’s clock speed of innovation, data engineers need to invest in data observability, the next frontier…

[VIDEO] Introducing Data Downtime: From Firefighting to Winning

During a 2019 Data Council meetup, Monte Carlo Co-founder & CEO Barr Moses discusses why data downtime matters to the…

How to Calculate the Cost of Data Downtime

Introducing a better way to measure the financial impact of bad data on your company…

How to Fix Your Data Quality Problem

Introducing a better way to prevent bad data.

What is Data Reliability?

And how to use it to start trusting your data.

How to Migrate to Snowflake Like a Boss

3 things you need to know for a smooth migration.

What We Got Wrong About Data Governance

And how we can make it right.

12 Data Quality Metrics That ACTUALLY Matter

How to improve your Data Quality Metrics and why it matters to your business.

Good Pipelines, Bad Data

How to start trusting data in your company.

Closing the Data Downtime Gap

How to get ahead of bad data.

What is Data Downtime?

Data downtime refers to periods of time when your data is partial, erroneous, missing or otherwise inaccurate.

[Video] What is Data Observability?

What is Data Observability?…

segment tag