Easily Integrate Monte Carlo with Databricks via Partner Connect

Michael Segner

Michael writes about data engineering, data quality, and data teams.

Monte Carlo and Databricks have been long-time partners, which is why we are excited to announce that, starting today, data teams can bring data observability to their Databricks environment in just a few clicks via Partner Connect

Mutual customers like ThredUp, Abacus Medicine, Comcast, and BairesDev that use Databricks to derive critical insights, build ML models, and launch generative AI initiatives can now more easily access the power of automatic, end-to-end coverage and advanced incident resolution features to mitigate the negative impacts of bad data with Monte Carlo.

Data observability has become a top priority as data products drive more revenue but suffer longer periods of data downtime year over year. A recent Monte Carlo survey of more than 200 data professionals found that data downtime–the period in which data is wrong, incomplete or missing–nearly doubled year over year largely as a result of teams struggling to identify the root cause of data incidents.

“The Databricks Lakehouse Platform enables organizations to unlock tremendous value from their data by delivering highly scalable, cost effective compute and storage. Monte Carlo helps protect that earned value by ensuring teams can then deliver that reliable high quality data at scale,” said Matt Sulkis, head of partnerships, Monte Carlo.

Connecting with Partner Connect

The Databricks Partner Connect portal simplifies the integration process for pre-validated solutions like Monte Carlo by automatically configuring resources such as clusters, tokens and connection files. Here’s how:

Step 1: Access Partner Connect via the sidebar within your Databricks account (requirements). Select the Monte Carlo partner tile. 

Step 2: Choose the SQL warehouse and schema you’d like to integrate.

Step 3: You will be taken to Monte Carlo’s integration page within the Settings tab. You will see the selected integration with an “Enabled” status.

Step 4: Click the three vertical dots to quickly validate each aspect of the integration is working correctly.

Congratulations, you have successfully connected your lakehouse! It’s that easy.

Learn More About Data Observability For Your Lakehouse

We’d love to hear from you if you are starting to consider approaches for improving your data quality. Monte Carlo can help:

  • Mitigate the impact of bad data by reducing data downtime 88%.
  • Increase data team efficiency 30% by reducing tedious manual data quality related tasks.

Our promise: we will show you the product.