Databricks is a cloud-based data engineering platform that is widely used to explore, process, and transform large quantities of data. Databricks helps organizations to leverage the full benefit that comes from combining their data, ETL processes, and machine learning models and algorithms.
Using Soda Core, Soda’s open-source framework, data engineers can check for data quality directly from within a Databricks Notebook, then push results to Soda Cloud. Data producers and data consumers can use Soda Cloud to define quality expectations and implement SLAs that ensure that data in Databricks Delta Lakes is, and remains, fit-for-purpose.
Integrate Soda with Databricks to:
