Databricks with Dagster Pipes

You can run code in Databricks while streaming logs and structured metadata back to Dagster in real time with Dagster Pipes. There are two approaches depending on your cluster type:

Guide	When to use
Serverless compute	Unity Catalog Volumes, serverless notebooks
DBFS, classic clusters	Python scripts on DBFS with classic (non-serverless) clusters