Databricks TPC-DS benchmark notebooks
Pre-built notebooks to benchmark the cost and performance of Jobs Classic vs Jobs Serverless vs serverless DBSQL using TPC-DS datasets.
Pre-built TPC-DS benchmark notebooks for Databricks
Use these notebooks to easily compare the cost and performance of Classic Jobs vs Serverless Jobs vs serverless DBSQL, including insights into P99 metrics and ideal use-cases for each compute plane.
How to use these notebooks:
The package includes 4 notebooks: Analysis notebook, DBSQL benchmark notebook, Jobs benchmark notebook and a Jobs bootstrap notebook.
To run the full benchmark, run the DBSQL benchmark notebook, followed by the Jobs benchmark notebook and then run the Analysis notebook.
To run only the Jobs Compute benchmark, run the Jobs bootstrap notebook to create the tables required for analysis, then run the Jobs benchmark notebooks followed by the Analysis notebook.
To run only the DBSQL benchmark, simply run the DBSQL benchmark notebook followed by the Analysis notebook.
Related Insights & Tools
