Databricks Asset Bundles provide a way to use the command line to deploy and run a set of Databricks assets - like notebooks, Python code, Delta Live Tables pipelines, and workflows. This is useful both for running jobs that are being developed locally and for automating CI/CD processes that will deploy and test code changes. In this video I explain why Databricks Asset Bundles are a good option for CI/CD and demo how to initialize a project and setup your first GitHub Action using DABs.
Blog post with extra examples: dustinvannoy.com/2023/10/03/databricks-ci-cd-intro-to-asset-bundles-dabs
* All thoughts and opinions are my own *
References:
Datakickstart DABs repo: github.com/datakickstart/datakickstart_dabs/blob/main/databricks.yml
Data & AI Summit Presentation: databricks.com/dataaisummit/session/databricks-asset-bundles-standard-unified-approach-deploying-data-products/
Data & AI Summit Repo: github.com/databricks/databricks-asset-bundles-dais2023
DABs Advanced Examples: youtube.com/watch?v=ZuQzIbRoFC4
More from Dustin:
Website: dustinvannoy.com
LinkedIn: linkedin.com/in/dustinvannoy
Github: github.com/datakickstart
CHAPTERS
00:00 Intro
02:10 Why use Asset Bundles?
5:45 Get started with Bundle Init
10:58 GitHub Action deploy and run
19:09 Outro
- Databricks CI/CD: Intro to Databricks Asset Bundles (DABs) ( Download)
- Databricks Asset Bundles Demo ( Download)
- Databricks Asset Bundles: A Unifying Tool for Deployment on Databricks ( Download)
- Databricks CI/CD: Azure DevOps Pipeline + DABs ( Download)
- Databricks Asset Bundles: A Standard, Unified Approach to Deploying Data Products on Databricks ( Download)
- Databricks Asset Bundles: Advanced Examples ( Download)
- Deploy DLT pipeline & Workflow using ASSET BUNDLES [CICD] #dataengineering #databricks #cicd ( Download)
- How to deploy Databricks Asset Bundle Projects ( Download)
- Deploy using DAB (Databricks Asset Bundles) ( Download)
- Databricks Asset Bundles (DAB) in 12 Minutes ( Download)
- Deploy Databricks Asset Bundles using GitHub Actions [DevOps] ( Download)
- Databricks - Asset Bundles Basics ( Download)
- Databricks Asset Bundles - 2023.10.16 ( Download)
- Build Python Packages in a Databricks Asset Bundle ( Download)
- Databricks Repos | CI/CD | Git Hub Part 1 ( Download)
