NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI · #1207 most downloaded on PyPI
Provider package apache-airflow-providers-databricks for Apache Airflow
Last release 3 days ago
29 Sep 2026
Ships on a steady schedule
a new release about every 2 weeks
Nearly every release is documented
notes for 60 of the last 60 stable releases
3 versions withdrawn
withdrawn after publishing
6 years old
185 releases · first in 2020
Nothing published for this version
- Fixing DatabricksNotebookOperator invalid dependency graph issue
Release Date: 2025-04-19
Fixing DatabricksNotebookOperator invalid dependency graph issue (#48492)
remove superfluous else block (#49199)
Fixing DatabricksNotebookOperator invalid dependency graph issue (#48492)
remove superfluous else block (#49199)
One column per quarter.
Nothing published for this version
- fix overriding_parameters missing in repair_task
Release Date: 2025-04-14
fix overriding_parameters missing in repair_task (#48877)
fix for databricks repair buttons not overriding the template parameters (#46704)
fix overriding_parameters missing in repair_task (#48877)
fix for databricks repair buttons not overriding the template parameters (#46704)
Nothing published for this version
- Add DatabricksSQLStatementsOperator
Release Date: 2025-04-09
Add DatabricksSQLStatementsOperator (#48507)
Nothing published for this version
- AIP-72: Handle Custom XCom Backend on Task SDK
Release Date: 2025-03-31
AIP-72: Handle Custom XCom Backend on Task SDK (#47339)
Nothing published for this version
- fIx deprecation warnings in common.sql
Release Date: 2025-03-13
fIx deprecation warnings in common.sql (#47169)
Relocate airflow.auth to airflow.api_fastapi.auth (#47492)
AIP-72: Moving BaseOperatorLink to task sdk (#47008)
Move 'airflow.www.auth' to 'airflow.providers.fab.www.auth' (#47307)
Remove 'api_connexion' (#47171)
Remove old UI and webserver (#46942)
Upgrade flit to 3.11.0 (#46938)
fIx deprecation warnings in common.sql (#47169)
Relocate airflow.auth to airflow.api_fastapi.auth (#47492)
AIP-72: Moving BaseOperatorLink to task sdk (#47008)
Move 'airflow.www.auth' to 'airflow.providers.fab.www.auth' (#47307)
Remove 'api_connexion' (#47171)
Remove old UI and webserver (#46942)
Upgrade flit to 3.11.0 (#46938)
Nothing published for this version
This version contains no code changes. It was released to replace a previous version that was yanked due to a packaging issue.
Release Date: 2025-02-26
Note
This version contains no code changes. It was released to replace a previous version that was yanked due to a packaging issue.
Nothing published for this version
- Accept task_key as an argument in 'DatabricksNotebookOperator'
Release Date: 2025-02-21
Accept task_key as an argument in 'DatabricksNotebookOperator' (#44960)
python_named_parameters should be python_named_params (#46299)
AIP-72: Support better type-hinting for Context dict in SDK (#45583)
Remove obsolete pandas specfication for pre-python 3.9 (#45399)
Accept task_key as an argument in 'DatabricksNotebookOperator' (#44960)
python_named_parameters should be python_named_params (#46299)
AIP-72: Support better type-hinting for Context dict in SDK (#45583)
Remove obsolete pandas specfication for pre-python 3.9 (#45399)
All deprecated classes, parameters and features have been removed from the databricks provider package. The following breaking changes were introduced…
Release Date: 2024-12-26
Note
This release of provider is only available for Airflow 2.9+ as explained in the Apache Airflow providers support policy .
Warning
All deprecated classes, parameters and features have been removed from the databricks provider package. The following breaking changes were introduced:
Removed deprecated DatabricksRunNowDeferrableOperator. Use DatabricksRunNowOperator with deferrable=True instead.
Removed deprecated DatabricksSubmitRunDeferrableOperator. Use DatabricksSubmitRunOperator with deferrable=True instead.
Removed deprecated return_tuple parameter from DatabricksSqlHook. Now namedtuple will always returned.
Remove deprecations from Databricks Provider (#44566)
[FIX] Fixed databricks repair run deferrable (#44213)
fix(providers/databricks): remove additional argument passed to repair_run (#44140)
Added job_clusters as a templated parameter to CreateDatabricksWorkflowOperator (#45022)
Bump minimum Airflow version in providers to Airflow 2.9.0 (#44956)
Bump minimum version of databricks SDK to 3.0.0 (#43272)
Update DAG example links in multiple providers documents (#44034)
Rename execution_date to logical_date across codebase (#43902)
Note
This release of provider is only available for Airflow 2.9+ as explained in the Apache Airflow providers support policy.
Warning
All deprecated classes, parameters and features have been removed from the databricks provider package. The following breaking changes were introduced:
Removed deprecated DatabricksRunNowDeferrableOperator. Use DatabricksRunNowOperator with deferrable=True instead.
Removed deprecated DatabricksSubmitRunDeferrableOperator. Use DatabricksSubmitRunOperator with deferrable=True instead.
Removed deprecated return_tuple parameter from DatabricksSqlHook. Now namedtuple will always returned.
Remove deprecations from Databricks Provider (#44566)
[FIX] Fixed databricks repair run deferrable (#44213)
fix(providers/databricks): remove additional argument passed to repair_run (#44140)
Added job_clusters as a templated parameter to CreateDatabricksWorkflowOperator (#45022)
Bump minimum Airflow version in providers to Airflow 2.9.0 (#44956)
Bump minimum version of databricks SDK to 3.0.0 (#43272)
Update DAG example links in multiple providers documents (#44034)
Rename execution_date to logical_date across codebase (#43902)
Nothing published for this version
Nothing published for this version
- Allow Databricks SQL hook to cancel timed out queries
Release Date: 2024-11-18
Allow Databricks SQL hook to cancel timed out queries (#42668)
Added support for job_parameters and dbt_commands in DatabricksRunNowOperator (#43895)
Enable workload identity authentication for the Databricks provider (#41639)
Add support for semicolon stripping to DbApiHook, PrestoHook, and TrinoHook (#41916)
Allow Databricks SQL hook to cancel timed out queries (#42668)
Added support for job_parameters and dbt_commands in DatabricksRunNowOperator (#43895)
Enable workload identity authentication for the Databricks provider (#41639)
Add support for semicolon stripping to DbApiHook, PrestoHook, and TrinoHook (#41916)
Nothing published for this version
- Add TimeoutError to be a retryable error in databricks provider
Release Date: 2024-10-31
Add TimeoutError to be a retryable error in databricks provider (#43137)
Add ClientConnectorError to be a retryable error in databricks provider (#43091)
DatabricksHook: fix status property to work with ClientResponse used in async mode (#43333)
[DatabricksHook] Respect connection settings (#42618)
Add TimeoutError to be a retryable error in databricks provider (#43137)
Add ClientConnectorError to be a retryable error in databricks provider (#43091)
DatabricksHook: fix status property to work with ClientResponse used in async mode (#43333)
[DatabricksHook] Respect connection settings (#42618)
Nothing published for this version
- Add 'on_kill' to Databricks Workflow Operator
Release Date: 2024-10-14
Add 'on_kill' to Databricks Workflow Operator (#42115)
add warning log when task_key>100 (#42813)
Add debug logs to print Request/Response data in Databricks provider (#42662)
Add 'on_kill' to Databricks Workflow Operator (#42115)
add warning log when task_key>100 (#42813)
Add debug logs to print Request/Response data in Databricks provider (#42662)
Nothing published for this version
- Removed deprecated method reference airflow.www.auth.has_access when min airflow version >= 2.8.0
Release Date: 2024-09-24
(feat) databricks repair run with reason match and appropriate new settings (#41412)
Removed deprecated method reference airflow.www.auth.has_access when min airflow version >= 2.8.0 (#41747)
remove deprecated soft_fail from providers (#41710)
Nothing published for this version
This release of provider is only available for Airflow 2.8+ as explained in the Apache Airflow providers support policy .
Release Date: 2024-08-22
Note
This release of provider is only available for Airflow 2.8+ as explained in the Apache Airflow providers support policy .
Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)
Note
This release of provider is only available for Airflow 2.8+ as explained in the Apache Airflow providers support policy.
Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)
Nothing published for this version
This release reverts some of the functionality added in 6.7.0 around json parameter compatible with XComs, Jinja expression values
Release Date: 2024-08-06
Note
This release reverts some of the functionality added in 6.7.0 around json parameter compatible with XComs, Jinja expression values
Add DatabricksWorkflowPlugin (#40724)
DatabricksPlugin - Fix dag view redirect URL by using url_for redirect (#41040)
Fix named parameters templating in Databricks operators (#40864)
[Databricks Provider] Revert PRs #40864 and #40471 (#41050)
Note
This release reverts some of the functionality added in 6.7.0 around json parameter compatible with XComs, Jinja expression values
Add DatabricksWorkflowPlugin (#40724)
DatabricksPlugin - Fix dag view redirect URL by using url_for redirect (#41040)
Fix named parameters templating in Databricks operators (#40864)
[Databricks Provider] Revert PRs #40864 and #40471 (#41050)
Nothing published for this version
- Make Databricks operators' json parameter compatible with XComs, Jinja expression values
Release Date: 2024-07-12
Make Databricks operators' json parameter compatible with XComs, Jinja expression values (#40471)
Bug/fix support azure managed identities in Databricks operator (#40332)
Make Databricks operators' json parameter compatible with XComs, Jinja expression values (#40471)
Bug/fix support azure managed identities in Databricks operator (#40332)
Nothing published for this version
- Add DatabricksWorkflowTaskGroup
Release Date: 2024-06-27
Add DatabricksTaskOperator (#40013)
Add DatabricksWorkflowTaskGroup (#39771)
Databricks: optional include of user names in 'list_jobs' (#40178)
implement per-provider tests with lowest-direct dependency resolution (#39946)
Lower log levels from INFO to DEBUG to reduce log verbosity - Databricks provider auth (#39941)
Update pandas minimum requirement for Python 3.12 (#40272)
Nothing published for this version
- add deferrable support to 'DatabricksNotebookOperator'
Release Date: 2024-05-30
add deferrable support to 'DatabricksNotebookOperator' (#39295)
get all failed tasks errors in when exception raised in DatabricksCreateJobsOperator (#39354)
Faster 'airflow_version' imports (#39552)
Simplify 'airflow_version' imports (#39497)
Better typing for BaseOperator 'defer' (#39742)
add deferrable support to 'DatabricksNotebookOperator' (#39295)
get all failed tasks errors in when exception raised in DatabricksCreateJobsOperator (#39354)
Faster 'airflow_version' imports (#39552)
Simplify 'airflow_version' imports (#39497)
Better typing for BaseOperator 'defer' (#39742)
Nothing published for this version
This release of provider is only available for Airflow 2.7+ as explained in the Apache Airflow providers support policy .
Release Date: 2024-05-06
Note
This release of provider is only available for Airflow 2.7+ as explained in the Apache Airflow providers support policy .
Add DatabricksNotebookOperator (#39178)
Add notification settings parameters (#39175)
[FEAT] raise exception with main notebook error in DatabricksRunNowDeferrableOperator (#39110)
Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240)
Nothing published for this version
- Add cancel_previous_run to DatabricksRunNowOperator
Release Date: 2024-04-21
Add cancel_previous_run to DatabricksRunNowOperator (#38702)
add repair_run support to DatabricksRunNowOperator in deferrable mode (#38619)
Adds job_id as path param in update permission (#38962)
Fix remaining D401 checks (#37434)
Update ACL during job reset (#38741)
Remove extra slash from update permission endpoint (#38918)
DatabricksRunNowOperator: fix typo in latest_repair_id (#39050)
refactor(databricks): remove redundant else block (#38397)
Rename 'DatabricksSqlOperator''s fields' names to comply with templated fields validation (#38052)
Add cancel_previous_run to DatabricksRunNowOperator (#38702)
add repair_run support to DatabricksRunNowOperator in deferrable mode (#38619)
Adds job_id as path param in update permission (#38962)
Fix remaining D401 checks (#37434)
Update ACL during job reset (#38741)
Remove extra slash from update permission endpoint (#38918)
DatabricksRunNowOperator: fix typo in latest_repair_id (#39050)
refactor(databricks): remove redundant else block (#38397)
Rename 'DatabricksSqlOperator''s fields' names to comply with templated fields validation (#38052)
Nothing published for this version
Nothing published for this version
Nothing published for this version
- Bump aiohttp min version to avoid CVE-2024-23829 and CVE-2024-23334
Release Date: 2024-02-15
Update DatabricksSqlOperator to work with namedtuple (#37025)
Bump aiohttp min version to avoid CVE-2024-23829 and CVE-2024-23334 (#37110)
feat: Switch all class, functions, methods deprecations to decorators (#36876)
Get rid of pytest-httpx as dependency (#37334)
Nothing published for this version
- [FEAT] adds repair run functionality for databricks
Release Date: 2024-01-27
[FEAT] adds repair run functionality for databricks (#36601)
Fix databricks_sql hook query failing on empty result for return_tuple (#36827)
Rename columns to valid namedtuple attributes + ensure Row.fields are retrieved as tuple (#36949)
check status before DatabricksSubmitRunOperator & DatabricksSubmitRunOperator executes in deferrable mode (#36862)
[FEAT] adds repair run functionality for databricks (#36601)
Fix databricks_sql hook query failing on empty result for return_tuple (#36827)
Rename columns to valid namedtuple attributes + ensure Row.fields are retrieved as tuple (#36949)
check status before DatabricksSubmitRunOperator & DatabricksSubmitRunOperator executes in deferrable mode (#36862)
Nothing published for this version
Nothing published for this version
This release of provider is only available for Airflow 2.6+ as explained in the Apache Airflow providers support policy .
Release Date: 2023-12-27
Note
This release of provider is only available for Airflow 2.6+ as explained in the Apache Airflow providers support policy .
Return common data structure in DBApi derived classes (#36205)
Fix: Implement support for 'fetchone()' in the ODBCHook and the Databricks SQL Hook (#36161)
Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)
fix typos in DatabricksSubmitRunOperator (#36248)
Add code snippet formatting in docstrings via Ruff (#36262)
Note
This release of provider is only available for Airflow 2.6+ as explained in the Apache Airflow providers support policy.
Return common data structure in DBApi derived classes (#36205)
Fix: Implement support for 'fetchone()' in the ODBCHook and the Databricks SQL Hook (#36161)
Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)
fix typos in DatabricksSubmitRunOperator (#36248)
Add code snippet formatting in docstrings via Ruff (#36262)
Nothing published for this version
Nothing published for this version
Nothing published for this version
This release has been yanked with a reason: The provider DBApiHook output returned broken output.
Warning
This release has been yanked with a reason: The provider DBApiHook output returned broken output.
Make pyodbc.Row and databricks.Row JSON-serializable via new 'make_serializable' method (#32319)
Warning
This release has been yanked with a reason: The provider DBApiHook output returned broken output.
Make pyodbc.Row and databricks.Row JSON-serializable via new 'make_serializable' method (#32319)
Nothing published for this version
The offset parameter has been deprecated from list_jobs in favor of faster pagination with page_token similarly to Databricks API .
Release Date: 2023-11-12
The offset parameter has been deprecated from list_jobs in favor of faster pagination with page_token similarly to Databricks API .
Remove offset-based pagination from 'list_jobs' function in 'DatabricksHook' (#34926)
Nothing published for this version
- Add operator to create jobs in Databricks
Release Date: 2023-10-31
Add operator to create jobs in Databricks (#35156)
Nothing published for this version
This release of provider is only available for Airflow 2.5+ as explained in the Apache Airflow providers support policy .
Release Date: 2023-10-17
Note
This release of provider is only available for Airflow 2.5+ as explained in the Apache Airflow providers support policy .
Add 'DatabricksHook' ClusterState (#34643)
Respect 'soft_fail' parameter in 'DatabricksSqlSensor' (#34544)
Respect 'soft_fail' argument when running DatabricksPartitionSensor (#34517)
Decode response in f-string (#34518)
Bump min airflow version of providers (#34728)
Use aiohttp.BasicAuth instead of HTTPBasicAuth for aiohttp session in databricks hook (#34590)
Update 'list_jobs' function in 'DatabricksHook' to token-based pagination (#33472)
Note
This release of provider is only available for Airflow 2.5+ as explained in the Apache Airflow providers support policy.
Add 'DatabricksHook' ClusterState (#34643)
Respect 'soft_fail' parameter in 'DatabricksSqlSensor' (#34544)
Respect 'soft_fail' argument when running DatabricksPartitionSensor (#34517)
Decode response in f-string (#34518)
Bump min airflow version of providers (#34728)
Use aiohttp.BasicAuth instead of HTTPBasicAuth for aiohttp session in databricks hook (#34590)
Update 'list_jobs' function in 'DatabricksHook' to token-based pagination (#33472)
Nothing published for this version
- Add "QUEUED" to RUN_LIFE_CYCLE_STATES following deployment of …
Release Date: 2023-09-12
Add "QUEUED" to RUN_LIFE_CYCLE_STATES following deployment of … (#33886)
allow DatabricksSubmitRunOperator to accept a pipeline name for a pipeline_task (#32903)
Replace sequence concatenation by unpacking in Airflow providers (#33933)
Improve modules import in Airflow providers by some of them into a type-checking block (#33754)
Use literal dict instead of calling dict() in providers (#33761)
Use f-string instead of in Airflow providers (#33752)
Nothing published for this version
Your coding agent can read these notes before it upgrades. Set up the MCP server →