PyPI · #1072 most downloaded on PyPI

apache-airflow

3.3.217M downloads/moapache/airflow ↗New releases in your daily digest, changelog included.

Programmatically author, schedule and monitor data pipelines

Last release 3 days ago
17 Sep 2026
Ships fairly regularly
a new release about every 2 weeks
Nearly every release is documented
notes for 60 of the last 60 stable releases
4 versions withdrawn
withdrawn after publishing
9 years old
300 releases · first in 2017

Release timeline

300 releases since 2017

2017201920212023

Releases

2.5.2rc110 Mar 2023pre-release
Nothing published for this version
2.5.120 Jan 20233 sources agree
Fix masking of non-sensitive environment variables
Bug Fixes

Fix masking of non-sensitive environment variables (#28802)

Remove swagger-ui extra from connexion and install swagger-ui-dist via npm package (#28788)

Fix UIAlert should_show when AUTH_ROLE_PUBLIC set (#28781)

Only patch single label when adopting pod (#28776)

Update CSRF token to expire with session (#28730)

Fix "airflow tasks render" cli command for mapped task instances (#28698)

Allow XComArgs for external_task_ids of ExternalTaskSensor (#28692)

Row-lock TIs to be removed during mapped task expansion (#28689)

Handle ConnectionReset exception in Executor cleanup (#28685)

Fix description of output redirection for access_log for gunicorn (#28672)

Add back join to zombie query that was dropped in #28198 (#28544)

Fix calendar view for CronTriggerTimeTable dags (#28411)

After running the DAG the employees table is empty. (#28353)

Fix DetachedInstanceError when finding zombies in Dag Parsing process (#28198)

Nest header blocks in divs to fix dagid copy nit on dag.html (#28643)

Fix UI caret direction (#28624)

Guard not-yet-expanded ti in trigger rule dep (#28592)

Move TI setNote endpoints under TaskInstance in OpenAPI (#28566)

Consider previous run in CronTriggerTimetable (#28532)

Ensure correct log dir in file task handler (#28477)

Fix bad pods pickled in executor_config (#28454)

Add ensure_ascii=False in trigger dag run API (#28451)

Add setters to MappedOperator on_*_callbacks (#28313)

Fix ti._try_number for deferred and up_for_reschedule tasks (#26993)

separate callModal from dag.js (#28410)

A manual run can't look like a scheduled one (#28397)

Dont show task/run durations when there is no start_date (#28395)

Maintain manual scroll position in task logs (#28386)

Correctly select a mapped task's "previous" task (#28379)

Trigger gevent monkeypatching via environment variable (#28283)

Fix db clean warnings (#28243)

Make arguments 'offset' and 'length' not required (#28234)

Make live logs reading work for "other" k8s executors (#28213)

Add custom pickling hooks to LazyXComAccess (#28191)

fix next run datasets error (#28165)

Ensure that warnings from @dag decorator are reported in dag file (#28153)

Do not warn when airflow dags tests command is used (#28138)

Ensure the dagbag_size metric decreases when files are deleted (#28135)

Improve run/task grid view actions (#28130)

Make BaseJob.most_recent_job favor "running" jobs (#28119)

Don't emit FutureWarning when code not calling old key (#28109)

Add airflow.api.auth.backend.session to backend sessions in compose (#28094)

Resolve false warning about calling conf.get on moved item (#28075)

Return list of tasks that will be changed (#28066)

Handle bad zip files nicely when parsing DAGs. (#28011)

Prevent double loading of providers from local paths (#27988)

Fix deadlock when chaining multiple empty mapped tasks (#27964)

fix: current_state method on TaskInstance doesn't filter by map_index (#27898)

Don't log CLI actions if db not initialized (#27851)

Make sure we can get out of a faulty scheduler state (#27834)

dagrun, next_dagruns_to_examine, add MySQL index hint (#27821)

Handle DAG disappearing mid-flight when dag verification happens (#27720)

fix: continue checking sla (#26968)

Allow generation of connection URI to work when no conn type (#26765)

Misc/Internal

Remove limit for dnspython after eventlet got fixed (#29004)

Limit dnspython to < 2.3.0 until eventlet incompatibility is solved (#28962)

Add automated version replacement in example dag indexes (#28090)

Cleanup and do housekeeping with plugin examples (#28537)

Limit SQLAlchemy to below 2.0 (#28725)

Bump json5 from 1.0.1 to 1.0.2 in /airflow/www (#28715)

Fix some docs on using sensors with taskflow (#28708)

Change Architecture and OperatingSystem classes into Enums (#28627)

Add doc-strings and small improvement to email util (#28634)

Fix Connection.get_extra type (#28594)

navbar, cap dropdown size, and add scroll bar (#28561)

Emit warnings for conf.get* from the right source location (#28543)

Move MyPY plugins of ours to dev folder (#28498)

Add retry to purge_inactive_dag_warnings (#28481)

Re-enable Plyvel on ARM as it now builds cleanly (#28443)

Add SIGUSR2 handler for LocalTaskJob and workers to aid debugging (#28309)

Convert test_task_command to Pytest and unquarantine tests in it (#28247)

Make invalid characters exception more readable (#28181)

Bump decode-uri-component from 0.2.0 to 0.2.2 in /airflow/www (#28080)

Use asserts instead of exceptions for executor not started (#28019)

Simplify dataset subgraph logic (#27987)

Order TIs by map_index (#27904)

Additional info about Segmentation Fault in LocalTaskJob (#27381)

Doc Only Changes

Mention mapped operator in cluster policy doc (#28885)

Slightly improve description of Dynamic DAG generation preamble (#28650)

Restructure Docs (#27235)

Update scheduler docs about low priority tasks (#28831)

Clarify that versioned constraints are fixed at release time (#28762)

Clarify about docker compose (#28729)

Adding an example dag for dynamic task mapping (#28325)

Use docker compose v2 command (#28605)

Add AIRFLOW_PROJ_DIR to docker-compose example (#28517)

Remove outdated Optional Provider Feature outdated documentation (#28506)

Add documentation for [core] mp_start_method config (#27993)

Documentation for the LocalTaskJob return code counter (#27972)

Note which versions of Python are supported (#27798)

One column per quarter.

2.5.1rc218 Jan 2023pre-release

Nothing published for this version

2.5.1rc114 Jan 2023pre-release

Nothing published for this version

2.5.02 Dec 2022Deprecated

Deprecate use of core get_kube_client in PodManager

New Features

TaskRunner: notify of component start and finish (#27855)
Add DagRun state change to the Listener plugin system(#27113)
Metric for raw task return codes (#27155)
Add logic for XComArg to pull specific map indexes (#27771)
Clear TaskGroup (#26658, #28003)
Add critical section query duration metric (#27700)
Add: #23880 :: Audit log for AirflowModelViews(Variables/Connection) (#24079, #27994, #27923)
Add postgres 15 support (#27444)
Expand tasks in mapped group at run time (#27491)
reset commits, clean submodules (#27560)
scheduler_job, add metric for scheduler loop timer (#27605)
Allow datasets to be used in taskflow (#27540)
Add expanded_ti_count to ti context (#27680)
Add user comment to task instance and dag run (#26457, #27849, #27867)
Enable copying DagRun JSON to clipboard (#27639)
Implement extra controls for SLAs (#27557)
add dag parsed time in DAG view (#27573)
Add max_wait for exponential_backoff in BaseSensor (#27597)
Expand tasks in mapped group at parse time (#27158)
Add disable retry flag on backfill (#23829)
Adding sensor decorator (#22562)
Api endpoint update ti (#26165)
Filtering datasets by recent update events (#26942)
Support Is /not Null filter for value is None on webui (#26584)
Add search to datasets list (#26893)
Split out and handle 'params' in mapped operator (#26100)
Add authoring API for TaskGroup mapping (#26844)
Add one_done trigger rule (#26146)
Create a more efficient airflow dag test command that also has better local logging (#26400)
Support add/remove permissions to roles commands (#26338)
Auto tail file logs in Web UI (#26169)
Add triggerer info to task instance in API (#26249)
Flag to deserialize value on custom XCom backend (#26343)

Improvements

Allow depth-first execution (#27827)
UI: Update offset height if data changes (#27865)
Improve TriggerRuleDep typing and readability (#27810)
Make views requiring session, keyword only args (#27790)
Optimize TI.xcom_pull() with explicit task_ids and map_indexes (#27699)
Allow hyphens in pod id used by k8s executor (#27737)
optimise task instances filtering (#27102)
Use context managers to simplify log serve management (#27756)
Fix formatting leftovers (#27750)
Improve task deadlock messaging (#27734)
Improve "sensor timeout" messaging (#27733)
Replace urlparse with urlsplit (#27389)
Align TaskGroup semantics to AbstractOperator (#27723)
Add new files to parsing queue on every loop of dag processing (#27060)
Make Kubernetes Executor & Scheduler resilient to error during PMH execution (#27611)
Separate dataset deps into individual graphs (#27356)
Use log.exception where more economical than log.error (#27517)
Move validation branch_task_ids into SkipMixin (#27434)
Coerce LazyXComAccess to list when pushed to XCom (#27251)
Update cluster-policies.rst docs (#27362)
Add warning if connection type already registered within the provider (#27520)
Activate debug logging in commands with --verbose option (#27447)
Add classic examples for Python Operators (#27403)
change .first() to .scalar() (#27323)
Improve reset_dag_run description (#26755)
Add examples and howtos about sensors (#27333)
Make grid view widths adjustable (#27273)
Sorting plugins custom menu links by category before name (#27152)
Simplify DagRun.verify_integrity (#26894)
Add mapped task group info to serialization (#27027)
Correct the JSON style used for Run config in Grid View (#27119)
No extra__conn_type__ prefix required for UI behaviors (#26995)
Improve dataset update blurb (#26878)
Rename kubernetes config section to kubernetes_executor (#26873)
decode params for dataset searches (#26941)
Get rid of the DAGRun details page & rely completely on Grid (#26837)
Fix scheduler crashloopbackoff when using hostname_callable (#24999)
Reduce log verbosity in KubernetesExecutor. (#26582)
Don't iterate tis list twice for no reason (#26740)
Clearer code for PodGenerator.deserialize_model_file (#26641)
Don't import kubernetes unless you have a V1Pod (#26496)
Add updated_at column to DagRun and Ti tables (#26252)
Move the deserialization of custom XCom Backend to 2.4.0 (#26392)
Avoid calculating all elements when one item is needed (#26377)
Add __future__.annotations automatically by isort (#26383)
Handle list when serializing expand_kwargs (#26369)
Apply PEP-563 (Postponed Evaluation of Annotations) to core airflow (#26290)
Add more weekday operator and sensor examples #26071 (#26098)
Align TaskGroup semantics to AbstractOperator (#27723)

Bug Fixes

Gracefully handle whole config sections being renamed (#28008)
Add allow list for imports during deserialization (#27887)
Soft delete datasets that are no longer referenced in DAG schedules or task outlets (#27828)
Redirect to home view when there are no valid tags in the URL (#25715)
Refresh next run datasets info in dags view (#27839)
Make MappedTaskGroup depend on its expand inputs (#27876)
Make DagRun state updates for paused DAGs faster (#27725)
Don't explicitly set include_examples to False on task run command (#27813)
Fix menu border color (#27789)
Fix backfill queued task getting reset to scheduled state. (#23720)
Fix clearing child dag mapped tasks from parent dag (#27501)
Handle json encoding of V1Pod in task callback (#27609)
Fix ExternalTaskSensor can't check zipped dag (#27056)
Avoid re-fetching DAG run in TriggerDagRunOperator (#27635)
Continue on exception when retrieving metadata (#27665)
External task sensor fail fix (#27190)
Add the default None when pop actions (#27537)
Display parameter values from serialized dag in trigger dag view. (#27482, #27944)
Move TriggerDagRun conf check to execute (#27035)
Resolve trigger assignment race condition (#27072)
Update google_analytics.html (#27226)
Fix some bug in web ui dags list page (auto-refresh & jump search null state) (#27141)
Fixed broken URL for docker-compose.yaml (#26721)
Fix xcom arg.py .zip bug (#26636)
Fix 404 taskInstance errors and split into two tables (#26575)
Fix browser warning of improper thread usage (#26551)
template rendering issue fix (#26390)
Clear autoregistered DAGs if there are any import errors (#26398)
Fix from airflow import version lazy import (#26239)
allow scroll in triggered dag runs modal (#27965)

Misc/Internal

Remove is_mapped attribute (#27881)
Simplify FAB table resetting (#27869)
Fix old-style typing in Base Sensor (#27871)
Switch (back) to late imports (#27730)
Completed D400 for multiple folders (#27748)
simplify notes accordion test (#27757)
completed D400 for airflow/callbacks/* airflow/cli/* (#27721)
Completed D400 for airflow/api_connexion/* directory (#27718)
Completed D400 for airflow/listener/* directory (#27731)
Completed D400 for airflow/lineage/* directory (#27732)
Update API & Python Client versions (#27642)
Completed D400 & D401 for airflow/api/* directory (#27716)
Completed D400 for multiple folders (#27722)
Bump minimatch from 3.0.4 to 3.0.8 in /airflow/www (#27688)
Bump loader-utils from 1.4.1 to 1.4.2 in /airflow/www (#27697)
Disable nested task mapping for now (#27681)
bump alembic minimum version (#27629)
remove unused code.html (#27585)
Enable python string normalization everywhere (#27588)
Upgrade dependencies in order to avoid backtracking (#27531)
Strengthen a bit and clarify importance of triaging issues (#27262)
Deduplicate type hints (#27508)
Add stub 'yield' to BaseTrigger.run (#27416)
Remove upper-bound limit to dask (#27415)
Limit Dask to under 2022.10.1 (#27383)
Update old style typing (#26872)
Enable string normalization for docs (#27269)
Slightly faster up/downgrade tests (#26939)
Deprecate use of core get_kube_client in PodManager (#26848)
Add memray files to gitignore / dockerignore (#27001)
Bump sphinx and sphinx-autoapi (#26743)
Simplify RTIF.delete_old_records() (#26667)
migrate last react files to typescript (#26112)
Work around pyupgrade edge cases (#26384)

Doc only changes

Document dag_file_processor_timeouts metric as deprecated (#27067)
Drop support for PostgreSQL 10 (#27594)
Update index.rst (#27529)
Add note about pushing the lazy XCom proxy to XCom (#27250)
Fix BaseOperator link (#27441)
[docs] best-practices add use variable with template example. (#27316)
docs for custom view using plugin (#27244)
Update graph view and grid view on overview page (#26909)
Documentation fixes (#26819)
make consistency on markup title string level (#26696)
Add documentation to dag test function (#26713)
Fix broken URL for docker-compose.yaml (#26726)
Add a note against use of top level code in timetable (#26649)
Fix example_datasets dag names (#26495)
Update docs: zip-like effect is now possible in task mapping (#26435)
changing to task decorator in docs from classic operator use (#25711)

Open source →

Additional notes2 sources agree

Significant Changes

airflow dags test no longer performs a backfill job (#26400)

In order to make airflow dags test more useful as a testing and debugging tool, we no longer run a backfill job and instead run a "local task runner". Users can still backfill their DAGs using the airflow dags backfill command.

Airflow config section kubernetes renamed to kubernetes_executor (#26873)

KubernetesPodOperator no longer considers any core kubernetes config params, so this section now only applies to kubernetes executor. Renaming it reduces potential for confusion.

AirflowException is now thrown as soon as any dependent tasks of ExternalTaskSensor fails (#27190)

ExternalTaskSensor no longer hangs indefinitely when failed_states is set, an execute_date_fn is used, and some but not all of the dependent tasks fail. Instead, an AirflowException is thrown as soon as any of the dependent tasks fail. Any code handling this failure in addition to timeouts should move to caching the AirflowException BaseClass and not only the AirflowSensorTimeout subclass.

The Airflow config option scheduler.deactivate_stale_dags_interval has been renamed to scheduler.parsing_cleanup_interval (#27828).

The old option will continue to work but will issue deprecation warnings, and will be removed entirely in Airflow 3.

New Features

TaskRunner: notify of component start and finish (#27855)
Add DagRun state change to the Listener plugin system(#27113)
Metric for raw task return codes (#27155)
Add logic for XComArg to pull specific map indexes (#27771)
Clear TaskGroup (#26658, #28003)
Add critical section query duration metric (#27700)
Add: #23880 :: Audit log for AirflowModelViews(Variables/Connection) (#24079, #27994, #27923)
Add postgres 15 support (#27444)
Expand tasks in mapped group at run time (#27491)
reset commits, clean submodules (#27560)
scheduler_job, add metric for scheduler loop timer (#27605)
Allow datasets to be used in taskflow (#27540)
Add expanded_ti_count to ti context (#27680)
Add user comment to task instance and dag run (#26457, #27849, #27867)
Enable copying DagRun JSON to clipboard (#27639)
Implement extra controls for SLAs (#27557)
add dag parsed time in DAG view (#27573)
Add max_wait for exponential_backoff in BaseSensor (#27597)
Expand tasks in mapped group at parse time (#27158)
Add disable retry flag on backfill (#23829)
Adding sensor decorator (#22562)
Api endpoint update ti (#26165)
Filtering datasets by recent update events (#26942)
Support Is /not Null filter for value is None on webui (#26584)
Add search to datasets list (#26893)
Split out and handle 'params' in mapped operator (#26100)
Add authoring API for TaskGroup mapping (#26844)
Add one_done trigger rule (#26146)
Create a more efficient airflow dag test command that also has better local logging (#26400)
Support add/remove permissions to roles commands (#26338)
Auto tail file logs in Web UI (#26169)
Add triggerer info to task instance in API (#26249)
Flag to deserialize value on custom XCom backend (#26343)

Improvements

Allow depth-first execution (#27827)
UI: Update offset height if data changes (#27865)
Improve TriggerRuleDep typing and readability (#27810)
Make views requiring session, keyword only args (#27790)
Optimize TI.xcom_pull() with explicit task_ids and map_indexes (#27699)
Allow hyphens in pod id used by k8s executor (#27737)
optimise task instances filtering (#27102)
Use context managers to simplify log serve management (#27756)
Fix formatting leftovers (#27750)
Improve task deadlock messaging (#27734)
Improve "sensor timeout" messaging (#27733)
Replace urlparse with urlsplit (#27389)
Align TaskGroup semantics to AbstractOperator (#27723)
Add new files to parsing queue on every loop of dag processing (#27060)
Make Kubernetes Executor & Scheduler resilient to error during PMH execution (#27611)
Separate dataset deps into individual graphs (#27356)
Use log.exception where more economical than log.error (#27517)
Move validation branch_task_ids into SkipMixin (#27434)
Coerce LazyXComAccess to list when pushed to XCom (#27251)
Update cluster-policies.rst docs (#27362)
Add warning if connection type already registered within the provider (#27520)
Activate debug logging in commands with --verbose option (#27447)
Add classic examples for Python Operators (#27403)
change .first() to .scalar() (#27323)
Improve reset_dag_run description (#26755)
Add examples and howtos about sensors (#27333)
Make grid view widths adjustable (#27273)
Sorting plugins custom menu links by category before name (#27152)
Simplify DagRun.verify_integrity (#26894)
Add mapped task group info to serialization (#27027)
Correct the JSON style used for Run config in Grid View (#27119)
No extra__conn_type__ prefix required for UI behaviors (#26995)
Improve dataset update blurb (#26878)
Rename kubernetes config section to kubernetes_executor (#26873)
decode params for dataset searches (#26941)
Get rid of the DAGRun details page & rely completely on Grid (#26837)
Fix scheduler crashloopbackoff when using hostname_callable (#24999)
Reduce log verbosity in KubernetesExecutor. (#26582)
Don't iterate tis list twice for no reason (#26740)
Clearer code for PodGenerator.deserialize_model_file (#26641)
Don't import kubernetes unless you have a V1Pod (#26496)
Add updated_at column to DagRun and Ti tables (#26252)
Move the deserialization of custom XCom Backend to 2.4.0 (#26392)
Avoid calculating all elements when one item is needed (#26377)
Add __future__.annotations automatically by isort (#26383)
Handle list when serializing expand_kwargs (#26369)
Apply PEP-563 (Postponed Evaluation of Annotations) to core airflow (#26290)
Add more weekday operator and sensor examples #26071 (#26098)
Align TaskGroup semantics to AbstractOperator (#27723)

Bug Fixes

Gracefully handle whole config sections being renamed (#28008)
Add allow list for imports during deserialization (#27887)
Soft delete datasets that are no longer referenced in DAG schedules or task outlets (#27828)
Redirect to home view when there are no valid tags in the URL (#25715)
Refresh next run datasets info in dags view (#27839)
Make MappedTaskGroup depend on its expand inputs (#27876)
Make DagRun state updates for paused DAGs faster (#27725)
Don't explicitly set include_examples to False on task run command (#27813)
Fix menu border color (#27789)
Fix backfill queued task getting reset to scheduled state. (#23720)
Fix clearing child dag mapped tasks from parent dag (#27501)
Handle json encoding of V1Pod in task callback (#27609)
Fix ExternalTaskSensor can't check zipped dag (#27056)
Avoid re-fetching DAG run in TriggerDagRunOperator (#27635)
Continue on exception when retrieving metadata (#27665)
External task sensor fail fix (#27190)
Add the default None when pop actions (#27537)
Display parameter values from serialized dag in trigger dag view. (#27482, #27944)
Move TriggerDagRun conf check to execute (#27035)
Resolve trigger assignment race condition (#27072)
Update google_analytics.html (#27226)
Fix some bug in web ui dags list page (auto-refresh & jump search null state) (#27141)
Fixed broken URL for docker-compose.yaml (#26721)
Fix xcom arg.py .zip bug (#26636)
Fix 404 taskInstance errors and split into two tables (#26575)
Fix browser warning of improper thread usage (#26551)
template rendering issue fix (#26390)
Clear autoregistered DAGs if there are any import errors (#26398)
Fix from airflow import version lazy import (#26239)
allow scroll in triggered dag runs modal (#27965)

Misc/Internal

Remove is_mapped attribute (#27881)
Simplify FAB table resetting (#27869)
Fix old-style typing in Base Sensor (#27871)
Switch (back) to late imports (#27730)
Completed D400 for multiple folders (#27748)
simplify notes accordion test (#27757)
completed D400 for airflow/callbacks/* airflow/cli/* (#27721)
Completed D400 for airflow/api_connexion/* directory (#27718)
Completed D400 for airflow/listener/* directory (#27731)
Completed D400 for airflow/lineage/* directory (#27732)
Update API & Python Client versions (#27642)
Completed D400 & D401 for airflow/api/* directory (#27716)
Completed D400 for multiple folders (#27722)
Bump minimatch from 3.0.4 to 3.0.8 in /airflow/www (#27688)
Bump loader-utils from 1.4.1 to 1.4.2 ``in ``/airflow/www (#27697)
Disable nested task mapping for now (#27681)
bump alembic minimum version (#27629)
remove unused code.html (#27585)
Enable python string normalization everywhere (#27588)
Upgrade dependencies in order to avoid backtracking (#27531)
Strengthen a bit and clarify importance of triaging issues (#27262)
Deduplicate type hints (#27508)
Add stub 'yield' to BaseTrigger.run (#27416)
Remove upper-bound limit to dask (#27415)
Limit Dask to under 2022.10.1 (#27383)
Update old style typing (#26872)
Enable string normalization for docs (#27269)
Slightly faster up/downgrade tests (#26939)
Deprecate use of core get_kube_client in PodManager (#26848)
Add memray files to gitignore / dockerignore (#27001)
Bump sphinx and sphinx-autoapi (#26743)
Simplify RTIF.delete_old_records() (#26667)
migrate last react files to typescript (#26112)
Work around pyupgrade edge cases (#26384)

Doc only changes

Document dag_file_processor_timeouts metric as deprecated (#27067)
Drop support for PostgreSQL 10 (#27594)
Update index.rst (#27529)
Add note about pushing the lazy XCom proxy to XCom (#27250)
Fix BaseOperator link (#27441)
[docs] best-practices add use variable with template example. (#27316)
docs for custom view using plugin (#27244)
Update graph view and grid view on overview page (#26909)
Documentation fixes (#26819)
make consistency on markup title string level (#26696)
Add documentation to dag test function (#26713)
Fix broken URL for docker-compose.yaml (#26726)
Add a note against use of top level code in timetable (#26649)
Fix example_datasets dag names (#26495)
Update docs: zip-like effect is now possible in task mapping (#26435)
changing to task decorator in docs from classic operator use (#25711)

2.5.0rc31 Dec 2022pre-release

Nothing published for this version

2.5.0rc227 Nov 2022pre-release

Nothing published for this version

2.5.0rc126 Nov 2022pre-release

Nothing published for this version

2.4.314 Nov 2022

Fix double logging with some task logging handler

Bug Fixes

Fix double logging with some task logging handler (#27591)
Replace FAB url filtering function with Airflow's (#27576)
Fix mini scheduler expansion of mapped task (#27506)
SLAMiss is nullable and not always given back when pulling task instances (#27423)
Fix behavior of _ when searching for DAGs (#27448)
Fix getting the dag/task ids from BaseExecutor (#27550)
Fix SQLAlchemy primary key black-out error on DDRQ (#27538)
Fix IntegrityError during webserver startup (#27297)
Add case insensitive constraint to username (#27266)
Fix python external template keys (#27256)
Reduce extraneous task log requests (#27233)
Make RotatingFilehandler used in DagProcessor non-caching (#27223)
Listener: Set task on SQLAlchemy TaskInstance object (#27167)
Fix dags list page auto-refresh & jump search null state (#27141)
Set executor.job_id to BackfillJob.id for backfills (#27020)

Misc/Internal

Bump loader-utils from 1.4.0 to 1.4.1 in /airflow/www (#27552)
Reduce log level for k8s TCP_KEEPALIVE etc warnings (#26981)

Doc only changes

Use correct executable in docker compose docs (#27529)
Fix wording in DAG Runs description (#27470)
Document that KubernetesExecutor overwrites container args (#27450)
Fix BaseOperator links (#27441)
Correct timer units to seconds from milliseconds. (#27360)
Add missed import in the Trigger Rules example (#27309)
Update SLA wording to reflect it is relative to Dag Run start. (#27111)
Add kerberos environment variables to the docs (#27028)

Open source →

2.4.3rc111 Nov 2022pre-release

Nothing published for this version

2.4.224 Oct 2022

Add missing AUTOINC/SERIAL for FAB tables

Bug Fixes

Make tracebacks opt-in (#27059)
Add missing AUTOINC/SERIAL for FAB tables (#26885)
Add separate error handler for 405(Method not allowed) errors (#26880)
Don't re-patch pods that are already controlled by current worker (#26778)
Handle mapped tasks in task duration chart (#26722)
Fix task duration cumulative chart (#26717)
Avoid 500 on dag redirect (#27064)
Filter dataset dependency data on webserver (#27046)
Remove double collection of dags in airflow dags reserialize (#27030)
Fix auto refresh for graph view (#26926)
Don't overwrite connection extra with invalid json (#27142)
Fix next run dataset modal links (#26897)
Change dag audit log sort by date from asc to desc (#26895)
Bump min version of jinja2 (#26866)
Add missing colors to state_color_mapping jinja global (#26822)
Fix running debuggers inside airflow tasks test (#26806)
Fix warning when using xcomarg dependencies (#26801)
demote Removed state in priority for displaying task summaries (#26789)
Ensure the log messages from operators during parsing go somewhere (#26779)
Add restarting state to TaskState Enum in REST API (#26776)
Allow retrieving error message from data.detail (#26762)
Simplify origin string cleaning (#27143)
Remove DAG parsing from StandardTaskRunner (#26750)
Fix non-hidden cumulative chart on duration view (#26716)
Remove TaskFail duplicates check (#26714)
Fix airflow tasks run --local when dags_folder differs from that of processor (#26509)
Fix yarn warning from d3-color (#27139)
Fix version for a couple configurations (#26491)
Revert "No grid auto-refresh for backfill dag runs (#25042)" (#26463)
Retry on Airflow Schedule DAG Run DB Deadlock (#26347)

Misc/Internal

Clean-ups around task-mapping code (#26879)
Move user-facing string to template (#26815)
add icon legend to datasets graph (#26781)
Bump sphinx and sphinx-autoapi (#26743)
Simplify RTIF.delete_old_records() (#26667)
Bump FAB to 4.1.4 (#26393)

Doc only changes

Fixed triple quotes in task group example (#26829)
Documentation fixes (#26819)
make consistency on markup title string level (#26696)
Add a note against use of top level code in timetable (#26649)
Fix broken URL for docker-compose.yaml (#26726)

Open source →

2.4.2rc120 Oct 2022pre-release

Nothing published for this version

2.4.130 Sept 2022Deprecated

Resolve deprecation warning re Table.exists()

Bug Fixes

When rendering template, unmap task in context (#26702)
Fix scroll overflow for ConfirmDialog (#26681)
Resolve deprecation warning re Table.exists() (#26616)
Fix XComArg zip bug (#26636)
Use COALESCE when ordering runs to handle NULL (#26626)
Check user is active (#26635)
No missing user warning for public admin (#26611)
Allow MapXComArg to resolve after serialization (#26591)
Resolve warning about DISTINCT ON query on dags view (#26608)
Log warning when secret backend kwargs is invalid (#26580)
Fix grid view log try numbers (#26556)
Template rendering issue in passing templates_dict to task decorator (#26390)
Fix Deferrable stuck as scheduled during backfill (#26205)
Suppress SQLALCHEMY_TRACK_MODIFICATIONS warning in db init (#26617)
Correctly set json_provider_class on Flask app so it uses our encoder (#26554)
Fix WSGI root app (#26549)
Fix deadlock when mapped task with removed upstream is rerun (#26518)
ExecutorConfigType should be cacheable (#26498)
Fix proper joining of the path for logs retrieved from celery workers (#26493)
DAG Deps extends base_template (#26439)
Don't update backfill run from the scheduler (#26342)

Doc only changes

Clarify owner links document (#26515)
Fix invalid RST in dataset concepts doc (#26434)
Document the non-sensitive-only option for expose_config (#26507)
Fix example_datasets dag names (#26495)
Zip-like effect is now possible in task mapping (#26435)
Use task decorator in docs instead of classic operators (#25711)

Open source →

2.4.1rc127 Sept 2022pre-release

Nothing published for this version

2.4.019 Sept 2022Deprecated

Remove remaining deprecated classes and replace them with PEP562

New Features

Add Data-aware Scheduling (https://github.com/apache/airflow/pulls?q=is%3Apr+is%3Amerged+label%3AAIP-48+milestone%3A%22Airflow+2.4.0%22)
Add @task.short_circuit TaskFlow decorator (#25752)
Make execution_date_or_run_id optional in tasks test command (#26114)
Automatically register DAGs that are used in a context manager (#23592, #26398)
Add option of sending DAG parser logs to stdout. (#25754)
Support multiple DagProcessors parsing files from different locations. (#25935)
Implement ExternalPythonOperator (#25780)
Make execution_date optional for command dags test (#26111)
Implement expand_kwargs() against a literal list (#25925)
Add trigger rule tooltip (#26043)
Add conf parameter to CLI for airflow dags test (#25900)
Include scheduled slots in pools view (#26006)
Add output property to MappedOperator (#25604)
Add roles delete command to cli (#25854)
Add Airflow specific warning classes (#25799)
Add support for TaskGroup in ExternalTaskSensor (#24902)
Add @task.kubernetes taskflow decorator (#25663)
Add a way to import Airflow without side-effects (#25832)
Let timetables control generated run_ids. (#25795)
Allow per-timetable ordering override in grid view (#25633)
Grid logs for mapped instances (#25610, #25621, #25611)
Consolidate to one schedule param (#25410)
DAG regex flag in backfill command (#23870)
Adding support for owner links in the Dags view UI (#25280)
Ability to clear a specific DAG Run's task instances via REST API (#23516)
Possibility to document DAG with a separate markdown file (#25509)
Add parsing context to DAG Parsing (#25161)
Implement CronTriggerTimetable (#23662)
Add option to mask sensitive data in UI configuration page (#25346)
Create new databases from the ORM (#24156)
Implement XComArg.zip(*xcom_args) (#25176)
Introduce sla_miss metric (#23402)
Implement map() semantic (#25085)
Add override method to TaskGroupDecorator (#25160)
Implement expand_kwargs() (#24989)
Add parameter to turn off SQL query logging (#24570)
Add DagWarning model, and a check for missing pools (#23317)
Add Task Logs to Grid details panel (#24249)
Added small health check server and endpoint in scheduler(#23905)
Add built-in External Link for ExternalTaskMarker operator (#23964)
Add default task retry delay config (#23861)
Add clear DagRun endpoint. (#23451)
Add support for timezone as string in cron interval timetable (#23279)
Add auto-refresh to dags home page (#22900, #24770)

Improvements

Add more weekday operator and sensor examples #26071 (#26098)
Add subdir parameter to dags reserialize command (#26170)
Update zombie message to be more descriptive (#26141)
Only send an SlaCallbackRequest if the DAG is scheduled (#26089)
Promote Operator.output more (#25617)
Upgrade API files to typescript (#25098)
Less hacky double-rendering prevention in mapped task (#25924)
Improve Audit log (#25856)
Remove mapped operator validation code (#25870)
More DAG(schedule=...) improvements (#25648)
Reduce operator_name dupe in serialized JSON (#25819)
Make grid view group/mapped summary UI more consistent (#25723)
Remove useless statement in task_group_to_grid (#25654)
Add optional data interval to CronTriggerTimetable (#25503)
Remove unused code in /grid endpoint (#25481)
Add and document description fields (#25370)
Improve Airflow logging for operator Jinja template processing (#25452)
Update core example DAGs to use @task.branch decorator (#25242)
Update DAG audit_log route (#25415)
Change stdout and stderr access mode to append in commands (#25253)
Remove getTasks from Grid view (#25359)
Improve taskflow type hints with ParamSpec (#25173)
Use tables in grid details panes (#25258)
Explicitly list @dag arguments (#25044)
More typing in SchedulerJob and TaskInstance (#24912)
Patch getfqdn with more resilient version (#24981)
Replace all NBSP characters by whitespaces (#24797)
Re-serialize all DAGs on airflow db upgrade (#24518)
Rework contract of try_adopt_task_instances method (#23188)
Make expand() error vague so it's not misleading (#24018)
Add enum validation for [webserver]analytics_tool (#24032)
Add dttm searchable field in audit log (#23794)
Allow more parameters to be piped through via execute_in_subprocess (#23286)
Use func.count to count rows (#23657)
Remove stale serialized dags (#22917)
AIP45 Remove dag parsing in airflow run local (#21877)
Add support for queued state in DagRun update endpoint. (#23481)
Add fields to dagrun endpoint (#23440)
Use sql_alchemy_conn for celery result backend when result_backend is not set (#24496)

Bug Fixes

Have consistent types between the ORM and the migration files (#24044, #25869)
Disallow any dag tags longer than 100 char (#25196)
Add the dag_id to AirflowDagCycleException message (#26204)
Properly build URL to retrieve logs independently from system (#26337)
For worker log servers only bind to IPV6 when dual stack is available (#26222)
Fix TaskInstance.task not defined before handle_failure (#26040)
Undo secrets backend config caching (#26223)
Fix faulty executor config serialization logic (#26191)
Show DAGs and Datasets menu links based on role permission (#26183)
Allow setting TaskGroup tooltip via function docstring (#26028)
Fix RecursionError on graph view of a DAG with many tasks (#26175)
Fix backfill occasional deadlocking (#26161)
Fix DagRun.start_date not set during backfill with --reset-dagruns True (#26135)
Use label instead of id for dynamic task labels in graph (#26108)
Don't fail DagRun when leaf mapped_task is SKIPPED (#25995)
Add group prefix to decorated mapped task (#26081)
Fix UI flash when triggering with dup logical date (#26094)
Fix Make items nullable for TaskInstance related endpoints to avoid API errors (#26076)
Fix BranchDateTimeOperator to be timezone-awreness-insensitive (#25944)
Fix legacy timetable schedule interval params (#25999)
Fix response schema for list-mapped-task-instance (#25965)
Properly check the existence of missing mapped TIs (#25788)
Fix broken auto-refresh on grid view (#25950)
Use per-timetable ordering in grid UI (#25880)
Rewrite recursion when parsing DAG into iteration (#25898)
Find cross-group tasks in iter_mapped_dependants (#25793)
Fail task if mapping upstream fails (#25757)
Support / in variable get endpoint (#25774)
Use cfg default_wrap value for grid logs (#25731)
Add origin request args when triggering a run (#25729)
Operator name separate from class (#22834)
Fix incorrect data interval alignment due to assumption on input time alignment (#22658)
Return None if an XComArg fails to resolve (#25661)
Correct json arg help in airflow variables set command (#25726)
Added MySQL index hint to use ti_state on find_zombies query (#25725)
Only excluded actually expanded fields from render (#25599)
Grid, fix toast for axios errors (#25703)
Fix UI redirect (#26409)
Require dag_id arg for dags list-runs (#26357)
Check for queued states for dags auto-refresh (#25695)
Fix upgrade code for the dag_owner_attributes table (#25579)
Add map index to task logs api (#25568)
Ensure that zombie tasks for dags with errors get cleaned up (#25550)
Make extra link work in UI (#25500)
Sync up plugin API schema and definition (#25524)
First/last names can be empty (#25476)
Refactor DAG pages to be consistent (#25402)
Check expand_kwargs() input type before unmapping (#25355)
Filter XCOM by key when calculating map lengths (#24530)
Fix ExternalTaskSensor not working with dynamic task (#25215)
Added exception catching to send default email if template file raises any exception (#24943)
Bring MappedOperator members in sync with BaseOperator (#24034)

Misc/Internal

Add automatically generated ERD schema for the MetaData DB (#26217)
Mark serialization functions as internal (#26193)
Remove remaining deprecated classes and replace them with PEP562 (#26167)
Move dag_edges and task_group_to_dict to corresponding util modules (#26212)
Lazily import many modules to improve import speed (#24486, #26239)
FIX Incorrect typing information (#26077)
Add missing contrib classes to deprecated dictionaries (#26179)
Re-configure/connect the ORM after forking to run a DAG processor (#26216)
Remove cattrs from lineage processing. (#26134)
Removed deprecated contrib files and replace them with PEP-562 getattr (#26153)
Make BaseSerialization.serialize "public" to other classes. (#26142)
Change the template to use human readable task_instance description (#25960)
Bump moment-timezone from 0.5.34 to 0.5.35 in /airflow/www (#26080)
Fix Flask deprecation warning (#25753)
Add CamelCase to generated operations types (#25887)
Fix migration issues and tighten the CI upgrade/downgrade test (#25869)
Fix type annotations in SkipMixin (#25864)
Workaround setuptools editable packages path issue (#25848)
Bump undici from 5.8.0 to 5.9.1 in /airflow/www (#25801)
Add custom_operator_name attr to _BranchPythonDecoratedOperator (#25783)
Clarify filename_template deprecation message (#25749)
Use ParamSpec to replace ... in Callable (#25658)
Remove deprecated modules (#25543)
Documentation on task mapping additions (#24489)
Remove Smart Sensors (#25507)
Fix elasticsearch test config to avoid warning on deprecated template (#25520)
Bump terser from 4.8.0 to 4.8.1 in /airflow/ui (#25178)
Generate typescript types from rest API docs (#25123)
Upgrade utils files to typescript (#25089)
Upgrade remaining context file to typescript. (#25096)
Migrate files to ts (#25267)
Upgrade grid Table component to ts. (#25074)
Skip mapping against mapped ti if it returns None (#25047)
Refactor js file structure (#25003)
Move mapped kwargs introspection to separate type (#24971)
Only assert stuff for mypy when type checking (#24937)
Bump moment from 2.29.3 to 2.29.4 in /airflow/www (#24885)
Remove "bad characters" from our codebase (#24841)
Remove xcom_push flag from BashOperator (#24824)
Move Flask hook registration to end of file (#24776)
Upgrade more javascript files to typescript (#24715)
Clean up task decorator type hints and docstrings (#24667)
Preserve original order of providers' connection extra fields in UI (#24425)
Rename charts.css to chart.css (#24531)
Rename grid.css to chart.css (#24529)
Misc: create new process group by set_new_process_group utility (#24371)
Airflow UI fix Prototype Pollution (#24201)
Bump moto version (#24222)
Remove unused [github_enterprise] from ref docs (#24033)
Clean up f-strings in logging calls (#23597)
Add limit for JPype1 (#23847)
Simply json responses (#25518)
Add min attrs version (#26408)

Doc only changes

Add url prefix setting for Celery Flower (#25986)
Updating deprecated configuration in examples (#26037)
Fix wrong link for taskflow tutorial (#26007)
Reorganize tutorials into a section (#25890)
Fix concept doc for dynamic task map (#26002)
Update code examples from "classic" operators to taskflow (#25845, #25657)
Add instructions on manually fixing MySQL Charset problems (#25938)
Prefer the local Quick Start in docs (#25888)
Fix broken link to Trigger Rules (#25840)
Improve docker documentation (#25735)
Correctly link to Dag parsing context in docs (#25722)
Add note on task_instance_mutation_hook usage (#25607)
Note that TaskFlow API automatically passes data between tasks (#25577)
Update DAG run to clarify when a DAG actually runs (#25290)
Update tutorial docs to include a definition of operators (#25012)
Rewrite the Airflow documentation home page (#24795)
Fix task-generated mapping example (#23424)
Add note on subtle logical date change in 2.2.0 (#24413)
Add missing import in best-practices code example (#25391)

Open source →

2.4.0rc115 Sept 2022pre-release

Nothing published for this version

2.4.0b18 Sept 2022pre-release

Nothing published for this version

2.3.423 Aug 2022

Disable attrs state management on MappedOperator

Bug Fixes

Disable attrs state management on MappedOperator (#24772)
Serialize pod_override to JSON before pickling executor_config (#24356)
Fix pid check (#24636)
Rotate session id during login (#25771)
Fix mapped sensor with reschedule mode (#25594)
Cache the custom secrets backend so the same instance gets re-used (#25556)
Add right padding (#25554)
Fix reducing mapped length of a mapped task at runtime after a clear (#25531)
Fix airflow db reset when dangling tables exist (#25441)
Change disable_verify_ssl behaviour (#25023)
Set default task group in dag.add_task method (#25000)
Removed interfering force of index. (#25404)
Remove useless logging line (#25347)
Adding mysql index hint to use index on task_instance.state in critical section query (#25673)
Configurable umask to all daemonized processes. (#25664)
Fix the errors raised when None is passed to template filters (#25593)
Allow wildcarded CORS origins (#25553)
Fix "This Session's transaction has been rolled back" (#25532)
Fix Serialization error in TaskCallbackRequest (#25471)
fix - resolve bash by absolute path (#25331)
Add __repr__ to ParamsDict class (#25305)
Only load distribution of a name once (#25296)
convert TimeSensorAsync target_time to utc on call time (#25221)
call updateNodeLabels after expandGroup (#25217)
Stop SLA callbacks gazumping other callbacks and DOS'ing the DagProcessorManager queue (#25147)
Fix invalidateQueries call (#25097)
airflow/www/package.json: Add name, version fields. (#25065)
No grid auto-refresh for backfill dag runs (#25042)
Fix tag link on dag detail page (#24918)
Fix zombie task handling with multiple schedulers (#24906)
Bind log server on worker to IPv6 address (#24755) (#24846)
Add %z for %(asctime)s to fix timezone for logs on UI (#24811)
TriggerDagRunOperator.operator_extra_links is attr (#24676)
Send DAG timeout callbacks to processor outside of prohibit_commit (#24366)
Don't rely on current ORM structure for db clean command (#23574)
Clear next method when clearing TIs (#23929)
Two typing fixes (#25690)

Doc only changes

Update set-up-database.rst (#24983)
Fix syntax in mysql setup documentation (#24893 (#24939)
Note how DAG policy works with default_args (#24804)
Update PythonVirtualenvOperator Howto (#24782)
Doc: Add hyperlinks to Github PRs for Release Notes (#24532)

Misc/Internal

Remove depreciation warning when use default remote tasks logging handlers (#25764)
clearer method name in scheduler_job.py (#23702)
Bump cattrs version (#25689)
Include missing mention of external_executor_id in sql_engine_collation_for_ids docs (#25197)
Refactor DR.task_instance_scheduling_decisions (#24774)
Sort operator extra links (#24992)
Extends resolve_xcom_backend function level documentation (#24965)
Upgrade FAB to 4.1.3 (#24884)
Limit Flask to <2.3 in the wake of 2.2 breaking our tests (#25511)
Limit astroid version to < 2.12 (#24982)
Move javascript compilation to host (#25169)
Bump typing-extensions and mypy for ParamSpec (#25088)

Open source →

2.3.4rc120 Aug 2022pre-release

Nothing published for this version

2.3.39 Jul 2022Deprecated

Fix deprecated log_id_template value

Bug Fixes

Fix exception in mini task scheduler (#24865)
Fix cycle bug with attaching label to task group (#24847)
Fix timestamp defaults for sensorinstance (#24638)
Move fallible ti.task.dag assignment back inside try/except block (#24533) (#24592)
Add missing types to FSHook (#24470)
Mask secrets in stdout for airflow tasks test (#24362)
DebugExecutor use ti.run() instead of ti._run_raw_task (#24357)
Fix bugs in URI constructor for MySQL connection (#24320)
Missing scheduleinterval nullable true added in openapi (#24253)
Unify return_code interface for task runner (#24093)
Handle occasional deadlocks in trigger with retries (#24071)
Remove special serde logic for mapped op_kwargs (#23860)
ExternalTaskSensor respects soft_fail if the external task enters a failed_state (#23647)
Fix StatD timing metric units (#21106)
Add cache_ok flag to sqlalchemy TypeDecorators. (#24499)
Allow for LOGGING_LEVEL=DEBUG (#23360)
Fix grid date ticks (#24738, #24849)
Debounce status highlighting in Grid view (#24710)
Fix Grid vertical scrolling (#24684)
don't try to render child rows for closed groups (#24637)
Do not calculate grid root instances (#24528)
Maintain grid view selection on filtering upstream (#23779)
Speed up grid_data endpoint by 10x (#24284)
Apply per-run log templates to log handlers (#24153)
Don't crash scheduler if exec config has old k8s objects (#24117)
TI.log_url fix for map_index (#24335)
Fix migration 0080_2_0_2 - Replace null values before setting column not null (#24585)
Patch sql_alchemy_conn if old Postgres schemes used (#24569)
Seed log_template table (#24511)
Fix deprecated log_id_template value (#24506)
Fix toast messages (#24505)
Add indexes for CASCADE deletes for task_instance (#24488)
Return empty dict if Pod JSON encoding fails (#24478)
Improve grid rendering performance with a custom tooltip (#24417, #24449)
Check for run_id for grid group summaries (#24327)
Optimize calendar view for cron scheduled DAGs (#24262)
Use get_hostname instead of socket.getfqdn (#24260)
Check that edge nodes actually exist (#24166)
Fix useTasks crash on error (#24152)
Do not fail re-queued TIs (#23846)
Reduce grid view API calls (#24083)
Rename Permissions to Permission Pairs. (#24065)
Replace use_task_execution_date with use_task_logical_date (#23983)
Grid fix details button truncated and small UI tweaks (#23934)
Add TaskInstance State REMOVED to finished states and success states (#23797)
Fix mapped task immutability after clear (#23667)
Fix permission issue for dag that has dot in name (#23510)
Fix closing connection dbapi.get_pandas_df (#23452)
Check bag DAG schedule_interval match timetable (#23113)
Parse error for task added to multiple groups (#23071)
Fix flaky order of returned dag runs (#24405)
Migrate jsx files that affect run/task selection to tsx (#24509)
Fix links to sources for examples (#24386)
Set proper Content-Type and chartset on grid_data endpoint (#24375)

Doc only changes

Fix doc description of [core] parallelism config setting (#23768)
Update templates doc to mention extras and format Airflow Vars / Conns (#24735)
Document built in Timetables (#23099)
Alphabetizes two tables (#23923)
Clarify that users should not use Maria DB (#24556)
Add imports to deferring code samples (#24544)
Add note about image regeneration in June 2022 (#24524)
Small cleanup of get_current_context() chapter (#24482)
Fix default 2.2.5 log_id_template (#24455)
Update description of installing providers separately from core (#24454)
Mention context variables and logging (#24304)

Misc/Internal

Do not support MSSQL less than v2017 in code (#24095)
Drop Python 3.6 compatibility objects/modules (#24048)
Remove upper-binding for SQLAlchemy (#24819)
Remove internet explorer support (#24495)
Removing magic status code numbers from api_connexion (#24050)
Upgrade FAB to 4.1.2 (#24619)
Switch Markdown engine to markdown-it-py (#19702)
Update rich to latest version across the board. (#24186)
Get rid of TimedJSONWebSignatureSerializer (#24519)
Update flask-appbuilder authlib/ oauth dependency (#24516)
Upgrade to webpack 5 (#24485)
Add typescript (#24337)
The JWT claims in the request to retrieve logs have been standardized: we use nbf and aud claims for maturity and audience of the requests. Also "filename" payload field is used to keep log name. (#24519)
Address all yarn test warnings (#24722)
Upgrade to react 18 and chakra 2 (#24430)
Refactor DagRun.verify_integrity (#24114)
Upgrade FAB to 4.1.1 (#24399)
We now need at least Flask-WTF 0.15 (#24621)

Open source →

2.3.3rc36 Jul 2022pre-release

Nothing published for this version

2.3.3rc26 Jul 2022pre-release

Nothing published for this version

2.3.3rc12 Jul 2022pre-release

Nothing published for this version

2.3.24 Jun 2022

Run the check_migration loop at least once

Bug Fixes

Run the check_migration loop at least once
Fix grid view for mapped tasks (#24059)
Icons in grid view for different DAG run types (#23970)
Faster grid view (#23951)
Disallow calling expand with no arguments (#23463)
Add missing is_mapped field to Task response. (#23319)
DagFileProcessorManager: Start a new process group only if current process not a session leader (#23872)
Mask sensitive values for not-yet-running TIs (#23807)
Add cascade to dag_tag to dag foreign key (#23444)
Use --subdir argument value for standalone dag processor. (#23864)
Highlight task states by hovering on legend row (#23678)
Fix and speed up grid view (#23947)
Prevent UI from crashing if grid task instances are null (#23939)
Remove redundant register exit signals in dag-processor command (#23886)
Add __wrapped__ property to _TaskDecorator (#23830)
Fix UnboundLocalError when sql is empty list in DbApiHook (#23816)
Enable clicking on DAG owner in autocomplete dropdown (#23804)
Simplify flash message for _airflow_moved tables (#23635)
Exclude missing tasks from the gantt view (#23627)

Doc only changes

Add column names for DB Migration Reference (#23853)

Misc/Internal

Remove pinning for xmltodict (#23992)

Open source →

2.3.2rc21 Jun 2022pre-release

Nothing published for this version

2.3.2rc130 May 2022pre-release

Nothing published for this version

2.3.125 May 2022Deprecated

Fix retrieval of deprecated non-config values

Bug Fixes

Automatically reschedule stalled queued tasks in CeleryExecutor (#23690)
Fix expand/collapse all buttons (#23590)
Grid view status filters (#23392)
Expand/collapse all groups (#23487)
Fix retrieval of deprecated non-config values (#23723)
Fix secrets rendered in UI when task is not executed. (#22754)
Fix provider import error matching (#23825)
Fix regression in ignoring symlinks (#23535)
Fix dag-processor fetch metadata database config (#23575)
Fix auto upstream dep when expanding non-templated field (#23771)
Fix task log is not captured (#23684)
Add reschedule to the serialized fields for the BaseSensorOperator (#23674)
Modify db clean to also catch the ProgrammingError exception (#23699)
Remove titles from link buttons (#23736)
Fix grid details header text overlap (#23728)
Ensure execution_timeout as timedelta (#23655)
Don't run pre-migration checks for downgrade (#23634)
Add index for event column in log table (#23625)
Implement send_callback method for CeleryKubernetesExecutor and LocalKubernetesExecutor (#23617)
Fix PythonVirtualenvOperator templated_fields (#23559)
Apply specific ID collation to root_dag_id too (#23536)
Prevent KubernetesJobWatcher getting stuck on resource too old (#23521)
Fix scheduler crash when expanding with mapped task that returned none (#23486)
Fix broken dagrun links when many runs start at the same time (#23462)
Fix: Exception when parsing log #20966 (#23301)
Handle invalid date parsing in webserver views. (#23161)
Pools with negative open slots should not block other pools (#23143)
Move around overflow, position and padding (#23044)
Change approach to finding bad rows to LEFT OUTER JOIN. (#23528)
Only count bad refs when moved table exists (#23491)
Visually distinguish task group summary (#23488)
Remove color change for highly nested groups (#23482)
Optimize 2.3.0 pre-upgrade check queries (#23458)
Add backward compatibility for core__sql_alchemy_conn__cmd (#23441)
Fix literal cross product expansion (#23434)
Fix broken task instance link in xcom list (#23367)
Fix connection test button (#23345)
fix cli airflow dags show for mapped operator (#23339)
Hide some task instance attributes (#23338)
Don't show grid actions if server would reject with permission denied (#23332)
Use run_id for ti.mark_success_url (#23330)
Fix update user auth stats (#23314)
Use <Time /> in Mapped Instance table (#23313)
Fix duplicated Kubernetes DeprecationWarnings (#23302)
Store grid view selection in url params (#23290)
Remove custom signal handling in Triggerer (#23274)
Override pool for TaskInstance when pool is passed from cli. (#23258)
Show warning if '/' is used in a DAG run ID (#23106)
Use kubernetes queue in kubernetes hybrid executors (#23048)
Add tags inside try block. (#21784)

Doc only changes

Move dag_processing.processor_timeouts to counters section (#23393)
Clarify that bundle extras should not be used for PyPi installs (#23697)
Synchronize support for Postgres and K8S in docs (#23673)
Replace DummyOperator references in docs (#23502)
Add doc notes for keyword-only args for expand() and partial() (#23373)
Document fix for broken elasticsearch logs with 2.3.0+ upgrade (#23821)

Misc/Internal

Add typing for airflow/configuration.py (#23716)
Disable Flower by default from docker-compose (#23685)
Added postgres 14 to support versions(including breeze) (#23506)
add K8S 1.24 support (#23637)
Refactor code references from tree to grid (#23254)

Open source →

2.3.1rc121 May 2022pre-release

Nothing published for this version

2.3.030 Apr 2022Security

fix all "high" npm vulnerabilities

New Features

Add dynamic task mapping (https://github.com/apache/airflow/pulls?q=is%3Apr+is%3Amerged+label%3AAIP-42+milestone%3A%22Airflow+2.3.0%22)
New Grid View replaces Tree View (#18675)
Templated requirements.txt in Python Operators (#17349)
Allow reuse of decorated tasks (#22941)
Move the database configuration to a new section (#22284)
Add SmoothOperator (#22813)
Make operator's execution_timeout configurable (#22389)
Events Timetable (#22332)
Support dag serialization with custom ti_deps rules (#22698)
Support log download in task log view (#22804)
support for continue backfill on failures (#22697)
Add dag-processor cli command (#22305)
Add possibility to create users in LDAP mode (#22619)
Add ignore_first_depends_on_past for scheduled jobs (#22491)
Update base sensor operator to support XCOM return value (#20656)
Add an option for run id in the ui trigger screen (#21851)
Enable JSON serialization for connections (#19857)
Add REST API endpoint for bulk update of DAGs (#19758)
Add queue button to click-on-DagRun interface. (#21555)
Add list-import-errors to airflow dags command (#22084)
Store callbacks in database if standalone_dag_processor config is True. (#21731)
Add LocalKubernetesExecutor (#19729)
Add celery.task_timeout_error metric (#21602)
Airflow db downgrade cli command (#21596)
Add ALL_SKIPPED trigger rule (#21662)
Add db clean CLI command for purging old data (#20838)
Add celery_logging_level (#21506)
Support different timeout value for dag file parsing (#21501)
Support generating SQL script for upgrades (#20962)
Add option to compress Serialized dag data (#21332)
Branch python operator decorator (#20860)
Add Audit Log View to Dag View (#20733)
Add missing StatsD metric for failing SLA Callback notification (#20924)
Add ShortCircuitOperator configurability for respecting downstream trigger rules (#20044)
Allow using Markup in page title in Webserver (#20888)
Add Listener Plugin API that tracks TaskInstance state changes (#20443)
Add context var hook to inject more env vars (#20361)
Add a button to set all tasks to skipped (#20455)
Cleanup pending pods (#20438)
Add config to warn public deployment exposure in UI (#18557)
Log filename template records (#20165)
Added windows extensions (#16110)
Showing approximate time until next dag_run in Airflow (#20273)
Extend config window on UI (#20052)
Add show dag dependencies feature to CLI (#19985)
Add cli command for 'airflow dags reserialize` (#19471)
Add missing description field to Pool schema(REST API) (#19841)
Introduce DagRun action to change state to queued. (#19353)
Add DAG run details page (#19705)
Add role export/import to cli tools (#18916)
Adding dag_id_pattern parameter to the /dags endpoint (#18924)

Improvements

Show schedule_interval/timetable description in UI (#16931)
Added column duration to DAG runs view (#19482)
Enable use of custom conn extra fields without prefix (#22607)
Initialize finished counter at zero (#23080)
Improve logging of optional provider features messages (#23037)
Meaningful error message in resolve_template_files (#23027)
Update ImportError items instead of deleting and recreating them (#22928)
Add option --skip-init to db reset command (#22989)
Support importing connections from files with ".yml" extension (#22872)
Support glob syntax in .airflowignore files (#21392) (#22051)
Hide pagination when data is a single page (#22963)
Support for sorting DAGs in the web UI (#22671)
Speed up has_access decorator by ~200ms (#22858)
Add XComArg to lazy-imported list of Airflow module (#22862)
Add more fields to REST API dags/dag_id/details endpoint (#22756)
Don't show irrelevant/duplicated/"internal" Task attrs in UI (#22812)
No need to load whole ti in current_state (#22764)
Pickle dag exception string fix (#22760)
Better verification of Localexecutor's parallelism option (#22711)
log backfill exceptions to sentry (#22704)
retry commit on MySQL deadlocks during backfill (#22696)
Add more fields to REST API get DAG(dags/dag_id) endpoint (#22637)
Use timetable to generate planned days for current year (#22055)
Disable connection pool for celery worker (#22493)
Make date picker label visible in trigger dag view (#22379)
Expose try_number in airflow vars (#22297)
Add generic connection type (#22310)
Add a few more fields to the taskinstance finished log message (#22262)
Pause auto-refresh if scheduler isn't running (#22151)
Show DagModel details. (#21868)
Add pip_install_options to PythonVirtualenvOperator (#22158)
Show import error for airflow dags list CLI command (#21991)
Pause auto-refresh when page is hidden (#21904)
Default args type check (#21809)
Enhance magic methods on XComArg for UX (#21882)
py files don't have to be checked is_zipfiles in refresh_dag (#21926)
Fix TaskDecorator type hints (#21881)
Add 'Show record' option for variables (#21342)
Use DB where possible for quicker airflow dag subcommands (#21793)
REST API: add rendered fields in task instance. (#21741)
Change the default auth backend to session (#21640)
Don't check if py DAG files are zipped during parsing (#21538)
Switch XCom implementation to use run_id (#20975)
Action log on Browse Views (#21569)
Implement multiple API auth backends (#21472)
Change logging level details of connection info in get_connection() (#21162)
Support mssql in airflow db shell (#21511)
Support config worker_enable_remote_control for celery (#21507)
Log memory usage in CgroupTaskRunner (#21481)
Modernize DAG-related URL routes and rename "tree" to "grid" (#20730)
Move Zombie detection to SchedulerJob (#21181)
Improve speed to run airflow by 6x (#21438)
Add more SQL template fields renderers (#21237)
Simplify fab has access lookup (#19294)
Log context only for default method (#21244)
Log trigger status only if at least one is running (#21191)
Add optional features in providers. (#21074)
Better multiple_outputs inferral for @task.python (#20800)
Improve handling of string type and non-attribute template_fields (#21054)
Remove un-needed deps/version requirements (#20979)
Correctly specify overloads for TaskFlow API for type-hinting (#20933)
Introduce notification_sent to SlaMiss view (#20923)
Rewrite the task decorator as a composition (#20868)
Add "Greater/Smaller than or Equal" to filters in the browse views (#20602) (#20798)
Rewrite DAG run retrieval in task command (#20737)
Speed up creation of DagRun for large DAGs (5k+ tasks) by 25-130% (#20722)
Make native environment Airflow-flavored like sandbox (#20704)
Better error when param value has unexpected type (#20648)
Add filter by state in DagRun REST API (List Dag Runs) (#20485)
Prevent exponential memory growth in Tasks with custom logging handler (#20541)
Set default logger in logging Mixin (#20355)
Reduce deprecation warnings from www (#20378)
Add hour and minute to time format on x-axis of all charts using nvd3.lineChart (#20002)
Add specific warning when Task asks for more slots than pool defined with (#20178)
UI: Update duration column for better human readability (#20112)
Use Viewer role as example public role (#19215)
Properly implement DAG param dict copying (#20216)
ShortCircuitOperator push XCom by returning python_callable result (#20071)
Add clear logging to tasks killed due to a Dagrun timeout (#19950)
Change log level for Zombie detection messages (#20204)
Better confirmation prompts (#20183)
Only execute TIs of running DagRuns (#20182)
Check and run migration in commands if necessary (#18439)
Log only when Zombies exists (#20118)
Increase length of the email and username (#19932)
Add more filtering options for TI's in the UI (#19910)
Dynamically enable "Test Connection" button by connection type (#19792)
Avoid littering postgres server logs with "could not obtain lock" with HA schedulers (#19842)
Renamed Connection.get_hook parameter to make it the same as in SqlSensor and SqlOperator. (#19849)
Add hook_params in SqlSensor using the latest changes from PR #18718. (#18431)
Speed up webserver boot time by delaying provider initialization (#19709)
Configurable logging of XCOM value in PythonOperator (#19378)
Minimize production js files (#19658)
Add hook_params in BaseSqlOperator (#18718)
Add missing "end_date" to hash components (#19281)
More friendly output of the airflow plugins command + add timetables (#19298)
Add sensor default timeout config (#19119)
Update taskinstance REST API schema to include dag_run_id field (#19105)
Adding feature in bash operator to append the user defined env variable to system env variable (#18944)
Duplicate Connection: Added logic to query if a connection id exists before creating one (#18161)

Bug Fixes

Use inherited 'trigger_tasks' method (#23016)
In DAG dependency detector, use class type instead of class name (#21706)
Fix tasks being wrongly skipped by schedule_after_task_execution (#23181)
Fix X-Frame enabled behaviour (#23222)
Allow extra to be nullable in connection payload as per schema(REST API). (#23183)
Fix dag_id extraction for dag level access checks in web ui (#23015)
Fix timezone display for logs on UI (#23075)
Include message in graph errors (#23021)
Change trigger dropdown left position (#23013)
Don't add planned tasks for legacy DAG runs (#23007)
Add dangling rows check for TaskInstance references (#22924)
Validate the input params in connection CLI command (#22688)
Fix trigger event payload is not persisted in db (#22944)
Drop "airflow moved" tables in command db reset (#22990)
Add max width to task group tooltips (#22978)
Add template support for external_task_ids. (#22809)
Allow DagParam to hold falsy values (#22964)
Fix regression in pool metrics (#22939)
Priority order tasks even when using pools (#22483)
Do not clear XCom when resuming from deferral (#22932)
Handle invalid JSON metadata in get_logs_with_metadata endpoint. (#22898)
Fix pre-upgrade check for rows dangling w.r.t. dag_run (#22850)
Fixed backfill interference with scheduler (#22701)
Support conf param override for backfill runs (#22837)
Correctly interpolate pool name in PoolSlotsAvailableDep statues (#22807)
Fix email_on_failure with render_template_as_native_obj (#22770)
Fix processor cleanup on DagFileProcessorManager (#22685)
Prevent meta name clash for task instances (#22783)
remove json parse for gantt chart (#22780)
Check for missing dagrun should know version (#22752)
Fixes ScheduleInterval spec (#22635)
Fixing task status for non-running and non-committed tasks (#22410)
Do not log the hook connection details even at DEBUG level (#22627)
Stop crashing when empty logs are received from kubernetes client (#22566)
Fix bugs about timezone change (#22525)
Fix entire DAG stops when one task has end_date (#20920)
Use logger to print message during task execution. (#22488)
Make sure finalizers are not skipped during exception handling (#22475)
update smart sensor docs and minor fix on is_smart_sensor_compatible() (#22386)
Fix run_id k8s and elasticsearch compatibility with Airflow 2.1 (#22385)
Allow to except_skip None on BranchPythonOperator (#20411)
Fix incorrect datetime details (DagRun views) (#21357)
Remove incorrect deprecation warning in secrets backend (#22326)
Remove RefreshConfiguration workaround for K8s token refreshing (#20759)
Masking extras in GET /connections/<connection> endpoint (#22227)
Set queued_dttm when submitting task to directly to executor (#22259)
Addressed some issues in the tutorial mentioned in discussion #22233 (#22236)
Change default python executable to python3 for docker decorator (#21973)
Don't validate that Params are JSON when NOTSET (#22000)
Add per-DAG delete permissions (#21938)
Fix handling some None parameters in kubernetes 23 libs. (#21905)
Fix handling of empty (None) tags in bulk_write_to_db (#21757)
Fix DAG date range bug (#20507)
Removed request.referrer from views.py (#21751)
Make DbApiHook use get_uri from Connection (#21764)
Fix some migrations (#21670)
[de]serialize resources on task correctly (#21445)
Add params dag_id, task_id etc to XCom.serialize_value (#19505)
Update test connection functionality to use custom form fields (#21330)
fix all "high" npm vulnerabilities (#21526)
Fix bug incorrectly removing action from role, rather than permission. (#21483)
Fix relationship join bug in FAB/SecurityManager with SQLA 1.4 (#21296)
Use Identity instead of Sequence in SQLAlchemy 1.4 for MSSQL (#21238)
Ensure on_task_instance_running listener can get at task (#21157)
Return to the same place when triggering a DAG (#20955)
Fix task ID deduplication in @task_group (#20870)
Add downgrade to some FAB migrations (#20874)
Only validate Params when DAG is triggered (#20802)
Fix airflow trigger cli (#20781)
Fix task instances iteration in a pool to prevent blocking (#20816)
Allow depending to a @task_group as a whole (#20671)
Use original task's start_date if a task continues after deferral (#20062)
Disabled edit button in task instances list view page (#20659)
Fix a package name import error (#20519) (#20519)
Remove execution_date label when get cleanup pods list (#20417)
Remove unneeded FAB REST API endpoints (#20487)
Fix parsing of Cloudwatch log group arn containing slashes (#14667) (#19700)
Sanity check for MySQL's TIMESTAMP column (#19821)
Allow using default celery command group with executors subclassed from Celery-based executors. (#18189)
Move class_permission_name to mixin so it applies to all classes (#18749)
Adjust trimmed_pod_id and replace '.' with '-' (#19036)
Pass custom_headers to send_email and send_email_smtp (#19009)
Ensure catchup=False is used in example dags (#19396)
Edit permalinks in OpenApi description file (#19244)
Navigate directly to DAG when selecting from search typeahead list (#18991)
[Minor] Fix padding on home page (#19025)

Doc only changes

Update doc for DAG file processing (#23209)
Replace changelog/updating with release notes and towncrier now (#22003)
Fix wrong reference in tracking-user-activity.rst (#22745)
Remove references to rbac = True from docs (#22725)
Doc: Update description for executor-bound dependencies (#22601)
Update check-health.rst (#22372)
Stronger language about Docker Compose customizability (#22304)
Update logging-tasks.rst (#22116)
Add example config of sql_alchemy_connect_args (#22045)
Update best-practices.rst (#22053)
Add information on DAG pausing/deactivation/deletion (#22025)
Add brief examples of integration test dags you might want (#22009)
Run inclusive language check on CHANGELOG (#21980)
Add detailed email docs for Sendgrid (#21958)
Add docs for db upgrade / db downgrade (#21879)
Update modules_management.rst (#21889)
Fix UPDATING section on SqlAlchemy 1.4 scheme changes (#21887)
Update TaskFlow tutorial doc to show how to pass "operator-level" args. (#21446)
Fix doc - replace decreasing by increasing (#21805)
Add another way to dynamically generate DAGs to docs (#21297)
Add extra information about time synchronization needed (#21685)
Update debug.rst docs (#21246)
Replaces the usage of postgres:// with postgresql:// (#21205)
Fix task execution process in CeleryExecutor docs (#20783)

Misc/Internal

Bring back deprecated security manager functions (#23243)
Replace usage of DummyOperator with EmptyOperator (#22974)
Deprecate DummyOperator in favor of EmptyOperator (#22832)
Remove unnecessary python 3.6 conditionals (#20549)
Bump moment from 2.29.1 to 2.29.2 in /airflow/www (#22873)
Bump prismjs from 1.26.0 to 1.27.0 in /airflow/www (#22823)
Bump nanoid from 3.1.23 to 3.3.2 in /airflow/www (#22803)
Bump minimist from 1.2.5 to 1.2.6 in /airflow/www (#22798)
Remove dag parsing from db init command (#22531)
Update our approach for executor-bound dependencies (#22573)
Use Airflow.Base.metadata in FAB models (#22353)
Limit docutils to make our documentation pretty again (#22420)
Add Python 3.10 support (#22050)
[FEATURE] add 1.22 1.23 K8S support (#21902)
Remove pandas upper limit now that SQLA is 1.4+ (#22162)
Patch sql_alchemy_conn if old postgres scheme used (#22333)
Protect against accidental misuse of XCom.get_value() (#22244)
Order filenames for migrations (#22168)
Don't try to auto generate migrations for Celery tables (#22120)
Require SQLAlchemy 1.4 (#22114)
bump sphinx-jinja (#22101)
Add compat shim for SQLAlchemy to avoid warnings (#21959)
Rename xcom.dagrun_id to xcom.dag_run_id (#21806)
Deprecate non-JSON conn.extra (#21816)
Bump upper bound version of jsonschema to 5.0 (#21712)
Deprecate helper utility days_ago (#21653)
Remove :type lines now sphinx-autoapi supports type hints (#20951)
Silence deprecation warning in tests (#20900)
Use DagRun.run_id instead of execution_date when updating state of TIs (UI & REST API) (#18724)
Add Context stub to Airflow packages (#20817)
Update Kubernetes library version (#18797)
Rename PodLauncher to PodManager (#20576)
Removes Python 3.6 support (#20467)
Add deprecation warning for non-json-serializable params (#20174)
Rename TaskMixin to DependencyMixin (#20297)
Deprecate passing execution_date to XCom methods (#19825)
Remove get_readable_dags and get_editable_dags, and get_accessible_dags. (#19961)
Remove postgres 9.6 support (#19987)
Removed hardcoded connection types. Check if hook is instance of DbApiHook. (#19639)
add kubernetes 1.21 support (#19557)
Add FAB base class and set import_name explicitly. (#19667)
Removes unused state transitions to handle auto-changing view permissions. (#19153)
Chore: Use enum for __var and __type members (#19303)
Use fab models (#19121)
Consolidate method names between Airflow Security Manager and FAB default (#18726)
Remove distutils usages for Python 3.10 (#19064)
Removing redundant max_tis_per_query initialisation on SchedulerJob (#19020)
Remove deprecated usage of init_role() from API (#18820)
Remove duplicate code on dbapi hook (#18821)

Open source →

2.3.0rc227 Apr 2022pre-release

Nothing published for this version

2.3.0rc127 Apr 2022pre-release

Nothing published for this version

2.3.0b114 Apr 2022pre-release

Nothing published for this version

2.2.54 Apr 2022

Check and disallow a relative path for sqlite

Bug Fixes

Check and disallow a relative path for sqlite (#22530)
Fixed dask executor and tests (#22027)
Fix broken links to celery documentation (#22364)
Fix incorrect data provided to tries & landing times charts (#21928)
Fix assignment of unassigned triggers (#21770)
Fix triggerer --capacity parameter (#21753)
Fix graph autorefresh on page load (#21736)
Fix filesystem sensor for directories (#21729)
Fix stray order_by(TaskInstance.execution_date) (#21705)
Correctly handle multiple '=' in LocalFileSystem secrets. (#21694)
Log exception in local executor (#21667)
Disable default_pool delete on web ui (#21658)
Extends typing-extensions to be installed with python 3.8+ #21566 (#21567)
Dispose unused connection pool (#21565)
Fix logging JDBC SQL error when task fails (#21540)
Filter out default configs when overrides exist. (#21539)
Fix Resources __eq__ check (#21442)
Fix max_active_runs=1 not scheduling runs when min_file_process_interval is high (#21413)
Reduce DB load incurred by Stale DAG deactivation (#21399)
Fix race condition between triggerer and scheduler (#21316)
Fix trigger dag redirect from task instance log view (#21239)
Log traceback in trigger excs (#21213)
A trigger might use a connection; make sure we mask passwords (#21207)
Update ExternalTaskSensorLink to handle templated external_dag_id (#21192)
Ensure clear_task_instances sets valid run state (#21116)
Fix: Update custom connection field processing (#20883)
Truncate stack trace to DAG user code for exceptions raised during execution (#20731)
Fix duplicate trigger creation race condition (#20699)
Fix Tasks getting stuck in scheduled state (#19747)
Fix: Do not render undefined graph edges (#19684)
Set X-Frame-Options header to DENY only if X_FRAME_ENABLED is set to true. (#19491)

Doc only changes

adding on_execute_callback to callbacks docs (#22362)
Add documentation on specifying a DB schema. (#22347)
Fix postgres part of pipeline example of tutorial (#21586)
Extend documentation for states of DAGs & tasks and update trigger rules docs (#21382)
DB upgrade is required when updating Airflow (#22061)
Remove misleading MSSQL information from the docs (#21998)

Misc

Add the new Airflow Trove Classifier to setup.cfg (#22241)
Rename to_delete to to_cancel in TriggerRunner (#20658)
Update Flask-AppBuilder to 3.4.5 (#22596)

Open source →

2.2.5rc330 Mar 2022pre-release

Nothing published for this version

2.2.5rc228 Mar 2022pre-release

Nothing published for this version

2.2.5rc127 Mar 2022pre-release

Nothing published for this version

2.2.422 Feb 2022Deprecated

Deprecate some functions in the experimental API

Bug Fixes

Adding missing login provider related methods from Flask-Appbuilder (#21294)
Fix slow DAG deletion due to missing dag_id index for job table (#20282)
Add a session backend to store session data in the database (#21478)
Show task status only for running dags or only for the last finished dag (#21352)
Use compat data interval shim in log handlers (#21289)
Fix mismatch in generated run_id and logical date of DAG run (#18707)
Fix TriggerDagRunOperator extra link (#19410)
Add possibility to create user in the Remote User mode (#19963)
Avoid deadlock when rescheduling task (#21362)
Fix the incorrect scheduling time for the first run of dag (#21011)
Fix Scheduler crash when executing task instances of missing DAG (#20349)
Deferred tasks does not cancel when DAG is marked fail (#20649)
Removed duplicated dag_run join in Dag.get_task_instances() (#20591)
Avoid unintentional data loss when deleting DAGs (#20758)
Fix session usage in /rendered-k8s view (#21006)
Fix airflow dags backfill --reset-dagruns errors when run twice (#21062)
Do not set TaskInstance.max_tries in refresh_from_task (#21018)
Don't require dag_id in body in dagrun REST API endpoint (#21024)
Add Roles from Azure OAUTH Response in internal Security Manager (#20707)
Allow Viewing DagRuns and TIs if a user has DAG "read" perms (#20663)
Fix running airflow dags test <dag_id> <execution_dt> results in error when run twice (#21031)
Switch to non-vendored latest connexion library (#20910)
Bump flask-appbuilder to >=3.3.4 (#20628)
upgrade celery to 5.2.3 (#19703)
Bump croniter from <1.1 to <1.2 (#20489)
Lift off upper bound for MarkupSafe (#20113)
Avoid calling DAG.following_schedule() for TaskInstance.get_template_context() (#20486)
Fix(standalone): Remove hardcoded Webserver port (#20429)
Remove unnecssary logging in experimental API (#20356)
Un-ignore DeprecationWarning (#20322)
Deepcopying Kubernetes Secrets attributes causing issues (#20318)
Fix(dag-dependencies): fix arrow styling (#20303)
Adds retry on taskinstance retrieval lock (#20030)
Correctly send timing metrics when using dogstatsd (fix schedule_delay metric) (#19973)
Enhance multiple_outputs inference of dict typing (#19608)
Fixing ses email backend (#18042)
Pin Markupsafe until we are able to upgrade Flask/Jinja (#21664)

Doc only changes

Added explaining concept of logical date in DAG run docs (#21433)
Add note about Variable precedence with env vars (#21568)
Update error docs to include before_send option (#21275)
Augment xcom docs (#20755)
Add documentation and release policy on "latest" constraints (#21093)
Add a link to the DAG model in the Python API reference (#21060)
Added an enum param example (#20841)
Compare taskgroup and subdag (#20700)
Add note about reserved params keyword (#20640)
Improve documentation on Params (#20567)
Fix typo in MySQL Database creation code (Set up DB docs) (#20102)
Add requirements.txt description (#20048)
Clean up default_args usage in docs (#19803)
Add docker-compose explanation to conn localhost (#19076)
Update CSV ingest code for tutorial (#18960)
Adds Pendulum 1.x -> 2.x upgrade documentation (#18955)
Updating explicit arg example in TaskFlow API tutorial doc (#18907)
Adds back documentation about context usage in Python/@task (#18868)
Clean up dynamic start_date values from docs (#19607)
Docs for multiple pool slots (#20257)
Update upgrading.rst with detailed code example of how to resolve post-upgrade warning (#19993)

Misc

Deprecate some functions in the experimental API (#19931)
Deprecate smart sensors (#20151)

Open source →

2.2.4rc118 Feb 2022pre-release

Nothing published for this version

2.2.321 Dec 2021Deprecated

Context class handles deprecation

Bug Fixes

Lazy Jinja2 context (#20217)
Exclude snowflake-sqlalchemy v1.2.5 (#20245)
Move away from legacy importlib.resources API (#19091)
Move setgid as the first command executed in forked task runner (#20040)
Fix race condition when starting DagProcessorAgent (#19935)
Limit httpx to <0.20.0 (#20218)
Log provider import errors as debug warnings (#20172)
Bump minimum required alembic version (#20153)
Fix log link in gantt view (#20121)
fixing #19028 by moving chown to use sudo (#20114)
Lift off upper bound for MarkupSafe (#20113)
Fix infinite recursion on redact log (#20039)
Fix db downgrades (#19994)
Context class handles deprecation (#19886)
Fix possible reference to undeclared variable (#19933)
Validate DagRun state is valid on assignment (#19898)
Workaround occasional deadlocks with MSSQL (#19856)
Enable task run setting to be able reinitialise (#19845)
Fix log endpoint for same task (#19672)
Cast macro datetime string inputs explicitly (#19592)
Do not crash with stacktrace when task instance is missing (#19478)
Fix log timezone in task log view (#19342) (#19401)
Fix: Add taskgroup tooltip to graph view (#19083)
Rename execution date in forms and tables (#19063)
Simplify "invalid TI state" message (#19029)
Handle case of nonexistent file when preparing file path queue (#18998)
Do not create dagruns for DAGs with import errors (#19367)
Fix field relabeling when switching between conn types (#19411)
KubernetesExecutor should default to template image if used (#19484)
Fix task instance api cannot list task instances with None state (#19487)
Fix IntegrityError in DagFileProcessor.manage_slas (#19553)
Declare data interval fields as serializable (#19616)
Relax timetable class validation (#19878)
Fix labels used to find queued KubernetesExecutor pods (#19904)
Fix moved data migration check for MySQL when replcation is used (#19999)

Doc only changes

Warn without tracebacks when example_dags are missing deps (#20295)
Deferrable operators doc clarification (#20150)
Ensure the example DAGs are all working (#19355)
Updating core example DAGs to use TaskFlow API where applicable (#18562)
Add xcom clearing behaviour on task retries (#19968)
Add a short chapter focusing on adapting secret format for connections (#19859)
Add information about supported OS-es for Apache Airflow (#19855)
Update docs to reflect that changes to the base_log_folder require updating other configs (#19793)
Disclaimer in KubernetesExecutor pod template docs (#19686)
Add upgrade note on execution_date -> run_id (#19593)
Expanding .output operator property information in TaskFlow tutorial doc (#19214)
Add example SLA DAG (#19563)
Add a proper example to patch DAG (#19465)
Add DAG file processing description to Scheduler Concepts (#18954)
Updating explicit arg example in TaskFlow API tutorial doc (#18907)
Adds back documentation about context usage in Python/@task (#18868)
Add release date for when an endpoint/field is added in the REST API (#19203)
Better pod_template_file examples (#19691)
Add decription on how you can customize image entrypoint (#18915)
Dags-in-image pod template example should not have dag mounts (#19337)

Open source →

2.2.3rc214 Dec 2021pre-release

Nothing published for this version

2.2.3rc110 Dec 2021pre-release

Nothing published for this version

2.2.215 Nov 2021

Fix bug when checking for existence of a Variable

Bug Fixes

Fix bug when checking for existence of a Variable (#19395)
Fix Serialization whenrelativedelta is passed as schedule_interval (#19418)
Fix moving of dangling TaskInstance rows for SQL Server (#19425)
Fix task instance modal in gantt view (#19258)
Fix serialization of Params with set data type (#19267)
Check if job object is None before calling .is_alive() (#19380)
Task should fail immediately when pod is unprocessable (#19359)
Fix downgrade for a DB Migration (#19390)
Only mark SchedulerJobs as failed, not any jobs (#19375)
Fix message on "Mark as" confirmation page (#19363)
Bugfix: Check next run exists before reading data interval (#19307)
Fix MySQL db migration with default encoding/collation (#19268)
Fix hidden tooltip position (#19261)
sqlite_default Connection has been hard-coded to /tmp, use gettempdir instead (#19255)
Fix Toggle Wrap on DAG code page (#19211)
Clarify "dag not found" error message in CLI (#19338)
Add Note to SLA regarding schedule_interval (#19173)
Use execution_date to check for existing DagRun for TriggerDagRunOperator (#18968)
Add explicit session parameter in PoolSlotsAvailableDep (#18875)
FAB still requires WTForms<3.0 (#19466)
Fix missing dagruns when catchup=True (#19528)

Doc only changes

Add missing parameter documentation for "timetable" (#19282)
Improve Kubernetes Executor docs (#19339)
Update image tag used in docker docs

Open source →

2.2.2rc211 Nov 2021pre-release

Nothing published for this version

2.2.2rc19 Nov 2021pre-release

Nothing published for this version

2.2.129 Oct 2021

Fix Unexpected commit error in schedulerjob

Bug Fixes

Fix Unexpected commit error in schedulerjob (#19213)
Add DagRun.logical_date as a property (#19198)
Clear ti.next_method and ti.next_kwargs on task finish (#19183)
Faster PostgreSQL db migration to Airflow 2.2 (#19166)
Remove incorrect type comment in Swagger2Specification._set_defaults classmethod (#19065)
Add TriggererJob to jobs check command (#19179, #19185)
Hide tooltip when next run is None (#19112)
Crerate TI context with data interval compat layer (#19148)
Fix queued dag runs changes catchup=False behaviour (#19130, #19145)
add detailed information to logging when a dag or a task finishes. (#19097)
Warn about unsupported Python 3.10 (#19060)
Fix catchup by limiting queued dagrun creation using max_active_runs (#18897)
Prevent scheduler crash when serialized dag is missing (#19113)
Don't install SQLAlchemy/Pendulum adapters for other DBs (#18745)
Workaround libstdcpp TLS error (#19010)
Change ds, ts, etc. back to use logical date (#19088)
Ensure task state doesn't change when marked as failed/success/skipped (#19095)
Relax packaging requirement (#19087)
Rename trigger page label to Logical Date (#19061)
Allow Param to support a default value of None (#19034)
Upgrade old DAG/task param format when deserializing from the DB (#18986)
Don't bake ENV and _cmd into tmp config for non-sudo (#18772)
CLI: Fail backfill command before loading DAGs if missing args (#18994)
BugFix: Null execution date on insert to task_fail violating NOT NULL (#18979)
Try to move "dangling" rows in upgradedb (#18953)
Row lock TI query in SchedulerJob._process_executor_events (#18975)
Sentry before send fallback (#18980)
Fix XCom.delete error in Airflow 2.2.0 (#18956)
Check python version before starting triggerer (#18926)

Doc only changes

Update access control documentation for TaskInstances and DagRuns (#18644)
Add information about keepalives for managed Postgres (#18850)
Doc: Add Callbacks Section to Logging & Monitoring (#18842)
Group PATCH DAGrun together with other DAGRun endpoints (#18885)

Open source →

2.2.1rc226 Oct 2021pre-release

Nothing published for this version

2.2.1rc124 Oct 2021pre-release

Nothing published for this version

2.2.011 Oct 2021Deprecated

Add deprecation notice for SubDagOperator

New Features

AIP-39: Add (customizable) Timetable class to Airflow for richer scheduling behaviour (#15397, #16030, #16352, #17030, #17122, #17414, #17552, #17755, #17989, #18084, #18088, #18244, #18266, #18420, #18434, #18421, #18475, #18499, #18573, #18522, #18729, #18706, #18742, #18786, #18804)
AIP-40: Add Deferrable "Async" Tasks (#15389, #17564, #17565, #17601, #17745, #17747, #17748, #17875, #17876, #18129, #18210, #18214, #18552, #18728, #18414)
Add a Docker Taskflow decorator (#15330, #18739)
Add Airflow Standalone command (#15826)
Display alert messages on dashboard from local settings (#18284)
Advanced Params using json-schema (#17100)
Ability to test connections from UI or API (#15795, #18750)
Add Next Run to UI (#17732)
Add default weight rule configuration option (#18627)
Add a calendar field to choose the execution date of the DAG when triggering it (#16141)
Allow setting specific cwd for BashOperator (#17751)
Show import errors in DAG views (#17818)
Add pre/post execution hooks [Experimental] (#17576)
Added table to view providers in Airflow ui under admin tab (#15385)
Adds secrets backend/logging/auth information to provider yaml (#17625)
Add date format filters to Jinja environment (#17451)
Introduce RESTARTING state (#16681)
Webserver: Unpause DAG on manual trigger (#16569)
API endpoint to create new user (#16609)
Add insert_args for support transfer replace (#15825)
Add recursive flag to glob in filesystem sensor (#16894)
Add conn to jinja template context (#16686)
Add default_args for TaskGroup (#16557)
Allow adding duplicate connections from UI (#15574)
Allow specifying multiple URLs via the CORS config option (#17941)
Implement API endpoint for DAG deletion (#17980)
Add DAG run endpoint for marking a dagrun success or failed(#17839)
Add support for kinit options [-f|-F] and [-a|-A] (#17816)
Queue support for DaskExecutor using Dask Worker Resources (#16829, #18720)
Make auto refresh interval configurable (#18107)

Improvements

Small improvements for Airflow UI (#18715, #18795)
Rename processor_poll_interval to scheduler_idle_sleep_time (#18704)
Check the allowed values for the logging level (#18651)
Fix error on triggering a dag that doesn't exist using dagrun_conf (#18655)
Add muldelete action to TaskInstanceModelView (#18438)
Avoid importing DAGs during clean DB installation (#18450)
Require can_edit on DAG privileges to modify TaskInstances and DagRuns (#16634)
Make Kubernetes job description fit on one log line (#18377)
Always draw borders if task instance state is null or undefined (#18033)
Inclusive Language (#18349)
Improved log handling for zombie tasks (#18277)
Adding Variable.update method and improving detection of variable key collisions (#18159)
Add note about params on trigger DAG page (#18166)
Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719)
Adding TaskGroup support in BaseOperator.chain() (#17456)
Advises the kernel to not cache log files generated by Airflow (#18054)
Allow filtering DAGS by tags in the REST API (#18090)
Optimize imports of Providers Manager (#18052)
Adds capability of Warnings for incompatible community providers (#18020)
Serialize the template_ext attribute to show it in UI (#17985)
Add robots.txt and X-Robots-Tag header (#17946)
Refactor BranchDayOfWeekOperator, DayOfWeekSensor (#17940)
Update error message to guide the user into self-help mostly (#17929)
Update to Celery 5 (#17397)
Avoid redirect loop for users with no permissions (#17838)
Improve graph view load time for dags with open groups (#17821)
Add links to provider's documentation (#17736)
Remove Marshmallow schema warnings (#17753)
Rename none_failed_or_skipped by none_failed_min_one_success trigger rule (#17683)
Remove [core] store_dag_code & use DB to get Dag Code (#16342)
Rename task_concurrency to max_active_tis_per_dag (#17708)
Import Hooks lazily individually in providers manager (#17682)
Adding support for multiple task-ids in the external task sensor (#17339)
Replace execution_date with run_id in airflow tasks run command (#16666)
Avoid endless redirect loop when user has no roles (#17613)
Make output from users cli command more consistent (#17642)
Open relative extra links in place (#17477)
Move worker_log_server_port option to the logging section (#17621)
Use gunicorn to serve logs generated by worker (#17591)
Improve validation of Group id (#17578)
Simplify 404 page (#17501)
Add XCom.clear so it's hookable in custom XCom backend (#17405)
Add deprecation notice for SubDagOperator (#17488)
Support DAGS folder being in different location on scheduler and runners (#16860)
Remove /dagrun/create and disable edit form generated by F.A.B (#17376)
Enable specifying dictionary paths in template_fields_renderers (#17321)
error early if virtualenv is missing (#15788)
Handle connection parameters added to Extra and custom fields (#17269)
Fix airflow celery stop to accept the pid file. (#17278)
Remove DAG refresh buttons (#17263)
Deprecate dummy trigger rule in favor of always (#17144)
Be verbose about failure to import airflow_local_settings (#17195)
Include exit code in AirflowException str when BashOperator fails. (#17151)
Adding EdgeModifier support for chain() (#17099)
Only allows supported field types to be used in custom connections (#17194)
Secrets backend failover (#16404)
Warn on Webserver when using SQLite or SequentialExecutor (#17133)
Extend init_containers defined in pod_override (#17537)
Client-side filter dag dependencies (#16253)
Improve executor validation in CLI (#17071)
Prevent running airflow db init/upgrade migrations and setup in parallel. (#17078)
Update chain() and cross_downstream() to support XComArgs (#16732)
Improve graph view refresh (#16696)
When a task instance fails with exception, log it (#16805)
Set process title for serve-logs and LocalExecutor (#16644)
Rename test_cycle to check_cycle (#16617)
Set process title for Worker when using LocalExecutor (#16623)
Add schema as DbApiHook instance attribute (#16521, #17423)
Improve compatibility with MSSQL (#9973)
Add transparency for unsupported connection type (#16220)
Call resource based fab methods (#16190)
Format more dates with timezone (#16129)
Replace deprecated dag.sub_dag with dag.partial_subset (#16179)
Treat AirflowSensorTimeout as immediate failure without retrying (#12058)
Marking success/failed automatically clears failed downstream tasks (#13037)
Add close/open indicator for import dag errors (#16073)
Add collapsible import errors (#16072)
Always return a response in TI's action_clear view (#15980)
Add cli command to delete user by email (#15873)
Use resource and action names for FAB permissions (#16410)
Rename DAG concurrency ([core] dag_concurrency) settings for easier understanding (#16267, #18730)
Calendar UI improvements (#16226)
Refactor: SKIPPED should not be logged again as SUCCESS (#14822)
Remove version limits for dnspython (#18046, #18162)
Accept custom run ID in TriggerDagRunOperator (#18788)

Bug Fixes

Make REST API patch user endpoint work the same way as the UI (#18757)
Properly set start_date for cleared tasks (#18708)
Ensure task_instance exists before running update on its state(REST API) (#18642)
Make AirflowDateTimePickerWidget a required field (#18602)
Retry deadlocked transactions on deleting old rendered task fields (#18616)
Fix retry_exponential_backoff divide by zero error when retry delay is zero (#17003)
Improve how UI handles datetimes (#18611, #18700)
Bugfix: dag_bag.get_dag should return None, not raise exception (#18554)
Only show the task modal if it is a valid instance (#18570)
Fix accessing rendered {{ task.x }} attributes from within templates (#18516)
Add missing email type of connection (#18502)
Don't use flash for "same-page" UI messages. (#18462)
Fix task group tooltip (#18406)
Properly fix dagrun update state endpoint (#18370)
Properly handle ti state difference between executor and scheduler (#17819)
Fix stuck "queued" tasks in KubernetesExecutor (#18152)
Don't permanently add zip DAGs to sys.path (#18384)
Fix random deadlocks in MSSQL database (#18362)
Deactivating DAGs which have been removed from files (#17121)
When syncing dags to db remove dag_tag rows that are now unused (#8231)
Graceful scheduler shutdown on error (#18092)
Fix mini scheduler not respecting wait_for_downstream dep (#18338)
Pass exception to run_finished_callback for Debug Executor (#17983)
Make XCom.get_one return full, not abbreviated values (#18274)
Use try/except when closing temporary file in task_runner (#18269)
show next run if not none (#18273)
Fix DB session handling in XCom.set (#18240)
Sort adopted tasks in _check_for_stalled_adopted_tasks method (#18208)
Fix external_executor_id not being set for manually run jobs (#17207)
Fix deleting of zipped Dags in Serialized Dag Table (#18243)
Return explicit error on user-add for duplicated email (#18224)
Remove loading dots even when last run data is empty (#18230)
Swap dag import error dropdown icons (#18207)
Automatically create section when migrating config (#16814)
Set encoding to utf-8 by default while reading task logs (#17965)
Set task state to failed when pod is DELETED while running (#18095)
Apply parent dag permissions to subdags (#18160)
Change id collation for MySQL to case-sensitive (#18072)
Logs task launch exception in StandardTaskRunner (#17967)
Applied permissions to self._error_file (#15947)
Hide variable import form if user lacks permission (#18000)
Fix blank dag dependencies view (#17990)
Add missing menu access for dag dependencies and configurations pages (#17450)
Fix passing Jinja templates in DateTimeSensor (#17959)
Fixing bug which restricted the visibility of ImportErrors (#17924)
Fix grammar in traceback.html (#17942)
Fix DagRunState enum query for MySQLdb driver (#17886)
Fixed button size in "Actions" group. (#17902)
Fix log links on graph TI modal (#17862)
Only show import errors for DAGs a user can access (#17835)
Show all import_errors from zip files (#17759)
fix EXTRA_LOGGER_NAMES param and related docs (#17808)
Use one interpreter for Airflow and gunicorn (#17805)
Fix: Mysql 5.7 id utf8mb3 (#14535)
Fix dag_processing.last_duration metric random holes (#17769)
Automatically use utf8mb3_general_ci collation for MySQL (#17729)
Fix wrong query on running tis (#17631)
Add root to tree refresh url (#17633)
Do not delete running DAG from the UI (#17630)
Rescue if a DagRun's DAG was removed from db (#17544)
fix: filter condition of TaskInstance does not work #17535 (#17548)
Regression on pid reset to allow task start after heartbeat (#17333)
Dont use TaskInstance in CeleryExecutor.trigger_tasks (#16248)
Remove locks for upgrades in MSSQL (#17213)
Create virtualenv via python call (#17156)
Ensure a DAG is acyclic when running DAG.cli() (#17105)
Translate non-ascii characters (#17057)
Change the logic of None comparison in model_list template (#16893)
Have UI and POST /task_instances_state API endpoint have same behaviour (#16539)
ensure task is skipped if missing sla (#16719)
Fix direct use of cached_property module (#16710)
Fix TI success confirm page (#16650)
Cattrs 1.7.0 released by the end of May 2021 break lineage usage (#16173)
Fix Celery executor getting stuck randomly because of reset_signals in multiprocessing (#15989)
Modify return value check in python virtualenv jinja template (#16049)
Fix dag dependency search (#15924)
Make custom JSON encoder support Decimal (#16383)
Bugfix: Allow clearing tasks with just dag_id and empty subdir (#16513)
Convert port value to a number before calling test connection (#16497)
Handle missing/null serialized DAG dependencies (#16393)
Correctly set dag.fileloc when using the @dag decorator (#16384)
Fix TI success/failure links (#16233)
Correctly implement autocomplete early return in airflow/www/views.py (#15940)
Backport fix to allow pickling of Loggers to Python 3.6 (#18798)
Fix bug that Backfill job fail to run when there are tasks run into reschedule state (#17305, #18806)

Doc only changes

Update dagbag_size documentation (#18824)
Update documentation about bundle extras (#18828)
Fix wrong Postgres search_path set up instructions (#17600)
Remove AIRFLOW_GID from Docker images (#18747)
Improve error message for BranchPythonOperator when no task_id to follow (#18471)
Improve guidance to users telling them what to do on import timeout (#18478)
Explain scheduler fine-tuning better (#18356)
Added example JSON for airflow pools import (#18376)
Add sla_miss_callback section to the documentation (#18305)
Explain sentry default environment variable for subprocess hook (#18346)
Refactor installation pages (#18282)
Improves installing from sources pages for all components (#18251)
Doc: Use closer.lua script for downloading sources (#18179)
Improves quick-start docker-compose warnings and documentation (#18164)
Production-level support for MSSQL (#18382)
Update non-working example in documentation (#18067)
Improve the description of how to handle dynamic task generation (#17963)
Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs (#16866)
Update max_tis_per_query to better render on the webpage (#17971)
Adds Github Oauth example with team based authorization (#17896)
Update docker.rst (#17882)
Example xcom update (#17749)
Add doc warning about connections added via envvars (#17915)
fix wrong documents around upgrade-check.rst (#17903)
Add Brent to Committers list (#17873)
Improves documentation about modules management (#17757)
Remove deprecated metrics from metrics.rst (#17772)
Make sure "production-readiness" of docker-compose is well explained (#17731)
Doc: Update Upgrade to v2 docs with Airflow 1.10.x EOL dates (#17710)
Doc: Replace deprecated param from docstrings (#17709)
docs(dagowner): describe dag owner more carefully (#17699)
docs(impersonation): update note so avoid misintrepretation (#17701)
Docs: Make DAG.is_active read-only in API (#17667)
Improve cross-links to operators and hooks references (#17622)
Update documentation regarding Python 3.9 support (#17611)
Fix MySQL database character set instruction (#17603)
Document overriding XCom.clear for data lifecycle management (#17589)
Path correction in docs for airflow core (#17567)
docs(celery): reworded, add actual multiple queues example (#17541)
Doc: Add FAQ to speed up parsing with tons of dag files (#17519)
Improve image building documentation for new users (#17409)
Doc: Strip unnecessary arguments from MariaDB JIRA URL (#17296)
Update warning about MariaDB and multiple schedulers (#17287)
Doc: Recommend using same configs on all Airflow components (#17146)
Move docs about masking to a new page (#17007)
Docs: Suggest use of Env vars instead of Airflow Vars in best practises doc (#16926)
Docs: Better description for pod_template_file (#16861)
Add Aneesh Joseph as Airflow Committer (#16835)
Docs: Added new pipeline example for the tutorial docs (#16548)
Remove upstart from docs (#16672)
Add new committers: Jed and TP (#16671)
Docs: Fix flask-ouathlib to flask-oauthlib in Upgrading docs (#16320)
Docs: Fix creating a connection docs (#16312)
Docs: Fix url for Elasticsearch (#16275)
Small improvements for README.md files (#16244)
Fix docs for dag_concurrency (#16177)
Check syntatic correctness for code-snippets (#16005)
Improvements for Docker Image docs (#14843)
Add proper link for wheel packages in docs. (#15999)
Add Docs for default_pool slots (#15997)
Add memory usage warning in quick-start documentation (#15967)
Update example KubernetesExecutor git-sync pod template file (#15904)
Docs: Fix Taskflow API docs (#16574)
Added new pipeline example for the tutorial docs (#16084)
Updating the DAG docstring to include render_template_as_native_obj (#16534)
Update docs on setting up SMTP (#16523)
Docs: Fix API verb from POST to PATCH (#16511)

Misc/Internal

Renaming variables to be consistent with code logic (#18685)
Simplify strings previously split across lines (#18679)
fix exception string of BranchPythonOperator (#18623)
Add multiple roles when creating users (#18617)
Move FABs base Security Manager into Airflow. (#16647)
Remove unnecessary css state colors (#18461)
Update boto3 to <1.19 (#18389)
Improve coverage for airflow.security.kerberos module (#18258)
Fix kinesis test (#18337)
Fix provider test acessing importlib-resources (#18228)
Silence warnings in tests from using SubDagOperator (#18275)
Fix usage of range(len()) to enumerate (#18174)
Test coverage on the autocomplete view (#15943)
Update version added fields in airflow/config_templates/config.yml (#18128)
Add "packaging" to core requirements (#18122)
Adds LoggingMixins to BaseTrigger (#18106)
Limit colorlog version (6.x is incompatible) (#18099)
Fix building docs in main builds (#18035)
Remove upper-limit on tenacity (#17593)
Remove redundant numpy dependency (#17594)
Bump mysql-connector-python to latest version (#17596)
Make pandas an optional core dependency (#17575)
Add more typing to airflow.utils.helpers (#15582)
Chore: Some code cleanup in airflow/utils/db.py (#17090)
Refactor: Remove processor_factory from DAG processing (#16659)
Remove AbstractDagFileProcessorProcess from dag processing (#16816)
Update TaskGroup typing (#16811)
Update click to 8.x (#16779)
Remove remaining Pylint disables (#16760)
Remove duplicated try, there is already a try in create_session (#16701)
Removes pylint from our toolchain (#16682)
Refactor usage of unneeded function call (#16653)
Add type annotations to setup.py (#16658)
Remove SQLAlchemy <1.4 constraint (#16630) (Note: our dependencies still have a requirement on <1.4)
Refactor dag.clear method (#16086)
Use DAG_ACTIONS constant (#16232)
Use updated _get_all_non_dag_permissions method (#16317)
Add updated-name wrappers for built-in FAB methods (#16077)
Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
Remove TaskInstance.log_filepath attribute (#15217)
Removes unnecessary function call in airflow/www/app.py (#15956)
Move plyvel to google provider extra (#15812)
Update permission migrations to use new naming scheme (#16400)
Use resource and action names for FAB (#16380)
Swap out calls to find_permission_view_menu for get_permission wrapper (#16377)
Fix deprecated default for fab_logging_level to WARNING (#18783)
Allow running tasks from UI when using CeleryKubernetesExecutor (#18441)

Open source →

2.2.0rc18 Oct 2021pre-release

Nothing published for this version

2.2.0b222 Sept 2021pre-release

Nothing published for this version

2.2.0b111 Sept 2021pre-release

Nothing published for this version

2.1.418 Sept 2021Deprecated

Fix deprecation error message rather than silencing it

Bug Fixes

Fix deprecation error message rather than silencing it (#18126)
Limit the number of queued dagruns created by the Scheduler (#18065)
Fix DagRun execution order from queued to running not being properly followed (#18061)
Fix max_active_runs not allowing moving of queued dagruns to running (#17945)
Avoid redirect loop for users with no permissions (#17838)
Avoid endless redirect loop when user has no roles (#17613)
Fix log links on graph TI modal (#17862)
Hide variable import form if user lacks permission (#18000)
Improve dag/task concurrency check (#17786)
Fix Clear task instances endpoint resets all DAG runs bug (#17961)
Fixes incorrect parameter passed to views (#18083) (#18085)
Fix Sentry handler from LocalTaskJob causing error (#18119)
Limit colorlog version (6.x is incompatible) (#18099)
Only show Pause/Unpause tooltip on hover (#17957)
Improve graph view load time for dags with open groups (#17821)
Increase width for Run column (#17817)
Fix wrong query on running tis (#17631)
Add root to tree refresh url (#17633)
Do not delete running DAG from the UI (#17630)
Improve discoverability of Provider packages' functionality
Do not let create_dagrun overwrite explicit run_id (#17728)
BugFix: Regression on pid reset to allow task start after heartbeat (#17333)
Set task state to failed when pod is DELETED while running (#18095)
Advises the kernel to not cache log files generated by Airflow (#18054)
Sort adopted tasks in _check_for_stalled_adopted_tasks method (#18208)
Fix DagRunState enum query for MySQLdb driver (#17886)

Doc only changes

Update version added fields in airflow/config_templates/config.yml (#18128)
Improve the description of how to handle dynamic task generation (#17963)
Improve cross-links to operators and hooks references (#17622)
Doc: Fix replacing Airflow version for Docker stack (#17711)
Make the providers operators/hooks reference much more usable (#17768)
Update description about the new connection-types provider meta-data
Suggest to use secrets backend for variable when it contains sensitive data (#17319)
Improves quick-start docker-compose warnings and documentation (#18164)
Separate Installing from sources section and add more details (#18171)
Doc: Use closer.lua script for downloading sources (#18179)
Doc: Improve installing from sources (#18194)
Improves installing from sources pages for all components (#18251)

Open source →

2.1.4rc215 Sept 2021pre-release

Nothing published for this version

2.1.4rc111 Sept 2021pre-release

Nothing published for this version

2.1.323 Aug 2021

Fix task retries when they receive sigkill and have retries and properly handle sigterm

Bug Fixes

Fix task retries when they receive sigkill and have retries and properly handle sigterm (#16301)
Fix redacting secrets in context exceptions. (#17618)
Fix race condition with dagrun callbacks (#16741)
Add 'queued' to DagRunState (#16854)
Add 'queued' state to DagRun (#16401)
Fix external elasticsearch logs link (#16357)
Add proper warning message when recorded PID is different from current PID (#17411)
Fix running tasks with default_impersonation config (#17229)
Rescue if a DagRun's DAG was removed from db (#17544)
Fixed broken json_client (#17529)
Handle and log exceptions raised during task callback (#17347)
Fix CLI kubernetes cleanup-pods which fails on invalid label key (#17298)
Show serialization exceptions in DAG parsing log (#17277)
Fix: TaskInstance does not show queued_by_job_id & external_executor_id (#17179)
Adds more explanatory message when SecretsMasker is not configured (#17101)
Enable the use of __init_subclass__ in subclasses of BaseOperator (#17027)
Fix task instance retrieval in XCom view (#16923)
Validate type of priority_weight during parsing (#16765)
Correctly handle custom deps` and task_group`` during DAG Serialization (#16734)
Fix slow (cleared) tasks being be adopted by Celery worker. (#16718)
Fix calculating duration in tree view (#16695)
Fix AttributeError: datetime.timezone object has no attribute name (#16599)
Redact conn secrets in webserver logs (#16579)
Change graph focus to top of view instead of center (#16484)
Fail tasks in scheduler when executor reports they failed (#15929)
fix(smart_sensor): Unbound variable errors (#14774)
Add back missing permissions to UserModelView controls. (#17431)
Better diagnostics and self-healing of docker-compose (#17484)
Improve diagnostics message when users have secret_key mis-configured (#17410)
Stop checking execution_date in task_instance.refresh_from_db (#16809)

Improvements

Run mini scheduler in LocalTaskJob during task exit (#16289)
Remove SQLAlchemy<1.4 constraint (#16630)
Bump Jinja2 upper-bound from 2.12.0 to 4.0.0 (#16595)
Bump dnspython (#16698)
Updates to FlaskAppBuilder 3.3.2+ (#17208)
Add State types for tasks and DAGs (#15285)
Set Process title for Worker when using LocalExecutor (#16623)
Move DagFileProcessor and DagFileProcessorProcess out of scheduler_job.py (#16581)

Doc-only changes

Fix inconsistencies in configuration docs (#17317)
Fix docs link for using SQLite as Metadata DB (#17308)

Misc

Switch back http provider after requests removes LGPL dependency (#16974)

Open source →

2.1.3rc118 Aug 2021pre-release

Nothing published for this version

2.1.214 Jul 2021

Only allow the webserver to request from the worker log server

Bug Fixes

Only allow the webserver to request from the worker log server (#16754)
Fix "Invalid JSON configuration, must be a dict" bug (#16648)
Fix CeleryKubernetesExecutor (#16700)
Mask value if the key is token (#16474)
Fix impersonation issue with LocalTaskJob (#16852)

Misc

Add Python 3.9 support (#15515)

Open source →

2.1.2rc110 Jul 2021pre-release

Nothing published for this version

2.1.12 Jul 2021Security

Fix normalize-url vulnerability

Bug Fixes

Don't crash attempting to mask secrets in dict with non-string keys (#16601)
Always install sphinx_airflow_theme from PyPI (#16594)
Remove limitation for elasticsearch library (#16553)
Adding extra requirements for build and runtime of the PROD image. (#16170)
Cattrs 1.7.0 released by the end of May 2021 break lineage usage (#16173)
Removes unnecessary packages from setup_requires (#16139)
Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
Improvements for Docker Image docs (#14843)
Ensure that dag_run.conf is a dict (#15057)
Fix CLI connections import and migrate logic from secrets to Connection model (#15425)
Fix Dag Details start date bug (#16206)
Fix DAG run state not updated while DAG is paused (#16343)
Allow null value for operator field in task_instance schema(REST API) (#16516)
Avoid recursion going too deep when redacting logs (#16491)
Backfill: Don't create a DagRun if no tasks match task regex (#16461)
Tree View UI for larger DAGs & more consistent spacing in Tree View (#16522)
Correctly handle None returns from Query.scalar() (#16345)
Adding only_active parameter to /dags endpoint (#14306)
Don't show stale Serialized DAGs if they are deleted in DB (#16368)
Make REST API List DAGs endpoint consistent with UI/CLI behaviour (#16318)
Support remote logging in elasticsearch with filebeat 7 (#14625)
Queue tasks with higher priority and earlier execution_date first. (#15210)
Make task ID on legend have enough width and width of line chart to be 100%. (#15915)
Fix normalize-url vulnerability (#16375)
Validate retries value on init for better errors (#16415)
add num_runs query param for tree refresh (#16437)
Fix templated default/example values in config ref docs (#16442)
Add passphrase and private_key to default sensitive field names (#16392)
Fix tasks in an infinite slots pool were never scheduled (#15247)
Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
Don't fail to log if we can't redact something (#16118)
Set max tree width to 1200 pixels (#16067)
Fill the "job_id" field for airflow task run without --local/--raw for KubeExecutor (#16108)
Fixes problem where conf variable was used before initialization (#16088)
Fix apply defaults for task decorator (#16085)
Parse recently modified files even if just parsed (#16075)
Ensure that we don't try to mask empty string in logs (#16057)
Don't die when masking log.exception when there is no exception (#16047)
Restores apply_defaults import in base_sensor_operator (#16040)
Fix auto-refresh in tree view When webserver ui is not in / (#16018)
Fix dag.clear() to set multiple dags to running when necessary (#15382)
Fix Celery executor getting stuck randomly because of reset_signals in multiprocessing (#15989)

Open source →

2.1.1rc126 Jun 2021pre-release

Nothing published for this version

Your coding agent can read these notes before it upgrades. Set up the MCP server →

apache-airflow

Release timeline

Releases

Bug Fixes

Misc/Internal

Doc Only Changes

New Features

Improvements

Bug Fixes

Misc/Internal

Doc only changes

Significant Changes

airflow dags test no longer performs a backfill job (#26400)

Airflow config section kubernetes renamed to kubernetes_executor (#26873)

AirflowException is now thrown as soon as any dependent tasks of ExternalTaskSensor fails (#27190)

The Airflow config option scheduler.deactivate_stale_dags_interval has been renamed to scheduler.parsing_cleanup_interval (#27828).

New Features

Improvements

Bug Fixes

Misc/Internal

Doc only changes

Bug Fixes

Misc/Internal

Doc only changes

Bug Fixes

Misc/Internal

Doc only changes

Bug Fixes

Doc only changes

New Features

Improvements

Bug Fixes

Misc/Internal

Doc only changes

Bug Fixes

Doc only changes

Misc/Internal

Bug Fixes

Doc only changes

Misc/Internal

Bug Fixes

Doc only changes

Misc/Internal

Bug Fixes

Doc only changes

Misc/Internal

New Features

Improvements

Bug Fixes

Doc only changes

Misc/Internal

Bug Fixes

Doc only changes

Misc

Bug Fixes

Doc only changes

Misc

Bug Fixes

Doc only changes

Bug Fixes

Doc only changes

Bug Fixes

Doc only changes

New Features

Improvements

Bug Fixes

Doc only changes

Misc/Internal

Bug Fixes

Doc only changes

Bug Fixes

Improvements

Doc-only changes

Misc

Bug Fixes

Misc

Bug Fixes