NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI, #1563 most downloaded on PyPI
Programmatically author, schedule and monitor data pipelines
Latest stable
3.4.0
Last release 15 days ago
06 Nov 2026
Ships fairly regularly
a new release about every 2 weeks
Nearly every release is documented
notes for 60 of the last 60 stable releases
4 versions withdrawn
withdrawn after publishing
10 years old
306 releases · first in 2017
Drag across the ruler to compare, or tap a release to open it.
Nothing published for this version
Use pyarrow-hotfix to mitigate CVE-2023-47248
Raw HTML code in DAG docs and DAG params descriptions is disabled by default
To ensure that no malicious javascript can be injected with DAG descriptions or trigger UI forms by DAG authors
a new parameter webserver.allow_raw_html_descriptions was added with default value of False.
If you trust your DAG authors code and want to allow using raw HTML in DAG descriptions and params, you can restore the previous
behavior by setting the configuration value to True.
To ensure Airflow is secure by default, the raw HTML support in trigger UI has been super-seeded by markdown support via
the description_md attribute. If you have been using description_html please migrate to description_md.
The custom_html_form is now deprecated. (#35460)
prev_end_date_success method access (#34528)List Task Instances view (#34529)clear_number to track DAG run being cleared (#34126)multiselect to run state in grid view (#35403)Connection.get_hook in case of ImportError (#36005)taskinstance (#35810)AIRFLOW_CONFIG path (#35818)JSON-string connection representation generator (#35723)BaseOperatorLink into the separate module (#35032)cbreak in execute_interactive and handle SIGINT (#35602)synchronize_log_template function (#35366)BaseOperatorLink.operators (#35003)SA2-compatible syntax for TaskReschedule (#33720)EventScheduler (#34808)update_forward_refs (#34657)Dataset from airflow package in codebase (#34610)airflow.datasets.Dataset in examples and tests (#34605)version top-level element from docker compose files (#33831)NOT EXISTS subquery instead of tuple_not_in_condition (#33527)triggerer_heartbeat (#33320)airflow variables export to print to stdout (#33279)reset_user_sessions to work from either CLI or web (#36056)overscroll behaviour to auto (#35717)borderWidthRight to grid for Firefox scrollbar (#35346)processor_subdir in serialized_dag table (#35661)get_dag_by_pickle util function (#35339)mappedoperator (#35257)Literal from typing_extensions (#33794)4.3.10 (#35991)Connection.to_json_dict to Connection.to_dict (#35894)moto version to >= 4.2.9 (#35687)pyarrow-hotfix to mitigate CVE-2023-47248 (#35650)axios from 0.26.0 to 1.6.0 in /airflow/www/ (#35624)navbar_text_color and rm condition in style (#35553)dag_next_execution (#35539)TCH004 and TCH005 rules (#35475)AirflowException from airflow (#34541)postcss from 8.4.25 to 8.4.31 in /airflow/www (#34770)airflow.models.dag.DAG in examples (#34617)re2 regex engine in the .airflowignore documentation. (#35663)best-practices.rst (#35692)dag-run.rst to mention Airflow's support for extended cron syntax through croniter (#35342)webserver.rst to include information of supported OAuth2 providers (#35237)rst code block format (#34708)Your coding agent can read these notes before it upgrades. Set up the MCP server →
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Update dags.rst to put SubDag deprecation note right after the SubDag section heading
No significant changes.
codemirror and extra (#35122)get_plugin_info for class based listeners. (#35022)all_skipped trigger rule as skipped if any task is in upstream_failed state (#34392)pendulum requirement to <3.0 (#35336)sentry_sdk to 1.33.0 (#35298)@babel/traverse from 7.16.0 to 7.23.2 in /airflow/www (#34988)undici from 5.19.1 to 5.26.3 in /airflow/www (#34971)SchedulerJobRunner (#34810)max_tis per query > parallelism (#34742)connexion<3.0 upper bound (#35218)< 3.12 (#35123)3.1.0 (#34943)conn.extras (#35165)mysql-connector-python from recommended MySQL driver (#34287)set_downstream example (#35075)airflow_local_settings.py template (#34826)'>' in provider section name (#34813)Nothing published for this version
Deprecate numeric type python version in PythonVirtualEnvOperator
No significant changes
taskgroup is mapped (#34587)cluster_activity view not loading due to standaloneDagProcessor templating (#34274)loglevel=DEBUG in 'Not syncing DAG-level permissions' (#34268)access_control={} (#34114)ab_user table in the CLI session (#34120)next_run_datasets_summary endpoint (#34143)_run_task_session in mapped render_template_fields (#33309)version_added (#34011)AUTH_REMOTE_USER from FAB in WSGI middleware example (#34721)astroid version < 3 (#34658)os.path.splitext to Path.* (#34352, #33669)pyproject.toml (#34014)isinstance in fab_security manager (#33760)isinstance calls for the same object in a single call (#33767)str.splitlines() to split lines (#33592)len() (#33454)Nothing published for this version
When setting catchup=False, CronTriggerTimetable no longer skips a run if the scheduler does not query the timetable immediately after the previous ru
When setting catchup=False, CronTriggerTimetable no longer skips a run if
the scheduler does not query the timetable immediately after the previous run
has been triggered.
This should not affect scheduling in most cases, but can change the behaviour if
a DAG is paused-unpaused to manually skip a run. Previously, the timetable (with
catchup=False) would only start a run after a DAG is unpaused, but with this
change, the scheduler would try to look at little bit back to schedule the
previous run that covers a part of the period when the DAG was paused. This
means you will need to keep a DAG paused longer (namely, for the entire cron
period to pass) to really skip a run.
Note that this is also the behaviour exhibited by various other cron-based
scheduling tools, such as anacron.
conf.set() becomes case insensitive to match conf.get() behavior (#33452)Also, conf.get() will now break if used with non-string parameters.
conf.set(section, key, value) used to be case sensitive, i.e. conf.set("SECTION", "KEY", value)
and conf.set("section", "key", value) were stored as two distinct configurations.
This was inconsistent with the behavior of conf.get(section, key), which was always converting the section and key to lower case.
As a result, configuration options set with upper case characters in the section or key were unreachable.
That's why we are now converting section and key to lower case in conf.set too.
We also changed a bit the behavior of conf.get(). It used to allow objects that are not strings in the section or key.
Doing this will now result in an exception. For instance, conf.get("section", 123) needs to be replaced with conf.get("section", "123").
MappedTaskGroup tasks not respecting upstream dependency (#33732)SECURITY_MANAGER_CLASS should be a reference to class, not a string (#33690)get_url_for_login in security manager (#33660)2.7.0 db migration job errors (#33652)groupby in TIS duration calculation (#33535)dialect.name in custom SA types (#33503)end_date is less than utcnow (#33488)formatDuration method (#33486)conf.set case insensitive (#33452)soft_fail argument when poke is called (#33401)processor_subdir (#33357)<br> text in Provider's view (#33326)soft_fail argument when ExternalTaskSensor runs in deferrable mode (#33196)expand_kwargs method (#32272)Pydantic 1 compatibility (#34081, #33998)Pydantic 2 (#33956)devel_only extra in Airflow's setup.py (#33907)FAB to 4.3.4 in order to fix issues with filters (#33931)sqlalchemy to 1.4.24 (#33892)OrderedDict with plain dict (#33508)Pydantic warning about orm_mode rename (#33220)Pydantic limitation for version < 2 (#33507)Nothing published for this version
Nothing published for this version
Add deprecation info to the Airflow modules and classes docstring
As of now, Python 3.7 is no longer supported by the Python community. Therefore, to use Airflow 2.7.0, you must ensure your Python version is either 3.8, 3.9, 3.10, or 3.11.
The old Graph View is removed. The new Graph View is the default view now.
If you are using dag_run.conf dictionary and web UI JSON entry to run your DAG you should either:
Add params to your DAG <https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/params.html#use-params-to-provide-a-trigger-ui-form>_show_trigger_form_if_no_params to bring back old behaviourInstead, you should use "airflow db migrate" command to create or upgrade database. This command will not create default connections. In order to create default connections you need to run "airflow connections create-default-connections" explicitly, after running "airflow db migrate".
The "default" context is Python's default_ssl_contest instead of previously used "none". The
default_ssl_context provides a balance between security and compatibility but in some cases,
when certificates are old, self-signed or misconfigured, it might not work. This can be configured
by setting "ssl_context" in "email" configuration of Airflow.
Setting it to "none" brings back the "none" setting that was used in Airflow 2.6 and before, but it is not recommended due to security reasons ad this setting disables validation of certificates and allows MITM attacks.
For security reasons, the test connection functionality is disabled by default across Airflow UI,
API and CLI. The availability of the functionality can be controlled by the
test_connection flag in the core section of the Airflow
configuration (airflow.cfg). It can also be controlled by the
environment variable AIRFLOW__CORE__TEST_CONNECTION.
The following values are accepted for this config param:
Disabled: Disables the test connection functionality and
disables the Test Connection button in the UI.This is also the default value set in the Airflow configuration.
2. Enabled: Enables the test connection functionality and
activates the Test Connection button in the UI.
Hidden: Disables the test connection functionality and
hides the Test Connection button in UI.For more information on capabilities of users, see the documentation: https://airflow.apache.org/docs/apache-airflow/stable/security/security_model.html#capabilities-of-authenticated-ui-users It is strongly advised to not enable the feature until you make sure that only highly trusted UI/API users have "edit connection" permissions.
xcomEntries API disables support for the deserialize flag by default (#32176)For security reasons, the /dags/*/dagRuns/*/taskInstances/*/xcomEntries/*
API endpoint now disables the deserialize option to deserialize arbitrary
XCom values in the webserver. For backward compatibility, server admins may set
the [api] enable_xcom_deserialize_support config to True to enable the
flag and restore backward compatibility.
However, it is strongly advised to not enable the feature, and perform deserialization at the client side instead.
Default name of the Celery application changed from airflow.executors.celery_executor to airflow.providers.celery.executors.celery_executor.
You should change both your configuration and Health check command to use the new name:
celery_app_name configuration in celery section) use airflow.providers.celery.executors.celery_executorairflow.providers.celery.executors.celery_executor.appscheduler.max_tis_per_query is changed from 512 to 16 (#32572)This change is expected to make the Scheduler more responsive.
scheduler.max_tis_per_query needs to be lower than core.parallelism.
If both were left to their default value previously, the effective default value of scheduler.max_tis_per_query was 32
(because it was capped at core.parallelism).
To keep the behavior as close as possible to the old config, one can set scheduler.max_tis_per_query = 0,
in which case it'll always use the value of core.parallelism.
In order to use the executors, you need to install the providers:
apache-airflow-providers-celery package >= 3.3.0apache-airflow-providers-cncf-kubernetes package >= 7.4.0apache-airflow-providers-daskexecutor package in any versionYou can achieve it also by installing airflow with [celery], [cncf.kubernetes], [daskexecutor] extras respectively.
Users who base their images on the apache/airflow reference image (not slim) should be unaffected - the base
reference image comes with all the three providers installed.
This index seems to have great positive effect in a setup with tens of millions such rows.
BranchExternalPythonOperator (#32787, #33360)Per-LocalTaskJob Configuration (#32313)AirflowClusterPolicySkipDag exception (#32013)reactflow for datasets graph (#31775)chain which doesn't require matched lists (#31927)--retry and --retry-delay to airflow db check (#31836)section query param in get config rest API (#30936)Scheduled->Queued->Running task state transition times (#30612)db upgrade to db migrate and add connections create-default-connections (#32810, #33136)<= parallelism (#32572)isdisjoint instead of not intersection (#32616)dag_processor status. (#32382)[triggers.running] (#32050)TriggerDagRunOperator: Add wait_for_completion to template_fields (#31122)PythonVirtualenvOperator termination log in alert (#31747)airflow db commands to SQLAlchemy 2.0 style (#31486)validators into their own modules (#30802)get_log api (#30729)Gantt chart: Use earliest/oldest ti dates if different than dag run start/end (#33215)virtualenv detection for Python virtualenv operator (#33223)chmod airflow.cfg (#33118)max_active_runs reached its upper limit. (#31414)get_task_instances query (#33054)$ref (#32887)PythonOperator sub-classes extend its decorator (#32845)virtualenv is installed in PythonVirtualenvOperator (#32939)__iter__ in is_container() (#32850)dagRunTimeout (#32565)/blocked endpoint (#32571)cli.dags.trigger command output (#32548)whitespaces from airflow connections form (#32292)readonly property in our API (#32510)resizer wouldn't expanse grid view (#31581)type_ arg to drop_constraint (#31306)drop_constraint call in migrations (#31302)requirepass redis sentinel (#30352)/config (#31057)dag_processing (#33161)Pydantic to < 2.0.0 (#33235)cncf.kubernetes provider (#32767, #32891)pydocstyle check - core Airflow only (#31297)1.2.3 to 1.2.4 in /airflow/www (#32680)6.3.0 to 6.3.1 in /airflow/www (#32506)4.18.0 (#32445)stylelint from 13.13.1 to 15.10.1 in /airflow/www (#32435)4.0.0 to 4.1.3 in /airflow/www (#32443)Pydantic 2 (#32366)enums (#31735)0.272 (#31966)asynctest (#31664)2.0 style (#31569, #31772, #32350, #32339, #32474, #32645)3.7 support (#30963)0.0.262 (#30809)1.2.0 (#30687)DAGRun / DAG / Task in templates-ref.rst (#33013)Nothing published for this version
Nothing published for this version
Nothing published for this version
Use linear time regular expressions
DagRun.run_id and allow flexibility (#32293)executor_class from Job - fixing backfill for custom executors (#32219)mapIndex to display extra links per mapped task. (#32154)re2 for matching untrusted regex (#32060)dag_dependencies in serialized dag (#32037)None if an XComArg fails to resolve in a multiple_outputs Task (#32027)rendered-templates when map index is not found (#32011)ExternalTaskSensor when there is no task group TIs for the current execution date (#32009)operator_extra_links property serialization in mapped tasks (#31904)xcom_pull and inlets (#31128)on_failure_callback is not invoked when task failed during testing dag. (#30965)ExternalPythonOperator and debug logging level (#30367)task.sensor annotation in type stub (#31954)Pydantic to < 2.0.0 until we solve 2.0.0 incompatibilities (#32312)Pydantic 2 pickiness about model definition (#32307)™ to Airflow in prominent places (#31977)Nothing published for this version
Cascade update of TaskInstance to TaskMap table
map_index to the xcom key when skipping downstream tasks (#31541)/health endpoint (#31529)max_active_tis_per_dagrun for Dynamic Task Mapping (#31406)url_for_asset fallback and 404 on DAG Audit Log (#31233)default_args in nested task groups (#31608)[secrets] backend_kwargs as a sensitive config (#31788)Nothing published for this version
Nothing published for this version
In the past SchedulerJob and other *Job classes are known to have been used to perform external health checks for Airflow components. Those are, howev
Job classes (#31277).In the past SchedulerJob and other *Job classes are known to have been used to perform
external health checks for Airflow components. Those are, however, Airflow DB ORM related classes.
The DB models and database structure of Airflow are considered as internal implementation detail, following
public interface <https://airflow.apache.org/docs/apache-airflow/stable/public-airflow-interface.html>_).
Therefore, they should not be used for external health checks. Instead, you should use the
airflow jobs check CLI command (introduced in Airflow 2.1) for that purpose.
job_type column (#31182)api_client_retry_configuration (#31174)interleave_timestamp_parser config to the logging section (#31102)MappedTaskGroup import in taskinstance file (#31100)apache-hive extra so it installs the correct package (#31068)airflow providers get command output (#30978)pandas.DataFrame (#30943)order_by request in list DAG rest api (#30926)state and start_date from being reset when clearing a task in a running DagRun (#30125)dag_processing.processes metric (#30891)config directory in docker compose (#30662)version_added config field for might_contain_dag and metrics_allow_list (#30969)Nothing published for this version
Nothing published for this version
Nothing published for this version
This is potentially a breaking change for any custom trigger implementations that override the cleanup() method and uses synchronous code, however usi…
Default setting handles case where impersonation is needed and both users (airflow and the impersonated user)
have the same group set as main group. Previously the default was also other-writeable and the user might choose
to use the other-writeable setting if they wish by configuring file_task_handler_new_folder_permissions
and file_task_handler_new_file_permissions in logging section.
This stops SLA callbacks from keeping the dag processor manager permanently busy. It means reduced CPU, and fixes issues where SLAs stop the system from seeing changes to existing dag files. Additional metrics added to help track queue state.
cleanup() method in BaseTrigger is now defined as asynchronous (following async/await) pattern (#30152).This is potentially a breaking change for any custom trigger implementations that override the cleanup()
method and uses synchronous code, however using synchronous operations in cleanup was technically wrong,
because the method was executed in the main loop of the Triggerer and it was introducing unnecessary delays
impacting other triggers. The change is unlikely to affect any existing trigger implementations.
scheduler.tasks.running no longer exist (#30374)The gauge has never been working and its value has always been 0. Having an accurate value for this metric is complex so it has been decided that removing this gauge makes more sense than fixing it with no certainty of the correctness of its value.
task_queued_timeout config (#30375)Logic for handling tasks stuck in the queued state has been consolidated, and the all configurations
responsible for timing out stuck queued tasks have been deprecated and merged into
[scheduler] task_queued_timeout. The configurations that have been deprecated are
[kubernetes] worker_pods_pending_timeout, [celery] stalled_task_timeout, and
[celery] task_adoption_timeout. If any of these configurations are set, the longest timeout will be
respected. For example, if [celery] stalled_task_timeout is 1200, and [scheduler] task_queued_timeout
is 600, Airflow will set [scheduler] task_queued_timeout to 1200.
The configurations view now only displays the running configuration. Previously, the default configuration
was displayed at the top but it was not obvious whether this default configuration was overridden or not.
Subsequently, the non-documented endpoint /configuration?raw=true is deprecated and will be removed in
Airflow 3.0. The HTTP response now returns an additional Deprecation header. The /config endpoint on
the REST API is the standard way to fetch Airflow configuration programmatically.
ExternalTaskSensor now has an explicit skipped_states list
Maximum retry task delay is set to be 24h (86400s) by default. You can change it globally via core.max_task_retry_delay
parameter.
The Hive Macros (hive.max_partition, hive.closest_ds_partition) are available only when Hive Provider is
installed. Please install Hive Provider > 5.1.0 when using those macros.
max_active_tis_per_dagrun for Dynamic Task Mapping (#29094)TriggerDagRunOperator (#30292)Blocklist to disable specific metric tags or metric names (#29881)check_migrations config (#29714)cli.dags.trigger (#29224)db export-archived command. (#29485)airflow db drop-archived command (#29309)FileTrigger (#29265)connections import CLI command (#28738)AIP-51 <https://github.com/apache/airflow/pulls?q=is%3Apr+is%3Amerged+label%3AAIP-51+milestone%3A%22Airflow+2.6.0%22>_)UX in grid view (#30373)select() to new style (#30515)metrics_*_list (#30174)on_*_callback/sla_miss_callbacks (#28469)renamed and previous_name in config sections (#28324)triggerer status (#27755)too old resource version exception by retrieving the latest resource_version (#30425)TriggerDagRunOperator with deferrable parameter (#30406)example_sensor_decorator DAG (#30513)skip_exit_code in BashOperator (#30734)scheduler.tasks.running (#30374)/airflow/www (#30568)/airflow/www (#30319)/airflow/www (#30316)dag.fileloc instead of dag.full_filepath in exception message (#30610)importlib-metadata backport to < 5.0.0 (#29924)importlib.metadata to get Version for speed (#29723)db export-cleaned to db export-archived (#29450)freezegun with time-machine (#28193)airflow/kubernetes/* (#28212)audit_logs.rst (#30405)*_lookup_pattern parameters (#29580)Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Fix DagProcessorJob integration for standalone dag-processor
No significant changes.
dag.partial_subset doesn't mutate task group properties (#30129)airflow dags next-execution cli command (#30117)TriggerRuleDep when the mapped tasks count is 0 (#30084)Nothing published for this version
Nothing published for this version
…time and no timezone was specified) but we raise deprecation warning.
In case of API calls, it was possible that "+" passed as part of the date-time fields were not URL-encoded, and
such date-time fields could pass validation. Such date-time parameters should now be URL-encoded (as %2B).
In case of parameters, we still allow IS8601-compliant date-time (so for example it is possible that
' ' was used instead of T separating date from time and no timezone was specified) but we raise
deprecation warning.
[webserver] expose_hostname changed to False (#29547)The default for [webserver] expose_hostname has been set to False, instead of True. This means administrators must opt-in to expose webserver hostnames to end users.
/dagRuns API should 404 if dag not active (#29860)openapi spec responses by adding additional return type (#29600)prev_logical_date variable offset-aware (#29454)Edgemodifier refactoring w/ labels in TaskGroup edge case (#29410)airflow connections add (#28922)undici from 5.9.1 to 5.19.1 (#29583)v67.2.0 (#29465)ua-parser-js from 0.7.31 to 0.7.33 in /airflow/www (#29172)pytest (#29086)run_id url param when linking to graph/gantt views (#29066)python_callable (#28932)swagger-ui-dist from 3.52.0 to 4.1.3 in /airflow/www (#28824)importlib-metadata backport to < 5.0.0 (#29924, #30069)merge_data() task (#29158)notes param from TriggerDagRunOperator docstring (#29298)schedule param rather than timetable in Timetables docs (#29255)Nothing published for this version
Nothing published for this version
Fix masking of non-sensitive environment variables
swagger-ui-dist via npm package (#28788)UIAlert should_show when AUTH_ROLE_PUBLIC set (#28781)external_task_ids of ExternalTaskSensor (#28692)DetachedInstanceError when finding zombies in Dag Parsing process (#28198)divs to fix dagid copy nit on dag.html (#28643)setNote endpoints under TaskInstance in OpenAPI (#28566)CronTriggerTimetable (#28532)ensure_ascii=False in trigger dag run API (#28451)ti._try_number for deferred and up_for_reschedule tasks (#26993)callModal from dag.js (#28410)monkeypatching via environment variable (#28283)LazyXComAccess (#28191)@dag decorator are reported in dag file (#28153)dagbag_size metric decreases when files are deleted (#28135)airflow.api.auth.backend.session to backend sessions in compose (#28094)next_dagruns_to_examine, add MySQL index hint (#27821)dnspython after eventlet got fixed (#29004)dnspython to < 2.3.0 until eventlet incompatibility is solved (#28962)SQLAlchemy to below 2.0 (#28725)json5 from 1.0.1 to 1.0.2 in /airflow/www (#28715)Enums (#28627)Connection.get_extra type (#28594)conf.get* from the right source location (#28543)purge_inactive_dag_warnings (#28481)test_task_command to Pytest and unquarantine tests in it (#28247)0.2.0 to 0.2.2 in /airflow/www (#28080)subgraph logic (#27987)map_index (#27904)LocalTaskJob (#27381)Nothing published for this version
Nothing published for this version
Deprecate use of core get_kube_client in PodManager
TaskRunner: notify of component start and finish (#27855)AirflowModelViews(Variables/Connection) (#24079, #27994, #27923)Is /not Null filter for value is None on webui (#26584)one_done trigger rule (#26146)TI.xcom_pull() with explicit task_ids and map_indexes (#27699)urlsplit (#27389)branch_task_ids into SkipMixin (#27434).first() to .scalar() (#27323)howtos about sensors (#27333)extra__conn_type__ prefix required for UI behaviors (#26995)crashloopbackoff when using hostname_callable (#24999)__future__.annotations automatically by isort (#26383)V1Pod in task callback (#27609)taskInstance errors and split into two tables (#26575)autoregistered DAGs if there are any import errors (#26398)from airflow import version lazy import (#26239)is_mapped attribute (#27881)airflow/callbacks/* airflow/cli/* (#27721)airflow/api_connexion/* directory (#27718)airflow/listener/* directory (#27731)airflow/lineage/* directory (#27732)airflow/api/* directory (#27716)minimatch from 3.0.4 to 3.0.8 in /airflow/www (#27688)1.4.1 to 1.4.2 in /airflow/www (#27697)BaseTrigger.run (#27416)2022.10.1 (#27383)memray files to gitignore / dockerignore (#27001)sphinx-autoapi (#26743)RTIF.delete_old_records() (#26667)pyupgrade edge cases (#26384)docker-compose.yaml (#26726)In order to make airflow dags test more useful as a testing and debugging tool, we no longer run a backfill job and instead run a "local task runner". Users can still backfill their DAGs using the airflow dags backfill command.
KubernetesPodOperator no longer considers any core kubernetes config params, so this section now only applies to kubernetes executor. Renaming it reduces potential for confusion.
ExternalTaskSensor no longer hangs indefinitely when failed_states is set, an execute_date_fn is used, and some but not all of the dependent tasks fail. Instead, an AirflowException is thrown as soon as any of the dependent tasks fail. Any code handling this failure in addition to timeouts should move to caching the AirflowException BaseClass and not only the AirflowSensorTimeout subclass.
The old option will continue to work but will issue deprecation warnings, and will be removed entirely in Airflow 3.
TaskRunner: notify of component start and finish (#27855)
Add DagRun state change to the Listener plugin system(#27113)
Metric for raw task return codes (#27155)
Add logic for XComArg to pull specific map indexes (#27771)
Clear TaskGroup (#26658, #28003)
Add critical section query duration metric (#27700)
Add: #23880 :: Audit log for AirflowModelViews(Variables/Connection) (#24079, #27994, #27923)
Add postgres 15 support (#27444)
Expand tasks in mapped group at run time (#27491)
reset commits, clean submodules (#27560)
scheduler_job, add metric for scheduler loop timer (#27605)
Allow datasets to be used in taskflow (#27540)
Add expanded_ti_count to ti context (#27680)
Add user comment to task instance and dag run (#26457, #27849, #27867)
Enable copying DagRun JSON to clipboard (#27639)
Implement extra controls for SLAs (#27557)
add dag parsed time in DAG view (#27573)
Add max_wait for exponential_backoff in BaseSensor (#27597)
Expand tasks in mapped group at parse time (#27158)
Add disable retry flag on backfill (#23829)
Adding sensor decorator (#22562)
Api endpoint update ti (#26165)
Filtering datasets by recent update events (#26942)
Support Is /not Null filter for value is None on webui (#26584)
Add search to datasets list (#26893)
Split out and handle 'params' in mapped operator (#26100)
Add authoring API for TaskGroup mapping (#26844)
Add one_done trigger rule (#26146)
Create a more efficient airflow dag test command that also has better local logging (#26400)
Support add/remove permissions to roles commands (#26338)
Auto tail file logs in Web UI (#26169)
Add triggerer info to task instance in API (#26249)
Flag to deserialize value on custom XCom backend (#26343)
Allow depth-first execution (#27827)
UI: Update offset height if data changes (#27865)
Improve TriggerRuleDep typing and readability (#27810)
Make views requiring session, keyword only args (#27790)
Optimize TI.xcom_pull() with explicit task_ids and map_indexes (#27699)
Allow hyphens in pod id used by k8s executor (#27737)
optimise task instances filtering (#27102)
Use context managers to simplify log serve management (#27756)
Fix formatting leftovers (#27750)
Improve task deadlock messaging (#27734)
Improve "sensor timeout" messaging (#27733)
Replace urlparse with urlsplit (#27389)
Align TaskGroup semantics to AbstractOperator (#27723)
Add new files to parsing queue on every loop of dag processing (#27060)
Make Kubernetes Executor & Scheduler resilient to error during PMH execution (#27611)
Separate dataset deps into individual graphs (#27356)
Use log.exception where more economical than log.error (#27517)
Move validation branch_task_ids into SkipMixin (#27434)
Coerce LazyXComAccess to list when pushed to XCom (#27251)
Update cluster-policies.rst docs (#27362)
Add warning if connection type already registered within the provider (#27520)
Activate debug logging in commands with --verbose option (#27447)
Add classic examples for Python Operators (#27403)
change .first() to .scalar() (#27323)
Improve reset_dag_run description (#26755)
Add examples and howtos about sensors (#27333)
Make grid view widths adjustable (#27273)
Sorting plugins custom menu links by category before name (#27152)
Simplify DagRun.verify_integrity (#26894)
Add mapped task group info to serialization (#27027)
Correct the JSON style used for Run config in Grid View (#27119)
No extra__conn_type__ prefix required for UI behaviors (#26995)
Improve dataset update blurb (#26878)
Rename kubernetes config section to kubernetes_executor (#26873)
decode params for dataset searches (#26941)
Get rid of the DAGRun details page & rely completely on Grid (#26837)
Fix scheduler crashloopbackoff when using hostname_callable (#24999)
Reduce log verbosity in KubernetesExecutor. (#26582)
Don't iterate tis list twice for no reason (#26740)
Clearer code for PodGenerator.deserialize_model_file (#26641)
Don't import kubernetes unless you have a V1Pod (#26496)
Add updated_at column to DagRun and Ti tables (#26252)
Move the deserialization of custom XCom Backend to 2.4.0 (#26392)
Avoid calculating all elements when one item is needed (#26377)
Add __future__.annotations automatically by isort (#26383)
Handle list when serializing expand_kwargs (#26369)
Apply PEP-563 (Postponed Evaluation of Annotations) to core airflow (#26290)
Add more weekday operator and sensor examples #26071 (#26098)
Align TaskGroup semantics to AbstractOperator (#27723)
Gracefully handle whole config sections being renamed (#28008)
Add allow list for imports during deserialization (#27887)
Soft delete datasets that are no longer referenced in DAG schedules or task outlets (#27828)
Redirect to home view when there are no valid tags in the URL (#25715)
Refresh next run datasets info in dags view (#27839)
Make MappedTaskGroup depend on its expand inputs (#27876)
Make DagRun state updates for paused DAGs faster (#27725)
Don't explicitly set include_examples to False on task run command (#27813)
Fix menu border color (#27789)
Fix backfill queued task getting reset to scheduled state. (#23720)
Fix clearing child dag mapped tasks from parent dag (#27501)
Handle json encoding of V1Pod in task callback (#27609)
Fix ExternalTaskSensor can't check zipped dag (#27056)
Avoid re-fetching DAG run in TriggerDagRunOperator (#27635)
Continue on exception when retrieving metadata (#27665)
External task sensor fail fix (#27190)
Add the default None when pop actions (#27537)
Display parameter values from serialized dag in trigger dag view. (#27482, #27944)
Move TriggerDagRun conf check to execute (#27035)
Resolve trigger assignment race condition (#27072)
Update google_analytics.html (#27226)
Fix some bug in web ui dags list page (auto-refresh & jump search null state) (#27141)
Fixed broken URL for docker-compose.yaml (#26721)
Fix xcom arg.py .zip bug (#26636)
Fix 404 taskInstance errors and split into two tables (#26575)
Fix browser warning of improper thread usage (#26551)
template rendering issue fix (#26390)
Clear autoregistered DAGs if there are any import errors (#26398)
Fix from airflow import version lazy import (#26239)
allow scroll in triggered dag runs modal (#27965)
Remove is_mapped attribute (#27881)
Simplify FAB table resetting (#27869)
Fix old-style typing in Base Sensor (#27871)
Switch (back) to late imports (#27730)
Completed D400 for multiple folders (#27748)
simplify notes accordion test (#27757)
completed D400 for airflow/callbacks/* airflow/cli/* (#27721)
Completed D400 for airflow/api_connexion/* directory (#27718)
Completed D400 for airflow/listener/* directory (#27731)
Completed D400 for airflow/lineage/* directory (#27732)
Update API & Python Client versions (#27642)
Completed D400 & D401 for airflow/api/* directory (#27716)
Completed D400 for multiple folders (#27722)
Bump minimatch from 3.0.4 to 3.0.8 in /airflow/www (#27688)
Bump loader-utils from 1.4.1 to 1.4.2 ``in ``/airflow/www (#27697)
Disable nested task mapping for now (#27681)
bump alembic minimum version (#27629)
remove unused code.html (#27585)
Enable python string normalization everywhere (#27588)
Upgrade dependencies in order to avoid backtracking (#27531)
Strengthen a bit and clarify importance of triaging issues (#27262)
Deduplicate type hints (#27508)
Add stub 'yield' to BaseTrigger.run (#27416)
Remove upper-bound limit to dask (#27415)
Limit Dask to under 2022.10.1 (#27383)
Update old style typing (#26872)
Enable string normalization for docs (#27269)
Slightly faster up/downgrade tests (#26939)
Deprecate use of core get_kube_client in PodManager (#26848)
Add memray files to gitignore / dockerignore (#27001)
Bump sphinx and sphinx-autoapi (#26743)
Simplify RTIF.delete_old_records() (#26667)
migrate last react files to typescript (#26112)
Work around pyupgrade edge cases (#26384)
Document dag_file_processor_timeouts metric as deprecated (#27067)
Drop support for PostgreSQL 10 (#27594)
Update index.rst (#27529)
Add note about pushing the lazy XCom proxy to XCom (#27250)
Fix BaseOperator link (#27441)
[docs] best-practices add use variable with template example. (#27316)
docs for custom view using plugin (#27244)
Update graph view and grid view on overview page (#26909)
Documentation fixes (#26819)
make consistency on markup title string level (#26696)
Add documentation to dag test function (#26713)
Fix broken URL for docker-compose.yaml (#26726)
Add a note against use of top level code in timetable (#26649)
Fix example_datasets dag names (#26495)
Update docs: zip-like effect is now possible in task mapping (#26435)
changing to task decorator in docs from classic operator use (#25711)
Nothing published for this version
Nothing published for this version
Nothing published for this version
Fix double logging with some task logging handler
SLAMiss is nullable and not always given back when pulling task instances (#27423)_ when searching for DAGs (#27448)dag/task ids from BaseExecutor (#27550)RotatingFilehandler used in DagProcessor non-caching (#27223)executor.job_id to BackfillJob.id for backfills (#27020)1.4.0 to 1.4.1 in /airflow/www (#27552)TCP_KEEPALIVE etc warnings (#26981)KubernetesExecutor overwrites container args (#27450)BaseOperator links (#27441)Dag Run start. (#27111)kerberos environment variables to the docs (#27028)Nothing published for this version
Add missing AUTOINC/SERIAL for FAB tables
airflow dags reserialize (#27030)state_color_mapping jinja global (#26822)airflow tasks test (#26806)sphinx and sphinx-autoapi (#26743)RTIF.delete_old_records() (#26667)4.1.4 (#26393)docker-compose.yaml (#26726)Nothing published for this version
Resolve deprecation warning re Table.exists()
Table.exists() (#26616)templates_dict to task decorator (#26390)scheduled during backfill (#26205)json_provider_class on Flask app so it uses our encoder (#26554)cacheable (#26498)base_template (#26439)non-sensitive-only option for expose_config (#26507)example_datasets dag names (#26495)Nothing published for this version
Remove remaining deprecated classes and replace them with PEP562
@task.short_circuit TaskFlow decorator (#25752)execution_date_or_run_id optional in tasks test command (#26114)DagProcessors parsing files from different locations. (#25935)ExternalPythonOperator (#25780)dags test (#26111)expand_kwargs() against a literal list (#25925)output property to MappedOperator (#25604)TaskGroup in ExternalTaskSensor (#24902)@task.kubernetes taskflow decorator (#25663)schedule param (#25410)CronTriggerTimetable (#23662)XComArg.zip(*xcom_args) (#25176)sla_miss metric (#23402)map() semantic (#25085)expand_kwargs() (#24989)DagWarning model, and a check for missing pools (#23317)ExternalTaskMarker operator (#23964)SlaCallbackRequest if the DAG is scheduled (#26089)Operator.output more (#25617)hacky double-rendering prevention in mapped task (#25924)DAG(schedule=...) improvements (#25648)operator_name dupe in serialized JSON (#25819)task_group_to_grid (#25654)CronTriggerTimetable (#25503)/grid endpoint (#25481)@task.branch decorator (#25242)audit_log route (#25415)getTasks from Grid view (#25359)@dag arguments (#25044)SchedulerJob and TaskInstance (#24912)getfqdn with more resilient version (#24981)NBSP characters by whitespaces (#24797)airflow db upgrade (#24518)expand() error vague so it's not misleading (#24018)[webserver]analytics_tool (#24032)dttm searchable field in audit log (#23794)execute_in_subprocess (#23286)func.count to count rows (#23657)sql_alchemy_conn for celery result backend when result_backend is not set (#24496)AirflowDagCycleException message (#26204)TaskInstance.task not defined before handle_failure (#26040)DAGs and Datasets menu links based on role permission (#26183)TaskGroup tooltip via function docstring (#26028)DagRun.start_date not set during backfill with --reset-dagruns True (#26135)mapped_task is SKIPPED (#25995)TaskInstance related endpoints to avoid API errors (#26076)BranchDateTimeOperator to be timezone-awreness-insensitive (#25944)list-mapped-task-instance (#25965)iter_mapped_dependants (#25793)/ in variable get endpoint (#25774)XComArg fails to resolve (#25661)json arg help in airflow variables set command (#25726)ti_state on find_zombies query (#25725)axios errors (#25703)dag_owner_attributes table (#25579)expand_kwargs() input type before unmapping (#25355)ExternalTaskSensor not working with dynamic task (#25215)MappedOperator members in sync with BaseOperator (#24034)ERD schema for the MetaData DB (#26217)PEP562 (#26167)dag_edges and task_group_to_dict to corresponding util modules (#26212)ORM after forking to run a DAG processor (#26216)PEP-562 getattr (#26153)BaseSerialization.serialize "public" to other classes. (#26142)moment-timezone from 0.5.34 to 0.5.35 in /airflow/www (#26080)CamelCase to generated operations types (#25887)SkipMixin (#25864)undici from 5.8.0 to 5.9.1 in /airflow/www (#25801)_BranchPythonDecoratedOperator (#25783)filename_template deprecation message (#25749)ParamSpec to replace ... in Callable (#25658)elasticsearch test config to avoid warning on deprecated template (#25520)terser from 4.8.0 to 4.8.1 in /airflow/ui (#25178)typescript types from rest API docs (#25123)typescript (#25089)typescript. (#25096)ts (#25267)ts. (#25074)ti if it returns None (#25047)js file structure (#25003)moment from 2.29.3 to 2.29.4 in /airflow/www (#24885)xcom_push flag from BashOperator (#24824)typescript (#24715)charts.css to chart.css (#24531)grid.css to chart.css (#24529)set_new_process_group utility (#24371)moto version (#24222)[github_enterprise] from ref docs (#24033)f-strings in logging calls (#23597)JPype1 (#23847)Celery Flower (#25986)MySQL Charset problems (#25938)Trigger Rules (#25840)task_instance_mutation_hook usage (#25607)task-generated mapping example (#23424)2.2.0 (#24413)Nothing published for this version
Nothing published for this version
Disable attrs state management on MappedOperator
attrs state management on MappedOperator (#24772)pod_override to JSON before pickling executor_config (#24356)pid check (#24636)airflow db reset when dangling tables exist (#25441)disable_verify_ssl behaviour (#25023)task_instance.state in critical section query (#25673)TaskCallbackRequest (#25471)__repr__ to ParamsDict class (#25305)TimeSensorAsync target_time to utc on call time (#25221)updateNodeLabels after expandGroup (#25217)DagProcessorManager queue (#25147)invalidateQueries call (#25097)airflow/www/package.json: Add name, version fields. (#25065)IPv6 address (#24755) (#24846)%z for %(asctime)s to fix timezone for logs on UI (#24811)TriggerDagRunOperator.operator_extra_links is attr (#24676)prohibit_commit (#24366)external_executor_id in sql_engine_collation_for_ids docs (#25197)DR.task_instance_scheduling_decisions (#24774)resolve_xcom_backend function level documentation (#24965)Nothing published for this version
Fix deprecated log_id_template value
sensorinstance (#24638)ti.task.dag assignment back inside try/except block (#24533) (#24592)FSHook (#24470)stdout for airflow tasks test (#24362)DebugExecutor use ti.run() instead of ti._run_raw_task (#24357)URI constructor for MySQL connection (#24320)scheduleinterval nullable true added in openapi (#24253)return_code interface for task runner (#24093)op_kwargs (#23860)ExternalTaskSensor respects soft_fail if the external task enters a failed_state (#23647)StatD timing metric units (#21106)cache_ok flag to sqlalchemy TypeDecorators. (#24499)LOGGING_LEVEL=DEBUG (#23360)grid_data endpoint by 10x (#24284)TI.log_url fix for map_index (#24335)0080_2_0_2 - Replace null values before setting column not null (#24585)sql_alchemy_conn if old Postgres schemes used (#24569)log_template table (#24511)log_id_template value (#24506)task_instance (#24488)run_id for grid group summaries (#24327)get_hostname instead of socket.getfqdn (#24260)useTasks crash on error (#24152)use_task_execution_date with use_task_logical_date (#23983)REMOVED to finished states and success states (#23797)dbapi.get_pandas_df (#23452)schedule_interval match timetable (#23113)jsx files that affect run/task selection to tsx (#24509)Content-Type and chartset on grid_data endpoint (#24375)[core] parallelism config setting (#23768)extras and format Airflow Vars / Conns (#24735)get_current_context() chapter (#24482)log_id_template (#24455)MSSQL less than v2017 in code (#24095)3.6 compatibility objects/modules (#24048)api_connexion (#24050)4.1.2 (#24619)markdown-it-py (#19702)rich to latest version across the board. (#24186)TimedJSONWebSignatureSerializer (#24519)authlib/ oauth dependency (#24516)webpack 5 (#24485)typescript (#24337)nbf and aud claims for
maturity and audience of the requests. Also "filename" payload field is used to keep log name. (#24519)yarn test warnings (#24722)DagRun.verify_integrity (#24114)4.1.1 (#24399)Flask-WTF 0.15 (#24621)Nothing published for this version
One column per quarter.