NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI, #1563 most downloaded on PyPI
Programmatically author, schedule and monitor data pipelines
Latest stable
3.4.0
Last release 9 days ago
06 Nov 2026
Ships fairly regularly
a new release about every 2 weeks
Nearly every release is documented
notes for 60 of the last 60 stable releases
4 versions withdrawn
withdrawn after publishing
10 years old
306 releases · first in 2017
Drag across the ruler to compare, or tap a release to open it.
Nothing published for this version
Nothing published for this version
Run the check_migration loop at least once
check_migration loop at least onceis_mapped field to Task response. (#23319)dag_tag to dag foreign key (#23444)--subdir argument value for standalone dag processor. (#23864)dag-processor command (#23886)__wrapped__ property to _TaskDecorator (#23830)sql is empty list in DbApiHook (#23816)_airflow_moved tables (#23635)Your coding agent can read these notes before it upgrades. Set up the MCP server →
Nothing published for this version
Nothing published for this version
Fix retrieval of deprecated non-config values
CeleryExecutor (#23690)dag-processor fetch metadata database config (#23575)reschedule to the serialized fields for the BaseSensorOperator (#23674)execution_timeout as timedelta (#23655)send_callback method for CeleryKubernetesExecutor and LocalKubernetesExecutor (#23617)PythonVirtualenvOperator templated_fields (#23559)root_dag_id too (#23536)KubernetesJobWatcher getting stuck on resource too old (#23521)moved table exists (#23491)core__sql_alchemy_conn__cmd (#23441)airflow dags show for mapped operator (#23339)ti.mark_success_url (#23330)<Time /> in Mapped Instance table (#23313)dag_processing.processor_timeouts to counters section (#23393)expand() and partial() (#23373)Nothing published for this version
fix all "high" npm vulnerabilities
requirements.txt in Python Operators (#17349)SmoothOperator (#22813)execution_timeout configurable (#22389)ti_deps rules (#22698)dag-processor cli command (#22305)ignore_first_depends_on_past for scheduled jobs (#22491)list-import-errors to airflow dags command (#22084)standalone_dag_processor config is True. (#21731)celery.task_timeout_error metric (#21602)db downgrade cli command (#21596)ALL_SKIPPED trigger rule (#21662)db clean CLI command for purging old data (#20838)celery_logging_level (#21506)ShortCircuitOperator configurability for respecting downstream trigger rules (#20044)dag_id_pattern parameter to the /dags endpoint (#18924)--skip-init to db reset command (#22989).airflowignore files (#21392) (#22051)has_access decorator by ~200ms (#22858)try_number in airflow vars (#22297)airflow dags list CLI command (#21991)is_zipfiles in refresh_dag (#21926)airflow dag subcommands (#21793)py DAG files are zipped during parsing (#21538)run_id (#20975)get_connection() (#21162)worker_enable_remote_control for celery (#21507)CgroupTaskRunner (#21481)SchedulerJob (#21181)airflow by 6x (#21438)template_fields (#21054)ShortCircuitOperator push XCom by returning python_callable result (#20071)Connection.get_hook parameter to make it the same as in SqlSensor and SqlOperator. (#19849)XCOM value in PythonOperator (#19378)hook_params in BaseSqlOperator (#18718)taskinstance REST API schema to include dag_run_id field (#19105)extra to be nullable in connection payload as per schema(REST API). (#23183)dag_id extraction for dag level access checks in web ui (#23015)CLI command (#22688)db reset (#22990)external_task_ids. (#22809)DagParam to hold falsy values (#22964)get_logs_with_metadata endpoint. (#22898)PoolSlotsAvailableDep statues (#22807)email_on_failure with render_template_as_native_obj (#22770)DagFileProcessorManager (#22685)ScheduleInterval spec (#22635)is_smart_sensor_compatible() (#22386)run_id k8s and elasticsearch compatibility with Airflow 2.1 (#22385)except_skip None on BranchPythonOperator (#20411)RefreshConfiguration workaround for K8s token refreshing (#20759)/connections/<connection> endpoint (#22227)queued_dttm when submitting task to directly to executor (#22259)bulk_write_to_db (#21757)request.referrer from views.py (#21751)DbApiHook use get_uri from Connection (#21764)dag_id, task_id etc to XCom.serialize_value (#19505)on_task_instance_running listener can get at task (#21157)@task_group (#20870)airflow trigger cli (#20781)@task_group as a whole (#20671)start_date if a task continues after deferral (#20062)execution_date label when get cleanup pods list (#20417)class_permission_name to mixin so it applies to all classes (#18749)catchup=False is used in example dags (#19396)towncrier now (#22003)rbac = True from docs (#22725)sql_alchemy_connect_args (#22045)db upgrade / db downgrade (#21879)postgres:// with postgresql:// (#21205)CeleryExecutor docs (#20783)DummyOperator with EmptyOperator (#22974)DummyOperator in favor of EmptyOperator (#22832)moment from 2.29.1 to 2.29.2 in /airflow/www (#22873)prismjs from 1.26.0 to 1.27.0 in /airflow/www (#22823)nanoid from 3.1.23 to 3.3.2 in /airflow/www (#22803)minimist from 1.2.5 to 1.2.6 in /airflow/www (#22798)Airflow.Base.metadata in FAB models (#22353)sql_alchemy_conn if old postgres scheme used (#22333)xcom.dagrun_id to xcom.dag_run_id (#21806)conn.extra (#21816)jsonschema to 5.0 (#21712)days_ago (#21653):type lines now sphinx-autoapi supports type hints (#20951)DagRun.run_id instead of execution_date when updating state of TIs (UI & REST API) (#18724)PodLauncher to PodManager (#20576)get_readable_dags and get_editable_dags, and get_accessible_dags. (#19961)__var and __type members (#19303)max_tis_per_query initialisation on SchedulerJob (#19020)init_role() from API (#18820)Nothing published for this version
Nothing published for this version
Nothing published for this version
Check and disallow a relative path for sqlite
--capacity parameter (#21753)order_by(TaskInstance.execution_date) (#21705)default_pool delete on web ui (#21658)typing-extensions to be installed with python 3.8+ #21566 (#21567)__eq__ check (#21442)max_active_runs=1 not scheduling runs when min_file_process_interval is high (#21413)ExternalTaskSensorLink to handle templated external_dag_id (#21192)clear_task_instances sets valid run state (#21116)X-Frame-Options header to DENY only if X_FRAME_ENABLED is set to true. (#19491)on_execute_callback to callbacks docs (#22362)to_delete to to_cancel in TriggerRunner (#20658)3.4.5 (#22596)Nothing published for this version
Nothing published for this version
Nothing published for this version
Deprecate some functions in the experimental API
dag_id index for job table (#20282)Dag.get_task_instances() (#20591)/rendered-k8s view (#21006)airflow dags backfill --reset-dagruns errors when run twice (#21062)TaskInstance.max_tries in refresh_from_task (#21018)airflow dags test <dag_id> <execution_dt> results in error when run twice (#21031)>=3.3.4 (#20628)5.2.3 (#19703)<1.1 to <1.2 (#20489)DAG.following_schedule() for TaskInstance.get_template_context() (#20486)multiple_outputs inference of dict typing (#19608)params keyword (#20640)Params (#20567)default_args usage in docs (#19803)@task (#18868)start_date values from docs (#19607)Nothing published for this version
Context class handles deprecation
snowflake-sqlalchemy v1.2.5 (#20245)importlib.resources API (#19091)DagProcessorAgent (#19935)httpx to <0.20.0 (#20218)alembic version (#20153)MarkupSafe (#20113)DagRun state is valid on assignment (#19898)KubernetesExecutor should default to template image if used (#19484)None state (#19487)DagFileProcessor.manage_slas (#19553)KubernetesExecutor pods (#19904)base_log_folder require updating other configs (#19793)KubernetesExecutor pod template docs (#19686)execution_date -> run_id (#19593).output operator property information in TaskFlow tutorial doc (#19214)@task (#18868)pod_template_file examples (#19691)Nothing published for this version
Nothing published for this version
Fix bug when checking for existence of a Variable
relativedelta is passed as schedule_interval (#19418)Params with set data type (#19267)None before calling .is_alive() (#19380)sqlite_default Connection has been hard-coded to /tmp, use gettempdir instead (#19255)schedule_interval (#19173)execution_date to check for existing DagRun for TriggerDagRunOperator (#18968)PoolSlotsAvailableDep (#18875)WTForms<3.0 (#19466)catchup=True (#19528)Nothing published for this version
Nothing published for this version
Fix Unexpected commit error in schedulerjob
Swagger2Specification._set_defaults classmethod (#19065)None (#19112)catchup=False behaviour (#19130, #19145)max_active_runs (#18897)ds, ts, etc. back to use logical date (#19088)None (#19034)backfill command before loading DAGs if missing args (#18994)task_fail violating NOT NULL (#18979)SchedulerJob._process_executor_events (#18975)XCom.delete error in Airflow 2.2.0 (#18956)Nothing published for this version
Nothing published for this version
Add deprecation notice for SubDagOperator
cwd for BashOperator (#17751)RESTARTING state (#16681)insert_args for support transfer replace (#15825)default_args for TaskGroup (#16557)kinit options [-f|-F] and [-a|-A] (#17816)DaskExecutor using Dask Worker Resources (#16829, #18720)processor_poll_interval to scheduler_idle_sleep_time (#18704)dagrun_conf (#18655)TaskInstanceModelView (#18438)Variable.update method and improving detection of variable key collisions (#18159)TaskInstance and TaskReschedule PK from execution_date to run_id (#17719)TaskGroup support in BaseOperator.chain() (#17456)template_ext attribute to show it in UI (#17985)robots.txt and X-Robots-Tag header (#17946)BranchDayOfWeekOperator, DayOfWeekSensor (#17940)none_failed_or_skipped by none_failed_min_one_success trigger rule (#17683)[core] store_dag_code & use DB to get Dag Code (#16342)task_concurrency to max_active_tis_per_dag (#17708)execution_date with run_id in airflow tasks run command (#16666)worker_log_server_port option to the logging section (#17621)SubDagOperator (#17488)template_fields_renderers (#17321)airflow celery stop to accept the pid file. (#17278)airflow_local_settings (#17195)AirflowException str when BashOperator fails. (#17151)SQLite or SequentialExecutor (#17133)init_containers defined in pod_override (#17537)airflow db init/upgrade migrations and setup in parallel. (#17078)chain() and cross_downstream() to support XComArgs (#16732)serve-logs and LocalExecutor (#16644)test_cycle to check_cycle (#16617)LocalExecutor (#16623)DbApiHook instance attribute (#16521, #17423)dag.sub_dag with dag.partial_subset (#16179)AirflowSensorTimeout as immediate failure without retrying (#12058)action_clear view (#15980)[core] dag_concurrency) settings for easier understanding (#16267, #18730)SKIPPED should not be logged again as SUCCESS (#14822)start_date for cleared tasks (#18708)AirflowDateTimePickerWidget a required field (#18602)retry_exponential_backoff divide by zero error when retry delay is zero (#17003){{ task.x }} attributes from within templates (#18516)sys.path (#18384)dag_tag rows that are now unused (#8231)wait_for_downstream dep (#18338)run_finished_callback for Debug Executor (#17983)XCom.get_one return full, not abbreviated values (#18274)XCom.set (#18240)_check_for_stalled_adopted_tasks method (#18208)StandardTaskRunner (#17967)self._error_file (#15947)DateTimeSensor (#17959)traceback.html (#17942)DagRunState enum query for MySQLdb driver (#17886)utf8mb3_general_ci collation for MySQL (#17729)TaskInstance does not work #17535 (#17548)DAG.cli() (#17105)None comparison in model_list template (#16893)cached_property module (#16710)Decimal (#16383)dag_id and empty subdir (#16513)dag.fileloc when using the @dag decorator (#16384)airflow/www/views.py (#15940)reschedule state (#17305, #18806)dagbag_size documentation (#18824)search_path set up instructions (#17600)AIRFLOW_GID from Docker images (#18747)sla_miss_callback section to the documentation (#18305)closer.lua script for downloading sources (#18179)DAG.is_active read-only in API (#17667)XCom.clear for data lifecycle management (#17589)pod_template_file (#16861)Jed and TP (#16671)flask-ouathlib to flask-oauthlib in Upgrading docs (#16320)Elasticsearch (#16275)dag_concurrency (#16177)default_pool slots (#15997)KubernetesExecutor git-sync pod template file (#15904)render_template_as_native_obj (#16534)POST to PATCH (#16511)BranchPythonOperator (#18623)boto3 to <1.19 (#18389)airflow.security.kerberos module (#18258)range(len()) to enumerate (#18174)main builds (#18035)tenacity (#17593)numpy dependency (#17594)mysql-connector-python to latest version (#17596)pandas an optional core dependency (#17575)airflow/utils/db.py (#17090)click to 8.x (#16779)dag.clear method (#16086)DAG_ACTIONS constant (#16232)_get_all_non_dag_permissions method (#16317)docutils to <0.17 until breaking behaviour is fixed (#16133)TaskInstance.log_filepath attribute (#15217)airflow/www/app.py (#15956)plyvel to google provider extra (#15812)find_permission_view_menu for get_permission wrapper (#16377)fab_logging_level to WARNING (#18783)CeleryKubernetesExecutor (#18441)Nothing published for this version
Nothing published for this version
Nothing published for this version
Fix deprecation error message rather than silencing it
DagRun execution order from queued to running not being properly followed (#18061)max_active_runs not allowing moving of queued dagruns to running (#17945)LocalTaskJob causing error (#18119)colorlog version (6.x is incompatible) (#18099)create_dagrun overwrite explicit run_id (#17728)_check_for_stalled_adopted_tasks method (#18208)DagRunState enum query for MySQLdb driver (#17886)connection-types provider meta-datacloser.lua script for downloading sources (#18179)Nothing published for this version
Nothing published for this version
Fix task retries when they receive sigkill and have retries and properly handle sigterm
sigkill and have retries and properly handle sigterm (#16301)default_impersonation config (#17229)kubernetes cleanup-pods which fails on invalid label key (#17298)TaskInstance does not show queued_by_job_id & external_executor_id (#17179)SecretsMasker is not configured (#17101)__init_subclass__ in subclasses of BaseOperator (#17027)priority_weight during parsing (#16765)deps` and task_group`` during DAG Serialization (#16734)AttributeError: datetime.timezone object has no attribute name (#16599)UserModelView controls. (#17431)secret_key mis-configured (#17410)execution_date in task_instance.refresh_from_db (#16809)LocalTaskJob during task exit (#16289)SQLAlchemy<1.4 constraint (#16630)dnspython (#16698)FlaskAppBuilder 3.3.2+ (#17208)LocalExecutor (#16623)DagFileProcessor and DagFileProcessorProcess out of scheduler_job.py (#16581)Nothing published for this version
Only allow the webserver to request from the worker log server
CeleryKubernetesExecutor (#16700)token (#16474)LocalTaskJob (#16852)Nothing published for this version
Fix normalize-url vulnerability
PyPI (#16594)dag_run.conf is a dict (#15057)only_active parameter to /dags endpoint (#14306)filebeat 7 (#14625)passphrase and private_key to default sensitive field names (#16392)airflow task run without --local/--raw for KubeExecutor (#16108)log.exception when there is no exception (#16047)/ (#16018)Nothing published for this version
Nothing published for this version
Nothing published for this version
Bump stylelint to remove vulnerable sub-dependency
New Features """"""""""""
PythonVirtualenvDecorator to Taskflow API (#14761)Taskgroup decorator (#15034)SubprocessHook for running commands from operators (#13423)WeekDayBranchOperator (#13997)worker_pod_pending_timeout support (#15263)template_fields_renderers additions (#15130)AirflowSkipException on exit code 99 (by default, configurable) (#13421) (#14963)airflow jobs check CLI command to check health of jobs (Scheduler etc) (#14519)DateTimeBranchOperator to BranchDateTimeOperator (#14720)Improvements """"""""""""
DbApiHook (#15581)apply_default to subclasses of BaseOperator (#15667)KubernetesExecutor pod templates to allow access to IAM permissions (#15669)airflow db check-migrations (#15662)secret_key when Webserver > 1 (#15546)JSONFormatter (#15414)on_failure_callback when SIGTERM is received (#15172)worker_refresh_interval to 6000 seconds (#14970)[celery] default_queue config to [operators] default_queue to re-use between executors (#14699)Bug Fixes """""""""
updateTaskInstancesState API endpoint when dry_run not passed (#15889)drawDagStatsForDag in dags.html (#13884)NotPreviouslySkippedDep (#13933)KubernetesExecutor (#14795)KubernetesPodOperator (#15388)dag.partial_subset (#13700) (#15308)pod_id for KubernetesPodOperator (#15445)pod_id ends with hyphen in KubernetesPodOperator (#15443)pool_slots > 1 (#15426)sync-perm to work correctly when update_fab_perms = False (#14847)GCSObjectsWtihPrefixExistenceSensor (#14179)CeleryKubernetesExecutor bug (#13247)StackdriverTaskHandler (#13784)func.sum may return Decimal that break rest APIs (#15585)AlreadyExists exception when the execution_date is same (#15174)sync_metadata inside DagFileProcessorManager (#15121)docker-py update to resolve docker op issues (#15731)user_id from API schema (#15117)airflow info work with pipes (#14528)CollectionInfo in all Collections that have total_entries (#14366)task_instance_mutation_hook when importing airflow.models.dagrun (#15851)Doc only changes """"""""""""""""
markdownlint and yamllint config files (#15682)git_sync_template.yaml (#13197)Misc/Internal """""""""""""
logging.exception redundancy (#14823)stylelint to remove vulnerable sub-dependency (#15784)ssri from 6.0.1 to 6.0.2 in /airflow/www (#15437)datepicker for task instance detail view (#15284)tableau extra (#13595)cached_property on Python 3.8 where possible (#14606)flynt. (#13732)jquery ready instead of vanilla js (#15258)Webpack entries (#14551)Remove extra/needless deprecation warnings from airflow.contrib module
TypeError when Serializing & sorting iterable properties of DAGs (#15395)on_load trigger for folder-based plugins (#15208)kubernetes cleanup-pods subcommand will only clean up Airflow-created Pods (#15204)pod_template_file in KubernetesExecutor (#15197)executor_config breaks Graph View in UI (#15199)dagrun.schedule_delay metric (#15105)executor_config is passed (#14323)Lax for cookie_samesite when empty string is passed (#14183)dag.cli() KeyError (#13647)[kubernetes] enable_tcp_keepalive for new installs to True (#15338)libyaml C library when available. (#14577)airflow dags show command display TaskGroups (#14269)extra connection field. (#12944)Nothing published for this version
Fix Deprecation for configuration.getsection
sql_alchemy_conn_secret (#13260)DROP CONSTRAINT in MySQL during airflow db upgrade (#13239)sync-perm (#13377)datatables.net from 1.10.21 to 1.10.22 in /airflow/www (#13143)datatables.net JS to 1.10.23 (#13253)dompurify from 2.0.12 to 2.2.6 in /airflow/www (#13164)cattrs version (#13223)python-daemon limit for python 3.8+ to fix daemon crash (#13540)worker_concurrency to 16 (#13612)dag_id is None (#13619)continue_token for cleanup list pods (#13563)max_tis_per_query to 0 now correctly removes the limit (#13512)BaseBranchOperator will push to xcom by default (#13704) (#13763)configuration.getsection (#13804)Website.can_read access to default roles. (#13923)FileTaskHandler (#14001)v1/config endpoint respect webserver expose_config setting (#14020)min_file_process_interval to decrease CPU Usage (#13664)os.fork & CeleryExecutor (#13265)example_kubernetes_executor example dag (#13216)flask-swagger, funcsigs (#13178)queued_by_job_id & external_executor_id Columns to TI View (#13266)json-merge-patch an optional library and unpin it (#13175)setup.py to better reflect changes in providers (#13314)pyjwt and Add integration tests for Apache Pinot (#13195)setup.cfg (#13409)__eq__ methods in models Dag and BaseOperator (#13449)contextdecorator (#13455)mysql-connector-python to allow 8.0.22 (#13370)NotFound response for DELETE methods in OpenAPI YAML (#13550)[core] lazy_load_plugins is False (#13578)colorlog dependency (#13176)python3-openid dependency (#13714)__repr__ for Executors (#13753)conn_type is missing (#13778)get_connnection REST endpoint (#13885)airflow_local_settings.py to fix an error message (#13927)TriggerDagRunOperator (#13964)start_date (REST API) (#13959)OperationalError (#14032)rbac UI (#13569)Nothing published for this version
Nothing published for this version
We’ve tried to make as few breaking changes as possible and to provide deprecation path in the code, especially in the case of anything called in the…
The full changelog is about 3,000 lines long (already excluding everything backported to 1.10), so for now I’ll simply share some of the major features in 2.0.0 compared to 1.10.14:
(Known in 2.0.0alphas as Functional DAGs.)
DAGs are now much much nicer to author especially when using PythonOperator. Dependencies are handled more clearly and XCom is nicer to use
A quick teaser of what DAGs can now look like:
from airflow.decorators import dag, task
from airflow.utils.dates import days_ago
@dag(default_args={'owner': 'airflow'}, schedule_interval=None, start_date=days_ago(2))
def tutorial_taskflow_api_etl():
@task
def extract():
return {"1001": 301.27, "1002": 433.21, "1003": 502.22}
@task
def transform(order_data_dict: dict) -> dict:
total_order_value = 0
for value in order_data_dict.values():
total_order_value += value
return {"total_order_value": total_order_value}
@task()
def load(total_order_value: float):
print("Total order value is: %.2f" % total_order_value)
order_data = extract()
order_summary = transform(order_data)
load(order_summary["total_order_value"])
tutorial_etl_dag = tutorial_taskflow_api_etl()
We now have a fully supported, no-longer-experimental API with a comprehensive OpenAPI specification
Read more here:
REST API Documentation.
As part of AIP-15 (Scheduler HA+performance) and other work Kamil did, we significantly improved the performance of the Airflow Scheduler. It now starts tasks much, MUCH quicker.
Over at Astronomer.io we’ve benchmarked the scheduler—it’s fast (we had to triple check the numbers as we don’t quite believe them at first!)
It’s now possible and supported to run more than a single scheduler instance. This is super useful for both resiliency (in case a scheduler goes down) and scheduling performance.
To fully use this feature you need Postgres 9.6+ or MySQL 8+ (MySQL 5, and MariaDB won’t work with more than one scheduler I’m afraid).
There’s no config or other set up required to run more than one scheduler—just start up a scheduler somewhere else (ensuring it has access to the DAG files) and it will cooperate with your existing schedulers through the database.
For more information, read the Scheduler HA documentation.
SubDAGs were commonly used for grouping tasks in the UI, but they had many drawbacks in their execution behaviour (primarirly that they only executed a single task in parallel!) To improve this experience, we’ve introduced “Task Groups”: a method for organizing tasks which provides the same grouping behaviour as a subdag without any of the execution-time drawbacks.
SubDAGs will still work for now, but we think that any previous use of SubDAGs can now be replaced with task groups. If you find an example where this isn’t the case, please let us know by opening an issue on GitHub
For more information, check out the Task Group documentation.
We’ve given the Airflow UI a visual refresh and updated some of the styling. Check out the UI section of the docs for screenshots.
We have also added an option to auto-refresh task states in Graph View so you no longer need to continuously press the refresh button :).
If you make heavy use of sensors in your Airflow cluster, you might find that sensor execution takes up a significant proportion of your cluster even with “reschedule” mode. To improve this, we’ve added a new mode called “Smart Sensors”.
This feature is in “early-access”: it’s been well-tested by AirBnB and is “stable”/usable, but we reserve the right to make backwards-incompatible changes to it in a future release (if we have to. We’ll try very hard not to!)
For Airflow 2.0, we have re-architected the KubernetesExecutor in a fashion that is simultaneously faster, easier to understand, and more flexible for Airflow users. Users will now be able to access the full Kubernetes API to create a .yaml pod_template_file instead of specifying parameters in their airflow.cfg.
We have also replaced the executor_config dictionary with the pod_override parameter, which takes a Kubernetes V1Pod object for a 1:1 setting override. These changes have removed over three thousand lines of code from the KubernetesExecutor, which makes it run faster and creates fewer potential errors.
Airflow 2.0 is not a monolithic “one to rule them all” package. We’ve split Airflow into core and 61 (for now) provider packages. Each provider package is for either a particular external service (Google, Amazon, Microsoft, Snowflake), a database (Postgres, MySQL), or a protocol (HTTP/FTP). Now you can create a custom Airflow installation from “building” blocks and choose only what you need, plus add whatever other requirements you might have. Some of the common providers are installed automatically (ftp, http, imap, sqlite) as they are commonly used. Other providers are automatically installed when you choose appropriate extras when installing Airflow.
The provider architecture should make it much easier to get a fully customized, yet consistent runtime with the right set of Python dependencies.
But that’s not all: you can write your own custom providers and add things like custom connection types, customizations of the Connection Forms, and extra links to your operators in a manageable way. You can build your own provider and install it as a Python package and have your customizations visible right in the Airflow UI.
Security
As part of Airflow 2.0 effort, there has been a conscious focus on Security and reducing areas of exposure. This is represented across different functional areas in different forms. For example, in the new REST API, all operations now require authorization. Similarly, in the configuration settings, the Fernet key is now required to be specified.
Configuration in the form of the airflow.cfg file has been rationalized further in distinct sections, specifically around “core”. Additionally, a significant amount of configuration options have been deprecated or moved to individual component-specific configuration files, such as the pod-template-file for Kubernetes execution-related configuration.
We’ve tried to make as few breaking changes as possible and to provide deprecation path in the code, especially in the case of anything called in the DAG. That said, please read through UPDATING.md to check what might affect you. For example: We re-organized the layout of operators (they now all live under airflow.providers.*) but the old names should continue to work - you’ll just notice a lot of DeprecationWarnings that need to be fixed up.
Nothing published for this version
Nothing published for this version
Nothing published for this version
Remove deprecated Elasticsearch Configs
Major features since beta2:
Update versions in UPDATING.md for 2.0.0b1 release
Nothing published for this version
Fixed deprecation message for "variables" command
airflow db upgrade to upgrade db as intended (#13267)KubernetesExecutor should accept images from executor_config (#13074)airflow/contrib/executors in the dist packagekubernetes_generate_dag_yaml] - Fix dag yaml generate function (#13816)airflow tasks clear cli command wirh --yes (#14188)delete_dag function of json_client (#14441)KubernetesExecutor (#14090)airflow/www_rbacairflow/www_rbacrbac_app's db.session use the same timezone with @provide_session (#14025)StreamLogWriter: Provide (no-op) close method (#10885)Nothing published for this version
Fix: Deprecated config force_log_out_after was not used
depends_on_past or task_concurrency are stuck (#12663)force_log_out_after was not used (#12661)setup_requires (#12880)[scheduler] max_threads to [scheduler] parsing_processes (#12605)Nothing published for this version
Nothing published for this version
Nothing published for this version
One column per quarter.