astronomer-cosmos

Bug fixes

• Honor on_warning_callback passed via operator_args by @tatiana in #2940
• Fix watcher fallback silently dropping --full-refresh overrides by @pankajastro in #2917

Bug Fixes

• Credit all parent models in ExecutionMode.WATCHER multi-parent test aggregation, so test sensors no longer hang by @hellowithchicken in #2901
• Honour dbt test operator_kwargs under TestBehavior.AFTER_EACH by @tatiana in #2936
• Skip generated dirs when hashing the dbt project folder by @goingforstudying-ctrl in #2942
• Address #2942 review feedback: manifest-mode hashing, additive excluded dirs, hash construction by @pankajastro in #2944

Docs

• Fix incorrect PR/issue references in the CHANGELOG by @tatiana in #2864
• Document retrying models but not tests by @pankajastro in #2835

Pre-release alpha of Cosmos 1.15.1, the first cut from the clean release-1.15 maintenance line (branched from the v1.15.0 tag with the milestone fixes cherry-picked).

Note for a1/a2 testers: those alphas were hotfix cuts from main and carried 1.16.0 features (#2844 dedicated WATCHER queues, #2871 gcs_upload retries) that this line does not ship. The a2 watcher --full-refresh fix (#2917) is not yet in this cut; it lands before GA.

Behaviour Changes

None of these break the public Cosmos API, but review before upgrading:

• Kubernetes-based dbt operators no longer override the container image's ENTRYPOINT by default: the full dbt command is passed via arguments and any user-supplied cmds is preserved. Images whose entrypoint is itself dbt now require an explicit cmds=["dbt"]. This restores the pre-1.15.0 default. See #2891.
• Passing output-only template fields (compiled_sql, freshness) via operator_args in async execution mode now raises CosmosValueError at DAG parse time instead of an opaque TypeError. See #2868.

Bug Fixes

• Preserve container ENTRYPOINT by default in Kubernetes-based dbt operators by @pankajkoti in #2891
• Make partial-parse cache reads resilient to NFS ESTALE races by @mungiyo in #2867
• Render env_var() Jinja when deriving ExecutionMode.WATCHER dataset namespace by @pankajastro in #2879
• Avoid deprecated airflow.exceptions.AirflowSkipException import on Airflow 3.1+ by @pankajastro in #2796
• Reject output-only template fields on the async operator_args path by @pankajastro in #2868

Docs

• Document container command and image ENTRYPOINT handling for Kubernetes modes by @pankajkoti in #2906
• Document verified Cosmos/Runtime/dbt Core compatibility by @pankajastro in #2914
• Replace redirecting documentation URLs and raise the link-check timeout by @pankajkoti in #2905
• Reference stable Cosmos 1.11.0 for dbt Fusion instead of the 1.11.0a1 alpha by @pankajastro in #2861
• Clarify callback support under ExecutionMode.WATCHER by @pankajastro in #2884
• Add Airflow 3.3 row to the dbt dependency conflict matrix by @pankajastro in #2886
• Improve privacy policy by @tatiana in #2910
• Remove duplicated sections in contributing.rst by @tatiana in #2859

Others

• Fix flaky source_pruning_dag integration test by seeding the database first by @tatiana in #2927
• Fix CI dependency cache by @tatiana in #2931
• Add dbt-core 1.12 to the test matrix by @pankajastro in #2773
• Add Python 3.14 to the test matrix (Airflow 3.2/3.3, dbt 1.12 only) by @pankajastro in #2903
• Pin Airflow 3.3 requirements and simplify the pre-install script by @pankajkoti in #2881

Milestone: Cosmos 1.15.1
Release PR: #2935
Full changelog: astronomer-cosmos-v1.15.0...astronomer-cosmos-v1.15.1a3

Bug Fixes

• Fix WATCHER_KUBERNETES consumer fallback dropping --full-refresh on templated params by @pankajastro in #2917

Hotfix alpha for validation. This alpha contains a single fix and is intended for the reporter of #2889 to confirm it resolves their issue before this is merged to main.

Bug Fixes

• Preserve container ENTRYPOINT by default in Kubernetes-based dbt operators (ExecutionMode.KUBERNETES, WATCHER_KUBERNETES, AWS_EKS, GCP_GKE, WATCHER_GCP_GKE). Previously, build_kube_args always set the pod container's command to ["dbt"], which overrode the image's ENTRYPOINT. Images that rely on their ENTRYPOINT to perform setup before dbt runs, such as sourcing secrets injected by a sidecar, would silently lose that setup. See #2889 and #2891.

Now Stable

ExecutionMode.WATCHER and ExecutionMode.WATCHER_KUBERNETES are now stable, effective in Cosmos 1.15.0 (they were experimental through 1.14.x). This milestone is the result of an ongoing effort across several releases; the highlights landing in this release include:

• ExecutionMode.WATCHER_KUBERNETES mode with test handling. See #2529 and #2543.
• An enable_watcher_reliable_retry config to harden watcher producer retries. See #2816.
• Fixes to watcher consumer logging and to the cached pod_manager context under Kubernetes. See #2805, #2806, and #2809.
• The documentation now marks both modes as stable. See #2865.

Breaking Changes

• The unused DBT_NO_TESTS_MSG and DBT_WARN_MSG constants and the module-level logger have been removed from cosmos.dbt.parser.output as part of a parser cleanup. If your custom code imported them, inline the literals ("Nothing to do" / "WARN") instead. See #2832.

Behaviour Changes

These changes adjust observable behaviour. None of them breaks the documented public API, but review them before upgrading — especially if you rely on ephemeral models running dbt.

• Ephemeral dbt models now render as EmptyOperator by default (RenderConfig.ephemeral_models_as_empty_operator=True). They no longer run dbt or emit datasets/assets, callbacks, OpenLineage events, or compiled SQL. Set RenderConfig(ephemeral_models_as_empty_operator=False) to restore the previous behaviour. See #2759.
• on_warning_callback now fires for dbt test warnings in ExecutionMode.LOCAL subprocess mode (previously skipped on dbt 1.10+, where PASS=.. WARN=N is no longer the final stdout line). See #2832.
• The output-only template fields compiled_sql and freshness are now rejected with CosmosValueError at task instantiation if passed via operator_args or directly to a local operator (they were previously overwritten by Cosmos at runtime, so any value silently had no effect); the guard covers both the synchronous local operators and the async BigQuery path. See #2726 and #2852.
• RenderConfig.exclude is now applied to per-model and detached test tasks under TestBehavior.AFTER_EACH and BUILD (previously only the AFTER_ALL aggregate test task honoured it), so exclusions such as exclude=["resource_type:unit_test"] now take effect without an operator_args workaround. See #2850.

Features

• Add ExecutionMode.GCP_GKE and ExecutionMode.WATCHER_GCP_GKE execution modes by @vricciardulli in #2488
• Add ExecutionMode.WATCHER_KUBERNETES mode with test handling by @vricciardulli in #2529 and #2543
• Enable the orjson parser for the whole project (experimental) by @corsettigyg in #2552
• Support dbt docs on Kubernetes via DbtDocsS3KubernetesOperator by @jx2lee in #2058
• Add use_tarball option to the upload_to_gcp_gs callback by @TTMichaelA in #2497
• Add AWS and Azure tarball upload options by @TTMichaelA in #2553
• Expose freshness_callback in ExecutionConfig.setup_operator_args for ExecutionMode.WATCHER by @pankajastro in #2586
• Allow templating dbt deps installation via ExecutionConfig by @pankajastro in #2728
• Add configurable seed rendering behaviour by @pankajkoti in #2755
• Render ephemeral dbt models as EmptyOperator by default by @pankajkoti in #2759
• Support per-node callbacks via string import paths by @highlyavailable in #2781
• Map Snowflake query_tag from connection extras to dbt profile by @pankajastro in #2650
• Add Snowflake profile mapping for non-encrypted private key file by @pankajastro in #2660
• Export Clickhouse and encrypted Snowflake mappings from cosmos.profiles by @pankajastro in #2668
• Forward Snowflake insecure_mode from connection Extra into dbt profile by @toor11 in #2744
• Extend Snowflake profile mappings with authenticator, client_session_keep_alive, host, and port by @Aaditya-git in #2748
• Support extra__google_cloud_platform__project in GoogleCloudServiceAccountDictProfileMapping by @jroachgolf84 in #2626
• Warn when users pass output-only template fields to local operators by @goingforstudying-ctrl in #2737
• Add an enable_watcher_reliable_retry config to harden ExecutionMode.WATCHER producer retries by @tatiana in #2816

Enhancements

• Replace openlineage-airflow with apache-airflow-providers-openlineage by @tatiana in #2753
• Refactor handling of watcher producer-only dbt flags by @tatiana in #2717
• Disclose the --no-static-parser flag in ExecutionMode.LOCAL by @pankajkoti in #2714
• Refactor _default_freshness_callback to return a list of (id, state) tuples by @pankajastro in #2572
• Restore dynamically resolved user-provided node types by @jroachgolf84 in #2608
• Promote inline watcher status collections to named constants by @pankajastro in #2671
• Align WATCHER_KUBERNETES producer default task_id with PRODUCER_WATCHER_TASK_ID by @tatiana in #2794
• Centralise version-aware EmptyOperator imports in a compatibility module by @pankajkoti in #2758
• Move safe_copy out of cosmos.cache into cosmos.fs by @pankajkoti in #2715
• Refactor seed checksum hashing and caching helpers by @pankajkoti in #2784
• Avoid O(n^2) string accumulation in store_compiled_sql by @pankajastro in #2751
• Use GA versions for propagate_logs in provider_info by @pankajastro in #2712
• Use cosmos.log.get_logger consistently by @pankajastro in #2670
• Use lazy logging instead of f-strings in logger calls by @pankajastro in #2672 and #2680
• Ban eager module-level imports of optional providers via ruff by @tatiana in #2743
• Remove unused # type: ignore comments and re-enable warn_unused_ignores by @pankajastro in #2710 and #2763
• Drop the Python <3.9 fallback for functools.cache by @pankajastro in #2732
• Remove stale Airflow 2.3 comment on registry_conn_id default by @pankajastro in #2766
• Remove an outdated TODO on watcher terminal-status handling by @pankajastro in #2697
• Remove the unused DBT_NO_TESTS_MSG / DBT_WARN_MSG constants and the module-level logger from cosmos.dbt.parser.output by @tatiana in #2832
• Unify operator logging on self.log by @pankajastro in #2681
• Centralise resource_name extraction from dbt unique_id by @pankajkoti in #2687
• Tighten # type: ignore comments to specify error codes by @pankajastro in #2711
• Defer the OpenLineage processor import to task execution to reduce DAG-parse memory by @pankajastro in #2785
• Use the SDK Variable in the ExecutionMode.WATCHER XCom backup to reduce log noise by @jhorlima in #2804
• Reduce Airflow 3 Asset URI migration warning noise in ExecutionMode.WATCHER producer runs by @faridnsh in #2788
• Log via self.log inside dbt operators for consistency by @pankajastro in #2798
• Refactor build_airflow_graph to satisfy the C901 complexity limit by @00yhj22-debug in #2689
• Surface dbt stdout/stderr in CosmosLoadDbtException by @DaPillah in #2826
• Avoid hard-coded watcher status strings in favour of named constants by @pankajastro in #2841

Bug Fixes

• Fix on_warning_callback skipping dbt test warnings in ExecutionMode.LOCAL subprocess mode by @tatiana in #2832
• Fix example_cosmos_sources to use a dbt project with sources by @jroachgolf84 in #2614
• Unify Postgres profiles.yml across dbt example projects by @yeoreums in #2501
• Pin dbt-core<2.0 in virtualenv example DAGs to avoid alpha pickup by @pankajastro in #2752
• Cache the packages lockfile regardless of whether dependencies are reinstalled by @ms32035 in #2787
• Maintain outlets passed to DbtRunLocalOperator when enable_dataset_alias=True by @jroachgolf84 in #2574
• Treat concurrent cosmos_cache Variable insert IntegrityError as benign by @pankajkoti in #2800
• Forward RenderConfig.exclude to per-model and detached test tasks for all test behaviours by @tatiana in #2850
• Reject the output-only template fields compiled_sql and freshness when passed via operator_args or to a local operator, on both the synchronous and async BigQuery paths by @00yhj22-debug in #2726 and @qorexdevs in #2852
• Fix group_nodes_by_folder collapsing folders that share a leaf name under different parents (opt-in via enable_hierarchical_naming_for_group_nodes_by_folder) by @anor4k in #2824
• Add an enable_hierarchical_naming_for_group_nodes_by_folder config (default False) to opt into hierarchical task-group naming for group_nodes_by_folder, rendering folders that share a leaf name under different parents as distinct task groups by @tatiana in #2862
• Raise a clear exception on an empty or invalid dbt manifest instead of an opaque JSONDecodeError by @karanw330 in #2819
• Atomically update the partial_parse.msgpack cache by @mungiyo in #2815
• Fix stale context in the cached pod_manager for ExecutionMode.WATCHER_KUBERNETES by @vricciardulli in #2809
• Capture the dbt-runner error message in ExecutionMode.WATCHER consumer logs by @pankajastro in #2806
• Fix duplicate consumer logs in ExecutionMode.WATCHER mode by @pankajastro in #2805

Docs

• Create a glossary stub by @lzdanski in #2461
• Improve the glossary: fix structure, add Cosmos-specific terms by @pankajastro in #2618
• Add a top-level FAQ page by @tatiana in #2635
• Align the FAQ page with the documentation style guide by @tatiana in #2667
• Update docs for DbtDocsS3KubernetesOperator by @jx2lee in #2575
• Add docs for ExecutionMode.WATCHER and the depends_on_past limitation by @tatiana in #2602
• Document watcher mode dbt 1.5+ requirement by @tatiana in #2700
• Improve clarity for watcher_dbt_execution_queue by @jroachgolf84 in #2705
• Document compiled_sql and freshness as output-only template fields by @00yhj22-debug in #2719
• Document seed rendering behaviour by @pankajkoti in #2757
• Document tradeoffs of remote cache and disabling the dbt ls cache by @pankajkoti in #2722
• Document the LOCAL vs WATCHER benchmark on the Helm chart by @pankajkoti in #2688
• Enhance S3 dbt docs documentation by @jroachgolf84 in #2765
• Restore memory-optimised imports docs for Cosmos < 1.14.0 by @pankajkoti in #2604
• Update dbt and Airflow Spark URLs in profile mapping docstrings by @pankajastro in #2695
• Remove a duplicate node_conversion_by_task_group entry in render config docs by @pankajkoti in #2770
• Capitalise Docker as a product name in prose by @pankajkoti in #2623
• Normalize heading underlines across docs by @pankajkoti in #2641, #2655, #2656, and #2663
• Add language hints to docs code-block directives by @pankajastro in #2686
• Add the Cosmos 1.14.2 row to the watcher-retry behavior history by @tatiana in #2742
• Add additional resources to the contributing docs by @lzdanski in #2460
• Move the GCP GKE execution modes to a dedicated documentation page by @vricciardulli in #2834
• Add a note and example for custom profile mapping by @karanw330 in #2825
• Document the self.log vs get_logger logging convention by @pankajastro in #2764
• Fix a malformed dbt-fusion docs redirect target by @pankajastro in #2849
• Mark ExecutionMode.WATCHER and ExecutionMode.WATCHER_KUBERNETES as stable (effective Cosmos 1.15.0) in the documentation by @pankajkoti in #2865

Others

• Reduce integration test CI time from ~30 min to ~16 min by @pankajkoti in #2562
• Speed up Airflow 3.1+ integration tests by caching InProcessExecutionAPI by @pankajkoti in #2547
• Carve dbt-loom tests into a dedicated CI job by @pankajastro in #2761
• Re-enable the cross-project dbt ls example DAG in the dbt-loom CI job by @pankajkoti in #2775
• Move test jobs that need no secrets to an unprivileged pull_request workflow by

Note truncated.

Pre-release alpha of Cosmos 1.15.0.

Refresh of a2 with 28 additional milestone PRs merged since the second alpha. Headline: ExecutionMode.WATCHER and ExecutionMode.WATCHER_KUBERNETES are now stable, effective Cosmos 1.15.0 (#2865). Also includes new Behaviour changes (output-only template fields compiled_sql/freshness now raise; RenderConfig.exclude now applies to per-model/detached test tasks) and an opt-in enable_hierarchical_naming_for_group_nodes_by_folder config. The head branch was synced with main so this cut actually contains all of them. See the release PR for full provenance, the complete 162-PR changelog, and the test plan: #2810.

Now Stable

• ExecutionMode.WATCHER and ExecutionMode.WATCHER_KUBERNETES are now stable, effective Cosmos 1.15.0 (they were experimental through 1.14.x).

Behaviour Changes

• The output-only template fields compiled_sql and freshness are now rejected with CosmosValueError at task instantiation if passed via operator_args or directly to a local operator; the guard covers both the sync local operators and the async BigQuery path by @00yhj22-debug in #2726 and @qorexdevs in #2852
• RenderConfig.exclude is now applied to per-model and detached test tasks under TestBehavior.AFTER_EACH and BUILD (previously only AFTER_ALL honoured it) by @tatiana in #2850

Features

• Add an enable_hierarchical_naming_for_group_nodes_by_folder config (default False) to opt into hierarchical task-group naming for group_nodes_by_folder by @tatiana in #2862

Enhancements

• Surface dbt stdout/stderr in CosmosLoadDbtException by @DaPillah in #2826
• Avoid hard-coded watcher status strings in favour of named constants by @pankajastro in #2841

Bug Fixes

• Forward RenderConfig.exclude to per-model and detached test tasks for all test behaviours by @tatiana in #2850
• Fix group_nodes_by_folder collapsing folders that share a leaf name under different parents (opt-in via enable_hierarchical_naming_for_group_nodes_by_folder) by @anor4k in #2824
• Raise a clear exception on an empty or invalid dbt manifest instead of an opaque JSONDecodeError by @karanw330 in #2819
• Atomically update the partial_parse.msgpack cache by @mungiyo in #2815
• Fix stale context in the cached pod_manager for ExecutionMode.WATCHER_KUBERNETES by @vricciardulli in #2809
• Capture the dbt-runner error message in ExecutionMode.WATCHER consumer logs by @pankajastro in #2806
• Fix duplicate consumer logs in ExecutionMode.WATCHER mode by @pankajastro in #2805

Docs

• Add additional resources to the contributing docs by @lzdanski in #2460
• Move the GCP GKE execution modes to a dedicated documentation page by @vricciardulli in #2834
• Add a note and example for custom profile mapping by @karanw330 in #2825
• Document the self.log vs get_logger logging convention by @pankajastro in #2764
• Fix a malformed dbt-fusion docs redirect target by @pankajastro in #2849
• Mark ExecutionMode.WATCHER and ExecutionMode.WATCHER_KUBERNETES as stable (effective Cosmos 1.15.0) in the documentation by @pankajkoti in #2865

Others

• Add apache-airflow 3.3 to the test matrix by @pankajkoti in #2831
• Add a blocking lychee linkcheck CI job and fix broken docs links by @pankajastro in #2699
• Restore running integration tests on external contributors' PRs by @tatiana in #2848
• Wait for all coverage jobs before combining coverage by @pankajastro in #2842
• Dependency updates by @dependabot in #2802, #2833, #2838, #2847, #2853, and #2855

Milestone: Cosmos 1.15.0

Full changelog: astronomer-cosmos-v1.15.0a2...astronomer-cosmos-v1.15.0a3

Pre-release alpha of Cosmos 1.15.0.

Refresh of a1 with 15 additional milestone PRs merged since the first alpha, plus newly surfaced Breaking and Behaviour changes (parser-constant removal in #2832; ephemeral models now render as EmptyOperator by default). The head branch was synced with main so this cut actually contains all of them. See the release PR for full provenance, the complete 134-PR changelog, and the test plan: #2810.

Breaking Changes

• Removed the unused DBT_NO_TESTS_MSG and DBT_WARN_MSG constants and the module-level logger from cosmos.dbt.parser.output; if your custom code imported them, inline the literals ("Nothing to do" / "WARN") instead by @tatiana in #2832

Behaviour Changes

• Ephemeral dbt models now render as EmptyOperator by default (RenderConfig.ephemeral_models_as_empty_operator=True) — they no longer run dbt or emit datasets/assets, callbacks, OpenLineage events, or compiled SQL. Set RenderConfig(ephemeral_models_as_empty_operator=False) to restore the previous behaviour by @pankajkoti in #2759
• on_warning_callback now fires for dbt test warnings in ExecutionMode.LOCAL subprocess mode (previously skipped on dbt 1.10+, where PASS=.. WARN=N is no longer the final stdout line) by @tatiana in #2832

Features

• Add ExecutionMode.GCP_GKE and ExecutionMode.WATCHER_GCP_GKE execution modes by @vricciardulli in #2488
• Add an enable_watcher_reliable_retry config to harden ExecutionMode.WATCHER producer retries by @tatiana in #2816

Enhancements

• Defer the OpenLineage processor import to task execution to reduce DAG-parse memory by @pankajastro in #2785
• Use the SDK Variable in the ExecutionMode.WATCHER XCom backup to reduce log noise by @jhorlima in #2804
• Reduce Airflow 3 Asset URI migration warning noise in ExecutionMode.WATCHER producer runs by @faridnsh in #2788
• Log via self.log inside dbt operators for consistency by @pankajastro in #2798
• Refactor build_airflow_graph to satisfy the C901 complexity limit by @00yhj22-debug in #2689

Bug Fixes

• Fix on_warning_callback skipping dbt test warnings in ExecutionMode.LOCAL subprocess mode by @tatiana in #2832
• Cache the packages lockfile regardless of whether dependencies are reinstalled by @ms32035 in #2787
• Maintain outlets passed to DbtRunLocalOperator when enable_dataset_alias=True by @jroachgolf84 in #2574
• Treat concurrent cosmos_cache Variable insert IntegrityError as benign by @pankajkoti in #2800

Others

• Fix the pytest-asyncio warning by marking async tests per-method instead of per-class by @pankajastro in #2795
• Ignore Claude Code user-local files by @pankajkoti in #2830
• Dependency updates by @dependabot in #2807 and #2820

Milestone: Cosmos 1.15.0

Full changelog: astronomer-cosmos-v1.15.0a1...astronomer-cosmos-v1.15.0a2

Features

• Add ExecutionMode.WATCHER_KUBERNETES mode with test handling by @vricciardulli in #2529 and #2543
• Support dbt docs on Kubernetes via DbtDocsS3KubernetesOperator by @jx2lee in #2058
• Add use_tarball option to the upload_to_gcp_gs callback by @TTMichaelA in #2497
• Add AWS and Azure tarball upload options by @TTMichaelA in #2553
• Expose freshness_callback in ExecutionConfig.setup_operator_args for ExecutionMode.WATCHER by @pankajastro in #2586
• Allow templating dbt deps installation via ExecutionConfig by @pankajastro in #2728
• Add configurable seed rendering behavior by @pankajkoti in #2755
• Render ephemeral dbt models as EmptyOperator by default by @pankajkoti in #2759
• Support per-node callbacks via string import paths by @highlyavailable in #2781
• Map Snowflake query_tag from connection extras to dbt profile by @pankajastro in #2650
• Add Snowflake profile mapping for non-encrypted private key file by @pankajastro in #2660
• Export Clickhouse and encrypted Snowflake mappings from cosmos.profiles by @pankajastro in #2668
• Forward Snowflake insecure_mode from connection Extra into dbt profile by @toor11 in #2744
• Extend Snowflake profile mappings with authenticator, client_session_keep_alive, host, and port by @Aaditya-git in #2748
• Support extra__google_cloud_platform__project in GoogleCloudServiceAccountDictProfileMapping by @jroachgolf84 in #2626
• Enable the orjson parser for the whole project (experimental) by @corsettigyg in #2552
• Warn when users pass output-only template fields to local operators by @goingforstudying-ctrl in #2737

Enhancements

• Replace openlineage-airflow with apache-airflow-providers-openlineage by @tatiana in #2753
• Refactor handling of watcher producer-only dbt flags by @tatiana in #2717
• Disclose the --no-static-parser flag in ExecutionMode.LOCAL by @pankajkoti in #2714
• Refactor _default_freshness_callback to return a list of (id, state) tuples by @pankajastro in #2572
• Restore dynamically resolved user-provided node types by @jroachgolf84 in #2608
• Promote inline watcher status collections to named constants by @pankajastro in #2671
• Align WATCHER_KUBERNETES producer default task_id with PRODUCER_WATCHER_TASK_ID by @tatiana in #2794
• Centralize version-aware EmptyOperator imports in a compatibility module by @pankajkoti in #2758
• Move safe_copy out of cosmos.cache into cosmos.fs by @pankajkoti in #2715
• Refactor seed checksum hashing and caching helpers by @pankajkoti in #2784
• Avoid O(n^2) string accumulation in store_compiled_sql by @pankajastro in #2751
• Use GA versions for propagate_logs in provider_info by @pankajastro in #2712
• Use cosmos.log.get_logger consistently by @pankajastro in #2670
• Use lazy logging instead of f-strings in logger calls by @pankajastro in #2672 and #2680
• Ban eager module-level imports of optional providers via ruff by @tatiana in #2743
• Remove unused # type: ignore comments and re-enable warn_unused_ignores by @pankajastro in #2710 and #2763
• Drop the Python <3.9 fallback for functools.cache by @pankajastro in #2732
• Remove stale Airflow 2.3 comment on registry_conn_id default by @pankajastro in #2766
• Remove an outdated TODO on watcher terminal-status handling by @pankajastro in #2697
• Unify operator logging on self.log by @pankajastro in #2681
• Centralise resource_name extraction from dbt unique_id by @pankajkoti in #2687
• Tighten # type: ignore comments to specify error codes by @pankajastro in #2711

Bug Fixes

• Fix example_cosmos_sources to use a dbt project with sources by @jroachgolf84 in #2614
• Unify Postgres profiles.yml across dbt example projects by @yeoreums in #2501
• Pin dbt-core<2.0 in virtualenv example DAGs to avoid alpha pickup by @pankajastro in #2752

Docs

• Create a glossary stub by @lzdanski in #2461
• Improve the glossary: fix structure, add Cosmos-specific terms by @pankajastro in #2618
• Add a top-level FAQ page by @tatiana in #2635
• Align the FAQ page with the documentation style guide by @tatiana in #2667
• Update docs for DbtDocsS3KubernetesOperator by @jx2lee in #2575
• Add docs for ExecutionMode.WATCHER and the depends_on_past limitation by @tatiana in #2602
• Document watcher mode dbt 1.5+ requirement by @tatiana in #2700
• Improve clarity for watcher_dbt_execution_queue by @jroachgolf84 in #2705
• Document compiled_sql and freshness as output-only template fields by @00yhj22-debug in #2719
• Document seed rendering behavior by @pankajkoti in #2757
• Document tradeoffs of remote cache and disabling the dbt ls cache by @pankajkoti in #2722
• Document the LOCAL vs WATCHER benchmark on the Helm chart by @pankajkoti in #2688
• Enhance S3 dbt docs documentation by @jroachgolf84 in #2765
• Restore memory-optimised imports docs for Cosmos < 1.14.0 by @pankajkoti in #2604
• Update dbt and Airflow Spark URLs in profile mapping docstrings by @pankajastro in #2695
• Remove a duplicate node_conversion_by_task_group entry in render config docs by @pankajkoti in #2770
• Capitalize Docker as a product name in prose by @pankajkoti in #2623
• Normalize heading underlines across docs by @pankajkoti in #2641, #2655, #2656, and #2663
• Add language hints to docs code-block directives by @pankajastro in #2686
• Add the Cosmos 1.14.2 row to the watcher-retry behavior history by @tatiana in #2742

Others

• Reduce integration test CI time from ~30 min to ~16 min by @pankajkoti in #2562
• Speed up Airflow 3.1+ integration tests by caching InProcessExecutionAPI by @pankajkoti in #2547
• Carve dbt-loom tests into a dedicated CI job by @pankajastro in #2761
• Re-enable the cross-project dbt ls example DAG in the dbt-loom CI job by @pankajkoti in #2775
• Move test jobs that need no secrets to an unprivileged pull_request workflow by @pankajkoti in #2791
• Remove the Authorize gate from CI jobs that don't use secrets by @pankajkoti in #2567
• Avoid running tests when PRs from forks only change docs by @tatiana in #2583
• Forward extra args to the test-integration hatch script by @tatiana in #2682
• Add release-* branches for pull_request_target to run CI on release branches by @pankajkoti in #2603
• Pin pre-commit hooks and GitHub Actions to commit SHAs by @pankajkoti in #2610, #2611, #2612, and #2613
• Set persist-credentials: false for checkout in the actionlint workflow by @pankajkoti in #2793
• Stop the stale bot from auto-closing PRs by @pankajkoti in #2746
• Make local hatch run docs:build fail on Sphinx warnings by @pankajkoti in #2639
• Skip the watcher gateway test on Airflow 3.0 by @tatiana in #2607
• Add an example DAG for seed rendering behavior by @pankajkoti in #2756
• Add integration tests for ephemeral models rendered as empty operators by @pankajkoti in #2760
• Improve coverage for DbtRunAirflowAsyncBigqueryOperator by @pankajastro in #2733
• Add test coverage for DbtModel._extract_config branches by @pankajastro in #2779
• Extract project conventions into AGENTS.md; slim CLAUDE.md by @tatiana in #2703
• Document the AI agent attribution convention by @tatiana in #2718
• Teach AI agents to use pre-commit before committing and pushing by @tatiana in #2702
• Instruct Claude Code to read AGENTS.md for commands before running them by @pankajkoti in #2774
• Document docs build and serve commands, and the docs style guide, in CLAUDE.md by @pankajkoti in #2637 and #2665
• Bump black from 26.3.1 to 26.5.1 by @pankajkoti in #2727
• Bump codecov-action to v6.0.2 by @pankajkoti in #2786
• Dependency updates by @dependabot in #2541, #2555, #2571, #2578, #2579, #2582, #2588, #2589, #2609, #2621, #2627, #2651, #2674, #2707, #2721, #2724, #2725, #2730, #2745, #2783, #2789, and #2790

Milestone: Cosmos 1.15.0

Behaviour Changes

These changes adjust observable behaviour of the ExecutionMode.WATCHER execution mode. None of them break the public Cosmos API, but users relying on undocumented internals (graph wiring assertions, XCom backup Variable names, retry-on-recovery semantics, or retry log format) should review before upgrading.

• ExecutionMode.WATCHER + depends_on_past=True: when the producer task has depends_on_past=True (typically set via default_args), the producer-done gateway task inside DbtTaskGroup is now wired downstream of every consumer task, in addition to the producer. This is required so that wait_for_downstream gating behaves correctly across DAG runs and the task group acts as a single unit that must fully succeed before the next run starts. Users with depends_on_past=False (the default) see no topology change. See #2615.
• ExecutionMode.WATCHER downstream retry on upstream recovery: dbt models that were skipped after an upstream-failure event are now retried in the same DAG run when the upstream task succeeds on retry. Previously these models remained skipped for the run. See #2684.
• ExecutionMode.WATCHER consumer-retry log format: the consumer's fallback dbt invocation no longer inherits the producer's internal --log-format json flag, so retry task logs now default to dbt's normal text format. Users who relied on JSON output in retry logs can opt in via operator_args={"dbt_cmd_flags": ["--log-format", "json"]}. See #2713.
• ExecutionMode.WATCHER XCom-backup Variable key scheme: the per-model XCom backup Variable key now includes the full task-group path and sanitises disallowed characters (+ / :) from run_id. External monitoring or cleanup scripts that match the old key pattern will need updating. See #2629 and #2683.

Bug Fixes

• Sanitize disallowed characters from XCom backup variable key by @MichaelRBlack in #2629
• Prevent watcher producers from colliding on one XCom-backup key by @tatiana in #2683
• Retry watcher downstream models on upstream-failure recovery by @tatiana in #2684
• Fix ExecutionMode.WATCHER interaction with depends_on_past by @johnhoran in #2615
• Strip --log-format from producer flags on watcher consumer retry by @tatiana in #2713
• Fix duplicate deferrable kwarg in DbtRunAirflowAsyncBigqueryOperator by @pankajastro in #2616
• Fix dbt docs iframe src missing deployment path prefix by @pankajastro in #2640
• Defer TaskInstance import in cluster policy to fix Sentry init crash by @pankajastro in #2662
• Restore type hints broken by lazy imports in cosmos/__init__.py by @pankajastro in #2647
• Fix ExecutionMode.WATCHER non-dbt stdout being suppressed from logs by @pankajastro in #2654
• Fix test sensor retry behaviour in ExecutionMode.WATCHER by @pankajkoti in #2658
• Fix watcher fallback selector for versioned dbt models by @pankajkoti in #2659
• Break out of iframe from Airflow 2 dbt Docs 404 link by @pankajastro in #2685

Docs

• Document source freshness aware execution for ExecutionMode.WATCHER by @pankajastro in #2617
• Add reference docs for DbtRunLocalOperator, DbtTestLocalOperator, DbtSnapshotLocalOperator and DbtBuildLocalOperator by @pankajastro in #2643
• Add watcher retry behaviour history documentation by @tatiana in #2600
• Add Apache Airflow® trademark on first prominent mention by @pankajkoti in #2624
• Sentence-case section headings by @pankajkoti in #2630
• Use - for bullet points by @pankajkoti in #2631
• Drop decorative separator lines by @pankajkoti in #2632
• Normalize heading underlines in docs/guides/ and docs/index.rst by @pankajkoti in #2664
• Fix broken cross-directory doc links by @pankajastro in #2694
• Fix broken external links in hand-written docs by @pankajastro in #2696
• Document support for Airflow 3.2 in the compatibility policy by @pankajastro in #2652
• Refresh the dbt/Airflow conflicts table to match the compatibility policy by @pankajastro in #2653
• Document incremental model limitation for ExecutionMode.AIRFLOW_ASYNC by @pankajastro in #2642

Others

• Import ParamValidationError from airflow.sdk to silence deprecation warning by @pankajastro in #2645
• Import DAG from airflow.sdk to silence deprecation warning by @pankajastro in #2644
• Enforce docs style guide via pre-commit hook by @pankajkoti and @tatiana in #2633
• Add Airflow 3.2 to the test matrix in CLAUDE.md by @pankajastro in #2646
• Document the lazy-logging standard in CLAUDE.md by @pankajastro in #2679
• Extract watcher XCom-key helpers and inline single-use bindings by @pankajastro in #2673
• Remove leftover scripts/airflow3 directory by @pankajastro in #2661
• Fix altered_jaffle_shop seed-dep CTE references by @pankajastro in #2690
• Skip Airflow 3.0 integration test stuck on example_watcher_with_freshness by @pankajastro in #2692
• Fix typo "constrantis" → "constraints" in tests env comment by @pankajastro in #2669

Pre-release alpha of Cosmos 1.14.2.

Refresh of a3 with eleven additional milestone PRs (nine from @pankajastro, two from @pankajkoti). All applied cleanly on top of the a3 cherry-picks. See the release PR for cherry-pick provenance and manual conflict resolution: #2708.

Bug Fixes

• Sanitize disallowed characters from XCom backup variable key by @MichaelRBlack in #2629
• Prevent watcher producers from colliding on one XCom-backup key by @tatiana in #2683
• Retry watcher downstream models on upstream-failure recovery by @tatiana in #2684
• Fix ExecutionMode.WATCHER interaction with depends_on_past by @johnhoran in #2615
• Fix duplicate deferrable kwarg in DbtRunAirflowAsyncBigqueryOperator by @pankajastro in #2616
• Fix dbt docs iframe src missing deployment path prefix by @pankajastro in #2640
• Defer TaskInstance import in cluster policy to fix Sentry init crash by @pankajastro in #2662
• Restore type hints broken by lazy imports in cosmos/__init__.py by @pankajastro in #2647
• Fix ExecutionMode.WATCHER non-dbt stdout being suppressed from logs by @pankajastro in #2654
• Fix test sensor retry behaviour in ExecutionMode.WATCHER by @pankajkoti in #2658
• Fix watcher fallback selector for versioned dbt models by @pankajkoti in #2659

Docs

• Document source freshness aware execution for ExecutionMode.WATCHER by @pankajastro in #2617
• Add reference docs for DbtRunLocalOperator, DbtTestLocalOperator, DbtSnapshotLocalOperator and DbtBuildLocalOperator by @pankajastro in #2643
• Add watcher retry behaviour history documentation by @tatiana in #2600
• Add Apache Airflow® trademark on first prominent mention by @pankajkoti in #2624
• Sentence-case section headings by @pankajkoti in #2630
• Use - for bullet points by @pankajkoti in #2631
• Drop decorative separator lines by @pankajkoti in #2632
• Normalize heading underlines in docs/guides/ and docs/index.rst by @pankajkoti in #2664
• Fix broken cross-directory doc links by @pankajastro in #2694
• Fix broken external links in hand-written docs by @pankajastro in #2696
• Document support for Airflow 3.2 in the compatibility policy by @pankajastro in #2652
• Refresh the dbt/Airflow conflicts table to match the compatibility policy by @pankajastro in #2653

Others

• Import ParamValidationError from airflow.sdk to silence deprecation warning by @pankajastro in #2645
• Import DAG from airflow.sdk to silence deprecation warning by @pankajastro in #2644
• Enforce docs style guide via pre-commit hook by @pankajkoti and @tatiana in #2633
• Add Airflow 3.2 to the test matrix in CLAUDE.md by @pankajastro in #2646
• Document the lazy-logging standard in CLAUDE.md by @pankajastro in #2679
• Extract watcher XCom-key helpers and inline single-use bindings by @pankajastro in #2673
• Remove leftover scripts/airflow3 directory by @pankajastro in #2661
• Fix altered_jaffle_shop seed-dep CTE references by @pankajastro in #2690
• Skip Airflow 3.0 integration test stuck on example_watcher_with_freshness by @pankajastro in #2692
• Fix typo "constrantis" → "constraints" in tests env comment by @pankajastro in #2669

Milestone: Cosmos 1.14.2

Full changelog: https://github.com/astronomer/astronomer-cosmos/compare/astronomer-cosmos-v1.14.2a3...astronomer-cosmos-v1.14.2a4

Pre-release alpha of Cosmos 1.14.2.

First alpha cut from release-1.14 with the full milestone applied (previous alphas a1 / a2 were point fixes off feature branches). See the release PR for cherry-pick provenance and manual conflict resolution: #2708.

Bug Fixes

• Sanitize disallowed characters from XCom backup variable key by @MichaelRBlack in #2629
• Prevent watcher producers from colliding on one XCom-backup key by @tatiana in #2683
• Retry watcher downstream models on upstream-failure recovery by @tatiana in #2684
• Fix ExecutionMode.WATCHER interaction with depends_on_past by @johnhoran in #2615
• Fix duplicate deferrable kwarg in DbtRunAirflowAsyncBigqueryOperator by @pankajastro in #2616
• Fix dbt docs iframe src missing deployment path prefix by @pankajastro in #2640
• Defer TaskInstance import in cluster policy to fix Sentry init crash by @pankajastro in #2662
• Restore type hints broken by lazy imports in cosmos/__init__.py by @pankajastro in #2647
• Fix ExecutionMode.WATCHER non-dbt stdout being suppressed from logs by @pankajastro in #2654

Docs

• Document source freshness aware execution for ExecutionMode.WATCHER by @pankajastro in #2617
• Add reference docs for DbtRunLocalOperator, DbtTestLocalOperator, DbtSnapshotLocalOperator and DbtBuildLocalOperator by @pankajastro in #2643
• Add watcher retry behaviour history documentation by @tatiana in #2600
• Add Apache Airflow® trademark on first prominent mention by @pankajkoti in #2624
• Sentence-case section headings by @pankajkoti in #2630
• Use - for bullet points by @pankajkoti in #2631
• Drop decorative separator lines by @pankajkoti in #2632
• Normalize heading underlines in docs/guides/ and docs/index.rst by @pankajkoti in #2664
• Fix broken cross-directory doc links by @pankajastro in #2694
• Fix broken external links in hand-written docs by @pankajastro in #2696

Others

• Import ParamValidationError from airflow.sdk to silence deprecation warning by @pankajastro in #2645
• Import DAG from airflow.sdk to silence deprecation warning by @pankajastro in #2644
• Enforce docs style guide via pre-commit hook by @pankajkoti and @tatiana in #2633

Milestone: Cosmos 1.14.2

Full changelog: https://github.com/astronomer/astronomer-cosmos/compare/astronomer-cosmos-v1.14.1...astronomer-cosmos-v1.14.2a3

Test: Forward non-dbt stdout to task log in WATCHER mode in https://github.com/astronomer/astronomer-cosmos/pull/2654

Test: Fix dbt docs iframe src missing deployment path prefix PR: https://github.com/astronomer/astronomer-cosmos/pull/2640

Bug Fixes

• Fix ExecutionMode.WATCHER producer retry behaviour by @tatiana in #2559
• Prevent watcher producer skip propagating to downstream tasks via gateway task by @johnhoran and @tatiana in #2597
• Keep watcher sensor polling when producer is still running by @pankajkoti in #2592
• Fix circular import error in Cosmos plugin discovery under Astro Runtime by @tatiana in #2538
• Fix CosmosRichLogger crash on None log message by @tatiana in #2540
• Enable inlets and outlets using dbt Fusion on Airflow 3 by @ichirotakami in #2561
• Fix incorrectly skipped source downstream tasks in ExecutionMode.WATCHER by @pankajastro in #2563
• Fix duplicate logs in dbt build when source freshness is enabled by @pankajastro in #2564
• Warn and normalize when source_rendering_behavior=None is passed by @pankajastro in #2570
• Gracefully handle Variable.set() failures on Astro Remote Execution by @hkc-8010 in #2573
• Skip malformed YAML selectors instead of failing entirely by @YourRoyalLinus in #2577

Docs

• Update watcher test behavior docs for Cosmos 1.14.0 by @tatiana in #2549
• Add redirect for moved partial-parsing docs page by @tatiana in #2550
• Document ExecutionMode.WATCHER and depends_on_past limitation by @tatiana in #2602
• Restore memory-optimised imports docs for Cosmos < 1.14.0 by @pankajkoti in #2604

Others

• Speed up Airflow 3.1+ integration tests by caching InProcessExecutionAPI by @pankajkoti in #2547
• Improve stability of cache hash unit tests by @tatiana in #2539
• Fix mypy 1.20.0 type check failures by @pankajkoti in #2546
• Fix CI failures caused by docs build memory exhaustion by @pankajkoti in #2580
• Fix dbt Fusion broken integration tests by @tatiana in #2581
• Fix flaky cosmos_manifest_selectors_example DAG in CI by @pankajkoti in #2593
• Reduce pre-commit autoupdate frequency PRs by @tatiana in #2544
• Bump reviewdog/action-actionlint from 1.71.0 to 1.72.0 by @dependabot in #2542
• Skip watcher gateway test on Airflow 3.0 by @tatiana in #2607

Cut from release PR: https://github.com/astronomer/astronomer-cosmos/pull/2601

Cut from release PR: https://github.com/astronomer/astronomer-cosmos/pull/2601

• Fix watcher producer retries behaviour by @tatiana in #2559
  • Fixes ExecutionMode.WATCHER_KUBERNETES as well

https://github.com/astronomer/astronomer-cosmos/pull/2559

• Fix watcher producer retries behaviour by @tatiana in #2559

https://github.com/astronomer/astronomer-cosmos/pull/2559

1.14.0 (2026-04-07)

Breaking Changes

• Drop support for Airflow versions earlier than 2.9 by @jedcunningham in #2288
• Fix inclusion of package models and selection/exclusion behavior by @pankajkoti in #2357
• ExecutionMode.WATCHER: The per-node *_status XCom value is now a dict ({"status": "<status>", "outlet_uris": [...]}) instead of a plain string. Any custom code that reads these internal XCom keys directly will need to be updated by @pankajkoti in #2507

Features

• Add cluster policy support for ExecutionMode.WATCHER sensor retries by @astro-anand in #2293
• Add debug mode to track memory utilization by @tatiana in #2327
• Add FQN selection support for LoadMode.DBT_MANIFEST by @pankajastro in #2375
• Introduce interceptors for Cosmos tasks by @tatiana in #2419
• Add config to allow disabling dag versioning by @pankajkoti in #2470
• Implement TaskGroups by models folder by @maximilianoarcieri and @tatiana in #1566, #2469, and #2420
• feat: implement DbtTestWatcherOperator by @michal-mrazek in #2447
• Add source freshness aware execution for ExecutionMode.WATCHER by @pankajastro and @tatiana in #2467
  • Note: Like ExecutionMode.WATCHER, this feature is experimental and its interface and implementation can change in the future.
• Add Airflow 3.2 support by @pankajastro and @pankajkoti in #2472

Enhancements

• Add watcher mode support for dbt test node states by @michal-mrazek in #2318
• Rename watcher-mode sensor retry queue and reuse it for producer tasks by @pankajastro in #2331
• Fix leaked semaphore warnings in Airflow 3 by resetting dbt adapters by @pankajkoti in #2335
• Improve dbt Fusion support and related tests by @tatiana in #2356
• Default Snowflake profile mappings to four threads by @tatiana in #2374
• Attempt to remove Pydantic as a dependency by @tatiana in #2377
• Log dbt-core and adapter versions in watcher consumer tasks by @pankajastro in #2412
• Log model errors in watcher consumer on dbt node failure by @pankajastro in #2431
• Reduce XCom read/write for tracking node state and errors in ConsumerWatcher task by @pankajastro in #2471
• Remove duplicate debug log in watcher subprocess path by @tatiana in #2494
• Simplify and unify WATCHER implementation regardless of InvocationMode by @tatiana in #2498
• Switch to lazy imports in cosmos/init.py by @pankajkoti in #2531

Bug Fixes

• Handle invalid YAML errors with LoadMode.DBT_MANIFEST and RenderConfig.selector by @YourRoyalLinus in #2316
• Populate compiled_sql for InvocationMode.SUBPROCESS in ExecutionMode.WATCHER by @pankajkoti in #2319
• Fix select/exclude type mismatch by @tatiana in #2364
• Set emit_datasets=False for DbtTest* operators by @pankajastro in #2365
• Set correct queue priority for watcher producer tasks by @pankajastro in #2372
• Preserve extra_context for watcher consumer task instances by @pankajkoti in #2381
• Respect deferrable=False from operator_args on watcher consumer sensors by @pankajkoti in #2384
• Fix watcher queue precedence and add documentation by @pankajastro in #2391
• Do not set compiled_sql on ExecutionMode.WATCHER producers by @pankajkoti in #2440
• Remove const attribute for __cosmos_telemetry_metadata__ dag param by @pankajkoti in #2466
• Remove timeout override from Cosmos watcher sensors by @tatiana and @claude in #2478
• Remove forced retries=0 from watcher producer operators by @tatiana in #2479
• RFC: Add patch for newer versions of amazon provider when running dbt on EKS by @aoelvp94 in #2481
• Fix cosmos_debug_max_memory_mb XCom not pushed in Watcher sensor tasks by @tatiana in #2503
• Fix TestBehavior.NONE and TestBehavior.AFTER_ALL exclude ignored with selectors in ExecutionMode.WATCHER by @pankajkoti in #2511
• Move dataset emission for ExecutionMode.WATCHER from producer to consumer sensors by @pankajkoti in #2507

Docs

• Document cluster policy configuration for ExecutionMode.WATCHER sensor tasks by @pankajastro in #2315
• Remove outdated docs for the dbt docs plugin with Airflow 3 by @pankajastro in #2353
• Make Watcher DBT Execution Queue heading clickable by @pankajastro in #2354
• Update ExecutionMode.WATCHER documentation regarding test node implementation by @jroachgolf84 in #2355
• Fix pre_dbt_fusion configuration rendering by @pankajastro in #2369
• Add documentation for including/excluding nodes based on FQN by @pankajastro in #2371
• Update watcher execution mode documentation by @tatiana in #2380
• Add documentation for DbtSeedLocalOperator by @jroachgolf84 in #2383
• Fix miscellaneous Sphinx warnings by @pankajastro in #2395
• Improve contributing documentation by @lzdanski in #2397
• Add Get Started in 5 Minutes guide by @lzdanski in #2398
• Add Sphinx redirects package for documentation redirects by @lzdanski in #2407
• Restructure Getting Started and Guides sections by @lzdanski in #2418
• Add open-source quickstart by @lzdanski in #2439
• Fix documentation redirects by @lzdanski in #2442
• Restructure and refactor reference documentation by @lzdanski in #2443
• Add execution modes decision documentation by @lzdanski in #2444
• Add Core Concepts page to Getting Started by @lzdanski in #2448
• Add guide: How Cosmos Works by @lzdanski in #2449
• Update Getting Started overview and index pages by @lzdanski in #2452
• Add guide: How Cosmos Runs dbt by @lzdanski in #2453
• Fix miscellaneous documentation links by @lzdanski in #2454
• Add Mermaid diagrams and execution mode diagrams by @lzdanski and @tatiana in #2459
• Add documentation for memory optimization options by @pankajastro in #2340
• Fix typo in watcher execution mode docs by @evanvolgas in #2485
• Fix minor documentation issues by @evanvolgas in #2489
• Add troubleshooting note for dbt debug logs in ExecutionMode.WATCHER by @tatiana in #2491
• docs: unify RST header styles across documentation by @jigangz in #2473
• docs: fix env var for rich logging by @vricciardulli in #2514
• docs: update dbt project path example for Airflow 3 Astro compatibility by @yeoreums in #2512
• Document missing Cosmos Airflow config settings in cosmos-conf.rst by @tatiana in #2515
• Split security-privacy policy doc and add dependency cooldown by @pankajkoti in #2519
• Add performance optimization and troubleshooting docs by @pankajkoti in #2521
• Update copyright year to 2026 by @tayloramurphy in #2527
• docs: Updating "Project Policies" to "Policies" in menu bar by @jroachgolf84 in #2526

Others

• Fix tests after removing support for Airflow versions earlier than 2.9 by @tatiana in #2321
• Enable listener tests for Airflow 3.1 by @pankajastro in #2348
• Accept int or float for cosmos_debug_max_memory_mb in integration tests by @pankajkoti in #2352
• Update CODEOWNERS to prioritize oss-integrations by @tatiana in #2359
• Fix automatic reviewer assignment in GitHub by @tatiana and @phanikumv in #2360
• Improve PyPI tagging by @tatiana in #2363
• Add integration tests for dbt Fusion and ExecutionMode.WATCHER by @tatiana in #2373
• Fix Zizmor check by @tatiana in #2376
• Remove methodtools dependency by @tatiana in #2378
• Improve comments on #2389 by @evanvolgas in #2394
• Refactor load_from_dbt_manifest to reduce code complexity by @pankajkoti in #2399
• Refactor _handle_no_precursors_or_descendants to reduce complexity by @pankajkoti in #2400
• Improve issue templates by @tatiana in #2401
• Avoid running tests when only docs change by @tatiana in #2402
• Add no-reload target for serving docs locally by @pankajkoti in #2405
• Fix test hash checks on macOS by @tatiana in #2406
• Attempt deterministic dbt project copy in test fixtures by @pankajkoti in #2409
• Pin virtualenv <21 due to hatch incompatibility in CI by @pankajkoti in #2410
• Revert virtualenv pin for hatch installation in CI by @pankajkoti in #2426
• Add version comments for commit SHA pinned GitHub Actions by @pankajkoti in #2436
• Fix hatch run docs:build issues by @tatiana in #2437
• Minor code improvements by @dnskr in #2446
• Pre-commit autoupdate by @pre-commit-ci in #2367, #2396, #2422, #2451, #2468, #2495, and #2516
• Add file to support Claude understanding the Cosmos repository by @tatiana in #2458
• Dependency updates by @dependabot in #2368, #2425, #2435, #2465, #2475, #2504, #2518, and #2528
• Isolate Scarf telemetry integration test into its own CI job by @pankajkoti and @claude in #2477
• ci: upgrade Airflow version to 3.1 in MyPy type-check job by @yeoreums in #2506
• Add commit message guidelines to CLAUDE.md by @pankajkoti in #2509
• Extend skipping tests in CI for more non-code file changes by @pankajkoti in #2510
• Add Dependabot pre-commit support with 7-day cooldown by @pankajkoti in #2517
• Enforce zero warnings policy for documentation by @dnskr in #2513

What's Changed

• docs: Updating "Project Policies" to "Policies" in menu bar by @jroachgolf84 in https://github.com/astronomer/astronomer-cosmos/pull/2526
• Enforce zero warnings policy for documentation by @dnskr in https://github.com/astronomer/astronomer-cosmos/pull/2513
• Add Airflow 3.2 in test matrix by @pankajastro and @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2472
• Revert "feat: handle tests for WATCHER_KUBERNETES mode (#2529)" by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2535

Full Changelog: https://github.com/astronomer/astronomer-cosmos/compare/astronomer-cosmos-v1.14.0a8...astronomer-cosmos-v1.14.0a9

What's Changed

• Fix typo in watcher execution mode docs by @evanvolgas in https://github.com/astronomer/astronomer-cosmos/pull/2485
• Fix minor documentation issues by @dnskr in https://github.com/astronomer/astronomer-cosmos/pull/2489
• Add troubleshooting note for dbt debug logs in ExecutionMode.WATCHER by @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/2491
• RFC: Add patch for newer versions of amazon provider when running dbt on EKS by @aoelvp94 in https://github.com/astronomer/astronomer-cosmos/pull/2481
• Remove duplicate debug log in watcher subprocess path by @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/2494
• ⬆ [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/astronomer/astronomer-cosmos/pull/2495
• docs: unify RST header styles across documentation by @jigangz in https://github.com/astronomer/astronomer-cosmos/pull/2473
• feat: implement DbtTestWatcherOperator by @michal-mrazek in https://github.com/astronomer/astronomer-cosmos/pull/2447
• Remove unused litellm dependency from pinned requirements by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2499
• Revert "Remove unused litellm dependency from pinned requirements (#2499)" by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2500
• Bump codecov/codecov-action from 5.5.2 to 5.5.3 by @dependabot[bot] in https://github.com/astronomer/astronomer-cosmos/pull/2504
• ci: upgrade Airflow version to 3.1 in MyPy type-check job by @yeoreums in https://github.com/astronomer/astronomer-cosmos/pull/2506
• Fix cosmos_debug_max_memory_mb XCom not pushed in Watcher sensor tasks by @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/2503
• Add commit message guidelines to CLAUDE.md by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2509
• Simplify and unify WATCHER implementation regardless of InvocationMode by @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/2498
• Extend skipping tests in CI for more non-code file changes by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2510
• docs: fix env var for rich logging by @vricciardulli in https://github.com/astronomer/astronomer-cosmos/pull/2514
• docs: update dbt project path example for Airflow 3 Astro compatibility by @yeoreums in https://github.com/astronomer/astronomer-cosmos/pull/2512
• Document missing Cosmos Airflow config settings in cosmos-conf.rst by @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/2515
• Add Dependabot pre-commit support with 7-day cooldown by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2517
• Fix TestBehavior.NONE and TestBehavior.AFTER_ALL exclude ignored with selectors in ExecutionMode.Watcher by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2511
• Split security-privacy policy doc and add dependency cooldown by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2519
• Bump black from 22.10.0 to 26.3.1 by @dependabot[bot] in https://github.com/astronomer/astronomer-cosmos/pull/2518
• Add performance optimization and troubleshooting docs by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2521
• Add source freshness aware execution for ExecutionMode.WATCHER by @pankajastro in https://github.com/astronomer/astronomer-cosmos/pull/2467
• Bump codecov/codecov-action from 5.5.3 to 6.0.0 by @dependabot[bot] in https://github.com/astronomer/astronomer-cosmos/pull/2528
• Update copyright year to 2026 by @tayloramurphy in https://github.com/astronomer/astronomer-cosmos/pull/2527
• ⬆ [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/astronomer/astronomer-cosmos/pull/2516
• Move dataset emission for ExecutionMode.WATCHER from producer to consumer sensors by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2507
• Switch to lazy imports in cosmos/init.py by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2531

Full Changelog: https://github.com/astronomer/astronomer-cosmos/compare/astronomer-cosmos-v1.14.0a5...astronomer-cosmos-v1.14.0a8

Cut from: https://github.com/astronomer/astronomer-cosmos/pull/2472 (branch: https://github.com/astronomer/astronomer-cosmos/tree/airflow_3.2)

• Fix cosmos_debug_max_memory_mb XCom not pushed in Watcher sensor tasks by @tatiana in #2503

On top of the other changes in the main branch by the time #2503 was created

1.14.0a5 (2026-03-20)

Features

• Add config to allow disabling dag versioning by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2470
• feature: implement TaskGroups by models folder by @maximilianoarcieri and @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/1566, https://github.com/astronomer/astronomer-cosmos/pull/2469 and https://github.com/astronomer/astronomer-cosmos/pull/2420

Enhancements

• Reduce XCom read/write for tracking node state and errors in ConsumerWatcher task by @pankajastro in https://github.com/astronomer/astronomer-cosmos/pull/2471

Bugs

• Remove const attribute for cosmos_telemetry_metadata dag param by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2466
• Remove timeout override from Cosmos watcher sensors by @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/2478
• Remove forced retries=0 from watcher producer operators by @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/2479

Others

• ⬆ [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/astronomer/astronomer-cosmos/pull/2468
• Bump actions/download-artifact from 8.0.0 to 8.0.1 by @dependabot[bot] in https://github.com/astronomer/astronomer-cosmos/pull/2475
• Isolate Scarf telemetry integration test into its own CI job by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2477

Full Changelog: https://github.com/astronomer/astronomer-cosmos/compare/astronomer-cosmos-v1.14.0a4...astronomer-cosmos-v1.14.0a5

Breaking changes

• Drop support for Airflow versions earlier than 2.9 by @jedcunningham in #2288
• Fix inclusion of package models and selection/exclusion behavior by @pankajkoti in #2357

Features

• Add cluster policy support for ExecutionMode.WATCHER sensor retries by @astro-anand in #2293
• Add FQN selection support for LoadMode.DBT_MANIFEST by @pankajastro in #2375
• Introduce interceptors for Cosmos tasks by @tatiana in #2419

Enhancements

• Add watcher mode support for dbt test node states by @michal-mrazek in #2318
• Add debug mode to track memory utilization by @tatiana in #2327
• Rename watcher-mode sensor retry queue and reuse it for producer tasks by @pankajastro in #2331
• Fix leaked semaphore warnings in Airflow 3 by resetting dbt adapters by @pankajkoti in #2335
• Improve dbt Fusion support and related tests by @tatiana in #2356
• Default Snowflake profile mappings to four threads by @tatiana in #2374
• Attempt to remove Pydantic as a dependency by @tatiana in #2377
• Log dbt-core and adapter versions in watcher consumer tasks by @pankajastro in #2412
• Log model errors in watcher consumer on dbt node failure by @pankajastro in #2431

Bug Fixes

• Handle invalid YAML errors with LoadMode.DBT_MANIFEST and RenderConfig.selector by @YourRoyalLinus in #2316
• Populate compiled_sql for InvocationMode.SUBPROCESS in ExecutionMode.WATCHER by @pankajkoti in #2319
• Fix select/exclude type mismatch by @tatiana in #2364
• Set emit_datasets=False for DbtTest* operators by @pankajastro in #2365
• Set correct queue priority for watcher producer tasks by @pankajastro in #2372
• Preserve extra_context for watcher consumer task instances by @pankajkoti in #2381
• Respect deferrable=False from operator_args on watcher consumer sensors by @pankajkoti in #2384
• Fix watcher queue precedence and add documentation by @pankajastro in #2391
• Do not set compiled_sql on ExecutionMode.WATCHER producers by @pankajkoti in #2440

Docs

• Document cluster policy configuration for ExecutionMode.WATCHER sensor tasks by @pankajastro in #2315
• Remove outdated docs for the dbt docs plugin with Airflow 3 by @pankajastro in #2353
• Make Watcher DBT Execution Queue heading clickable by @pankajastro in #2354
• Update ExecutionMode.WATCHER documentation regarding test node implementation by @jroachgolf84 in #2355
• Fix pre_dbt_fusion configuration rendering by @pankajastro in #2369
• Add documentation for including/excluding nodes based on FQN by @pankajastro in #2371
• Update watcher execution mode documentation by @tatiana in #2380
• Add documentation for DbtSeedLocalOperator by @jroachgolf84 in #2383
• Fix miscellaneous Sphinx warnings by @pankajastro in #2395
• Improve contributing documentation by @lzdanski in #2397
• Add Get Started in 5 Minutes guide by @lzdanski in #2398
• Add Sphinx reredirects package for documentation redirects by @lzdanski in #2407
• Restructure Getting Started and Guides sections by @lzdanski in #2418
• Add open-source quickstart by @lzdanski in #2439
• Fix documentation redirects by @lzdanski in #2442
• Restructure and refactor reference documentation by @lzdanski in #2443
• Add execution modes decision documentation by @lzdanski in #2444
• Add Core Concepts page to Getting Started by @lzdanski in #2448
• Add guide: How Cosmos Works by @lzdanski in #2449
• Update Getting Started overview and index pages by @lzdanski in #2452
• Add guide: How Cosmos Runs dbt by @lzdanski in #2453
• Fix miscellaneous documentation links by @lzdanski in #2454
• Add Mermaid diagrams and execution mode diagrams by @lzdanski in #2459
• Add documentation for memory optimization options by @pankajastro in #2340

Others

• Fix tests after removing support for Airflow versions earlier than 2.9 by @tatiana in #2321
• Enable listener tests for Airflow 3.1 by @pankajastro in #2348
• Accept int or float for cosmos_debug_max_memory_mb in integration tests by @pankajkoti in #2352
• Update CODEOWNERS to prioritize oss-integrations by @tatiana in #2359
• Fix automatic reviewer assignment in GitHub by @tatiana and @phanikumv in #2360
• Improve PyPI tagging by @tatiana in #2363
• Add integration tests for dbt Fusion and ExecutionMode.WATCHER by @tatiana in #2373
• Fix Zizmor check by @tatiana in #2376
• Remove methodtools dependency by @tatiana in #2378
• Improve comments on #2389 by @evanvolgas in #2394
• Refactor load_from_dbt_manifest to reduce code complexity by @pankajkoti in #2399
• Refactor _handle_no_precursors_or_descendants to reduce complexity by @pankajkoti in #2400
• Improve issue templates by @tatiana in #2401
• Avoid running tests when only docs change by @tatiana in #2402
• Add no-reload target for serving docs locally by @pankajkoti in #2405
• Fix test hash checks on macOS by @tatiana in #2406
• Attempt deterministic dbt project copy in test fixtures by @pankajkoti in #2409
• Pin virtualenv <21 due to hatch incompatibility in CI by @pankajkoti in #2410
• Revert virtualenv pin for hatch installation in CI by @pankajkoti in #2426
• Add version comments for commit SHA pinned GitHub Actions by @pankajkoti in #2436
• Fix hatch run docs:build issues by @tatiana in #2437
• Minor code improvements by @dnskr in #2446
• Pre-commit autoupdate by @pre-commit-ci in #2367, #2396, #2422, and #2451
• Add file to support Claude understanding the Cosmos repository by @tatiana in #2458
• Dependency updates by @dependabot in #2368, #2425, #2435, and #2465

Alpha release to validate the branch: customer-issue-328-everything-together

1.14.0a2 (2026-02-16)

Breaking changes

• Drop support for Airflow under 2.9 by @jedcunningham in #2288

Features

• Add Add cluster policy for ExecutionMode.WATCHER sensor for retry by @astro-anand in #2293
• Add debug mode feature to track memory utilisation by @tatiana in #2327

Enhancements

• Rename watcher-mode sensor retry queue and reuse it for producer tasks by @pankajastro in #2331

Docs

• Document the cluster policy config for ExecutionMode.WATCHER sensor task by @pankajastro in #2315
• Make Watcher DBT Execution Queue heading clickable by @pankajastro in #2354

Others

• Accept int or float for cosmos_debug_max_memory_mb in integration test by @pankajkoti in #2352
• Fix tests after removing support to Airflow versions under 2.9 support @tatiana in #2321

1.14.0a1 (2026-02-02)

Features

• Add Add cluster policy for ExecutionMode.WATCHER sensor for retry by @astro-anand in #2293

Enhancements

• Change Snowflake profile mappings to default to four threads by @tatiana in #2374
• Refactor to avoid potential future UnboundLocalError for producer_task in calculate_tasks_map by @rin in #2309

Bug Fixes

• Fix graph selector when using + selector with dbt-loom by @award1230 in #2389
• Populate compiled_sql for InvocationMode.SUBPROCESS in ExecutionMode.WATCHER by @pankajkoti in #2319
• Preserve extra_context for watcher consumer task instances by @pankajkoti in #2381
• Fix watcher: respect deferrable=False from operator_args on consumer sensor by @pankajkoti in #2384
• Error handle invalid YAML with LoadMode.DBT_MANIFEST and RenderConfig.selector by @YourRoyalLinus in #2316
• Fix selecting model when it has the same name as folder by @pankajastro in #2328
• Handle Param Validation errors by @tatiana in #2358
• Fix cache swap issue by @YourRoyalLinus in #2332
• Fix leaked semaphore warnings in Airflow 3 by resetting dbt adapters by @pankajkoti in #2335

Docs

• Document ExecutionMode.KUBERNETES limitations by @tatiana in #2326

Others

• Add .airflow-registry.yaml for Airflow Provider Registry by @kaxil in #2387
• Improve test coverage for PR #2307 by @tatiana in #2308
• Address feedback from code review #2389 by @evanvolgas in #2394

Enhancements

• Change Snowflake profile mappings to default to four threads by @tatiana in #2374
• Refactor to avoid potential future UnboundLocalError for producer_task in calculate_tasks_map by @rin in #2309

Bug Fixes

• Fix graph selector when using + selector with dbt-loom by @award1230 in #2389
• Populate compiled_sql for InvocationMode.SUBPROCESS in ExecutionMode.WATCHER by @pankajkoti in #2319
• Preserve extra_context for watcher consumer task instances by @pankajkoti in #2381
• Fix watcher: respect deferrable=False from operator_args on consumer sensor by @pankajkoti in #2384
• Error handle invalid YAML with LoadMode.DBT_MANIFEST and RenderConfig.selector by @jonbillings in #2316
• Fix selecting model when it has the same name as folder by @pankajastro in #2328
• Handle Param Validation errors by @tatiana in #2358
• Fix cache swap issue by @jonbillings in #2332
• Fix leaked semaphore warnings in Airflow 3 by resetting dbt adapters by @pankajkoti in #2335

Docs

• Document ExecutionMode.KUBERNETES limitations by @tatiana in #2326

Others

• Improve test coverage for PR #2307 by @tatiana in #2308
• Address feedback from code review #2389 by @evanvolgas in #2394

Cut from: #2388

Features

• Support cross-referencing models across dbt projects using dbt-loom by @pankajkoti in #2271
• Support use of YAML selectors when using LoadMode.DBT_MANIFEST by @YourRoyalLinus in #2261
• Introduce ExecutionMode.WATCHER_KUBERNETES to use the watcher with KubernetesPodOperator by @tatiana in #2207
• Add support for StarRocks profile mapping by @kurkim0661 in #2256
• Allow pushing URIs as XComs for Cosmos tasks by @corsettigyg in #2275
• Support defining custom callbacks alongside the WATCHER_KUBERNETES callback by @johnhoran in #2307

Enhancements

• Refactor: remove duplicate _construct_dest_file_path by @jx2lee in #2077
• Leverage Airflow ::group:: to group logs associated with DAG parsing by @tatiana in #2235
• Refactor DbtConsumerWatcherSensor for reusability by @tatiana in #2245
• Restore plain text output when using ExecutionMode.WATCHER by @tiovader in #2241

Bug Fixes

• Fix running empty models or ephemeral nodes in ExecutionMode.WATCHER by @tatiana in #2279
• Improve watcher producer task priority in scheduling and the UI by @tatiana in #2237
• Fix typos and formatting issues in documentation by @pankajkoti in #2259
• Allow watcher producer retries without erroring by @tatiana in #2283
• Fix TestBehavior.AFTER_ALL is missing project_name information when loading project using manifest file by @tuantran0910 in #2242
• Fix duplicate log lines in watcher subprocess execution and format timestamps by @pankajkoti in #2301

Docs

• Add Watcher Kubernetes documentation by @tatiana in #2303
• Document newly added telemetry metrics in the privacy notice by @pankajkoti in #2249
• Add compatibility policy document by @pankajastro in #2251
• Improve watcher documentation related to dbt threads by @tatiana in #2273
• Fix link in watcher execution mode documentation by @jedcunningham in #2277
• Update Apache Airflow minimum compatibility policy by @tatiana in #2285
• Clarify Cosmos runtime support until "End of Basic Support" by @jedcunningham in #2286
• Update watcher docs by @tatiana in #2298
• Update watcher kubernetes documentation by @tatiana in #2306

Others

• Add Airflow 3 DAG versioning tests for Cosmos by @michal-mrazek in #2177
• Add dbt Core 1.11 to the test matrix by @tatiana in #2230
• Add integration tests using InvocationMode.SUBPROCESS and validate output by @tatiana in #2287
• Fix main branch failing tests by @tatiana in #2296
• Update pre-commit hooks to the latest versions by @jedcunningham in #2289
• Pre-commit autoupdates by @pre-commit in #2222, #2264, #2274 and #2290
• Dependabot updates by @dependabot in #2218, #2219, #2220, #2280 and #2284
• Add Scarf metrics to understand Cosmos feature usage patterns
  • Add telemetry tracking for dbt docs plugin usage by @pankajkoti in #2240
  • Add DAG run telemetry metrics for load mode, invocation, and render_config parameters by @pankajkoti in #2223
  • Collect profile metrics for DAG runs by @pankajastro in #2228
  • Compress telemetry metadata to reduce serialized DAG size by @pankajkoti in #2252
  • Skip storing telemetry metadata when emission is disabled by @pankajkoti in #2278
  • Hide telemetry metadata parameters from the Airflow trigger UI by @pankajkoti in #2247

Features

• Support use of YAML selectors when using LoadMode.DBT_MANIFEST by @YourRoyalLinus in https://github.com/astronomer/astronomer-cosmos/pull/2261

Bugs

• Fix duplicate log lines in watcher subprocess execution and format timestamps by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/2301

Others

• Fix main branch failing tests by @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/2296

Full Changelog: https://github.com/astronomer/astronomer-cosmos/compare/astronomer-cosmos-v1.13.0a3...astronomer-cosmos-v1.13.0a4

1.13.0a3 (2026-01-29)

Features

• Introduce ExecutionMode.WATCHER_KUBERNETES to use the watcher with KubernetesPodOperator by @tatiana in #2207

• Leverage Airflow ::group:: to group logs associated with DAG parsing by @tatiana in #2235

• Add support for StarRocks profile mapping by @kurkim0661 in #2256

• Allow pushing URIs as XComs for Cosmos tasks by @corsettigyg in #2275

• Add Scarf metrics to understand Cosmos feature usage patterns

  • Add telemetry tracking for dbt docs plugin usage by @pankajkoti in #2240
  • Add DAG run telemetry metrics for load mode, invocation, and render_config parameters by @pankajkoti in #2223
  • Collect profile metrics for DAG runs by @pankajastro in #2228
  • Compress telemetry metadata to reduce serialized DAG size by @pankajkoti in #2252
  • Skip storing telemetry metadata when emission is disabled by @pankajkoti in #2278

• Support cross-referencing models across dbt projects using dbt-loom by @pankajkoti in #2271 Enhancements

• Refactor: remove duplicate _construct_dest_file_path by @jx2lee in #2077

• Hide telemetry metadata parameters from the Airflow trigger UI by @pankajkoti in #2247

• Refactor DbtConsumerWatcherSensor for reusability by @tatiana in #2245

• Restore plain text output when using ExecutionMode.WATCHER by @tiovader in #2241

Bug Fixes

• Fix running empty models or ephemeral nodes in ExecutionMode.WATCHER by @tatiana in #2279
• Improve watcher producer task priority in scheduling and the UI by @tatiana in #2237
• Fix typos and formatting issues in documentation by @pankajkoti in #2259
• Allow watcher producer retries without erroring by @tatiana in #2283
• Fix TestBehavior.AFTER_ALL is missing project_name information when loading project using manifest file by @tuantran0910 in #2242

Docs

• Document newly added telemetry metrics in the privacy notice by @pankajkoti in #2249
• Add compatibility policy document by @pankajastro in #2251
• Improve watcher documentation related to dbt threads by @tatiana in #2273
• Fix link in watcher execution mode documentation by @jedcunningham in #2277
• Update Apache Airflow minimum compatibility policy by @tatiana in #2285
• Clarify Cosmos runtime support until "End of Basic Support" by @jedcunningham in #2286
• Update watcher docs by @tatiana in #2298

Others

• Add dbt Core 1.11 to the test matrix by @tatiana in #2230
• Add integration tests using InvocationMode.SUBPROCESS and validate output by @tatiana in #2287
• Update pre-commit hooks to the latest versions by @jedcunningham in #2289
• Pre-commit autoupdates by @pre-commit in #2222, #2264, #2274, and #2290
• Dependabot updates by @dependabot in #2218, #2219, #2220, #2280, and #2284

(Includes more changes - cut from the branch fix-empty-model-issue)

Features

• Introduce ExecutionMode.WATCHER_KUBERNETES to use watcher with KubernetesPodOperator by @tatiana in #2207

Enhancements

• Allow watcher producer retries without erroring by @tatiana in #2283

Bug Fixes

• Fix running empty models or ephemeral nodes in ExecutionMode.WATCHER by @tatiana in #2279

Features:

• (WIP) Introduce ExecutionMode.WATCHER_KUBERNETES to use watcher with KubernetesPodOperator by @tatiana in #2207

Release cut from:

• https://github.com/astronomer/astronomer-cosmos/pull/2207

Bug Fixes

• Fix DbtSourceWatcherOperator.template_fields to inherit from DbtSourceLocalOperator instead of DbtConsumerWatcherSensor by @pankajkoti in #2226
• Fix TypeError in Watcher mode with subprocess invocation by @pankajkoti in #2227
• Error when RenderConfig.invocation_mode is incorrectly set by @tatiana in #2267

Docs

• Fix minor documentation typo by @dnskr in #2093
• Fix default values in documentation by @dnskr in #2092
• Remove emitting event for ExecutionMode.AIRFLOW_ASYNC limitation in docs by @pankajastro in #2214

Others

• Add test to check profile metrics with non-Cosmos operator by @pankajastro in #2215
• Fix CI main branch Airflow 2.6 tests by @tatiana in #2268

Bug Fixes

• Fix DbtSourceWatcherOperator.template_fields to inherit from DbtSourceLocalOperator instead of DbtConsumerWatcherSensor by @pankajkoti in #2226
• Fix TypeError in Watcher mode with subprocess invocation by @pankajkoti in #2227

Docs

• Fix minor documentation typo by @dnskr in #2093
• Fix default values in documentation by @dnskr in #2092
• Remove emit event for ExecutionMode.AIRFLOW_ASYNC limitation in docs by @pankajastro in #2214

Others

• Add test to check profile metrics with non-cosmos operator by @pankajastro in #2215

Breaking changes

• Introduced in the PR #2080. The following functions are expected to be used internally only to Cosmos, so we hope these won't impact end-users, but we are documenting the changes just in case:
  • generate_task_or_group receives render_config instead of its individual configurations, such as test_behavior, source_rendering_behavior and enable_owner_inheritance
  • create_task_metadata receives render_config instead of its individual configurations, such as test_behavior, source_rendering_behavior and enable_owner_inheritance
  • create_task_metadata now expects the node_converters argument
• Drop Python 3.9 support by @pankajastro in #2118
• Drop Airflow 2.4 support by @pankajastro in #2161
• Drop Airflow 2.5 support by @pankajastro in #2165

Features

• Support applying node_converter at a task level instead of task group level by @anyapriya in #1759
• Allow overriding DbtProducerWatcherOperator parameters via ExecutionConfig.setup_operator_args by @pankajastro in #2133
• Use deferrable sensors by default in ExecutionMode.WATCHER by @pankajastro in #2084
• Support real-time consumer updates when using ExecutionMode.WATCHER and InvocationMode.SUBPROCESS by @pankajastro in #2152
• Update telemetry to v3 format with query parameters by @pankajkoti in #2192
• Add initial set of telemetry task listener metrics for Cosmos operators by @pankajkoti in #2195

Enhancements

• Unify Airflow version handling into constants.py by @tatiana in #2089
• Refactor airflow/graph.py to simplify the code base by @tatiana in #2080
• Force watcher producer retries to zero by @pankajkoti in #2114
• Fail ExecutionMode.WATCHER consumer sensors immediately when the producer fails using Airflow context by @pankajkoti in #2126
• ExecutonMode.WATCHER: fetch producer status asynchronously from the Airflow runtime so deferrable sensors fail immediately when the producer task fails by @pankajkoti in #2144
• Refactor ExecutionMode.WATCHER InvocationMode.SUBPROCESS log parser by @tatiana in #2183
• Replace map_index with is_mapped_task boolean in task telemetry metrics by @pankajkoti in #2210
• Collect cosmos profile metrics in task telemetry metrics by @pankajastro in #2198
• Remove unnecessary information from telemetry by @tatiana in #2211

Bug fixes

• Clarify ExecutionMode.WATCHER deferrable failure messaging by @pankajkoti in #2124
• Remove empty test tasks when all tests are detached by @anyapriya in #2010
• Fix forwarding DbtProducerWatcherOperator dbt build flags by @michal-mrazek in #2127
• Add databricks oauth mock profile by @fjmacagno in #2164
• Register listeners in Airflow 3 plugin implementation by @pankajastro in #2187
• Fix resolution of packages-install-path when it uses env_var by @tatiana in #2194
• Fix template_fields in DbtConsumerWatcherSensor to include DbtRunLocalOperator template_fields`` by @tiovader and @emanuel-luis in #2209
• Emit asset events in ExecutionMode.AIRFLOW_ASYNC mode by @pankajastro in #2184
• Remove dag_run_id from telemetry tests by @tatiana in #2213

Docs

• Document dataset-event limitation when using ExecutionMode.AIRFLOW_ASYNC by @varaprasadregani in #2143
• Expand ExecutionMode.KUBERNETES guidance by @tatiana in #2139
• Add docs for deferrable DbtConsumerWatcherSensor by @pankajastro in #2115
• Fix reStructuredText formatting by @dnskr in #2132
• Add docs for setup_operator_args param by @pankajastro in #2136
• Remove experimental flag for ExecutionMode.AIRFLOW_ASYNC by @pankajastro in #2153
• Clarify ExecutionMode.AIRFLOW_ASYNC dataset limits by @pankajkoti in #2167
• Update PRIVACY_NOTICE.rst by @tatiana in #2212

Others

• Drop Python 3.9 support by @pankajastro in #2118
• Drop Airflow 2.4 support by @pankajastro in #2161
• Drop Airflow 2.5 support by @pankajastro in #2165
• Improve example DAG jaffle_shop_kubernetes.py by @tatiana in #2140
• Enable tests for Python 3.13 by @pankajastro in #2154
• Add Python 3.12 to CI integration tests matrix by @pankajastro in #2168
• Retry flaky Telemetry success test to stabilise CI by @pankajkoti in #2138
• Drop unused producer state xcom handling in ExecutionMode.WATCHER by @pankajkoti in #2145
• Remove unused Python3.9 uses from Github action CI by @pankajastro in #2117
• Run pre-commit on ExecutionMode.WATCHER modules by @pankajkoti in #2150
• Refactor: Use shared airflow version constant by @pankajkoti in #2157
• Pin pydantic<2.0 for Airflow 2.6 compatibility by @pankajastro in #2172
• Remove duplicate dbt-duckdb dependency by @pankajastro in #2170
• Add targeted type: ignore for untyped decorators to fix mypy errors by @pankajastro in #2174
• Replace Legacy typing Aliases with Built-in Types for Python 3.10+ by @pankajastro in #2175
• Refactor to reuse load_method_from_module from _utils/importer.py by @pankajastro in #2176
• Remove try except block for cache import and unused python_version variable by @pankajastro in #2186
• Unpin Airflow to satisfy GitHub Security tab requirements by @pankajastro in #2171
• Update Python version for pyupgrade in pre-commit config by @pankajastro in #2190
• Add cooldown config in dependabot config by @pankajastro in #2189
• Adjust pre-commit so Python 3.10 or higher can be used by @tatiana in #2196
• Remove empty variables emission from telemetry metrics by @pankajkoti in #2197
• Reformat documented comments for historical URL formats by @pankajkoti in #2199
• Bump actions/checkout from 5.0.0 to 5.0.1 by @dependabot in #2135
• Bump actions/checkout to 6.0.0 in GitHub workflows by @dependabot in #2147
• Bump zizmorcore/zizmor-action from 0.2.0 to 0.3.0 by @dependabot in #2156
• Bump actions/checkout from 5.0.1 to 6.0.0 by @dependabot in #2155
• Bump actions/checkout from 6.0.0 to 6.0.1 by @dependabot in #2178
• Bump codecov/codecov-action from 5.5.1 to 5.5.2 by @dependabot in #2208
• pre-commit autoupdate by @pre-commit-ci[bot] in #2134, #2162, #2173, #2191, #2202

Everything in v1.12.0a3 and additionally:

Breaking changes

• Drop Airflow 2.4 support by @pankajastro in #2161
• Drop Airflow 2.5 support by @pankajastro in #2165

Features

• Support real-time consumer updates when using ExecutionMode.WATCHER and InvocationMode.SUBPROCESS by @pankajastro in #2152

Enhancements

• Refactor ExecutionMode.WATCHER InvocationMode.SUBPROCESS log parser by @tatiana in #2183

Bug fixes

• Add Databricks Oauth mock profile by @fjmacagno in #2164
• Register listeners in Airflow 3 plugin implementation by @pankajastro in #2187

Docs

• Add docs for setup_operator_args param by @pankajastro in #2136
• Remove experimental flag for ExecutionMode.AIRFLOW_ASYNC by @pankajastro in #2153
• Clarify ExecutionMode.AIRFLOW_ASYNC dataset limits by @pankajkoti in #2167

Others

• Drop Airflow 2.4 support by @pankajastro in #2161
• Drop Airflow 2.5 support by @pankajastro in #2165
• Improve example DAG jaffle_shop_kubernetes.py by @tatiana in #2140
• Enable tests for Python 3.13 by @pankajastro in #2154
• Add Python 3.12 to CI integration tests matrix by @pankajastro in #2168
• Run pre-commit on ExecutionMode.WATCHER modules by @pankajkoti in #2150
• Refactor: Use shared airflow version constant by @pankajkoti in #2157
• Pin pydantic<2.0 for Airflow 2.6 compatibility by @pankajastro in #2172
• Remove duplicate dbt-duckdb dependency by @pankajastro in #2170
• Add targeted type: ignore for untyped decorators to fix mypy errors by @pankajastro in #2174
• Replace Legacy typing Aliases with Built-in Types for Python 3.10+ by @pankajastro in #2175
• Refactor to reuse load_method_from_module from _utils/importer.py by @pankajastro in #2176
• Remove try except block for cache import and unused python_version variable by @pankajastro in #2186
• Unpin Airflow to satisfy GitHub Security tab requirements by @pankajastro in #2171
• Update Python version for pyupgrade in pre-commit config by @pankajastro in #2190
• Add cooldown config in dependabot config by @pankajastro in #2189
• Bump zizmorcore/zizmor-action from 0.2.0 to 0.3.0 by @dependabot in #2156
• Bump actions/checkout from 5.0.1 to 6.0.0 by @dependabot in #2155
• Bump actions/checkout from 6.0.0 to 6.0.1 by @dependabot in #2178
• pre-commit autoupdate by @pre-commit-ci[bot] in #2162, #2173, #2191

Release prepared via PR: https://github.com/astronomer/astronomer-cosmos/pull/2149 (branch: https://github.com/astronomer/astronomer-cosmos/tree/release-1.12)

Breaking changes

• Introduced in the PR #2080. The following functions are expected to be used internally only to Cosmos, so we hope these won't impact end-users, but we are documenting the changes just in case:
  • generate_task_or_group receives render_config instead of its individual configurations, such as test_behavior, source_rendering_behavior and enable_owner_inheritance
  • create_task_metadata receives render_config instead of its individual configurations, such as test_behavior, source_rendering_behavior and enable_owner_inheritance
  • create_task_metadata now expects the node_converters argument
• Drop Python 3.9 support by @pankajastro in #2118

Features

• Support applying node_converter at a task level instead of task group level by @anyapriya in #1759
• Allow overriding DbtProducerWatcherOperator parameters via ExecutionConfig.setup_operator_args by @pankajastro in #2133
• Use deferrable sensors by default in ExecutionMode.WATCHER by @pankajastro in #2084

Enhancements

• Unify Airflow version handling into constants.py by @tatiana in #2089
• Refactor airflow/graph.py to simplify the code base by @tatiana in #2080
• Force watcher producer retries to zero by @pankajkoti in #2114
• Fail ExecutionMode.WATCHER consumer sensors immediately when the producer fails using Airflow context by @pankajkoti in #2126
• ExecutonMode.Watcher: fetch producer status asynchronously from the Airflow runtime so deferrable sensors fail immediately when the producer task fails by @pankajkoti in #2144

Bug fixes

• Clarify watcher deferrable failure messaging by @pankajkoti in #2124
• Remove empty test tasks when all tests are detached by @anyapriya in #2010
• Fix forwarding DbtProducerWatcherOperator dbt build flags by @michal-mrazek in #2127

Docs

• Document dataset-event limitation when using ExecutionMode.AIRFLOW_ASYNC by @varaprasadregani in #2143
• Expand ExecutionMode.KUBERNETES guidance by @pankajastro in #2139
• Add docs for deferrable DbtConsumerWatcherSensor by @pankajastro in #2115
• Fix reStructuredText formatting by @dnskr in #2132

Others

• Retry flaky Telemetry success test to stabilise CI by @pankajkoti in #2138
• Drop unused producer state xcom handling in ExecutionMode.WATCHER by @pankajkoti in #2145
• Drop Python 3.9 support by @pankajastro in #2118
• Remove unused Python3.9 uses from Github action CI by @pankajastro in #2117
• Bump actions/checkout from 5.0.0 to 5.0.1 by @dependabot in #2135
• Bump actions/checkout to 6.0.0 in GitHub workflows by @dependabot in #2147
• pre-commit autoupdate by @pre-commit-ci[bot] in #2134

Release prepared via PR: #2149 (branch: https://github.com/astronomer/astronomer-cosmos/tree/release-1.12)

Breaking changes

• Introduced in the PR #2080. The following functions are expected to be used internally only to Cosmos, so we hope these won't impact end-users, but we are documenting the changes just in case:
  • generate_task_or_group receives render_config instead of its individual configurations, such as test_behavior, source_rendering_behavior and enable_owner_inheritance
  • create_task_metadata receives render_config instead of its individual configurations, such as test_behavior, source_rendering_behavior and enable_owner_inheritance
  • create_task_metadata now expects the node_converters argument

Features

• Support applying node_converter at a task level instead of task group level by @anyapriya in #1759

Enhancements

• Remove usage of contextmanager in plugins for accessing connections in Airflow >= 3.1.2 by @pankajkoti in #2073
• Refactor airflow/graph.py to simplify code-base by @tatiana in #2080

Others

• Fix broken CI due to fastapi incompatibility with cadwyn for Airflow 3 by @pankajkoti in #2076
• Pre-commit updates: #2078

Breaking changes

• Introduced in the PR #2080. The following functions are expected to be used internally only to Cosmos, so we hope these won't impact end-users, but we are documenting the changes just in case:
  • generate_task_or_group receives render_config instead of its individual configurations, such as test_behavior, source_rendering_behavior and enable_owner_inheritance
  • create_task_metadata receives render_config instead of its individual configurations, such as test_behavior, source_rendering_behavior and enable_owner_inheritance
  • create_task_metadata now expects the node_converters argument

Features

• Support applying node_converter at a task level instead of task group level by @anyapriya in #1759

Enhancements

• Remove usage of contextmanager in plugins for accessing connections in Airflow >= 3.1.2 by @pankajkoti in #2073
• Refactor airflow/graph.py to simplify code-base by @tatiana in #2080

Others

• Fix broken CI due to fastapi incompatibility with cadwyn for Airflow 3 by @pankajkoti in #2076

Bug Fixes

• (back-ported) Fix resolution of packages-install-path when it uses env_var by @tatiana in #2194

Bug fixes

• Force DbtProducerWatcherOperator retries to zero by @pankajkoti in #2114
• Fail DbtConsumerWatcherSensor tasks immediately when the DbtProducerWatcherOperator fails using Airflow context by @pankajkoti in #2126
• Fix forwarding DbtProducerWatcherOperator dbt build flags by by @michal-mrazek in #2127

Documentation

• Expand ExecutionMode.KUBERNETES guidance by @tatiana in #2139
• Document dataset-event limitation when using ExecutionMode.AIRFLOW_ASYNC by @varaprasadregani in #2143

Bug fixes

• Fix ExecutionMode.WATCHER deadlock in Airflow 3.0 & 3.1 by @tatiana in #2087
• Fix ExecutionMode.AIRFLOW_ASYNC TaskGroup XCom issue by @tatiana in #2088
• Guard watcher callback exceptions to avoid hanging producer tasks by @pankajkoti in #2101
• Fix SQL templated field rendering for dynamically mapped tasks in Airflow 2 by @tatiana in #2119
• Fix ExecutionMode.WATCHER to use install_dbt_deps from ProjectConfig by @michal-mrazek in #2112

Enhancements

• Remove usage of contextmanager in plugins for accessing connections in Airflow >= 3.1.2 by @pankajkoti in #2073

Docs

• Improve ExecutionMode.AIRFLOW_ASYNC docs by @tatiana in #2103
• Add note about experimenting threads count for the Watcher Execution mode by @pankajkoti in #2083
• Fix minor documentation formatting issue by @dnskr in #2098
• Correct example YAML key from operator_args to operator_kwargs by @jx2lee in #2091

Others

• Fix broken CI due to fastapi incompatibility with cadwyn for Airflow 3 by @pankajkoti in #2076
• pre-commit autoupdate in #2078, #2104

Bug fixes

• Fix ExecutionMode.WATCHER deadlock in Airflow 3.0 & 3.1 by @tatiana in #2087
• Fix ExecutionMode.AIRFLOW_ASYNC TaskGroup XCom issue by @tatiana in #2088

Enhancements

• Remove usage of contextmanager in plugins for accessing connections in Airflow >= 3.1.2 by @pankajkoti in #2073

Others

• Fix broken CI due to fastapi incompatibility with cadwyn for Airflow 3 by @pankajkoti in #2076
• pre-commit autoupdate in #2078

Features

• Introduce ExecutionMode.WATCHER to reduce DAG run time by 1/5 in several PRs. Learn more about it here. This feature was implemented via multiple PRs, including:

  • Expose new execution mode by @tatiana @pankajastro @pankajkoti in #1999
  • Add DbtProducerWatcherOperator for the proposed ExecutionMode.WATCHER by @pankajkoti in #1982
  • Add DbtConsumerWatcherSensor for the proposed ExecutionMode.WATCHER by @pankajastro in #1998
  • Push producer's task completion status to XCOM by @pankajkoti in #2000
  • Add default priority_weight for DbtProducerWatcherOperator by @pankajkoti in #1995
  • Add sample dbt events for the dbt watcher execution mode by @pankajkoti in #1952
  • Add compiled_sql as a template fields on ExecutionMode.WATCHER when using run_results.json by @pankajastro in #2070
  • Set push_run_results_to_xcom kwargs correctly for invocation mode subprocess and Watcher mode by @pankajastro in #2067
  • Store compiled SQL as template field for dbt callback events in ExecutionMode.WATCHER by @pankajkoti in #2068
  • Add initial documentation for ExecutionMode.WATCHER by @tatiana in #2046
  • Support running State.UPSTREAM_FAILED tasks when WATCHER consumer upstream tasks fail by @tatiana in #2062
  • Fail sensor tasks immediately if the ExecutionMode.WATCHER producer task fails by @pankajastro in #2040
  • Add ``WATCHER``` to GitHub issue template by @tatiana in #2056
  • Add support for TestBehavior.AFTER_ALL with ExecutionMode.WATCHER by @pankajastro in #2049
  • Add support for TestBehavior.NONE with ExecutionMode.WATCHER by @pankajastro in #2047
  • Fix ExecutionMode.WATCHER behaviour with DbtTaskGroup by @tatiana in #2044
  • Fix Cosmos behaviour when using watcher with InvocationMode.DBT_RUNNER by @tatiana in #2048

• Add Airflow 3 plugin for dbt docs with multiple dbt projects support by @pankajkoti in #2009, check the documentation.

• Initial support to dbt Fusion by @tatiana in #1803. More details here.

• Support to prune sources without downstream references in dbt projects by @corsettigyg in #1988

• Allow to set task display name as a user-defined function by @corsettigyg in #1761

• Add dbt project's hash to dag docs to support dag versioning in Airflow 3 by @pankajkoti in #1907

• feat: Add Jinja templating support for dbt_cmd_flags by @skillicinski in #1899

• Add Scarf metric to collect the execution mode uses by @pankajastro in #1981

• Support Airflow 3.1 by @tatiana in #1980

• Add MySQL profile mapping by @Lee2532 in #1977

• Add sqlserver profile mapping by @pankajastro in #1737

Enhancement

• Improved the runtime speed of ExecutionMode.AIRFLOW_ASYNC by 36% , via the following tickets:
  • Use XCom to store sql when using ExecutionMode.AIRFLOW_ASYNC by @pankajastro in #1934
  • Refactor AIRFLOW_ASYNC teardown so it doesn't install the virtualenv by @pankajastro in #1938
  • Reuse the virtual env for AIRFLOW_ASYNC setup task by @pankajastro in #1939
• Improve dataset/asset experience in Cosmos by @tatiana in #2030
• Add downstreams to DbtNode by @wornjs in #2028

Bug fixes

• Fix tags extraction by @ms32035 in #1915
• Fix task flow operator args by @anyapriya in #2024

Documentation

• Add documentation for Airflow 3 Plugin supporting dbt docs for multiple dbt projects by @pankajkoti in #2063
• Add Cosmos Deferrable Operator Guide by @pankajastro in #1922
• Add dbt Fusion documentation by @tatiana in #1824 #1830
• Update dbt-fusion.rst to explicitly highlight it is in alpha by @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/1838
• Fix a bunch of docs build errors and warnings by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/1886
• Add docs note for param virtualenv_dir for async execution mode by @pankajastro in #1969
• Use pepy.tech downloads badge in README by @pankajkoti in #1920
• Correct the default value of cache_dir by @seokyun.ha in #2027

Others

• Promote @corsettigyg to committer by @tatiana in #1985
• Add @pankajkoti and @pankajastro to contributors.rst by @tatiana in #1983
• Update setup script for airflow3 script by @dwreeves in #2023
• Prevent pytest from trying to test classes that aren't actually tests by @anyapriya in #2032
• Fix dag.test() for Airflow 3.1+ by syncing DAG to database bby @kaxil in #2037
• Disable Scarf in CI by @pankajastro in #2016
• Fix failing dbt Fusion tests when run in parallel in CI by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/1896
• Fix MyPy issues related to ObjectStoragePath in main branch by @tatiana in #2012
• Cleanup example dbt event JSON dictionaries kept for XCOM referencby @pankajkoti in #1997
• Bump min hatch version that includes fixes for click>=8.3.0 by @pankajkoti in #1996
• Use official postgres image from Docker hub for kubernetes setup by @pankajkoti in #1986
• Use click<8.3.0 for hatch as click 8.3 breaks hatch by @pankajkoti in #1987
• Pin Airflow version in type check CI job by @pankajastro in #2003
• Improve comments after feedback on #1948 by @tatiana in #1963
• Fix running tests with dbt Fusion 2.0.0 preview versions by @tatiana in #1948
• Test hardening of dbt node having tags as unset or missing by @pankajkoti in #1918
• Fix Sphinx issue in the main branch by @tatiana in #2064
• pre-commit autoupdate in #2065, #2043, #2033, #2019, #1990, #2019, #2008, #1941, #1935, #1924
• GitHub dependabot update in #2051, #2050, #2038, #2022, #1947, #1955, #1946, #1944, #1945, #1928, #1921, #1917

Co-authored-by: Pankaj Koti pankaj.koti@astronomer.io Co-authored-by: Pankaj Singh pankaj.singh@astronomer.io

Failured fixes in fix_1960_additional_fixes

Latest improvements on ExecutionMode.WATCHER

Includes fixes based on early feedback on ExecutionMode.WATCHER:

• https://github.com/astronomer/astronomer-cosmos/pull/2044
• https://github.com/astronomer/astronomer-cosmos/pull/2048

Fixed issues with DbtTaskGroup and ExecutionMode.WATCHER when there is an upstream task to the task group. Airflow 3.1 support is close to completion. Cut from af-31.

Improvement on DbtTaskGroup with ExecutionMode.WATCHER and Airflow 3.1 support - cut from af-31 branch.

cut from branch: af3-plugin-draft PR: https://github.com/astronomer/astronomer-cosmos/pull/2009

cut from branch: af3-plugin-draft PR: https://github.com/astronomer/astronomer-cosmos/pull/2009

Features

• Introduce ExecutionMode.WATCHER to reduce DAG run time by 1/5 in several PRs, including:
  • Expose new execution mode by @tatiana @pankajastro @pankajkoti in #1999
  • Add DbtProducerWatcherOperator for the proposed ExecutionMode.WATCHER by @pankajkoti in #1982
  • Add DbtConsumerWatcherSensor for the proposed ExecutionMode.WATCHER by @pankajastro in #1998
  • Push producer's task completion status to XCOM by @pankajkoti in #2000
  • Add default priority_weight for DbtProducerWatcherOperator by @pankajkoti in #1995
  • Add sample dbt events for the dbt watcher execution mode by @pankajkoti in #1952
• Initial support to dbt Fusion by @tatiana in #1803. More details here. <https://astronomer.github.io/astronomer-cosmos/configuration/dbt-fusion>_.
• Support to prune sources without downstream references in dbt projects by @corsettigyg in #1988
• Allow to set task display name as a user-defined function by @corsettigyg in #1761
• Add dbt project's hash to dag docs to support dag versioning in Airflow 3 by @pankajkoti in #1907
• feat: Add Jinja templating support for dbt_cmd_flags by @skillicinski in #1899
• Add Scarf metric to collect the execution mode uses by @pankajastro in #1981

Enhancement

• Use XCom to store sql when using ExecutionMode.AIRFLOW_ASYNC by @pankajastro in #1934
• Refactor AIRFLOW_ASYNC teardown so it doesn't install the virtualenv by @pankajastro in #1938
• Reuse the virtual env for AIRFLOW_ASYNC setup task by @pankajastro in #1939

Bug fixes

• Fix tags extraction by @ms32035 in #1915

Documentation

• Add Cosmos Deferrable Operator Guide by @pankajastro in #1922
• Add dbt Fusion documentation by @tatiana in #1824 #1830
• Update dbt-fusion.rst to explicitly highlight it is in alpha by @tatiana in https://github.com/astronomer/astronomer-cosmos/pull/1838
• Fix a bunch of docs build errors and warnings by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/1886
• Add docs note for param virtualenv_dir for async execution mode by @pankajastro in #1969
• Use pepy.tech downloads badge in README by @pankajkoti in #1920

Others

• Promote @corsettigyg to committer by @tatiana in #1985
• Add @pankajkoti and @pankajastro to contributors.rst by @tatiana in #1983
• Fix failing dbt Fusion tests when run in parallel in CI by @pankajkoti in https://github.com/astronomer/astronomer-cosmos/pull/1896
• Fix MyPy issues related to ObjectStoragePath in main branch by @tatiana in #2012
• Cleanup example dbt event JSON dictionaries kept for XCOM reference by @pankajkoti in #1997
• Bump min hatch version that includes fixes for click>=8.3.0 by @pankajkoti in #1996
• Use official Postgres image from Docker hub for Kubernetes setup by @pankajkoti in #1986
• Use click<8.3.0 for hatch as click 8.3 breaks hatch by @pankajkoti in #1987
• Pin Airflow version in type check CI job by @pankajastro in #2003
• Improve comments after feedback on #1948 by @tatiana in #1963
• Fix running tests with dbt Fusion 2.0.0 preview versions by @tatiana in #1948
• Test hardening of dbt node having tags as unset or missing by @pankajkoti in #1918
• pre-commit autoupdate in #1990, #2019, #2008, #1941, #1935, #1924
• GitHub dependabot update in #1947, #1955, #1946, #1944, #1945, #1928 #1921 #1917

Set bq deferrable false for testing (bq_sync_mode)

Reuse the virtual env for the AIRFLOW_ASYNC setup task PR: https://github.com/astronomer/astronomer-cosmos/pull/1939