NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI · #4198 most downloaded on PyPI
Provider package apache-airflow-providers-apache-kafka for Apache Airflow
Last release 20 days ago
14 Sep 2026
Ships fairly regularly
a new release about every 2 weeks
Nearly every release is documented
notes for 37 of 37 stable releases
Nothing withdrawn
no release was ever pulled
3 years old
79 releases · first in 2023
librdkafka callbacks given as dotted-path strings on a Kafka connection extra ( error_cb , throttle_cb , stats_cb , log_cb , oauth_cb , on_commit ) ar
Release Date: 2026-09-14
Note
librdkafka callbacks given as dotted-path strings on a Kafka connection extra ( error_cb , throttle_cb , stats_cb , log_cb , oauth_cb , on_commit ) are no longer imported unless the full importable path of the callback is listed in the new [apache_kafka] callback_allowlist option, which is empty by default. A connection that relies on such a callback now raises ValueError until its path is added to the allowlist. Callbacks passed as actual callables, and managed authentication (Amazon MSK IAM, Google Managed Kafka), are unaffected.
Add an allowlist config option for Kafka connection string callbacks (#72208)
Improve documentation for the KafkaEventProducer plugin (#71085)
Note
librdkafka callbacks given as dotted-path strings on a Kafka connection extra (error_cb, throttle_cb, stats_cb, log_cb, oauth_cb, on_commit) are no longer imported unless the full importable path of the callback is listed in the new [apache_kafka] callback_allowlist option, which is empty by default. A connection that relies on such a callback now raises ValueError until its path is added to the allowlist. Callbacks passed as actual callables, and managed authentication (Amazon MSK IAM, Google Managed Kafka), are unaffected.
Add an allowlist config option for Kafka connection string callbacks (#72208)
Improve documentation for the KafkaEventProducer plugin (#71085)
One column per quarter.
Nothing published for this version
- Add 'return_apply_function_results' to ConsumeFromTopicOperator to return apply_function results
Release Date: 2026-08-23
Add 'return_apply_function_results' to ConsumeFromTopicOperator to return apply_function results (#69740)
Add 'return_apply_function_results' to ConsumeFromTopicOperator to return apply_function results (#69740)
Nothing published for this version
- Fix Kafka consumer not being closed on error in ConsumeFromTopicOperator
Release Date: 2026-08-08
Fix Kafka consumer not being closed on error in ConsumeFromTopicOperator (#69641)
Fix AwaitMessageTrigger crash on tombstone messages when apply_function is unset (#69665)
Fix KafkaBaseHook.test_connection missing oauth_cb for managed Kafka (#69507)
Fix AwaitMessageTriggerFunctionSensor not honoring timeout (#69639)
Validate ProduceToTopicOperator topic after rendering (#70333)
Fix Kafka consumer not being closed on error in ConsumeFromTopicOperator (#69641)
Fix AwaitMessageTrigger crash on tombstone messages when apply_function is unset (#69665)
Fix KafkaBaseHook.test_connection missing oauth_cb for managed Kafka (#69507)
Fix AwaitMessageTriggerFunctionSensor not honoring timeout (#69639)
Validate ProduceToTopicOperator topic after rendering (#70333)
Nothing published for this version
Nothing published for this version
- Add Kafka Event Producer publishing DagRun and TaskInstance state-change events (#68082, #70014)
Release Date: 2026-07-28
Add Kafka Event Producer publishing DagRun and TaskInstance state-change events (#68082, #70014)
Add Amazon MSK IAM (OAUTHBEARER) support to Apache Kafka provider (#69427)
Document 'apply_function' dot notation requirement for Kafka message queues (#68414)
Document each provider's optional extras in its docs index (#69478)
Add Kafka Event Producer publishing DagRun and TaskInstance state-change events (#68082, #70014)
Add Amazon MSK IAM (OAUTHBEARER) support to Apache Kafka provider (#69427)
Document 'apply_function' dot notation requirement for Kafka message queues (#68414)
Document each provider's optional extras in its docs index (#69478)
Nothing published for this version
- Add uri sanitizers and asset factories for new schemes
Release Date: 2026-05-23
Add uri sanitizers and asset factories for new schemes (#66426)
Fix KafkaError.name() called as property instead of method in create_topic (#65734)
Fix AwaitMessageTrigger missing _task_instance attribute (#66302)
Add uri sanitizers and asset factories for new schemes (#66426)
Fix KafkaError.name() called as property instead of method in create_topic (#65734)
Fix AwaitMessageTrigger missing _task_instance attribute (#66302)
Nothing published for this version
- Add cleanup to Kafka AwaitMessageTrigger for consumer management
Release Date: 2026-04-26
Add cleanup to Kafka AwaitMessageTrigger for consumer management (#64612)
Add cleanup to Kafka AwaitMessageTrigger for consumer management (#64612)
Nothing published for this version
- Load hook metadata from YAML without importing Hook class
Release Date: 2026-04-12
Load hook metadata from YAML without importing Hook class (#63826)
Load hook metadata from YAML without importing Hook class (#63826)
Nothing published for this version
- Fix AwaitMessageSensor not honoring timeout
Release Date: 2026-03-28
Fix AwaitMessageSensor not honoring timeout (#62104)
Fix docstring for AwaitMessageSensor and AwaitMessageTrigger in apache-kafka-provider (#63333)
Add Python 3.14 Support (#63520)
Migrate apache/kafka connection UI metadata to YAML (#63171)
Fix AwaitMessageSensor not honoring timeout (#62104)
Fix docstring for AwaitMessageSensor and AwaitMessageTrigger in apache-kafka-provider (#63333)
Add Python 3.14 Support (#63520)
Migrate apache/kafka connection UI metadata to YAML (#63171)
Nothing published for this version
- Add commit_offset option to AwaitMessageSensor and AwaitMessageTrigger
Release Date: 2026-03-13
Add commit_offset option to AwaitMessageSensor and AwaitMessageTrigger (#62916)
Add commit_offset option to AwaitMessageSensor and AwaitMessageTrigger (#62916)
Nothing published for this version
- Support Python 3.13 in apache.kafka provider
Release Date: 2026-02-14
Support Python 3.13 in apache.kafka provider (#61434)
Nothing published for this version
- Consume ''AirflowOptionalProviderFeatureException'' from compat sdk in providers
Release Date: 2026-01-17
Consume ''AirflowOptionalProviderFeatureException'' from compat sdk in providers (#60335)
New year means updated Copyright notices (#60344)
Consume ''AirflowOptionalProviderFeatureException'' from compat sdk in providers (#60335)
New year means updated Copyright notices (#60344)
Nothing published for this version
- Extract shared "module_loading" distribution
Release Date: 2026-01-02
Extract shared "module_loading" distribution (#59139)
Nothing published for this version
- Add backcompat for exceptions in providers
Release Date: 2025-12-13
Add backcompat for exceptions in providers (#58727)
Nothing published for this version
This release of provider is only available for Airflow 2.11+ as explained in the Apache Airflow providers support policy < https://github.com/apache/a
Release Date: 2025-11-30
Note
This release of provider is only available for Airflow 2.11+ as explained in the Apache Airflow providers support policy < https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers >_.
Fix AwaitMessageSensor to accept timeout and soft_fail parameters (#57863) (#58070)
Bump minimum Airflow version in providers to Airflow 2.11.0 (#58612)
Note
This release of provider is only available for Airflow 2.11+ as explained in the Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
Fix AwaitMessageSensor to accept timeout and soft_fail parameters (#57863) (#58070)
Bump minimum Airflow version in providers to Airflow 2.11.0 (#58612)
Nothing published for this version
- Convert all airflow distributions to be compliant with ASF requirements
Release Date: 2025-11-17
Convert all airflow distributions to be compliant with ASF requirements (#58138)
Convert all airflow distributions to be compliant with ASF requirements (#58138)
[AIRFLOW-XXX] Add message about breaking change in DAG#get_task_instances in 1.10.4
aws_session_token in extra_config of the aws hook (#6303)airflow backfill command (#6195)airflow/utils/dag_processing.py (#6314)sudo to kill cleared tasks when running with impersonation (#6026) (#6176)[AIRFLOW-5284] Replace deprecated log.warn by log.warning
Release Date: 2025-10-26
Make 'AwaitMessageTrigger' inherit 'BaseEventTrigger' (#56741)
Migrate Apache providers & Elasticsearch to ''common.compat'' (#57016)
Make 'AwaitMessageTrigger' inherit 'BaseEventTrigger' (#56741)
Migrate Apache providers & Elasticsearch to ''common.compat'' (#57016)
Nothing published for this version
- Make 'apply_function' optional in 'AwaitMessageTrigger'
Release Date: 2025-09-22
Make 'apply_function' optional in 'AwaitMessageTrigger' (#55437)
Make 'apply_function' optional in 'AwaitMessageTrigger' (#55437)
Nothing published for this version
[AIRFLOW-3923] Update flask-admin dependency to 1.5.3 to resolve security vulnerabilities from safety
none_skipped trigger rule (#5032)airflow test. (#4828)allowed_states for ExternalTaskSensor (#4536)fallback arg in airflow.configuration.get (#4567)query_params in BigQueryOperator is wrong. (#4876)Release Date: 2025-09-09
Refactor Common Queue Interface (#54651)
Make term Dag consistent in providers docs (#55101)
Refactor Common Queue Interface (#54651)
Make term Dag consistent in providers docs (#55101)
Nothing published for this version
- Set minimum version for common.messaging to 1.0.3
Release Date: 2025-08-11
Set minimum version for common.messaging to 1.0.3 (#54160)
Nothing published for this version
- Add validation for commit_cadence in Kafka ConsumeFromTopicOperator
Release Date: 2025-08-02
Add validation for commit_cadence in Kafka ConsumeFromTopicOperator (#52015)
Add Python 3.13 support for Airflow. (#46891)
Cleanup type ignores (#53300)
Remove type ignore across codebase after mypy upgrade (#53243)
Make kafka provider compatible with mypy 1.16.1 (#53125)
Remove upper-binding for "python-requires" (#52980)
Temporarily switch to use >=,< pattern instead of '~=' (#52967)
Replace BaseHook to Task SDK for apache/kafka (#52784)
Add validation for commit_cadence in Kafka ConsumeFromTopicOperator (#52015)
Add Python 3.13 support for Airflow. (#46891)
Cleanup type ignores (#53300)
Remove type ignore across codebase after mypy upgrade (#53243)
Make kafka provider compatible with mypy 1.16.1 (#53125)
Remove upper-binding for "python-requires" (#52980)
Temporarily switch to use >=,< pattern instead of '~=' (#52967)
Replace BaseHook to Task SDK for apache/kafka (#52784)
Nothing published for this version
- Add 'KafkaMessageQueueTrigger' for enhanced message queue trigger usability on Kafka queue
Release Date: 2025-07-06
Add 'KafkaMessageQueueTrigger' for enhanced message queue trigger usability on Kafka queue (#51718)
Move 'BaseHook' implementation to task SDK (#51873)
Update BaseOperator imports for Airflow 3.0 compatibility (#52503)
Drop support for Python 3.9 (#52072)
Add 'KafkaMessageQueueTrigger' for enhanced message queue trigger usability on Kafka queue (#51718)
Move 'BaseHook' implementation to task SDK (#51873)
Update BaseOperator imports for Airflow 3.0 compatibility (#52503)
Drop support for Python 3.9 (#52072)
Nothing published for this version
This release of provider is only available for Airflow 2.10+ as explained in the Apache Airflow providers support policy < https://github.com/apache/a
Release Date: 2025-05-18
Note
This release of provider is only available for Airflow 2.10+ as explained in the Apache Airflow providers support policy < https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers >_.
AIP-82: Add KafkaMessageQueueProvider (#49938)
fix: correct invalid arg timeout (#49426)
Fix max_messages warning of Kafka ConsumeFromTopicOperator (#48646)
Bump min Airflow version in providers to 2.10 (#49843)
Note
This release of provider is only available for Airflow 2.10+ as explained in the Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
AIP-82: Add KafkaMessageQueueProvider (#49938)
fix: correct invalid arg timeout (#49426)
Fix max_messages warning of Kafka ConsumeFromTopicOperator (#48646)
Bump min Airflow version in providers to 2.10 (#49843)
Nothing published for this version
- remove superfluous else block
Release Date: 2025-04-19
remove superfluous else block (#49199)
Nothing published for this version
- Create operators for working with Consumer Groups for GCP Apache Kafka
Release Date: 2025-03-31
Create operators for working with Consumer Groups for GCP Apache Kafka (#47056)
Remove google provider dependencies from apache-kafka provider (#47563)
Remove exclusions of confluent-kafka (#47240)
Limit confluent-kafka temporarily to exclude 2.8.1 (#47204)
Add legacy namespace packages to airflow.providers (#47064)
Create operators for working with Consumer Groups for GCP Apache Kafka (#47056)
Remove google provider dependencies from apache-kafka provider (#47563)
Remove exclusions of confluent-kafka (#47240)
Limit confluent-kafka temporarily to exclude 2.8.1 (#47204)
Add legacy namespace packages to airflow.providers (#47064)
Nothing published for this version
for the record, generated with: ~/node_modules/github-changes/bin/index.js -o airbnb -r airflow --only-pulls --use-commit-body --between-tags 1.6.2...
Raw changelog
for the record, generated with:
~/node_modules/github-changes/bin/index.js -o airbnb -r airflow --only-pulls --use-commit-body --between-tags 1.6.2...1.7.0rc1 --token {your_gh_token_here}
Session.remove after each run, to survive DB restart (@KMK-ONLINE)Release Date: 2024-12-26
Note
This release of provider is only available for Airflow 2.9+ as explained in the Apache Airflow providers support policy .
fix 'ConsumeFromTopicOperator' does not fail even if wrong credentials (#44307)
Bump minimum Airflow version in providers to Airflow 2.9.0 (#44956)
Update DAG example links in multiple providers documents (#44034)
Note
This release of provider is only available for Airflow 2.9+ as explained in the Apache Airflow providers support policy.
fix 'ConsumeFromTopicOperator' does not fail even if wrong credentials (#44307)
Bump minimum Airflow version in providers to Airflow 2.9.0 (#44956)
Update DAG example links in multiple providers documents (#44034)
Nothing published for this version
Nothing published for this version
- remove callable functions parameter from kafka operator template_fields
Release Date: 2024-10-14
remove callable functions parameter from kafka operator template_fields (#42555)
remove callable functions parameter from kafka operator template_fields (#42555)
Nothing published for this version
[scheduler] the notion of DAG runs allows for more parallelization, and controls around scheduling (max number of running task instance per DAG, max n
v1.6.0 brings:
Thanks to everyone in the community for all the PRs (stellar contributions!), comments and issue reporting.
Release Date: 2024-08-22
Note
This release of provider is only available for Airflow 2.8+ as explained in the Apache Airflow providers support policy .
Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)
Note
This release of provider is only available for Airflow 2.8+ as explained in the Apache Airflow providers support policy.
Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)
Nothing published for this version
v1.5.0 is a huge release. Tons of important features.
v1.5.0 is a huge release. Tons of important features.
Make sure to run airflow upgradedb after you upgrade
Improvements:
airflow upgradedb to get your database up to date as you upgrade AirflowRelease Date: 2024-06-27
Add 'delete_topic' to 'KafkaAdminClientHook' (#40142)
Default client in KafkaBaseHook (#40284)
implement per-provider tests with lowest-direct dependency resolution (#39946)
Nothing published for this version
- Group id is mandatory configuration option for confluent_kafka 2.4.0+
Release Date: 2024-05-30
Group id is mandatory configuration option for confluent_kafka 2.4.0+ (#39559)
Faster 'airflow_version' imports (#39552)
Simplify 'airflow_version' imports (#39497)
Group id is mandatory configuration option for confluent_kafka 2.4.0+ (#39559)
Faster 'airflow_version' imports (#39552)
Simplify 'airflow_version' imports (#39497)
Nothing published for this version
Your coding agent can read these notes before it upgrades. Set up the MCP server →