NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI, #494 most downloaded on PyPI
Confluent's Python client for Apache Kafka
Latest stable
2.16.1
Last release 14 days ago
30 Oct 2026
Ships fairly regularly
a new release about every 4 weeks
Nearly every release is documented
notes for 48 of 53 stable releases
2 versions withdrawn
withdrawn after publishing
10 years old
72 releases · first in 2016
Drag across the ruler to compare, or tap a release to open it.
This release also changes configuration defaults and deprecates a set of configuration properties, make sure to read the Upgrade considerations sectio…
confluent-kafka-python is based on librdkafka v1.0.0, see the librdkafka v1.0.0 release notes for a complete list of changes, enhancements and fixes and upgrade considerations.
v1.0.0 is a major feature release:
max.poll.interval.ms support in the Consumer.This release also changes configuration defaults and deprecates a set of configuration properties, make sure to read the Upgrade considerations section below.
The following configuration properties have changed default values, which may require application changes:
acks(alias request.required.acks) now defaults to all; wait for all in-sync replica brokers to ack. The previous default, 1 , only waited for an ack from the partition leader. This change places a greater emphasis on durability at a slight cost to latency. It is not recommended that you lower this value unless latency takes a higher precedence than data durability in your application.
broker.version.fallback now to defaults to 0.10, previously 0.9. broker.version.fallback.ms now defaults to 0. Users on Apache Kafka <0.10 must set api.version.request=false and broker.version.fallback=.. to their broker version. For users >=0.10 there is no longer any need to specify any of these properties.
enable.partition.eof now defaults to false. KafkaError._PARTITION_EOF was previously emitted by default to signify the consumer has reached the end of a partition. Applications which rely on this behavior must now explicitly set enable.partition.eof=true if this behavior is required. This change simplifies the more common case where consumer applications consume in an endless loop.
group.id is now required for Python consumers.
The following configuration properties have been deprecated. Use of any deprecated configuration property will result in a warning when the client instance is created. The deprecated configuration properties will be removed in a future release.
offset.store.method=file is deprecated.offset.store.path is deprecated.offset.store.sync.interval.ms is deprecated.produce.offset.report is no longer used. Offsets are always reported.queuing.strategy was an experimental property that is now deprecated.reconnect.backoff.jitter.ms is no longer used, see reconnect.backoff.ms and reconnect.backoff.max.ms.socket.blocking.max.ms is no longer used.topic.metadata.refresh.fast.cnt is no longer used.default.topic.config is deprecated.This release adds support for Idempotent Producer, providing exactly-once producing and guaranteed ordering of messages.
Enabling idempotence is as simple as setting the enable.idempotence
configuration property to true.
There are no required application changes, but it is recommended to add support for the newly introduced fatal errors that will be triggered when the idempotent producer encounters an unrecoverable error that would break the ordering or duplication guarantees.
See Idempotent Producer in the manual and the Exactly once semantics blog post for more information.
In previous releases librdkafka would maintain open connections to all brokers in the cluster and the bootstrap servers.
With this release librdkafka now connects to a single bootstrap server to retrieve the full broker list, and then connects to the brokers it needs to communicate with: partition leaders, group coordinators, etc.
For large scale deployments this greatly reduces the number of connections between clients and brokers, and avoids the repeated idle connection closes for unused connections.
Sparse connections is on by default (recommended setting), the old
behavior of connecting to all brokers in the cluster can be re-enabled
by setting enable.sparse.connections=false.
See Sparse connections in the manual for more information.
Original issue librdkafka #825.
max.poll.interval.ms is enforcedThis release adds support for max.poll.interval.ms (KIP-62), which requires
the application to call consumer.poll() at least every max.poll.interval.ms.
Failure to do so will make the consumer automatically leave the group, causing a group rebalance,
and not rejoin the group until the application has called ..poll() again, triggering yet another group rebalance.
max.poll.interval.ms is set to 5 minutes by default.
CachedSchemaRegistryClient configuration with configuration dict for application configsDelete Schema support to CachedSchemaRegistryClientConsumer.consume without setting group.id(now required)CachedSchemaRegistryClient handles get_compatibility properly./tests/run.sh added to simplify unit and integration test executionYour coding agent can read these notes before it upgrades. Set up the MCP server →
Nothing published for this version
The property default.topic.configuration has been deprecated and will be removed in 1.0, but still has precedence to topic configuration specified in…
See librdkafka v0.11.6 release notes for enhancements and fixes in librdkafka.
default.topic.configuration has been deprecated and will be removed in 1.0, but still has precedence to topic configuration specified in the global configuration dictionary. (#446)debug configuration property prior to plugin.library.paths for enhanced debugging. (#464)Nothing published for this version
v0.11.5 is a feature release that adds support for the Kafka Admin API (KIP-4).
v0.11.5 is a feature release that adds support for the Kafka Admin API (KIP-4).
This release adds support for the Admin API, enabling applications and users to perform administrative Kafka tasks programmatically:
The API closely follows the Java Admin API:
def example_create_topics(a, topics):
new_topics = [NewTopic(topic, num_partitions=3, replication_factor=1) for topic in topics]
# Call create_topics to asynchronously create topics
fs = a.create_topics(new_topics)
# Wait for operation to finish.
for topic, f in fs.items():
try:
f.result() # The result itself is None
print("Topic {} created".format(topic))
except Exception as e:
print("Failed to create topic {}: {}".format(topic, e))
Additional examples can be found in examples/adminapi
throttle_cb (#237) (#377)test_compatibility() should return False not None would return None when unable to check compatibility (#372, @Enether)Producer.produce documentation to use correct time unit of seconds (#384) (#385)This release adds binary wheels containing all required dependencies (librdkafka, openssl, zlib, etc) for Linux and OSX.
This release adds binary wheels containing all required dependencies (librdkafka, openssl, zlib, etc) for Linux and OSX.
Should these wheels not work on your platform then please file an issue outlining what is failing, and then use the previous method of installing librdkafka manually followed by pip install --no-binary all confluent-kafka
Support for Kafka message headers has been added (requires broker version >= v0.11.0).
When producing messages simply provide a list of key,value tuples as headers=:
myproducer.produce(topic, 'A message payload', headers=[('hdr1', 'val1'), ('another', 'one'), ('hdr1', 'duplicates are supported and ordering is retained')])
Message headers are returned as a list of tuples for consumed messages:
msg = myconsumer.poll(1)
if msg is not None and not msg.error():
headers = msg.headers()
if headers is not None:
# convert to dict, collapsing duplicate header keys
headers_dict = dict(headers)
logger kwarg in constructors) (#148)__version__ to __init__.py (@mrocklin)async kwargs to asynchronous (async will continue working until the 1.0 API bump)This is a minimal librdkafka version-synchronized release of the Python client.
This is a minimal librdkafka version-synchronized release of the Python client.
Changes:
Nothing published for this version
Nothing published for this version
Use bytes for Message payload and key
Bugfix release:
Nothing published for this version
Nothing published for this version
One column per quarter.