github.com/hibiken/asynq

Added

• PreEnqueueFunc, PostEnqueueFunc is added in Scheduler and deprecated EnqueueErrorHandler (PR: #476)

Changed

• Removed error log when Scheduler failed to enqueue a task. Use PostEnqueueFunc to check for errors and task actions if needed.
• Changed log level from ERROR to WARNINING when Scheduler failed to record SchedulerEnqueueEvent.

This version adds Task Aggregation feature and includes a few improvements and fixes.

Task Aggregation

This is a new feature which allows you to enqueue multiple tasks successively, and have them passed to the Handler together rather than individually. The feature allows you to batch multiple successive operations into one, in order to save on costs, optimize caching, or batch notifications, for example. See the Wiki page for details.

---

Added

• Group option is introduced to enqueue task in a group.
• GroupAggregator and related types are introduced for task aggregation feature.
• GroupGracePeriod, GroupMaxSize, GroupMaxDelay, and GroupAggregator fields are added to Config.
• Inspector has new methods related to "aggregating tasks".
• Group field is added to TaskInfo.
• (CLI): group ls command is added
• (CLI): task ls supports listing aggregating tasks via --state=aggregating --group=<GROUP> flags
• Enable rediss url parsing support: Thanks to @eleboucher

Fixed

• Fixed overflow issue with 32-bit systems (For details, see #426): Thanks to @assimon!

Fixed

• Fixed Redis version compatibility: Keep support for redis v4.0+ (See issue #401 for details).

This version improves worker crash recovery by introducing a concept of worker lease for an active task.
It also adds an optional field to Config to customize the context passed to the Handler.

Important Note:
Since this version changes the logic of crash recovery, update of the library version should be done with a clean restart of the process.
In other words, please make sure that the process running asynq.Server shutdown cleanly before restarting the process with this new version.

Added

• BaseContext is introduced in Config to specify callback hook to provide a base context from which Handler context is derived
• IsOrphaned field is added to TaskInfo to describe a task left in active state with no worker processing it.

Changed

• Server now recovers tasks with an expired lease. Recovered tasks are retried/archived with ErrLeaseExpired error.

Added

• PeriodicTaskManager is added. Prefer using this over Scheduler as it has better support for dynamic periodic tasks. See the wiki page for an example of using PeriodicTaskManager
• The asynq stats command now supports a --json option, making its output a JSON object
• Introduced new configuration for DelayedTaskCheckInterval. See godoc for more details.

This release includes changes to support Prometheus integration in the Web UI. The integration is optional, there shouldn't be any changes in performance or behavior of the library in this release.

Added

• Package x/metrics is added.
• Tool tools/metrics_exporter binary is added.
• ProcessedTotal and FailedTotal fields were added to QueueInfo struct.

Added

• Latency field is added to QueueInfo.
• EnqueueContext method is added to Client.

Fixed

• Fixed an error when user pass a duration less than 1s to Unique option

Changed

• NewTask takes Option as variadic argument
• Bumped minimum supported go version to 1.14 (i.e. go1.14 or higher is required).

Added

• Retention option is added to allow user to specify task retention duration after completion.
• TaskID option is added to allow user to specify task ID.
• ErrTaskIDConflict sentinel error value is added.
• ResultWriter type is added and provided through Task.ResultWriter method.
• TaskInfo has new fields CompletedAt, Result and Retention.

Removed

• Client.SetDefaultOptions is removed. Use NewTask instead to pass default options for tasks.