NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI, #4526 most downloaded on PyPI
Python client for Taskcluster
Latest stable
116.0.0
Last release 10 days ago
10 Nov 2026
Ships on a steady schedule
a new release about every 2 weeks
Nearly every release is documented
notes for 60 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
12 years old
502 releases · first in 2014
Drag across the ruler to compare, or tap a release to open it.
▶ [patch] #7202 Fixes github.renderTaskclusterYml rendering error for the payloads including invalid params
▶ [patch] #7202
Fixes github.renderTaskclusterYml rendering error for the payloads including invalid params
▶ [patch] #7195 Fixes worker-manager intermittent test failure
▶ [patch] bug 1907075 Web server graphql endpoints return 413 instead of 500 error.
▶ [patch] Upgrades to Node.js v20.16.0, go v1.23.0, and yarn v4.4.0.
▶ [MAJOR] #7036 Secrets are being introduced in services configuration. All sensitive values that are marked as secrets would be deployed in kubernetes as Secrets (as they used to be). All non-sensitive values would be stored inside ConfigMap resources. Deployments and CronJobs would fetch values from both secrets and configuration maps.
▶ [patch] #7167 Change the polling period for EC2 spot instance interruption notices to 5 seconds, as recommended by AWS documentation.
▶ [MAJOR] #7073 Generic Worker now logs to standard error instead of standard out. This is a bug fix, it seems it has always been logging to standard out.
▶ [minor]
Change adduser usage to useradd
adduser is a debian specific wrapper around useradd and friends. By
changing to useradd, we allow workers to be deployed on non debian
derivative distributions.
Generic Worker multiuser engine on Linux/FreeBSD now depends on:
and no longer depends on:
▶ [minor] #7145
Fixes inconsistency in the internal queue implementation that could lead to tasks being visible as pending in the UI
after they were resolved with deadline-exceeded.
▶ [patch] #7128 Generic Worker / D2G partial bug fix: support has been improved for running Docker Worker tasks with caches under Generic Worker. Previously, caches from a Docker Worker task running under Generic Worker containing files owned by a user other than root would not be owned by the same (container) user when the cache was mounted in a future task. D2G now consistently maps container uids and gids to host subuids and subgids (when caches are used) in order that cache file ownership, as seen from inside the container, is maintained across task runs. However, this fix does not apply when the privileged capability is enabled in the Docker Worker payload, since privileged tasks are executed under docker rather than podman. This fix only applies when podman is used.
▶ [patch] #7128
Generic Worker multiuser engine on Linux now uses /usr/sbin/deluser --remove-home instead of /usr/sbin/deluser --remove-all-files when deleting previous task users. This ensures that caches that may still be owned (in whole or in part) by the task user are not deleted.
<details> <summary>5 Dependabot updates</summary>
</details>
Your coding agent can read these notes before it upgrades. Set up the MCP server →
▶ [patch] #7073 CLI tools and generic-worker now returns short-version string if executed with --short-version argument:
▶ [patch] #7073
CLI tools and generic-worker now returns short-version string if executed with --short-version argument:
generic-worker --short-versionlivelog --short-versionwebsocktunnel --short-versionstart-worker --short-versiontaskcluster version --short-version▶ [patch] #7129 Worker-manager would avoid sending emails with duplicate error messages, as long as error message and information are the same.
▶ [minor] #7139
Generic Worker now sets environment variable TASK_GROUP_ID to the taskGroupId of the currently running task.
▶ [patch] #7132
Bug fix: Generic Worker multiuser on Linux/macOS was previously executing task
commands as processes that did not include the supplementary groups of the task
user, only its primary group. Until upgrading from Ubuntu 22.04 to Ubuntu 24.04
task users did not have supplementary groups, so this had no negative
consequences. However, /usr/sbin/adduser on Ubuntu 24.04 by default gives
newly generated users the supplementary group users, which introduced a
discrepency between the groups that the task command process was in, and the
groups that the user was in. Generic Worker multiuser on Linux and macOS now
ensures that the launched processes of task commands are given not only the
primary group of the task user, but also any supplementary groups that it has.
<details> <summary>3 Dependabot updates</summary>
</details>
▶ [patch] #7085 Adds timestamp to the worker related pulse events that were added in #7085.
▶ [patch] #7085
Adds timestamp to the worker related pulse events that were added in #7085.
▶ [patch] Switch CI to use Ubuntu 24.04
▶ [MAJOR] #7126 d2g no longer includes --privileged in all generated podman run commands. This was previously introduced as a breaking change in relea…
▶ [MAJOR] #7126
d2g no longer includes --privileged in all generated podman run commands. This was previously introduced as a breaking change in release 61.0.0 (PR #6891) but has broken some tasks. The original reason for adding it (#6890) seems to no longer apply, as the original bug report is no longer reproducible. This therefore reverts the d2g treatment of the --privileged flag to how it was before release 61.0.0.
▶ [minor] #7085 Worker-manager publishes more events to new exchanges in Pulse:
worker-pool-errorworker-requestedworker-runningworker-stopped▶ [patch] #7120 Removed memory, pid, and ulimits for d2g payloads.
▶ [patch] Updated azure test certificates.
▶ Additional change not described here: #7095.
<details> <summary>20 Dependabot updates</summary>
</details>
▶ [MAJOR] #7082 This change comprises three elements:
▶ [MAJOR] #7082 This change comprises three elements:
docker rather than podman if the Docker
Worker task has the privileged capability enabled. This should result in
fewer tasks failing due to differences in default behaviour between docker
and podman privileged containers.▶ [patch] #7083 Fixes query validation in pagination queries that were throwing 500 InternalServerError instead of 400 InputError
▶ [patch] #7083
Fixes query validation in pagination queries that were throwing 500 InternalServerError instead of 400 InputError
▶ [minor] #7089 Fixes an issue when cancelling a task didn't remove it from the pending queue. This made worker-manager think there are more pending tasks than there actually were, and create more workers.
▶ [patch] Upgrades to node v20.14.0 and go1.22.4 (SECURITY release).
▶ [patch] Upgrades to node v20.14.0 and go1.22.4 (SECURITY release).
▶ [minor] #7035 Helm chart allows conditional deployment of several resource types:
This might be useful in the deployments that use custom Ingress or manage secrets and configs externally.
Example usage: helm template --values .. --set "skipResourceTypes[0]"=ingress --set "skipResourceTypes[0]"=secert .
▶ [minor] #7076 Worker Runner now uses IMDSv2 instead of IMDSv1 in EC2. IMDSv1 is being phased out by Amazon.
▶ [patch] #7080 Fixes github service issue during cancellation of the previous runs that were not created. Response code was not checked properly which resulted in sending same error for each new build.
▶ [patch] #6668 Fixes an issue to support yarn run for dev:start and dev:stop scripts
▶ [minor] #7070 Generic Worker now sets the environment variable TASKCLUSTER_INSTANCE_TYPE in task commands to the instance type of the worker, if con
▶ [minor] #7070 Generic Worker now sets the environment variable TASKCLUSTER_INSTANCE_TYPE in task commands to the instance type of the worker, if configured. This matches the (undocumented) behaviour of Docker Worker. D2G also passes this environment variable through to podman, to emulate Docker Worker's behaviour.
▶ [patch] Fixes UI issue in worker view where error was shown despite worker being found.
▶ [patch] #7059
D2G now includes libvirt OS group in generated Generic Worker task payloads that use Docker Worker KVM device.
▶ [patch] #6954 Fixes an issue with github badges that timed out on non-existing branches.
▶ [patch]
Tasks using notify.pulse.<topic>.on-<event> routes now send out messages
using the specified topic. This means it's now possible to subscribe to
specific topics.
▶ [minor] #5073
Github service supports issue_comment events to trigger jobs through /tasckluster param comments in open Pull Requests.
.taskcluster.yml in default branch should allow this with policy.allowComments: collaborators value.
Tasks would be rendered with tasks_for = "github-issue-comment" and event.taskcluster_comment = param
This is an implementation of RFC 168
▶ [patch] #6567
yarn generate commands will attempt to run pg_dump inside the docker container if local binary is missing or its version is different from the server version.
<details> <summary>2 Dependabot updates</summary>
</details>
▶ [minor] #5967 Allows Docker Worker payloads to be used on the insecure Generic Worker engine, translated by d2g.
▶ [minor] #5967
Allows Docker Worker payloads to be used on the insecure Generic Worker engine, translated by d2g.
▶ [patch] #7025 Fixes JavaScript error in "Create Worker Pool" page that was introduced in the last release. Adds link to "Errors" in workers navigati
▶ [patch] #7025 Fixes JavaScript error in "Create Worker Pool" page that was introduced in the last release. Adds link to "Errors" in workers navigation bar.
<details> <summary>2 Dependabot updates</summary>
</details>
▶ [patch] Upgrades to go1.22.3 (SECURITY release). Was supposed to be handled in PR #7006, but was accidentally left out.
▶ [patch] Upgrades to go1.22.3 (SECURITY release). Was supposed to be handled in PR #7006, but was accidentally left out.
▶ [MAJOR] #7017 Generic Worker multiuser engine now places task directories under /home (Linux and FreeBSD) and /Users on macOS. Previously it was pla
▶ [MAJOR] #7017
Generic Worker multiuser engine now places task directories under /home
(Linux and FreeBSD) and /Users on macOS. Previously it was placing them under
/ by default on all three platforms, unless either HOME was set to a
non-standard value in the process launching Generic Worker multiuser engine, or
if tasksDir was explicitly set in Generic Worker config.
This is a bug fix, but due to being a significant change in behaviour, is being released as a major change to trigger a major version bump.
▶ [patch] #6117 Fixes Worker page when queue information was missing and error was displayed. If worker-manager data exists for this worker, it would be displayed instead.
▶ [patch] #6117 Workers in UI use consistent navigation element that allows to switch between worker pool definition, workers, pending and claimed tasks.
▶ [patch] #6117 Workers list page in UI shows "Worker Pool" link when it is available to improve navigation.
▶ [patch] Upgrades to node v20.13.0 and go1.22.3 (SECURITY release).
▶ [patch] Upgrades to node v20.13.0 and go1.22.3 (SECURITY release).
▶ [minor] #6979
Generic Worker multiuser engine on Linux now sets environment variableXDG_RUNTIME_DIR to /run/user/<UID> in task command processes (unless Generic Worker config setting runTasksAsCurrentUser is set to true).
▶ [patch] bug 1768667
Adds Task Group link in UI for indexed tasks.
Introduces new route to redirect to the Task Group view: /tasks/index/:namespace/:indexTask/task-group
<details> <summary>1 Dependabot updates</summary>
</details>
build(deps): bump the node-deps group across 1 directory with 17 updates
<details> <summary>8 Dependabot updates</summary>
</details>
▶ [patch] #6983 AWS provider correctly detects InvalidInstanceID.NotFound error and marks worker as stopped.
▶ [patch] #6983
AWS provider correctly detects InvalidInstanceID.NotFound error and marks worker as stopped.
▶ [patch] #6987
Generic Worker now checks if a graceful termination was requested from worker runner before calling queue.claimWork().
This helps fix a race condition where a preemption occurs right after Generic Worker starts up, but before the graceful termination handler to abort the task has been initialized.
▶ [patch] #6984 Github auto-cancel gracefully ignores missing task groups and doesn't log errors in github comments. This can happen when decision task failed on previous runs.
▶ [patch] #6761
Switching from googleapis package to a smaller @googleapis/* libraries to reduce startup time and avoid loading APIs we don't use.
▶ [patch] #6972 Generic Worker now uploads task payload artifacts in parallel to decrease graceful termination time in the event of a spot termination
▶ [patch] #6972 Generic Worker now uploads task payload artifacts in parallel to decrease graceful termination time in the event of a spot termination.
The insecure engine no longer performs a file copy command as the task user before the artifact upload process happens to help speed up the process.
Generic Worker (posix only) now tries to put an exclusive file lock on artifacts before upload to prevent the file from being written to by any other process. This is done in lieu of copying the file to a temporary location which was achieving the same thing. If putting the lock on the file fails, Generic Worker will fallback to copying the file.
▶ [patch] #6972
Don't compress .npz artifacts by default in Generic Worker.
<details> <summary>2 Dependabot updates</summary>
</details>
▶ [patch] Upgrades to Node.js v20.12.2 which is a security release.
▶ [patch] Upgrades to Node.js v20.12.2 which is a security release.
<details> <summary>6 Dependabot updates</summary>
</details>
▶ [patch] #6900 Worker Runner on Azure no longer sends a graceful-termination message if the scheduled event type is Freeze. It will continue to send
▶ [patch] #6900
Worker Runner on Azure no longer sends a graceful-termination message if the scheduled event type is Freeze. It will continue to send the message for all other event types: Reboot, Redeploy, Preempt, and Terminate.
▶ [patch] #6957
Improves performance of the findTasksAtIndex call (introduced in #6915)
that returns multiple tasks for a given list of namespaces and indexes.
▶ [patch] #6958 Worker Manager now only applies GCP disk labels to PERSISTENT disk types.
▶ [patch] #6958
Worker Manager now only applies GCP disk labels to PERSISTENT disk types.
This fixes an issue in v64.2.2 where initializeParams.labels was being set on all disk types and caused GCP to error on local SSDs (SCRATCH type disks).
▶ [patch] Upgrades to go1.22.2 and Node.js 20.12.1 which are both security releases.
▶ [patch] Upgrades rust version to 1.77.1 and ran cargo audit fix to fix insecure crates.
▶ [patch]
Upgrades rust version to 1.77.1 and ran cargo audit fix to fix insecure crates.
▶ [patch] Upgrades to Node.js v20.12.0
<details> <summary>7 Dependabot updates</summary>
</details>
▶ [patch] #6802 Worker Runner no longer polls the metadata service for the Google provider. Instead, we've added ?wait_for_change=true to the endpoint
▶ [patch] #6802
Worker Runner no longer polls the metadata service for the Google provider. Instead, we've added ?wait_for_change=true to the endpoint to perform a hanging GET request that'll return as soon as the metadata has changed and the VM has been preempted.
▶ [minor] Remove maxRunTime limitations for docker payloads in generic worker (d2g)
<details> <summary>2 Dependabot updates</summary>
</details>
▶ [patch] #6928 D2G no longer adds --cap-add=SYS_PTRACE for the docker worker allowPtrace feature since all capabilities are already added with the --
▶ [patch] #6928
D2G no longer adds --cap-add=SYS_PTRACE for the docker worker allowPtrace feature since all capabilities are already added with the --privileged flag being passed to all D2G commands as of #6890.
No changes
No changes
▶ [MAJOR] The Docker Worker binary is no longer built during releases. The most recent Docker Worker binary can be found here.
▶ [MAJOR] The Docker Worker binary is no longer built during releases. The most recent Docker Worker binary can be found here.
▶ [MAJOR] #6832 The Generic Worker simple engine has been renamed to the insecure engine.
▶ [MAJOR] #6832
The Generic Worker simple engine has been renamed to the insecure engine.
All future release binaries for this engine will also be renamed (e.g. generic-worker-simple-darwin-arm64 --> generic-worker-insecure-darwin-arm64), so please update any scripts that reference the simple engine binary.
This change was made to help make it extremely apparent that it should not be used in production environments and is only recommened for testing and development.
▶ [patch] Upgrades to go1.22.1 which is a security release.
▶ [patch]
Generic Worker now utilizes filepath.WalkDir instead of filepath.Walk.
filepath.WalkDir was introduced in go1.16 and is more performant and efficient over filepath.Walk.
This may help with race conditions during artifact uploads, where a file was initially seen, but then became unavailable at upload time.
▶ [patch] Upgrades to go1.22.1 which is a security release.
▶ [MAJOR] #6881
Google cloud workers spawned by Worker Manager now have workerGroup set to
the Google Cloud Zone (e.g. us-east1-d) rather than the Google Cloud
Region (e.g. us-east1). This makes it easier to issue api requests against
an instance, e.g. gcloud compute instances delete <workerId> --zone=<workerGroup>.
▶ [patch] #6890
D2G now always passes --privileged to the generated podman run command.
Without this option, some tasks that ran successfully under Docker Worker,
including tasks without Docker Worker capabilities, would not run correctly
under Generic Worker. Please note, this only elevates the privileges inside the
podman container, which runs as the task user on the host. The privileges
inside the container are still limited to the host privileges of the task user.
▶ [patch]
Generic Worker now correctly reports the Worker Pool ID when an interactive task is attempted on a worker pool with the interactive feature disabled. Previously the task log would report the Worker Pool ID in the exception/malformed-payload task run as <workerGroup>/<workerType>; now it correctly reports it as <provisionerId>/<workerType>. The Interactive feature is considered disabled when Generic Worker config setting enableInteractive is either absent or explicitly set to false in the Generic Worker config.
▶ [patch] Upgrades internal references library to use async fs operations to make upcoming node20 upgrade easier.
<details> <summary>7 Dependabot updates</summary>
</details>
▶ [patch] Fixes graphql validation rules for hooks groups query.
▶ [patch] Fixes graphql validation rules for hooks groups query.
▶ [patch] #6864
D2G now passes --privileged flag to the generated podman run command when
Docker Worker payload enables device capability hostSharedMemory. Without
this option, the podman container could not successfully access the shared
memory, despite the inclusion of argument --device=/dev/shm. With both
arguments present (--privileged and --device=/dev/shm), shared memory now
appears to be available inside the podman container.
<details> <summary>3 Dependabot updates</summary>
</details>
▶ [patch] Fix docker worker interactive shell UI rows/cols settings.
▶ [patch] Fix docker worker interactive shell UI rows/cols settings.
▶ [patch] #6836 Upgrades graphql server and client libraries to graphql 16.8
▶ [patch] #6836 Upgrades graphql to 16.8.1 in ui
<details> <summary>1 Dependabot updates</summary>
</details>
▶ [minor] #6845 D2G now provides support for the (discontinued) disableSeccomp capability which was removed from Docker Worker, but was still used by
▶ [minor] #6845 D2G now provides support for the (discontinued) disableSeccomp capability which was removed from Docker Worker, but was still used by the bugmon fuzzing project in the Community taskcluster environment. This was added to ease the migration path of this project from Docker Worker to Generic Worker.
▶ [patch] #6848 Fix an issue where an interactive session would close up when the shell would output invalid UTF-8.
▶ [patch] #6850 Add a proper TERM environment variable to interative sessions. This helps with some ncurses apps and tmux for example.
▶ Additional change not described here: #6852.
<details> <summary>4 Dependabot updates</summary>
</details>
▶ [patch] Upgrades to node v18.19.1, which is a security release.
▶ [patch]
Switched to use math/rand/v2 (new in go1.22), removed deprecated call to windows.OpenCurrentProcessToken(), fixed staticcheck errors, and added a staticcheck GitHub actions workflow for our repo.
▶ [patch] Upgrades to node v18.19.1, which is a security release.
▶ [patch] Kubernetes lifecycle timeouts correctly set to avoid having 502s.
▶ [patch] #6795 Fixes "Raw Log" button in UI that can point to an expired artifact.
▶ [patch] #6820 Fixes scope view in the UI. Search by scope shows roles and clients that use given scope.
▶ [patch] Upgrades to go1.22.0
▶ [patch] #6820 Fixes scope view in the UI. Search by scope shows roles and clients that use given scope.
<details> <summary>1 Dependabot updates</summary>
</details>
▶ [patch] Upgrades to yarn v4.1.0
▶ [patch] Upgrades to yarn v4.1.0
<details> <summary>5 Dependabot updates</summary>
</details>
▶ [patch] Worker Runner now checks for termination notice when starting the Google provider.
▶ [patch] Worker Runner now checks for termination notice when starting the Google provider.
When Worker Runner runs, the instance may already be scheduled to be shutdown. So on Google provider startup, we now check for this case.
This functionality mimics what's already in place for AWS.
This change also decreases the time Worker Runner checks to see if the instance is scheduled to be shutdown from 30 seconds to 15 seconds on the Google and Azure providers, as they each have a 30 second notice before a hard-shutdown Google: https://cloud.google.com/compute/docs/instances/spot#preemption-process Azure: https://learn.microsoft.com/en-us/azure/virtual-machines/spot-vms.
▶ [patch] #6801
Fixes a bug in notify service where multiple messages to the same channel were not sent.
Adds 204 status code to the email, matrix, pulse, slack endoints when message was detected to be duplicate and was not sent.
▶ [patch] #6793 D2G will now ensure that tasks whose max run time is exceeded still have the chance to publish artifacts. This means that Docker Worker tasks definitions that are run under Generic Worker and are aborted due to hitting the max run time should still publish the artifacts from the aborted docker container they ran in.
▶ [patch] #6798 Generic Worker now includes the original Docker Worker task definition in the chain of trust certificate, if the task payload is a Docker Worker task payload. Previously, it was including the internal Generic Worker representation of the task definition.
▶ [patch] The Task Creator now defaults to a task that only takes 1 minute to run instead of 10 mins, to redue resource consumption. Tutorials updated to reflect change.
<details> <summary>1 Dependabot updates</summary>
</details>
▶ [patch] #6789 Generic Worker no longer modifies task scopes passed to Taskcluster Proxy. Previously there was a bug where Taskcluster Proxy would be
▶ [patch] #6789
Generic Worker no longer modifies task scopes passed to Taskcluster Proxy.
Previously there was a bug where Taskcluster Proxy would be passed the
d2g-modified scopes by Generic Worker rather than the original task scopes from
the task definition of the queue.claimWork response body. If the task was not
also explicitly assigned the required generic-worker scopes, this would result
in HTTP 401 errors from Taskcluster Proxy calls.
This has now been fixed, so that it is sufficient for tasks with a Docker Worker payload to contain only Docker Worker scopes, not have the associated generic-worker scopes, yet still work under Generic Worker and use the Taskcluster Proxy feature without causing HTTP 401 errors.
▶ [patch] Generic Worker now copies archives to the task user's directory before unarchiving.
▶ [patch] Generic Worker now copies archives to the task user's directory before unarchiving.
▶ [minor] #6785 Generic Worker now exits with exit code 82 if the chain of trust key is missing.
▶ [patch] Go upgrade to 1.21.6.
▶ [patch] Go upgrade to 1.21.6.
go1.21.6 (released 2024-01-09) includes fixes to the compiler, the runtime, and the crypto/tls, maps, and runtime/pprof packages. See the Go 1.21.6 milestone on our issue tracker for details.
▶ [minor]
Generic Worker: adds unarchive subcommand to the generic-worker binary.
▶ [minor] #6720
The taskcluster UI now shows errors when an action's input does not match the action.schema
▶ [patch] #6235 Migrates to aws sdk v3.
▶ [patch] #6235 Migrates to aws sdk v3.
▶ [patch] #6563 Ensure livelog and interactive tasks tunnels work after a websocktunnel restart.
▶ [patch] #6563 Ensure livelog and interactive tasks tunnels work after a websocktunnel restart.
▶ [patch] #6779 Interactive feature data race fixed, whereby an error could cause a concurrent read and write of process state in different go routine
▶ [patch] #6779 Interactive feature data race fixed, whereby an error could cause a concurrent read and write of process state in different go routines.
▶ [minor] bug 1874568 Fixes token expiry issue for Auth0 login strategy that was not refetched.
▶ [patch] #6495 Improve changelog rendering in UI
▶ [patch] Added helper script to make it easier to run websocktunnel locally.
<details> <summary>1 Dependabot updates</summary>
</details>
▶ [patch] #6762 Generic Worker: Tasks internally translated by D2G will add exit code 128 to the retry exit status array for retrying on an intermitte
▶ [patch] #6762 Generic Worker: Tasks internally translated by D2G will add exit code 128 to the retry exit status array for retrying on an intermittent docker image pull issue.
<details> <summary>5 Dependabot updates</summary>
</details>
▶ [patch] Generic Worker: No longer logs out the redirect URL for the interactive shell feature since they are signed.
▶ [patch] Generic Worker: No longer logs out the redirect URL for the interactive shell feature since they are signed.
▶ [MAJOR] #6759 Kubernetes pods use liveness probe instead of unconditionally killing containers daily.
▶ [patch] #6641 Worker-manager no longer counts "stopping" instances as part of the existing capacity when estimating the number of workers to start (although they are still counted towards maxCapacity).
<details> <summary>7 Dependabot updates</summary>
</details>
▶ [minor] #6671 Several UI changes:
▶ [minor] #6671 Several UI changes:
<details> <summary>1 Dependabot updates</summary>
</details>
No changes
No changes
▶ [patch] #6733 Generic Worker: fixes file-not-readable-on-worker error while uploading artifacts with the simple engine.
▶ [patch] #6733
Generic Worker: fixes file-not-readable-on-worker error while uploading artifacts with the simple engine.
▶ [patch] Upgrades to go1.21.5 and Node 18.19.0.
▶ [minor] bug 1858424 Generic Worker: ensure task user has access to the mount location specified.
▶ [minor] bug 1858424 Generic Worker: ensure task user has access to the mount location specified.
Generic Worker: Add create-file and create-dir subcommands to generic-worker intended for internal use during task execution.
▶ [patch] #6688 The hooks list table now displays the timestamp of each hook's latest created task.
▶ [patch] #6716 Adds lifecycle preStop hook for services to allow graceful termination of pods in kubernetes without loss of connections.
▶ [MAJOR] #5514 Removes postgres v11 support.
▶ [MAJOR] #5514 Removes postgres v11 support.
▶ [minor] #6716
Services now support graceful server termination by listening to SIGTERM and letting existing connections to be served while rejecting new connections.
<details> <summary>6 Dependabot updates</summary>
</details>
▶ [patch] #6701 Generic Worker: Fixes permission denied error while checking if generic-worker binary is executable by the task user for simple engine
▶ [patch] #6701
Generic Worker: Fixes permission denied error while checking if generic-worker binary is executable by the task user for simple engine.
▶ [patch]
Upgrades rust version to 1.74.0 and ran cargo audit fix to fix insecure crates.
<details> <summary>1 Dependabot updates</summary>
</details>
▶ [patch] Generic Worker: Adds validation that the task user is able to read and execute the generic-worker binary on startup of the worker. If the ta
▶ [patch] Generic Worker: Adds validation that the task user is able to read and execute the generic-worker binary on startup of the worker. If the task user is not able to read and execute the binary, the worker will exit with exit code 69, internal error.
▶ [patch] #4998 This fixes a bug in the Python client where an exception was raised on 300 HTTP status.
▶ [MAJOR] bug 1855653 Generic Worker: The generic-worker binary _must be_ readable and executable by the task user. If it's not, artifact uploads _wil
▶ [MAJOR] bug 1855653
Generic Worker: The generic-worker binary must be readable and executable by the task user. If it's not, artifact uploads will fail.
Generic Worker: Add copy-to-temp-file subcommand to generic-worker to copy a file (--copy-file) to a temporary file.
▶ [patch] #6671
Introduces workerManager.workerPoolErrorStats() to return total number of errors for any worker pool or all worker pools.
Stats are split into totals by day, hour, kind of error and error code.
Worker Pool errors are kept in db for 7 days.
▶ [patch] Removes compatibility columns in refactored queue tables that were used during migration for backward-compatibility purposes.
▶ [patch] #6682
Tweaking server.keepAliveTimeout to fix downstream errors in reverse proxy and load balancer.
Default node's http server keepAliveTimeout is 5s which might be an issue when working behind a reverse proxy which has bigger timeouts.
To reduce number of 502 errors, application's keep alive timeout should be larger than the one of the reverse proxy,
and that in turn, should be larger than the Load Balancer's one.
▶ [patch] Upgrades to go1.21.4 and node 18.18.2.
▶ [patch] bug 1859323 Generic Worker now reports the full path of tasks-resolved-count.txt, next-task-user.json and current-task-user.json in worker logs.
<details> <summary>3 Dependabot updates</summary>
</details>
▶ [minor] #2939 Introduces queue.listPendingTasks(taskQueueId) and queue.listClaimedTasks(taskQueueId). Those endpoints return a list of tasks that ar
▶ [minor] #2939
Introduces queue.listPendingTasks(taskQueueId) and queue.listClaimedTasks(taskQueueId).
Those endpoints return a list of tasks that are currently pending or claimed by workers.
New scopes introduced for those endpoints:
queue:pending-list:<taskQueueId>queue:claimed-list:<taskQueueId>▶ [patch] #6656
D2G now shell escapes environment variable key names in case they contain spaces or special characters that would previously mess up the podman run... command.
<details> <summary>3 Dependabot updates</summary>
</details>
▶ [patch] Expired azure test certificates updated
▶ [patch] Expired azure test certificates updated
▶ [patch] Fix hooks UI page "unknown" task state error.
▶ [patch] #6636
Fix Dockerfile from PR #6646. The .yarn directory does not exist anymore, so it shouldn't be copied.
▶ [patch] #6636 Upgrades to modern Yarn version 4.
To enable on your machine:
corepack enable
yarn set version berry
▶ [patch] #6644 Fixes __version__ endpiont in web-server
▶ [patch] #6644 Fixes version endpiont in web-server
▶ [patch] #6634
Fixes queue.claimWork endpoint returning 500 in some rare conditions.
▶ [minor] #6371 D2G tool now can convert an entire Docker Worker task definition to a Generic Worker task definition.
New taskcluster d2g -h output:
Converts a docker-worker payload (JSON) to a generic-worker payload (JSON).
To convert a task definition (JSON), you must use the task definition flag (-t, --task-def).
Usage:
taskcluster d2g [flags]
Examples:
taskcluster d2g -f /path/to/input/payload.json
taskcluster d2g -t -f /path/to/input/task-definition.json
cat /path/to/input/payload.json | taskcluster d2g
cat /path/to/input/task-definition.json | taskcluster d2g -t
echo '{"image": "ubuntu", "command": ["bash", "-c", "echo hello world"], "maxRunTime": 300}' | taskcluster d2g
Flags:
-f, --file string Path to a .json file containing a docker-worker payload or task definition.
-h, --help help for d2g
-t, --task-def Must use if the input is a docker-worker task definition.
Global Flags:
-v, --verbose verbose output
▶ [patch]
Hooks last fires display unknown as task state if task is missing or not scheduled. This can happen with task was expired and removed but last run information still exist.
▶ [patch] #6472
D2G: Add the kvm OS group to the Generic Worker payload if the KVM device is enabled in the Docker Worker payload.
▶ [patch] docker-worker: fix error message when a task is missing scopes for cache volumes
▶ [MAJOR] #4260
Javascript codebase converted to use ECMAScript modules (ESM).
This includes db, libraries/*, services/* and infrastructure/tooling/* folders.
Clients remain unchanged.
▶ [patch] Introduces helper databaes utilities to create new version (migration) and renumber existing.
yarn db:new creates new db migration and test
yarn db:renumber old new renumbers existing version
▶ [patch]
Move docker compose image names to .env file to keep compose files unchanged between releases.
▶ Additional change not described here: #6621.
<details> <summary>4 Dependabot updates</summary>
</details>
▶ [patch] #6616 Github service no longer cancels builds for the same SHA for push events. Only pull_request events would cancel running builds for the
▶ [patch] #6616
Github service no longer cancels builds for the same SHA for push events.
Only pull_request events would cancel running builds for the same pull request if they exist.
This is to avoid canceling same commit pushed to different branches.
▶ [patch]
Allow specifying 0 as a value for onExitStatus.purgeCaches.
<details> <summary>2 Dependabot updates</summary>
</details>
▶ [patch] #2940 Fixes claimed task resolver db query that returned too many records. Bug introduced in migration 91
▶ [patch] #2940 Fixes claimed task resolver db query that returned too many records. Bug introduced in migration 91
▶ [patch] #2940 Patches existing migration to prevent data loss because of incorrect field values.
▶ [patch] Upgrades to go1.21.3 and node v18.18.1
<details> <summary>1 Dependabot updates</summary>
</details>
▶ [patch] #2940 Patches 91-migration script to account for non-unique pending tasks. This was a blocking exception during migration time.
▶ [patch] #2940 Patches 91-migration script to account for non-unique pending tasks. This was a blocking exception during migration time.
▶ [MAJOR] #2940 Queue service internals refactored. azure_queue_messages table and azqueue library are no longer used. Claim, resolved, deadline and p
▶ [MAJOR] #2940
Queue service internals refactored. azure_queue_messages table and azqueue library are no longer used.
Claim, resolved, deadline and pending queues now use separate tables. Existing messages are preserved during migration.
Database migration 0091 expects that previous 0090 migration was applied and there are no pending tasks that didn't migrate to the new format yet.
Make sure that v55.3.x was deployed first and data was fully migrated before deploying this version.
▶ [patch] #2940 Resolved tasks do not drop deadline messages, which was removed during queue refactoring. Messages will stay until task deadline even if task is being resolved.
▶ [patch] Upgrades to go1.21.2
▶ [patch] UI: Task Definitions and Payloads now display in YAML by default for readability.
<details> <summary>1 Dependabot updates</summary>
</details>
▶ [patch] Patches an issue in github service cancelling task groups for non-push/pull-request events
▶ [patch] Patches an issue in github service cancelling task groups for non-push/pull-request events
<details> <summary>1 Dependabot updates</summary>
</details>
▶ [patch] #6592 Generic Worker no longer allows you to specify the same group twice in the osGroups array property.
▶ [patch] #6592 Generic Worker no longer allows you to specify the same group twice in the osGroups array property.
▶ [patch] #6590 Generic Worker osGroups feature on Linux has been fixed. It never worked on this platform.
▶ [patch] #6471
Worker Runner now sets the TASKCLUSTER_WORKER_LOCATION variable for Generic Worker.
<details> <summary>5 Dependabot updates</summary>
</details>
One column per quarter.