github.com/fluxcd/source-controller

Release date: 2022-12-20

This prerelease comes with dedicated mux for the controller's fileserver. All code references to libgit2 were removed, and the spec.gitImplementation field is no longer being honored, but rather go-git is used. For more information, refer to version 0.32.0's changelog, which started libgit2's deprecation process.

The controller's garbage collection now takes into consideration lock files.

The feature gate ForceGoGitImplementation was removed, users passing it as their controller's startup args will need to remove it before upgrading.

Fixes:

• git: Fix issue with recurseSubmodules #975
• Fix aliased chart dependencies resolution #988

Improvements:

• fileserver: Use new ServeMux #972
• Remove libgit2 and git2go from codebase #977
• Use Event v1 API metadata keys in notifications #990
• storage: take lock files into consideration while garbage collecting #991
• Migrate to Go Native fuzz and improve reliability #965
• build: Add tidy to make verify #966
• build: Add postbuild script for fuzzing #968
• build: Link libgit2 via LIB_FUZZING_ENGINE #969
• GitRepo: git impl. deprecation test cleanup #980
• minio: use container image for tests #981
• helm: Update SDK to v3.10.3 #982
• Update fluxcd/pkg/oci dependency #983
• Update dependencies #985

Release date: 2022-11-18

This prerelease rectifies the v0.32.0 release by retracting the previous Go version, bumping the controller api version and the controller deployment.

Release date: 2022-11-17

This prerelease comes with a major refactoring of the controller's Git operations. The go-git implementation now supports all Git servers, including Azure DevOps, which previously was only supported by libgit2.

This version initiates the soft deprecation of the libgit2 implementation. The motivation for removing support for libgit2 being:

• Reliability: over the past months we managed to substantially reduce the issues users experienced, but there are still crashes happening when the controller runs over longer periods of time, or when under intense GC pressure.
• Performance: due to the inherit nature of libgit2 implementation, which is a C library called via CGO through git2go, it will never perform as well as a pure Go implementations. At scale, memory pressure insues which then triggers the reliability issues above.
• Lack of Shallow Clone Support.
• Maintainability: supporting two Git implementations is a big task, even more so when one of them is in a complete different tech stack. Given its nature, to support libgit2, we have to maintain an additional repository. Statically built libgit2 libraries need to be cross-compiled for all our supported platforms. And a lot of "unnecessary" code has to be in place to make building, testing and fuzzing work seamlessly.

As a result the field spec.gitImplementation is ignored and the reconciliations will use go-git. To opt-out from this behaviour, start the controller with: --feature-gates=ForceGoGitImplementation=false.

Users having any issues with go-git should report it to the Flux team, so any issues can be resolved before support for libgit2 is completely removed from the codebase.

Improvements:

• Refactor Git operations and introduce go-git support for Azure DevOps and AWS CodeCommit #944
• Use Flux Event API v1beta1 #952
• gogit: Add new ForceGoGitImplementation FeatureGate #945
• Remove nsswitch.conf creation from Dockerfile #958
• Update dependencies #960 #950 #959
• Upgrade to azure-sdk-for-go/storage/azblob v0.5.1 #931

Release date: 2022-10-21

This prerelease comes with support for Cosign verification of Helm charts. The signatures verification can be configured by setting HelmChart.spec.verify with provider as cosign and a secretRef to a secret containing the public key. Cosign keyless verification is also supported, please see the HelmChart API documentation for more details.

In addition, the controller dependencies have been updated to Kubernetes v1.25.3 and Helm v3.10.1.

Improvements:

• Implement Cosign verification for HelmCharts #925
• Update dependencies #942

Fixes:

• Allow deleting suspended objects #937

Release date: 2022-10-10

This prerelease enables the use of container-level SAS tokens when using Bucket objects to access Azure Storage. The Azure SDK error message has also been enriched to hint Flux users the potential reasons in case of failure.

Improvements:

• List objects when checking if bucket exists to allow use of container-level SAS token #906

Release date: 2022-09-29

This prerelease adds support for Cosign verification in OCIRepository source. The signatures verification can be configured by setting OCIRepository.spec.verify with provider as cosign and a secretRef to a secret containing the public key. Cosign keyless verification is also supported, please see the OCIRepository API documentation for more details.

It also comes with strict validation rules for API fields which define a (time) duration. Effectively, this means values without a time unit (e.g. ms, s, m, h) will now be rejected by the API server. To stimulate sane configurations, the units ns, us and µs can no longer be configured, nor can h be set for fields defining a timeout value.

In addition, the controller dependencies have been updated to Kubernetes controller-runtime v0.13.

:warning: Breaking changes:

• .spec.interval new validation pattern is "^([0-9]+(\\.[0-9]+)?(ms|s|m|h))+$"
• .spec.timeout new validation pattern is "^([0-9]+(\\.[0-9]+)?(ms|s|m))+$"

Improvements:

• api: add custom validation for v1.Duration types #903
• [RFC-0003] Implement OCIRepository verification using Cosign #876
• Consider bipolarity conditions in Ready condition summarization #907
• Update Bucket related SDK dependencies #911
• Add custom CA certificates to system certificates #904
• [OCIRepository] Optimise OCI artifacts reconciliation #913
• Update dependencies #919
• Build with Go 1.19 #920
• Bump libgit2 image and disable cosign verification for CI #921
• OCIRepositoryReconciler no-op improvements #917
• Accept a slice of remote.Option for cosign verification #916
• Update pkg/oci to v0.11.0 #922

Fixes:

• Handle nil OCI authenticator with malformed registry #897

Release date: 2022-09-09

This prerelease adds support for non-TLS container registries such as Kubernetes Kind Docker Registry. Connecting to an in-cluster registry over plain HTTP, requires setting the OCIRepository.spec.insecure field to true.

:warning: Breaking change: The controller logs have been aligned with the Kubernetes structured logging. For more details on the new logging structure please see: fluxcd/flux2#3051.

Improvements:

• Align controller logs to Kubernetes structured logging #882
• [OCIRepository] Add support for non-TLS insecure container registries #881
• Fuzz optimisations #886

Fixes:

• [OCI] Static credentials should take precedence over the OIDC provider #884

Release date: 2022-08-29

This prerelease adds support for contextual login to container registries when pulling Helm charts from Azure Container Registry, Amazon Elastic Container Registry and Google Artifact Registry. Contextual login for HelmRepository objects can be enabled by setting the spec.provider field to azure, aws or gcp.

Selecting the OCI layer containing Kubernetes manifests is now possible when defining OCIRepository objects by setting the spec.layerSelector.mediaType field.

In addition, the controller dependencies have been updated to Kubernetes v1.25.0 and Helm v3.9.4.

Improvements:

• [HelmRepository] Enable contextual login for OCI #873
• [OCIRepository] Select layer by media type #871
• Update Kubernetes packages to v1.25.0 #875
• Update dependencies #869
• Ensure Go 1.18 for fuzz image #872

Release date: 2022-08-17

This prerelease adds support for SAS Keys when authenticating against Azure Blob Storage and improves the documentation for OCIRepository.

The package sourceignore, which is used for excluding files from Flux internal artifacts, has been moved to fluxcd/pkg/sourceignore.

Improvements:

• OCIRepo docs: auto-login setup details #862
• Add Support for SAS keys in Azure Blob #738
• Use sourceignore from fluxcd/pkg/sourceignore #864
• Update dependencies #869

Release date: 2022-08-11

This prerelease comes with panic recovery, to protect the controller from crashing when reconciliations lead to a crash. It also adds OCI documentation and improvements to the controllers CI pipeline.

Improvements:

• Enable panic recovery #859
• build: Ignore CI workflows for markdown files #858
• oci: Document Auto-Login usage in SC #860

Release date: 2022-08-08

This prerelease comes with a new API kind named OCIRepository, for fetching OCI artifacts from container registries as defined in RFC-0003 Flux OCI support for Kubernetes manifests. Please see the OCIRepository API documentation for more details.

In addition, Helm charts stored in Git can now have dependencies to other charts stored as OCI artifacts in container registries.

Features:

• Implement OCIRepository reconciliation #788

Improvements:

• Enable Umbrella Chart with dependencies from OCI repositories #770
• Allow for charts from OCI registries to specify a chart path #856
• Remove MUSL and enable threadless libgit2 support #853
• Upgrade to Go 1.18 #816
• Update Azure Go SDK to v1.1.0 #786

Fixes:

• fix(openapi): full regex for url to prevent error #838

Release date: 2022-07-27

This prerelease comes with an improvement in the Helm OCI Chart to use an exact version when provided. This makes it possible to work with registries that don't support listing tags.

Improvements:

• Don't fetch tags when exact version is specified in HelmChart #846

Release date: 2022-07-13

This prerelease fixes SIGSEGV when resolving charts dependencies. It also brings CI improvements and update dependencies to patch upstream CVEs.

Fixes:

• Fix SIGSEGV when resolving charts dependencies #827
• Fix Panic when no artifact in source #832

Improvements:

• Update go-yaml to v3.0.1 #804
• build: provenance and tampering checks for libgit2 #823
• Decrease fs perms to 0o700 #818
• build: run darwin tests on macos 10.15, 11 and 12 #817
• Minor comment updates #812
• Split GitHub workflows #811
• docs: Add password-protected SSH keys information #801
• Bump Helm to v3.9.1 #833
• Update libgit2 to v1.3.2 #834

Release date: 2022-06-29

This prerelease fixes an authentication issue for Helm OCI where the credentials were cached instead of being discarded after each reconciliation.

Fixes:

• helm-oci: disable cache in oci registry client #799
• helm-oci: remove the trailing slash in spec.url #799

Release date: 2022-06-24

This prerelease fixes an authentication issue when using libgit2 managed transport to checkout repos on BitBucket server.

Fixes:

• set request auth if both username and password are non empty #794

Improvements:

• libgit2/managed/http: test for incomplete creds #796

Release date: 2022-06-22

This prerelease comes with an improvement in the SSH managed transport error messages related to known hosts check and removes a deadlock in the SSH smart subtransport.

Fixes:

• libgit2: remove deadlock #785

Improvements:

• libgit2: improve known_hosts error messages #783

Release date: 2022-06-14

This prerelease fixes an issue with leaked SSH connections on managed transport and adds some general build and libgit2 improvements.

Fixes:

• libgit2: dispose connections in SubTransport.Close #775

Improvements:

• build: enable -race for go test #615
• libgit2: refactor tests to use managed and unmanaged transport cleanly #777
• libgit2: add contextual logging to subtransports #778
• libgit2: fix managed transport enabled flag update #781

Release date: 2022-06-08

This prerelease fixes a regression for SSH host key verification and fixes semver sorting for Helm OCI charts.

In addition, the controller dependencies have been updated to Kubernetes v1.24.1.

Fixes:

• helm: Fix sorting semver from OCI repository tags #769
• libgit2: Fix SSH host key verification regression #771

Improvements:

• libgit2: Improve HTTP redirection observability #772
• Update dependencies #773

Release date: 2022-06-07

This prerelease fixes a regression when accessing Gitlab via HTTPS when the URL does not have the '.git' suffix. Plus some small documentation fixes and dependency updates.

Fixes:

• Update link to v1beta2 in the API spec #764
• libgit2: fix gitlab redirection for HTTP #765

Improvements:

• Update dependencies #766

Release date: 2022-06-06

This prerelease fixes a regression in HelmRepository index caching.

Fixes:

• Fix repository cache regression #761

Release date: 2022-06-03

This prerelease fixes a bug which prevented the use of the OptimizedGitClones feature when using tags to checkout a Git repository, and adds docs on how to access Azure Blob using managed identities and aad-pod-identity.

Improvements:

• Add docs on managed identity for Azure Blob #752

Fixes:

• libgit2: return CheckoutTag with LastRevision #755
• Log on new artifact and failure recovery #759

Release date: 2022-06-02

This prerelease fixes some race conditions in the libgit2 managed ssh smart subtransport.

Fixes:

• libgit2/managed: fix race issues in ssh transport #753

Release date: 2022-06-01

This prerelease adds support for Helm OCI. Users can specify .spec.type of a HelmRepository to use an OCI repository instead of an HTTP/S Helm repository.

Please note that this currently has a couple of limitations (which will be addressed in a future release):

• Chart dependencies from OCI repositories are not supported. #722
• Custom CA certificates are not supported. #723

An example of OCI HelmRepository can be found here.

A new flag --feature-gate has been added to disable/enable new experimental features. It works in a similar manner to Kubernetes feature gates.

The libgit2 managed transport feature has been enabled by default. Furthermore, a few changes have been made to make the feature more stable and enable quicker clones. Users that want to opt out and use the unmanaged transports may do so by passing the flag --feature-gate=GitManagedTransport=false, but please note that we encourage users not to do so.

GitRepository reconciliation has been made more efficient by adding support for no-op clones, when checking out repositories using branches or tags. This feature is also enabled by default, and users can opt out by passing the flag --feature-gate=OptimizedGitClones=false. Please note that this feature is only active when the managed transport feature is enabled. Disabling managed transports, quietly disables optimzed Git clones.

Improvements:

• Optimise clone operations #665
• [RFC 0002] Flux OCI support for Helm #690
• Add Git test coverage for supported algorithms #708
• Add new flag --ssh-hostkey-algos #711
• libgit2: Disable connection caching #713
• Update dependencies #717
• libgit2: enable managed transport by default #718
• libgit2: Add support for hashed known_hosts #720
• Remove dependency on libgit2 credentials callback #727
• Update Alpine to v3.16 #731
• Update dependencies #739
• libgit2: enforce context timeout #740
• libgit2: Pass ctx to all the transport opts #743

Fixes:

• Ensure git status is checked at the correct time #575
• libgit2: recover from git2go panic #707
• Remove minio region #715
• GitRepositoryReconciler no-op clone improvements #724
• Support dockerconfigjson with OCI HelmRepositories #725
• log when the OCI temp credentials file can't be deleted #726
• Helm reconcilers conditions and test improvements #728
• reconcile: Set observed gen only when conditions exist #729
• helmrepo: Fix test flake in type update test #730
• Fix tests failing in Ubuntu #732
• tests: ignore proxy settings when running tests #734
• gitrepo: gitCheckout() return typed errors only #736
• gitrepo: set conditions in gitCheckout #741
• libgit2: Enable tests #744
• OCI HelmRepo: handle status conditions in-line #748
• registry: repo URL and dockerconfig URL mismatch #749
• libgit2: fix checkout logic for CheckoutBranch #750