github.com/VictoriaMetrics/operator

Release date: 27 Jun 2025

• BUGFIX: vmoperator: clear status.reason when transitioning to expanding state. This makes less confusing as resource in expanding state is no longer affected by an error displayed in status.reason. See #1426.

• BUGFIX: vmalert: properly load TLS secrets into VMAlert secret. See #1437.

• FEATURE: vmalertmanagerconfig: support utf-8 symbols at matchers. See this 1446 issue for details.

• FEATURE: vmalertmanager: enable utf-8 support at labels and matchers by default for v0.28.+ versions of alertmanager. See this 1446 issue for details.

Release date: 24 Jun 2025

• SECURITY: upgrade Go builder from Go1.24.3 to Go1.24.4. See the list of issues addressed in Go1.24.4.

• Dependency: vmoperator: Updated default versions for VMAnomaly to v1.24.1 version

• BUGFIX: vmanomaly: fix marshaling of of .spec.configRawYaml.settings, previously it was skipped which caused VManomaly resource to be created with empty settings.

• BUGFIX: vmanomaly: fixed typo in VMAnomaly shard creation.

• BUGFIX: vmanomaly: properly apply strict security.

Release date: 23 Jun 2025

• Dependency: vmoperator: Updated default versions for VM apps to v1.120.0 version

• Dependency: vmoperator: Updated default versions for VL apps to v1.24.0 version

• FEATURE: vmanomaly: add support of decay field for online models.

• FEATURE: operator: introduce new resource VMAnomaly. See 1136 issue for details.

• BUGFIX: vmagent: use scrape namespace instead of VMAgent one for VMStaticScrape secrets lookup.

• BUGFIX: vmagent: properly set ScrapeObjects failed status on missing references. See 1416 issue for details.

• BUGFIX: vmagent: properly validate ScrapeObjects syntax. Previously operator could panic in case of spec.selectors incorrect values. See 1415 issue for details.

• BUGFIX: vmalert: properly calculate Deployment prev spec diff with notifier.selectors. See 1418 issue for details.

• BUGFIX: vmanomaly: fix marshalling of .spec.reader.latencyOffset field. Previously, it was causing an error when trying to create VManomaly resource with latencyOffset.

• BUGFIX: vmanomaly: fix parsing of Inf value for data_range of .spec.configRawYaml.reader.queries.<query>.data_range.

• BUGFIX: vmanomaly: fix marshaling of of .spec.configRawYaml.settings, previously it was skipped which caused VManomaly resource to be created with empty settings.

• BUGFIX: VLCluster: properly set HPA target for vlselect component. See PR-1406 for details. Thanks to the @bmiguel-teixeira.

• BUGFIX: Renamed metric operator_vmagent_config_fetch_secret_errors_total to operator_fetch_errors_total. Now it's incremented during each unsuccessful attempt to retrieve data from K8s secret or configmap, not only for VMAgent scrape objects.

Release date: 10 Jun 2025

• Dependency: vmoperator: Updated default versions for VM apps to v1.119.0 version

• Dependency: vmoperator: Updated default versions for VL apps to v1.23.3 version

• BUGFIX: VLCluster: properly set spec.vlstorage.retentionMaxDiskSpaceUsageBytes and spec.vlstorage.futureRetention settings. See this issue 1402 for details.

• BUGFIX: operator: consistently use ^[0-9]+(h|d|w|y)?$ validation pattern for retentionPeriod configuration at VMCluster, VMSingle, VLSingle.

Release date: 30 May 2025

Update Note 1: This release by deprecates VLogs resource. It will transit into read-only state after v0.61.0 release. To perform migration to the VLSingle please follow this docs

• BUGFIX: vlcluster: properly apply replicaCount for VLSelect component

Release date: 30 May 2025

Update Note 1: This release by deprecates VLogs resource. It will transit into read-only state after v0.61.0 release. To perform migration to the VLSingle please follow this docs

• Dependency: vmoperator: Updated default versions for VM apps to v1.118.0 version

• FEATURE: config-reloader: exclude hidden directories from watch. It should prevent possible errors with hidden symlinks, which may occur during dir walk. See this commit for details.

• FEATURE: operator: introduce new resource VLSingle. It replaces deprecated VLogs. See this issue for details.

• FEATURE: operator: introduce new resource VLCluster. See this issue and this doc for details.

• FEATURE: operator: manifests distributed via GitHub release artifacts now include the label app.kubernetes.io/instance: default, and the value of app.kubernetes.io/name has been changed to victoria-metrics-operator. See #1364 for details.

• FEATURE: operator: add new field proxyURL to the VMagent remoteWriteSpec. See this PR for details. Thanks to the @DanielLeone

• FEATURE: operator: introduce new flags for leader election configuration - leader-elect-lease-duration, leader-elect-renew-deadline. See this issue for details.

• FEATURE: operator: add spec.configMaps as volumeMounts for watch with config-reloader container for VMAgent and VMAlert components. See this issue for details.

• BUGFIX: converter: properly apply filter prefixes for objects with VM_FILTERPROMETHEUSCONVERTERLABELPREFIXES and VM_FILTERPROMETHEUSCONVERTERANNOTATIONPREFIXES env variables. See this PR 1391 for details. Thanks to the @padlyuck

• BUGFIX: operator: remove alerting rule BadObjects as metric operator_controller_bad_objects_count isn't exposed anymore.

• BUGFIX: operator: properly validate HPA object. metrics and behaviour are optional fields.

• BUGFIX: vmcluster: fixes typo at addDefaults function for VMCLuster, it prevents possible panic if VMInsert is not configured. See this issue for details.

Release date: 14 May 2025

Update Note 1: This release by default deploysvmagent which contains a bug, see more details in VictoriaMetrics#8941. We recommend skipping this release and waiting for newer release. If you still want to upgrade, you can override the vmagent image version by setting the environment variable: VM_VMAGENTDEFAULT_VERSION=v1.117.1

• Dependency: vmoperator: Updated default versions for VM apps to v1.117.0 version

• FEATURE: operator: introduce new flags for leader election configuration - leader-elect-namespace, leader-elect-id.

• FEATURE: operator: upgraded prometheus-config-reloader image 0.68.0 -> 0.82.1. See helm-charts#2174.

• FEATURE: vmpodscrape, vmnodescrape, vmservicescrape, vmscrapeconfig, vmscrapeconfig and vmprobe: added validation with admission webhook. See this issue for details.

• FEATURE: vmpodscrape, vmnodescrape, vmservicescrape, vmscrapeconfig, vmscrapeconfig and vmprobe: properly validate parsing errors at spec definition. See this issue for details.

• BUGFIX: converter: properly retry watch request errors. Previously watcher could stale and ignore any Prometheus CRD object events. See this issue for details.

Release date: 09 May 2025

• Dependency: vmoperator: Updated default versions for VM apps to v1.116.0 version

• Dependency: vmoperator: Updated default VLogs v1.21.0 version

• Dependency: vmoperator: Updated default alertmanager to 0.28.1 version

• FEATURE: operator: introduce FIPS builds for operator and config-reloader containers with -fips tag prefix. See this issue for details.

• FEATURE: operator: introduce new field spec.configReloadAuthKeySecret for VMAgent, VMAlert and VMAuth components. It instructs application to use provided value for -configReload auth key. See this issue for details.

• FEATURE: converter: add msteamsv2_configs conversion from Prometheus resource AlertmanagerConfig. See this commit for details.

• FEATURE: upgrade Go builder from Go1.24.0 to Go1.24.4 See Go1.24 release notes.

• FEATURE: vmalertmanagerconfig: add timeout field to the webhook_configs definition. It's supported by alertmanager v0.28.0+. See this commit for details.

• FEATURE: vmsingle: add 8428 port alias to the VMSingle Service. See this issue for details.

• BUGFIX: operator: fix typo in -remoteWrite.streamAggr.enableWindows flag when enableWindows is set to true in VMAgent resources. See this commit for details.

• BUGFIX: vmagent: properly build oauth2 clientSecret configuration for remoteWrite targets. See this issue for details. Thanks to the @Unichron for catching this bug.

• BUGFIX: vmauth: properly create and delete VMServiceScrape with internalListenPort option configured. See this issue for details.

Release date: 15 Apr 2025

Update note 1: config-reloader container now longer uses proxy-protocol for internal web-server if reload-use-proxy-protocol is set.

• Dependency: vmoperator: Updated default versions for VM apps to v1.115.0 version

• Dependency: vmoperator: Updated default VLogs v1.18.0 version

• FEATURE: operator: support VM_METRICS_VERSION and VM_LOGS_VERSION env variables as a source for all VM and VL related CR image versions

• FEATURE: vmauth: add new field internalListenPort for serving internal routes. See this issue and this docs.

• FEATURE: vmauth: add new field useProxyProtocol for enabling proxy protocol for vmauth. See this issue.

• FEATURE: vmalertmanager: add runtime configuration validation. See this issue for details.

• FEATURE: operator: add StatefulSet volumeMounts name validation. See this issue for details.

• FEATURE: operator: made retentionPeriod in VMSingle and VMCluster optional; it now defaults to 1 (month) if not specified. Add a validation regexp ^[0-9]+(h|d|y)?$ for retentionPeriod. See #1326 for details.

• BUGFIX: vmalertmanagerconfig: properly validate unknown fields at route.routes, http_config and tls_config. See this issue for details.

• BUGFIX: config-reloader: properly use reload-use-proxy-protocol flag. See this issue for details.

• BUGFIX: operator: fix shard count backward range bounds, as now it produced shard with negative index.

Release date: 02 Apr 2025

• Dependency: vmoperator: Updated default versions for VM apps to v1.114.0 version

• Dependency: vmoperator: make project layout compatible with [kubebuilder v4](https://book.kubebuilder.io/migration/v3vsv4)

• Dependency: vmoperator: Updated default VLogs v1.17.0 version

• FEATURE: operator: add tls_config and proxy_url fields to the oauth2 scrape target configurations. See this issue for details

• FEATURE: operator: add extraEnvsFrom field to all applications, which defines source for env variables as Secret or ConfigMap. See this issue for details.

• FEATURE: operator: set publishNotReadyAddresses: true to the vmstorage, vmselect, vmalertmanager services. See this issue for details.

• FEATURE: operator: log fields changes diff for Deployment, StatefulSet, Service, PDB, HPA and VMServiceScrape during reconcile process. See this issue for details.

• FEATURE: operator: add global env variables VM_CONFIG_RELOADER_LIMIT_CPU and VM_CONFIG_RELOADER_LIMIT_MEMORY with unlimited as default value. It controls global limits for config-reloader containers. See this issue for details.

• FEATURE: operator: add global env variables VM_CONFIG_RELOADER_REQUEST_CPU and VM_CONFIG_RELOADER_REQUEST_MEMORY with empty as default value. It controls global requests for config-reloader containers. See this issue for details. All per resource config-reloader requests env variables are now deprecated.

• FEATURE: vmagent: introduce daemonSetMode as a beta feature. See this issue and this docs for details.

• FEATURE: vmagent: reduce Kubernetes API server load on large scale by removing selectors from VMPodscrape kubernetes_sd_configs. Add new field VMAgent.spec.enableKubernetesAPISelectors, which restores original behaviour. See this issue for details.

• FEATURE: vmagent: allow to define remoteWrite.MaxDiskUsage as integer and adds validation to it. See this issue for details.

• FEATURE: vmagent: allow to define remoteWriteSettings.maxDiskUsagePerURL as string with bytes suffix and adds validation to it. See this issue for details.

• FEATURE: vmalertmanagerconfig: add content, username and avatar_url to discord_configs definition. It's supported by alertmanager v0.28.0+. See this commit for details.

• FEATURE: vmalertmanagerconfig: add new receiver jira_configs, which was added at alertmanager v0.28.0. See this issue for details.

• FEATURE: vmalertmanagerconfig: add new receiver rocketchat_configs, which was added at alertmanager v0.28.0. See this issue for details.

• FEATURE: vmalertmanagerconfig: add new receiver msteamsv2_configs, which was added at alertmanager v0.28.0. See this issue for details.

• BUGFIX: operator: properly throttle concurrent reconcile events on high load. By raising default value for the controller.maxConcurrentReconciles command-line flag from 5 to 15. See this issue for details.

• BUGFIX: vmoperator: properly track immutable fields changes for StatefulSet. See this issue for details.

• BUGFIX: vmcluster: properly propagate podMetadata to requestsLoadBalancer Deployment. See this PR for details. Thanks to the @solidDoWant

• BUGFIX: vmauth: properly sort VMUsers at generated configuration. See this issue for details.

• BUGFIX: vmprobe: properly add vmProberSpec.scheme to the generated configuration. See this issue for details.

• BUGFIX: vmagent: properly apply remoteWriteSettings.maxDiskUsagePerURL global setting. Previously, if remoteWrite.MaxDiskUsage was set to 1 remoteWrite and others don't have this setting, default value was used instead of remoteWriteSettings. See this issue for details.

Release date: 12 Mar 2025

• BUGFIX: vmoperator: reduce operator memory usage. Memory usage increased at v0.48.0. This change updates default value for -controller.disableCacheFor="" flag from empty to configmap,secret and disables go-client cache for Secret and ConfigMap. See this issue for details.
• BUGFIX: vmoperator: properly reload webhook and metricsserver TLS certificates. Reload logic was broken at v0.54.0. See related commit.

Release date: 11 Mar 2025

Update note 1: remove deprecated fields Replicas, UpdateReplicas, AvailableReplicas and UnAvailableReplicas from vlogs, vmsingle,vmagent, vmalert objects .status.

• Dependency: vmoperator: Updated default versions for VM apps to v1.113.0 version

• Dependency: vmoperator: Updated default VLogs v1.15.0 version

• Dependency: vmoperator: Updated Kubernetes libraries to v1.32.2 version and controller-runtime to v0.20.2 version.

• Dependency: vmoperator: Updated client-gen to v0.32.4 version and generate api client. See this commit for details.

• FEATURE: upgrade Go builder from Go1.23.4 to Go1.24. See Go1.24 release notes.

• FEATURE: operator: add new field to CRD objects spec: disableAutomountServiceAccountToken. See this issue and this docs for details.

• FEATURE: vmagent: deprecate aPIServerConfig in favor of apiServerConfig. aPIServerConfig will be removed at v0.56.0 release. See this issue for details

• FEATURE: vmpodscrape: add portNumber to podMetricEndpoints. See this issue for details.

• FEATURE: vmagent: support stream aggregation enableWindows.

• FEATURE: vmagent: add RBAC access to /metrics/slis. See this issue for details.

• FEATURE: vmoperator: Introduce possible labels breaking changes to kustomize configs. See this commit.

• FEATURE: vmoperator: reduce config-reloader container resources.cpu.requests from 100m to 10m. And remove container resources.limits. See this issue for details. Thanks @xiaozongyang

• BUGFIX: vmoperator: Properly generate kustomize config for validation webhook. See this commit.

• BUGFIX: vmagent: reduce request latency for validation webhook. See this issue for details.

• BUGFIX: vmuser: properly validate targetRef.crd.kind. Previously it incorrectly forbid VLogs reference. See this issue for details.

• BUGFIX: vmoperator: reduce CPU and memory usage at large scale. Now operator could skip expensive runtime validation for VMRule and VMAlertmanagerConfig objects if -webhook.enable is set. See this issue for details.

Release date: 05 Feb 2025

• SECURITY: upgrade Go builder from Go1.23.4 to Go1.23.5. See the list of issues addressed in Go1.23.5.

• Dependency: vmoperator: Updated default versions for VM apps to v1.110.0 version

• FEATURE: vmalertmanagerconfig: add thread_message_id to telegram_configs definition. It's supported by alertmanager v0.28.0+. See this issue for details.

• FEATURE: vlogs: support VLogs in VMUser targetRefs.crd

• BUGFIX: vmoperator: properly check Pod state during StatefulSet rolling upgrade procedure. See this issue for details.

• BUGFIX: vmagent: properly upscale on shardCount change. See this issue for details.

• BUGFIX: vmauth: properly apply vmuser changes. See this PR for details.

Release date: 21 Jan 2025

• Dependency: vmoperator: Updated default versions for VM apps to v1.109.1 version

• Dependency: vmoperator: Updated default version for VictoriaLogs app to v1.6.1 version

• FEATURE: vmscrapeconfig: allow multiple values for zone at gceSDConfigs. See this issue for details.

• FEATURE: vmoperator: decrease latency of generated configuration updates. Previously, configuration was update after status of child objects were changed. It could take significant time at large scale. See this issue for details.

• FEATURE: vmoperator: reduce load on Kubernetes API server at prometheus-converter client.

• FEATURE: vmoperator: change default value for client.qps=50 and client.burst=100 in order to improve operator performance on scale. See this issue for details.

• FEATURE: vmoperator: add new flag controller.statusLastUpdateTimeTTL=1h to control staleness detection at status.conditions field. If operator serves large amount of object ( > 5_000) value for it should be increased.

• FEATURE: vmoperator: add more context to the failed status with the reason and logs of crashed container. See this issue for details.

• FEATURE: vmoperator: Properly expose service ports for VMServiceScrape generated for CRD objects by operator. Add -vmbackupmanager suffix to the VMServiceScrape job name and expose only well-known http port. See this issue for details.

• BUGFIX: vmagent: properly build relabelConfigs with empty string values for separator and replacement fields. See this issue for details.

• BUGFIX: converter: properly format regex single value expression at Prometheus Operator CRD relabelings and metricsRelabelings. See this issue for details.

• BUGFIX: vmoperator: keep spec.template.annotations added by 3rd party tools, kike kubectl rollout restart. See this issue for details.

Release date: 8 Jan 2025

• BUGFIX: vmagent: properly route headless service traffic to vmagent pods with statefulMode and shardCount defined.
• BUGFIX: vmsingle: properly add volumeMount for external storageDataPath volume.
• BUGFIX: vmcluster: properly mount serviceAccount for requestsLoadBalancer Deployment. See this issue for details.

Release date: 23 Dec 2024

• SECURITY: upgrade Go builder from Go1.23 to Go1.23.4. See the list of issues addressed in Go1.23.2 and Go1.23.3.

• BUGFIX: vmoperator: keep resourceVersion and other significant metadata fields during update objects requests. See this issue for details.

• BUGFIX: vmoperator: properly update updateStatus: failed field. It fixes excessive errors logging and amount of created Kubernetes Events.

• BUGFIX: vmoperator: Properly rollback incorrect object configuration. Previously diff for objects could be calculate incorrectly and update request could be skipped.

• BUGFIX: vmcluster and vmsingle: restore deprecated fields status.clusterStatus and status.singleStatus removed at v0.51.0. Those deprecated fields will be removed at upcoming v0.52.0 version.