github.com/vdaas/vald

Signed-off-by: Vdaas CI [email protected]

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.8.0</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.8.0</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.8.0</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.8.0</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.8.0</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.8.0</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.8.0</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

<!--- Provide a general summary of your changes in the Title above -->

Description

:sparkle: New feature

• [Feature] Add Vald Operator (enabled multiple cluster operation) [#3557]
• feat(helm): add configurable image registry for all images [#3538]
• Support dynamic edge size parameter for Search API [#3480]
• add creator.creation_pool_size [#3443]
• Add TiKV client for Metadata API [#3401]
• Apply default epsilon to index creation as well on local branch [#3320]
• hot-reload (minimal test impl, opt-in) [#3247]
• add txnkv [#3311]
• Add resource stats gRPC API [#3243]
• add internal kvs [#3281]
• add metadata manifest [#3260]
• Add optional tls support for gateway ingress [#3226]
• add executeRPC function for gRPC client [#3079]
• [Feature] Add Persistent VQueue [#3058]
• [Feature] Add Production Bidirectional KVS [#3057]

:zap: Improve performance

• resolve broadcast concurrency and tune connection pool [#3518]
• improve rangeConns's performance for Release v1.7.17 [#3039]

:recycle: Refactor

• Refactor gRPC codes and update libs & feat: Migrate from npm to bun [#3264]
• ♻️ Refactor: bidirectional map module structure [#3218]
• refactor: add missing k8s type aliases to types.go [#3439]
• Migrate from bincode to wincode [#3448]
• Omit usearch implementation from Go [#3319]
• Update default parameters for gRPC [#3239]
• Migrate go tool [#3209]
• Add strings.TrimForCompare func [#3064]
• check port-forward enabled/disabled [#3061]
• Add RBAC permissions for DaemonSet access [#3059]

:bug: Bugfix

• hotfix: Remove stray ci-container in release workflow [#3584]
• fix: skip NGT AVX2 on arm64 [#3580]
• fix SBOM [#3565]
• [Bugfix] fix SIGABRT problem for Agent NGT [#3531]
• fix typo [#3453]
• fix(rust/proto): resolve build errors by correcting prost_types usage [#3403]
• :bug: fix grpc benchmark [#3342]
• hotfix: Use init instead of once.Do to prevent data race [#3328]
• fix docker build condition [#3289]
• fix tag [#3277]
• fix extra tag process [#3275]
• [Bugfix] unknown serviceAccount use for serviceAccountName [#3252]
• fix faiss_create_index_ivfpq [#3249]
• Added serviceAccountName to lb/filter gateways and bugfix [#3230]
• Fix dashboard variables in overview board [#3030]

:pencil2: Document

• add ADOPTERS.md, MAINTAINERS.md [#3556]
• Add AGENTS.md for AI Co-Worker standardization [#3473]
• restore loadtest.md [#3187]

:white_check_mark: Testing

• feat(e2e): Implement and refactor metrics collection for E2E tests [#3418]
• Add support for patial execution of e2e v2 [#3297]
• Unified E2E V2 YAML setttings using envvars [#3105]
• [VALD-350] Add retry_until_success_timeout and use it in readreplica CI [#3104]
• Run E2E Test as a Kubernetes Job [#3073]
• [VALD-326] E2E with Kind & Support readreplica/rollout case [#3054]
• Add Agent Execution for E2E V2 [#3074]
• Added Loop test case [#3063]

:green_heart: CI

• fix CI permission [#3609]
• fix scan docker image job [#3602]
• hotfix: Pin sha of trivy and fix permission [#3601]
• hotfix: Fix and update CodeQL versions [#3600]
• fix update helm chart job [#3599]
• fix release workflow [#3594]
• Use ubuntu-latest in release workflow [#3590]
• hotfix: Install chaos-mesh using Helm [#3521]
• chore(coderabbit): add coderabbit configuration [#3464]
• Merge dev and ci container [#3425]
• Use golangci-lint as a formatter [#3405]
• Use ubuntu-slim for lightweight jobs [#3312]
• Add wait --for=create [#3303]
• hotfix: Support workflow_dispatch images for e2e v2 [#3295]
• hotfix: build target architecture for main branch [#3268]
• Fix joining architectures [#3262]
• hotfix: docker build failure on GitHub Actions [#3258]
• Multi platform build with native amd64/arm64 GitHub hosted runner [#3251]
• Add GitHub actions workflow linter [#3213]
• hotfix: ARM64 dev-container build [#3229]
• hotfix: Unify image tag by nightly for format [#3214]
• Use --retry for get.helm.sh [#3195]
• revert: Platform Separation [#3192]
• hotfix: Use extra tags to push nightly [#3189]
• hotfix: separated unification job [#3186]
• Avoid overwrite for ghcr.io [#3182]
• Try to separate amd64/arm64 builds [#3178]
• hotfix: Support debugging for ChatOps [#3055]
• hotfix: Handle cherrypick without diff [#3047]
• [VALD-361] Backport changes into release v1.7 by default [#3050]
• [VALD-359] Support Mac C flags [#3040]

:chart_with_upwards_trend: metrics/tracing

• Add opentelemetry collector dashboard [#3208]
• [VALD-147] Implement MetricMiddleware [#3010]
• hotfix: Support prometheus without container label [#3043]

:arrow_up: Update dependencies

• Update dependencies [#3606]
• update dependencies and modules [#3440]
• update rust dependencies and migration [#3436]

:lock: Security

:art: Design

:handshake: Contributor

• add new chatops permissions for contributor [#3548]
• docs: add nac-39 as a contributor for infra [#3234]
• docs: add Sh1ragami as a contributor for tool, and code [#3210]
• docs: add jumpei527 as a contributor for code, and maintenance [#3205]

Related Issue

<!-- This project mainly accepts pull requests related to open issues --> <!-- NOTE: If suggesting a new feature or change, please discuss it in an issue first --> <!-- NOTE: If fixing a bug, there should be an issue describing it with steps to reproduce --> <!-- Please link to the issue here: -->

Versions

<!--- Please change the versions below along with your environment -->

• Vald Version: v1.7.17
• Go Version: v1.26.5
• Rust Version: v1.97.1
• Docker Version: v29.6.2
• Kubernetes Version: v1.36.3
• Helm Version: v4.2.3
• NGT Version: v2.7.4
• Faiss Version: v1.14.3

Checklist

<!-- For completed items, change [ ] to [x]. --> <!-- NOTE: these things are not required to open a PR and can be done afterwards / while the PR is open. -->

• [x] I have read the CONTRIBUTING document and completed our CLA agreement.
• [x] I have checked open Pull Requests for the similar feature or fixes?

Special notes for your reviewer

<!-- Please tell us anything you would like to share with reviewers related to this PR. Your thoughts and feedback are highly valued -->

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.8.0</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.8.0</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.8.0</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.8.0</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.8.0</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.8.0</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.8.0</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.8.0</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

<!--- Provide a general summary of your changes in the Title above -->

Description

:sparkle: New feature

• [Feature] Add Vald Operator (enabled multiple cluster operation) [#3557]
• feat(helm): add configurable image registry for all images [#3538]
• Support dynamic edge size parameter for Search API [#3480]
• add creator.creation_pool_size [#3443]
• Add TiKV client for Metadata API [#3401]
• Apply default epsilon to index creation as well on local branch [#3320]
• hot-reload (minimal test impl, opt-in) [#3247]
• add txnkv [#3311]
• Add resource stats gRPC API [#3243]
• add internal kvs [#3281]
• add metadata manifest [#3260]
• Add optional tls support for gateway ingress [#3226]
• add executeRPC function for gRPC client [#3079]
• [Feature] Add Persistent VQueue [#3058]
• [Feature] Add Production Bidirectional KVS [#3057]

:zap: Improve performance

• resolve broadcast concurrency and tune connection pool [#3518]
• improve rangeConns's performance for Release v1.7.17 [#3039]

:recycle: Refactor

• Refactor gRPC codes and update libs & feat: Migrate from npm to bun [#3264]
• ♻️ Refactor: bidirectional map module structure [#3218]
• refactor: add missing k8s type aliases to types.go [#3439]
• Migrate from bincode to wincode [#3448]
• Omit usearch implementation from Go [#3319]
• Update default parameters for gRPC [#3239]
• Migrate go tool [#3209]
• Add strings.TrimForCompare func [#3064]
• check port-forward enabled/disabled [#3061]
• Add RBAC permissions for DaemonSet access [#3059]

:bug: Bugfix

• hotfix: Remove stray ci-container in release workflow [#3584]
• fix: skip NGT AVX2 on arm64 [#3580]
• fix SBOM [#3565]
• [Bugfix] fix SIGABRT problem for Agent NGT [#3531]
• fix typo [#3453]
• fix(rust/proto): resolve build errors by correcting prost_types usage [#3403]
• :bug: fix grpc benchmark [#3342]
• hotfix: Use init instead of once.Do to prevent data race [#3328]
• fix docker build condition [#3289]
• fix tag [#3277]
• fix extra tag process [#3275]
• [Bugfix] unknown serviceAccount use for serviceAccountName [#3252]
• fix faiss_create_index_ivfpq [#3249]
• Added serviceAccountName to lb/filter gateways and bugfix [#3230]
• Fix dashboard variables in overview board [#3030]

:pencil2: Document

• add ADOPTERS.md, MAINTAINERS.md [#3556]
• Add AGENTS.md for AI Co-Worker standardization [#3473]
• restore loadtest.md [#3187]

:white_check_mark: Testing

• feat(e2e): Implement and refactor metrics collection for E2E tests [#3418]
• Add support for patial execution of e2e v2 [#3297]
• Unified E2E V2 YAML setttings using envvars [#3105]
• [VALD-350] Add retry_until_success_timeout and use it in readreplica CI [#3104]
• Run E2E Test as a Kubernetes Job [#3073]
• [VALD-326] E2E with Kind & Support readreplica/rollout case [#3054]
• Add Agent Execution for E2E V2 [#3074]
• Added Loop test case [#3063]

:green_heart: CI

• fix release workflow [#3594]
• Use ubuntu-latest in release workflow [#3590]
• hotfix: Install chaos-mesh using Helm [#3521]
• chore(coderabbit): add coderabbit configuration [#3464]
• Merge dev and ci container [#3425]
• Use golangci-lint as a formatter [#3405]
• Use ubuntu-slim for lightweight jobs [#3312]
• Add wait --for=create [#3303]
• hotfix: Support workflow_dispatch images for e2e v2 [#3295]
• hotfix: build target architecture for main branch [#3268]
• Fix joining architectures [#3262]
• hotfix: docker build failure on GitHub Actions [#3258]
• Multi platform build with native amd64/arm64 GitHub hosted runner [#3251]
• Add GitHub actions workflow linter [#3213]
• hotfix: ARM64 dev-container build [#3229]
• hotfix: Unify image tag by nightly for format [#3214]
• Use --retry for get.helm.sh [#3195]
• revert: Platform Separation [#3192]
• hotfix: Use extra tags to push nightly [#3189]
• hotfix: separated unification job [#3186]
• Avoid overwrite for ghcr.io [#3182]
• Try to separate amd64/arm64 builds [#3178]
• hotfix: Support debugging for ChatOps [#3055]
• hotfix: Handle cherrypick without diff [#3047]
• [VALD-361] Backport changes into release v1.7 by default [#3050]
• [VALD-359] Support Mac C flags [#3040]

:chart_with_upwards_trend: metrics/tracing

• Add opentelemetry collector dashboard [#3208]
• [VALD-147] Implement MetricMiddleware [#3010]
• hotfix: Support prometheus without container label [#3043]

:arrow_up: Update dependencies

• update dependencies and modules [#3440]
• update rust dependencies and migration [#3436]

:lock: Security

:art: Design

:handshake: Contributor

• add new chatops permissions for contributor [#3548]
• docs: add nac-39 as a contributor for infra [#3234]
• docs: add Sh1ragami as a contributor for tool, and code [#3210]
• docs: add jumpei527 as a contributor for code, and maintenance [#3205]

Related Issue

<!-- This project mainly accepts pull requests related to open issues --> <!-- NOTE: If suggesting a new feature or change, please discuss it in an issue first --> <!-- NOTE: If fixing a bug, there should be an issue describing it with steps to reproduce --> <!-- Please link to the issue here: -->

Versions

<!--- Please change the versions below along with your environment -->

• Vald Version: v1.7.17
• Go Version: v1.26.5
• Rust Version: v1.97.1
• Docker Version: v29.6.2
• Kubernetes Version: v1.36.3
• Helm Version: v4.2.3
• NGT Version: v2.7.4
• Faiss Version: v1.14.3

Checklist

<!-- For completed items, change [ ] to [x]. --> <!-- NOTE: these things are not required to open a PR and can be done afterwards / while the PR is open. -->

• [x] I have read the CONTRIBUTING document and completed our CLA agreement.
• [x] I have checked open Pull Requests for the similar feature or fixes?

Special notes for your reviewer

<!-- Please tell us anything you would like to share with reviewers related to this PR. Your thoughts and feedback are highly valued -->

See CHANGELOG.md for details.

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.17</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.17</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.17</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.17</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.17</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.17</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.17</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:sparkles: New feature [VALD-125] feat: Implement index exporter #2746

[VALD-147] add server_config #2958

[VALD-147] implement AccessLogMiddleware #2991

[VALD-148] Generate grafana boards by grafana-foundation-sdk Go #2937

[VALD-322] e2e/v2: Support selector for wait action #2956

[VALD-325] E2E V2: Index Correction Job #3000

[VALD-336] Implement expect in E2E v2 to assert API results #2971

[VALD-351] Add Rust version VQueue prototype implementation #2998

Add git-lfs to dev container image #2978

Fix dashboard variables in overview board (#3030) (#3042)

[VALD-359] Support Mac C flags (#3040) (#3044)

Support prometheus without container label (#3043) (#3045)

:zap: Improve performance

improve rangeConns's performance for Release v1.7.17 (#3039) (#3041)

:bug: Bugfix [BUGFIX] use client config for tls dialer #2938

[Bugfix] prevent nil pointer panic for internal/config/grpc.go #3017

[VALD-148] hotfix: Fix name & despcription of metrics #2981

Avoid concurrent assignment of stream client in RoundRobin #2954

fix: make format has conflicts in some targets #2977

:pencil2: Document docs: Fix a typo in the value that specified the service name #3005

docs: add Kynea0b as a contributor for doc #3006

docs: add Matts966 as a contributor for code, infra, and 2 more #3007

:white_check_mark: Testing E2E V2 CI #2950

:green_heart: CI feat: automatically resolve go.mod & go.sum conflicts in backport workflow #2980

:chart_with_upwards_trend: Metrics/Tracing [VALD-148] Generate grafana boards by grafana-foundation-sdk Go #2937

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.17</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.17</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.17</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.17</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.17</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.17</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.17</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.17</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:sparkles: New feature [VALD-125] feat: Implement index exporter #2746

[VALD-147] add server_config #2958

[VALD-147] implement AccessLogMiddleware #2991

[VALD-148] Generate grafana boards by grafana-foundation-sdk Go #2937

[VALD-322] e2e/v2: Support selector for wait action #2956

[VALD-325] E2E V2: Index Correction Job #3000

[VALD-336] Implement expect in E2E v2 to assert API results #2971

[VALD-351] Add Rust version VQueue prototype implementation #2998

Add git-lfs to dev container image #2978

Fix dashboard variables in overview board (#3030) (#3042)

[VALD-359] Support Mac C flags (#3040) (#3044)

Support prometheus without container label (#3043) (#3045)

:zap: Improve performance

improve rangeConns's performance for Release v1.7.17 (#3039) (#3041)

:bug: Bugfix [BUGFIX] use client config for tls dialer #2938

[Bugfix] prevent nil pointer panic for internal/config/grpc.go #3017

[VALD-148] hotfix: Fix name & despcription of metrics #2981

Avoid concurrent assignment of stream client in RoundRobin #2954

fix: make format has conflicts in some targets #2977

:pencil2: Document docs: Fix a typo in the value that specified the service name #3005

docs: add Kynea0b as a contributor for doc #3006

docs: add Matts966 as a contributor for code, infra, and 2 more #3007

:white_check_mark: Testing E2E V2 CI #2950

:green_heart: CI feat: automatically resolve go.mod & go.sum conflicts in backport workflow #2980

:chart_with_upwards_trend: Metrics/Tracing [VALD-148] Generate grafana boards by grafana-foundation-sdk Go #2937

See CHANGELOG.md for details.

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.16</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.16</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.16</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.16</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.16</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.16</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.16</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:recycle: Refactor

• Fix format of proto files #2778 (#2783)
• Refactor merge docker and github actions workflow gen logic #2769 (#2774)

:pencil2: Document

• Change symlink API documents #2741 (#2776)

:green_heart: CI

• Refactor github actions #2773 (#2779) Change make command #2765 (#2770)

:arrow_up: Update dependencies

• Update libs dependency #2775 (#2785)

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.16</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.16</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.16</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.16</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.16</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.16</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.16</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.16</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:recycle: Refactor

• Fix format of proto files #2778 (#2783)
• Refactor merge docker and github actions workflow gen logic #2769 (#2774)

:pencil2: Document

• Change symlink API documents #2741 (#2776)

:green_heart: CI

• Refactor github actions #2773 (#2779) Change make command #2765 (#2770)

:arrow_up: Update dependencies

• Update libs dependency #2775 (#2785)

See CHANGELOG.md for details.

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.15</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.15</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.15</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.15</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.15</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.15</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.15</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:sparkles: New feature

• Add affinity to jobTemplate #2758 (#2760)
• feat: Implement delete expired index job #2702 (#2722)
• Add QUIC support #1771
• add example-client docker image #2705 (#2709)

:recycle: Refactor

• refactor dockerfiles and update gitattributes #2743 (#2745)

:bug: Bugfix

• :bug: Fix update deps workflow: buf is not found #2737 (#2739)
• [BUGFIX] resolve agent GetGraphStatistics API double-free error problem #2733
• fix rust-analyzer #2731 (#2732)
• Fix installation command for arm64 #2729 (#2730)
• fix not found error #2726 (#2727)
• Fix bind DOCKER_OPTS option #2718 (#2719)

:pencil2: Document

• Update README.md #2724 (#2725)
• :pencil: Remove clj link #2710 (#2714)

:green_heart: CI

• :green_heart: Multi-PF build for example-client #2713
• Add auto deps version update workflow #2707 (#2717)

:arrow_up: Update dependencies

• :green_heart: use ci-container for update deps cron job #2744 (#2748)
• update ubuntu version for devcontainer #2736 (#2750)
• :arrow_up: update versions/BUF_VERSION #2703 (#2704)

:handshake: Contributor

• docs: add highpon as a contributor for code #2721

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.15</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.15</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.15</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.15</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.15</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.15</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.15</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.15</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:sparkles: New feature

• Add affinity to jobTemplate #2758 (#2760)
• feat: Implement delete expired index job #2702 (#2722)
• Add QUIC support #1771
• add example-client docker image #2705 (#2709)

:recycle: Refactor

• refactor dockerfiles and update gitattributes #2743 (#2745)

:bug: Bugfix

• :bug: Fix update deps workflow: buf is not found #2737 (#2739)
• [BUGFIX] resolve agent GetGraphStatistics API double-free error problem #2733
• fix rust-analyzer #2731 (#2732)
• Fix installation command for arm64 #2729 (#2730)
• fix not found error #2726 (#2727)
• Fix bind DOCKER_OPTS option #2718 (#2719)

:pencil2: Document

• Update README.md #2724 (#2725)
• :pencil: Remove clj link #2710 (#2714)

:green_heart: CI

• :green_heart: Multi-PF build for example-client #2713
• Add auto deps version update workflow #2707 (#2717)

:arrow_up: Update dependencies

• :green_heart: use ci-container for update deps cron job #2744 (#2748)
• update ubuntu version for devcontainer #2736 (#2750)
• :arrow_up: update versions/BUF_VERSION #2703 (#2704)

:handshake: Contributor

• docs: add highpon as a contributor for code #2721

See CHANGELOG.md for details.

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.14</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.14</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.14</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.14</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.14</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.14</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.14</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:sparkles: New feature

• Add String sorted topologicalSort #2696 #2698
• Add CPU_INFO_FLAGS for Apple Silicon #2694 #2697
• Add New gRPC Options and Add Reconnect Logic for connection Pool #2685 #2693
• Add option to disable dns resolve #2634 #2641
• Backport PR #2584 to release/v1.7 for Implement ngt property get API #2588
• add HTTP2 support for http.Client and Vald HTTP Server #2572 #2575

:zap: Improve performance

• Refactor grpc/status.withDetails function for performance #2664 #2668

:recycle: Refactor

• Refactor use Absolute path for Makefile #2673
• Refactor internal/net/grpc/client.go #2675
• modify ParseError to FromError for agent handler #2667 #2679
• Backport PR #2674 to release/v1.7 for Refactor internal/net/grpc/client.go #2675
• Backport PR #2670 to release/v1.7 for Refactor use Absolute path for Makefile #2673
• Refactor grpc/status.withDetails function for performance #2664 #2668
• Refactor for release v1.7.14 #2639 #2648
• refactor(gateway): delete unused file #2644 #2646
• Refactor test checkFunc condition #2599 #2602
• Backport PR #2586 to release/v1.7 for modify rust package structure #2590
• Backport PR #2577 to release/v1.7 for refactor docker and change buildkit-syft-scanner reference to ghcr.io #2578

:bug: Bugfix

• Fix gRPC error handling for gateway/filter handler #2669 #2689
• fix: increase limit #2683 #2686
• Fix gRPC error handling for mirror-gateway handler #2665 #2681
• Fix gRPC error msg handling for lb-gateway handler #2663 #2682
• Bugfix ingress route settings #2636 #2642
• Fix broken links in the document files #2611 #2614
• Fix: make command name #2610 #2612
• Bugfix NGT flush logic #2598 #2606

:pencil2: Document

• Fix broken links in the document files #2611 #2614

:white_check_mark: Testing

• Refactor test checkFunc condition #2599 #2602

:green_heart: CI

• Buf CLI migrate to v2 #2691 #2695
• [create-pull-request] automated change #2677 #2678
• automatically generate workflows #2595 #2603

:chart_with_upwards_trend: Metrics/Tracing

• Introduce an observability crate using opentelemetry-rust #2535 #2609

<!-- This is an auto-generated comment: release notes by coderabbit.ai -->

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.14</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.14</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.14</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.14</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.14</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.14</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.14</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.14</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:sparkles: New feature

• Add String sorted topologicalSort #2696 #2698
• Add CPU_INFO_FLAGS for Apple Silicon #2694 #2697
• Add New gRPC Options and Add Reconnect Logic for connection Pool #2685 #2693
• Add option to disable dns resolve #2634 #2641
• Backport PR #2584 to release/v1.7 for Implement ngt property get API #2588
• add HTTP2 support for http.Client and Vald HTTP Server #2572 #2575

:zap: Improve performance

• Refactor grpc/status.withDetails function for performance #2664 #2668

:recycle: Refactor

• Refactor use Absolute path for Makefile #2673
• Refactor internal/net/grpc/client.go #2675
• modify ParseError to FromError for agent handler #2667 #2679
• Backport PR #2674 to release/v1.7 for Refactor internal/net/grpc/client.go #2675
• Backport PR #2670 to release/v1.7 for Refactor use Absolute path for Makefile #2673
• Refactor grpc/status.withDetails function for performance #2664 #2668
• Refactor for release v1.7.14 #2639 #2648
• refactor(gateway): delete unused file #2644 #2646
• Refactor test checkFunc condition #2599 #2602
• Backport PR #2586 to release/v1.7 for modify rust package structure #2590
• Backport PR #2577 to release/v1.7 for refactor docker and change buildkit-syft-scanner reference to ghcr.io #2578

:bug: Bugfix

• Fix gRPC error handling for gateway/filter handler #2669 #2689
• fix: increase limit #2683 #2686
• Fix gRPC error handling for mirror-gateway handler #2665 #2681
• Fix gRPC error msg handling for lb-gateway handler #2663 #2682
• Bugfix ingress route settings #2636 #2642
• Fix broken links in the document files #2611 #2614
• Fix: make command name #2610 #2612
• Bugfix NGT flush logic #2598 #2606

:pencil2: Document

• Fix broken links in the document files #2611 #2614

:white_check_mark: Testing

• Refactor test checkFunc condition #2599 #2602

:green_heart: CI

• Buf CLI migrate to v2 #2691 #2695
• [create-pull-request] automated change #2677 #2678
• automatically generate workflows #2595 #2603

:chart_with_upwards_trend: Metrics/Tracing

• Introduce an observability crate using opentelemetry-rust #2535 #2609

<!-- This is an auto-generated comment: release notes by coderabbit.ai -->

See CHANGELOG.md for details.

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.13</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.13</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.13</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.13</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.13</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.13</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.13</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

[Bugfix]

• General Fixes

  1. Fix index correction process #2565 (#2566)
  2. libquadmath is not available on ARM #2559
  3. fix: add checkout option #2545 (#2546)
  4. fix: make format #2534 (#2540)
  5. fix conflict bug #2537
  6. Bugfix that caused an error when argument has 3 or more nil arguments #2517 (#2520)
  7. Bugfix recreate benchmark job when operator reboot #2463 (#2464)
  8. Fix agent-faiss build failed #2418 (#2419)
  9. Fix the logic to determine docker image #2410 (#2420)

• Backport and Release-Related

  1. Fix workflow trigger for backport pr creation #2471 (#2472)
  2. Fix output settings to determine-docker-image-tag action and release branch build tag name #2423 (#2425)

• E2E and Index

  1. Fix e2e for read replica and add e2e for index operator #2455 (#2459)
  2. Fix index job logic to pass DNS A record #2438 (#2448)

• Documentation and Other

  1. fix: typo of execution rule #2426 (#2427)
  2. :pencil: Fix typo of file name #2413 (#2415)

[Enhancement]

• General Improvements

  1. Update dependencies, C++ standard, and improve Dockerfiles for better build systems and localization #2549 (#2557)
  2. Implement ngt Statistics API #2539 (#2547)
  3. refactor index manager service add index service API to expose index informations #2525 (#2532)

• API and Logic Changes

  1. Change default image tag from latest to nightly #2516 (#2518)
  2. update large top-K ratio handling logic #2509 (#2511)
  3. add inner product distance type for ngt #2454 (#2458)
  4. Implement index operator logic for read replica rotation #2444 (#2456)

• Performance and Optimization

  1. update deps & add validation for Flush API when agent is Read Only #2433 (#2436)
  2. Add index-operator template implementation #2375 (#2424)

• Testing and Metrics

  1. Implement client metrics interceptor for continuous benchmark job #2477 (#2480)
  2. Add tests for index information export #2412 (#2414)

[CI]

1. [create-pull-request] automated change #2552 (#2556)
2. Add workflow to check git conflict for backport PR #2548 (#2550)
3. [CI] Add workflow to synchronize ubuntu base image #2526 (#2527)
4. Automatically add backport main label for release-pr #2473 (#2475)
5. change external docker image reference to ghcr.io registry #2567 (#2568)

[Backport]

1. Backport PR #2542, #2538 to release/v1.7 #2543
2. Backport docs updates to release/v1.7 #2521
3. Backport Flush API #2434

[Documentation]

1. capitalize faq #2512 (#2522)
2. add faiss in values.yaml & valdrelease.yaml #2514 (#2519)
3. add read replica and rotator docs #2497 (#2499)
4. Update continuous benchmark docs #2485 (#2486)
5. docs: add hrichiksite as a contributor for doc #2441 (#2442)

[Other]

1. Add base of benchmark operator dashboard #2430 (#2453)
2. Add client metrics panels for continuous benchmark job #2481 (#2483)
3. Add unit tests for index operator #2460 (#2461)
4. add reviewer guideline #2507 (#2508)
5. Sync release/v1.7 to main #2495
6. Add snapshot timestamp annotations to read replica agent #2428 (#2443)
7. Update build rule for nightly image #2421 (#2422)

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.13</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.13</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.13</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.13</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.13</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.13</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.13</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.13</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

[Bugfix]

• General Fixes

  1. Fix index correction process #2565 (#2566)
  2. libquadmath is not available on ARM #2559
  3. fix: add checkout option #2545 (#2546)
  4. fix: make format #2534 (#2540)
  5. fix conflict bug #2537
  6. Bugfix that caused an error when argument has 3 or more nil arguments #2517 (#2520)
  7. Bugfix recreate benchmark job when operator reboot #2463 (#2464)
  8. Fix agent-faiss build failed #2418 (#2419)
  9. Fix the logic to determine docker image #2410 (#2420)

• Backport and Release-Related

  1. Fix workflow trigger for backport pr creation #2471 (#2472)
  2. Fix output settings to determine-docker-image-tag action and release branch build tag name #2423 (#2425)

• E2E and Index

  1. Fix e2e for read replica and add e2e for index operator #2455 (#2459)
  2. Fix index job logic to pass DNS A record #2438 (#2448)

• Documentation and Other

  1. fix: typo of execution rule #2426 (#2427)
  2. :pencil: Fix typo of file name #2413 (#2415)

[Enhancement]

• General Improvements

  1. Update dependencies, C++ standard, and improve Dockerfiles for better build systems and localization #2549 (#2557)
  2. Implement ngt Statistics API #2539 (#2547)
  3. refactor index manager service add index service API to expose index informations #2525 (#2532)

• API and Logic Changes

  1. Change default image tag from latest to nightly #2516 (#2518)
  2. update large top-K ratio handling logic #2509 (#2511)
  3. add inner product distance type for ngt #2454 (#2458)
  4. Implement index operator logic for read replica rotation #2444 (#2456)

• Performance and Optimization

  1. update deps & add validation for Flush API when agent is Read Only #2433 (#2436)
  2. Add index-operator template implementation #2375 (#2424)

• Testing and Metrics

  1. Implement client metrics interceptor for continuous benchmark job #2477 (#2480)
  2. Add tests for index information export #2412 (#2414)

[CI]

1. [create-pull-request] automated change #2552 (#2556)
2. Add workflow to check git conflict for backport PR #2548 (#2550)
3. [CI] Add workflow to synchronize ubuntu base image #2526 (#2527)
4. Automatically add backport main label for release-pr #2473 (#2475)
5. change external docker image reference to ghcr.io registry #2567 (#2568)

[Backport]

1. Backport PR #2542, #2538 to release/v1.7 #2543
2. Backport docs updates to release/v1.7 #2521
3. Backport Flush API #2434

[Documentation]

1. capitalize faq #2512 (#2522)
2. add faiss in values.yaml & valdrelease.yaml #2514 (#2519)
3. add read replica and rotator docs #2497 (#2499)
4. Update continuous benchmark docs #2485 (#2486)
5. docs: add hrichiksite as a contributor for doc #2441 (#2442)

[Other]

1. Add base of benchmark operator dashboard #2430 (#2453)
2. Add client metrics panels for continuous benchmark job #2481 (#2483)
3. Add unit tests for index operator #2460 (#2461)
4. add reviewer guideline #2507 (#2508)
5. Sync release/v1.7 to main #2495
6. Add snapshot timestamp annotations to read replica agent #2428 (#2443)
7. Update build rule for nightly image #2421 (#2422)

See CHANGELOG.md for details.

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.12</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.12</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.12</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.12</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.12</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.12</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.12</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:sparkles: New feature

• Add rotate-all option to rotator #2305 #2393
• Make agent export index metrics to Pod k8s resource #2319 #2372

:recycle: Refactor

• Delete unnecessary code for mirror #2366 #2391

:bug: Bugfix

• Resolve kvs already closed before last saving #2390 #2394

:pencil2: Document

• Create continous benchmark doc #2352 #2395

:white_check_mark: Testing

• Fix: build error of internal kvs test #2396 #2398

:green_heart: CI

• Fix: disable protobuf dispatch for client #2401 #2403
• Add Con-Bench helm chart to the Vald charts #2388 #2389
• Update workflow to release readreplica chart #2383 #2387
• Backport ci deps others #2386
• Update docker build target platform selection rules #2370 #2374
• Add commit hash build image #2359 #2371
• Refactor code using golangci-lint #2362 #2365
• Change docker scan timeout longer #2363 #2364

:arrow_up: Update dependencies

• Update deps #2404 #2405

:lock: Security

• Create SECURITY.md #2367 #2368

:art: Design

• Change JP logo to EN logo #2369 #2392

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.12</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.12</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.12</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.12</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.12</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.12</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.12</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.12</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:sparkles: New feature

• Add rotate-all option to rotator #2305 #2393
• Make agent export index metrics to Pod k8s resource #2319 #2372

:recycle: Refactor

• Delete unnecessary code for mirror #2366 #2391

:bug: Bugfix

• Resolve kvs already closed before last saving #2390 #2394

:pencil2: Document

• Create continous benchmark doc #2352 #2395

:white_check_mark: Testing

• Fix: build error of internal kvs test #2396 #2398

:green_heart: CI

• Fix: disable protobuf dispatch for client #2401 #2403
• Add Con-Bench helm chart to the Vald charts #2388 #2389
• Update workflow to release readreplica chart #2383 #2387
• Backport ci deps others #2386
• Update docker build target platform selection rules #2370 #2374
• Add commit hash build image #2359 #2371
• Refactor code using golangci-lint #2362 #2365
• Change docker scan timeout longer #2363 #2364

:arrow_up: Update dependencies

• Update deps #2404 #2405

:lock: Security

• Create SECURITY.md #2367 #2368

:art: Design

• Change JP logo to EN logo #2369 #2392

See CHANGELOG.md for details.

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.11</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.11</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.11</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.11</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.11</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.11</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.11</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:sparkles: New feature

• Add HPA for read replica #2307
• Add internal KVS pogreb package #2302
• Two version deploy support #2171
• Add mirror gateway definitions and Implementations #2262
• Initialize dev env for Rust agent #2293
• Add new grafana dashboard for agent memory metrics #2279
• Implement continuous benchmark tool #2216

:recycle: Refactor

• Add newline between params to avoid false formatting #2347
• Fix golangci-lint config and apply tagalign #2326
• Refactor postAttachCommand #2312
• Refactor ignore rule #2339
• Fix NGT default params #2332
• Format yaml using google/yamlfmt & update go version and dependencies #2322
• Refactor update opentelemetry-go & faiss #2303
• Change discoverer client to broadcast to read replicas #2276
• Add stern and telepresence #2320
• Add issue metrics #2308
• Add dispatch workflow for update contents of vdaas/web repo #2294
• Fix: add release build for bench and mirror #2300
• Fix deeepsource errors #2299
• Add go cache for improvement docker build performance #2297
• Add detailed log for readreplica rotator #2281
• Add isSymlink function and test to gen license to avoid for symlink to become normal file. #2290
• Add owner reference to the resources made by rotator to delete them when read replica resources are deleted #2287
• Make vald-readreplica values.yaml to symbolic link #2286
• Separate readreplica chart #2283
• Happy New Year 2024 #2284

:bug: Bugfix

• Fix: disable arm64 #2354
• gcc environment for ARM #2334
• Revert dev Dockerfile to use official devcontainer image #2335
• Revert docker-image.yaml change #2336
• Fix release pr workflow #2333
• Fix e2e regressions #2327
• Bugfix grpc ip direct connection status check #2316
• Fix k3d connectivity error #2317
• Change lincense/gen/main.go to skip shebang #2313
• Stop using ENV ARCH and add --platform in Dockerfile #2304
• gRPC pool connection health check for DNS Addr may fail during VIP member disconnection #2277
• Fix isSymlink function to correctly check for symbolic links #2292
• Disable disconnection during non-IP-direct connection #2291
• Fix git add chart directory for release #2356

:pencil2: Document

• Add search optimization document #2306
• Update capacity planning doc #2295

:green_heart: CI

• Change to dynamically switch CI container image tag #2310
• Add E2E tests for read replica feature #2298
• CI, Docker EXTRA_ARGS not working problem #2278

Docker images

<table> <tr> <th>component</th> <th>Docker pull</th> </tr> <tr> <td>Agent NGT</td> <td> <code>docker pull vdaas/vald-agent-ngt:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-ngt:v1.7.11</code> </td> </tr> <tr> <td>Agent sidecar</td> <td> <code>docker pull vdaas/vald-agent-sidecar:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-agent-sidecar:v1.7.11</code> </td> </tr> <tr> <td>Discoverers</td> <td> <code>docker pull vdaas/vald-discoverer-k8s:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-discoverer-k8s:v1.7.11</code> </td> </tr> <tr> <td>Gateways</td> <td> <code>docker pull vdaas/vald-lb-gateway:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-lb-gateway:v1.7.11</code><br/> <code>docker pull vdaas/vald-filter-gateway:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-filter-gateway:v1.7.11</code> </td> </tr> <tr> <td>Index Manager</td> <td> <code>docker pull vdaas/vald-manager-index:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-manager-index:v1.7.11</code> </td> </tr> <tr> <td>Helm Operator</td> <td> <code>docker pull vdaas/vald-helm-operator:v1.7.11</code><br/> <code>docker pull ghcr.io/vdaas/vald/vald-helm-operator:v1.7.11</code> </td> </tr> </table>

Documents

• GoDoc
• Helm Chart Reference
• Helm Operator Chart Reference

Changes

:sparkles: New feature

• Add HPA for read replica #2307
• Add internal KVS pogreb package #2302
• Two version deploy support #2171
• Add mirror gateway definitions and Implementations #2262
• Initialize dev env for Rust agent #2293
• Add new grafana dashboard for agent memory metrics #2279
• Implement continuous benchmark tool #2216

:recycle: Refactor

• Add newline between params to avoid false formatting #2347
• Fix golangci-lint config and apply tagalign #2326
• Refactor postAttachCommand #2312
• Refactor ignore rule #2339
• Fix NGT default params #2332
• Format yaml using google/yamlfmt & update go version and dependencies #2322
• Refactor update opentelemetry-go & faiss #2303
• Change discoverer client to broadcast to read replicas #2276
• Add stern and telepresence #2320
• Add issue metrics #2308
• Add dispatch workflow for update contents of vdaas/web repo #2294
• Fix: add release build for bench and mirror #2300
• Fix deeepsource errors #2299
• Add go cache for improvement docker build performance #2297
• Add detailed log for readreplica rotator #2281
• Add isSymlink function and test to gen license to avoid for symlink to become normal file. #2290
• Add owner reference to the resources made by rotator to delete them when read replica resources are deleted #2287
• Make vald-readreplica values.yaml to symbolic link #2286
• Separate readreplica chart #2283
• Happy New Year 2024 #2284

:bug: Bugfix

• Fix: disable arm64 #2354
• gcc environment for ARM #2334
• Revert dev Dockerfile to use official devcontainer image #2335
• Revert docker-image.yaml change #2336
• Fix release pr workflow #2333
• Fix e2e regressions #2327
• Bugfix grpc ip direct connection status check #2316
• Fix k3d connectivity error #2317
• Change lincense/gen/main.go to skip shebang #2313
• Stop using ENV ARCH and add --platform in Dockerfile #2304
• gRPC pool connection health check for DNS Addr may fail during VIP member disconnection #2277
• Fix isSymlink function to correctly check for symbolic links #2292
• Disable disconnection during non-IP-direct connection #2291
• Fix git add chart directory for release #2356

:pencil2: Document

• Add search optimization document #2306
• Update capacity planning doc #2295

:green_heart: CI

• Change to dynamically switch CI container image tag #2310
• Add E2E tests for read replica feature #2298
• CI, Docker EXTRA_ARGS not working problem #2278