What's Changed

• deps(deps): bump google.golang.org/grpc from 1.81.1 to 1.82.1 by @dependabot[bot] in #5374
• deps(deps): bump next from 16.2.10 to 16.2.11 in /webui by @dependabot[bot] in #5375
• deps(deps): bump brace-expansion from 2.1.0 to 2.1.2 in /webui by @dependabot[bot] in #5376
• deps(deps): bump github.com/moby/go-archive from 0.2.0 to 0.2.1 in /test_integration in the go-test-dependencies group by @dependabot[bot] in #5377
• deps(deps): update certifi requirement from >=2026.6.17 to >=2026.7.22 in /clients/python by @dependabot[bot] in #5378
• deps(deps): bump the ops-python-dependencies group in /ops with 4 updates by @dependabot[bot] in #5379
• deps(deps): bump the sdk-python-dependencies group in /python with 5 updates by @dependabot[bot] in #5380
• deps(deps): bump types-six from 1.17.0.20260518 to 1.17.0.20260724 in /python by @dependabot[bot] in #5381
• deps(deps): bump the root-python-dependencies group with 6 updates by @dependabot[bot] in #5382
• deps(deps): bump the go-dependencies group across 1 directory with 13 updates by @dependabot[bot] in #5385
• Clarify Bacalhau open-source project identity by @aronchick in #5386
• deps(deps): bump github.com/sigstore/sigstore-go from 1.2.0 to 1.2.1 in /test_integration by @dependabot[bot] in #5387
• deps(deps): bump brace-expansion from 2.1.2 to 2.1.4 in /webui by @dependabot[bot] in #5388
• deps(deps): bump the webui-dependencies group in /webui by @dependabot[bot] in #5383
• deps(deps): bump the sdk-python-dependencies group in /python with 2 updates by @dependabot[bot] in #5390
• deps(deps): bump the go-dependencies group with 11 updates by @dependabot[bot] in #5391
• fix(webui): keep compatible dependency updates by @aronchick in #5392
• deps(deps): bump cryptography from 49.0.0 to 50.0.0 in /ops by @dependabot[bot] in #5393
• deps(deps): bump cryptography from 49.0.0 to 50.0.0 by @dependabot[bot] in #5394
• deps(deps): bump postcss from 8.5.19 to 8.5.25 in /webui by @dependabot[bot] in #5395
• deps(deps): bump cryptography from 49.0.0 to 50.0.0 in /python by @dependabot[bot] in #5396
• deps(deps): bump github.com/moby/go-archive from 0.2.1 to 0.3.3 in /test_integration in the go-test-dependencies group by @dependabot[bot] in #5397
• deps(deps): update coverage requirement from >=7.15.2 to >=7.15.3 in /clients/python by @dependabot[bot] in #5398
• deps(deps): bump the sdk-python-dependencies group in /python with 3 updates by @dependabot[bot] in #5399
• deps(deps): bump the ops-python-dependencies group in /ops with 7 updates by @dependabot[bot] in #5401
• deps(deps): bump nanoid from 3.3.12 to 3.3.18 in /webui by @dependabot[bot] in #5404
• deps(deps): bump the root-python-dependencies group across 1 directory with 2 updates by @dependabot[bot] in #5405
• deps(deps): bump the go-dependencies group across 1 directory with 21 updates by @dependabot[bot] in #5406
• fix(webui): retain compatible dependency upgrades by @aronchick in #5408

Full Changelog: v1.9.2...v1.9.3

v1.9.3 Latest

Latest

Compare

Choose a tag to compare

What's Changed

• ci: automate weekly dependency releases on Blacksmith by @aronchick in #5347
• ci: handle unsupported gateway tests on Blacksmith by @aronchick in #5360
• fix: propagate compute execution errors by @aronchick in #5361
• deps: consolidate weekly dependency updates by @aronchick in #5362
• deps(deps): update urllib3 requirement from >=1.15.1 to >=2.7.0 in /clients/python by @dependabot[bot] in #5366
• deps(deps): update python-dateutil requirement from >=2.5.3 to >=2.9.0.post0 in /clients/python by @dependabot[bot] in #5364
• deps(deps): update pytest requirement from >=9.0.3 to >=9.1.1 in /clients/python by @dependabot[bot] in #5365
• deps(deps): bump github.com/nats-io/nats.go from 1.51.0 to 1.52.0 in the go-dependencies group by @dependabot[bot] in #5368
• deps(deps): bump tox from 4.48.1 to 4.57.0 in /python in the sdk-python-dependencies group by @dependabot[bot] in #5369
• deps(deps): update six requirement from >=1.10 to >=1.17.0 in /clients/python by @dependabot[bot] in #5363
• ci: consolidate weekly Dependabot updates by @aronchick in #5370
• fix: harden weekly release gates by @aronchick in #5371
• fix: fetch release lint baseline by @aronchick in #5372
• fix: create release tag before publishing by @aronchick in #5373

Full Changelog: v1.9.1...v1.9.2

v1.9.2

Compare

Choose a tag to compare

What's Changed

• fix: smoke-test friction (version parse, dev-compat, no-profile API) by @aronchick in #5270
• ci: repair dependency update container tests by @aronchick in #5336
• deps: refresh dependencies for v1.9.1 by @aronchick in #5338
• deps: apply latest security patches by @aronchick in #5345

Full Changelog: v1.9.0...v1.9.1

v1.9.1

Compare

Choose a tag to compare

What's Changed

• deps(deps): bump k8s.io/apimachinery from 0.33.1 to 0.33.2 by @dependabot[bot] in #5072
• add job version to swagger schema by @markkuhn in #5076
• deps(deps): bump golang.org/x/time from 0.11.0 to 0.12.0 by @dependabot[bot] in #5073
• deps(deps): bump github.com/hashicorp/go-retryablehttp from 0.7.7 to 0.7.8 by @dependabot[bot] in #5074
• deps(deps): bump go.opentelemetry.io/otel/trace from 1.36.0 to 1.37.0 by @dependabot[bot] in #5078
• S3 Managed Publisher Tests by @Olg-K in #5069
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc from 1.36.0 to 1.37.0 by @dependabot[bot] in #5080
• deps(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.81.0 to 1.82.0 by @dependabot[bot] in #5081
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.36.0 to 1.37.0 by @dependabot[bot] in #5083
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 1.36.0 to 1.37.0 by @dependabot[bot] in #5084
• Bump github.com/go-viper/mapstructure/v2 from 2.0.0 to 2.3.0 in /test_integration by @dependabot[bot] in #5085
• deps(deps): bump github.com/go-viper/mapstructure/v2 from 2.2.1 to 2.3.0 by @dependabot[bot] in #5086
• deps(deps): bump sigs.k8s.io/yaml from 1.4.0 to 1.5.0 by @dependabot[bot] in #5088
• deps(deps): bump github.com/ipfs/go-ipld-format from 0.6.1 to 0.6.2 by @dependabot[bot] in #5090
• Bump urllib3 from 2.2.1 to 2.5.0 in /integration/airflow by @dependabot[bot] in #5092
• deps(deps): bump github.com/nats-io/nats-server/v2 from 2.11.4 to 2.11.6 by @dependabot[bot] in #5093
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.36.0 to 1.37.0 by @dependabot[bot] in #5094
• deps(deps): bump github.com/aws/aws-sdk-go-v2/feature/s3/manager from 1.17.81 to 1.17.84 by @dependabot[bot] in #5102
• refactor: remove licensing system by @wdbaruni in #5156
• fix swagger by @wdbaruni in #5159
• refactor: remove Expanso-specific analytics tracking by @wdbaruni in #5157
• refactor: remove Expanso enterprise support card from Web UI by @wdbaruni in #5158
• refactor: remove dead license validation code by @wdbaruni in #5160
• refactor: remove remaining license-related code by @wdbaruni in #5161
• deps: consolidate all Dependabot updates (2025-01-11) by @wdbaruni in #5162
• ci: configure Dependabot to group dependency updates by @wdbaruni in #5182
• feat(cli): add profile management for multi-cluster connections by @wdbaruni in #5188
• Remove Expanso cross-reference from README by @aronchick in #5196
• deps: bump webui + python dependencies (toward v1.9.0) by @aronchick in #5241
• chore: remove unmaintained integration/ directory (airflow + flyte) by @aronchick in #5244
• ci: pin coverage job to Go 1.25 for gocovmerge install by @aronchick in #5245
• deps(webui): bump next ^15.5.15, drop stale package-lock.json by @aronchick in #5243
• deps(deps): bump github.com/pion/dtls/v3 from 3.0.6 to 3.0.11 by @dependabot[bot] in #5202
• Bump github.com/moby/spdystream from 0.5.0 to 0.5.1 in /test_integration by @dependabot[bot] in #5239
• deps(deps): bump github.com/golang-jwt/jwt/v5 from 5.2.2 to 5.3.0 by @dependabot[bot] in #5187
• deps(deps): bump github.com/docker/go-connections from 0.5.0 to 0.6.0 by @dependabot[bot] in #5185
• deps(deps): bump github.com/aws/aws-sdk-go-v2/feature/ec2/imds from 1.16.32 to 1.18.17 by @dependabot[bot] in #5184
• chore(deps): bump requests from 2.32.4 to 2.33.0 in /ops by @dependabot[bot] in #5221
• deps(deps): bump github.com/go-jose/go-jose/v4 from 4.1.2 to 4.1.4 by @dependabot[bot] in #5225
• chore(deps): bump pyasn1 from 0.4.8 to 0.6.3 in /ops by @dependabot[bot] in #5213
• deps(deps): bump github.com/ipld/go-ipld-prime from 0.21.0 to 0.22.0 by @dependabot[bot] in #5227
• deps(deps): bump github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream from 1.6.11 to 1.7.8 by @dependabot[bot] in #5228
• chore(deps): bump google.golang.org/grpc from 1.74.2 to 1.79.3 in /test_integration by @dependabot[bot] in #5214
• deps(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.84.0 to 1.97.3 by @dependabot[bot] in #5229
• chore(deps): bump protobuf from 4.25.8 to 5.29.6 in /ops by @dependabot[bot] in #5195
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 1.37.0 to 1.43.0 by @dependabot[bot] in #5230
• chore(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 1.35.0 to 1.43.0 in /test_integration by @dependabot[bot] in #5231
• chore(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.35.0 to 1.43.0 in /test_integration by @dependabot[bot] in #5232
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.38.0 to 1.43.0 by @dependabot[bot] in #5235
• ci(deps): bump the github-actions group across 1 directory with 11 updates by @dependabot[bot] in #5218
• deps(deps): bump github.com/nats-io/nats-server/v2 from 2.11.6 to 2.12.3 by @dependabot[bot] in #5186
• ci: migrate golangci-lint to v2.5.0 (unblock Static Analysis) by @aronchick in #5246
• chore: configure Dependabot grouped updates and upgrade to Go 1.25.5 by @wdbaruni in #5163
• docs(dev): add moby module migration tracker by @aronchick in #5268
• deps(python-sdk): refresh for security fixes; require Python 3.10+ by @aronchick in #5265
• deps(webui): force transitive fixes for handlebars/tar/minimatch/glob by @aronchick in #5266
• deps: bump libp2p 0.43→0.48, quic-go 0.55→0.59 (security fixes) by @aronchick in #5267
• deps(deps): bump the pip-dependencies group with 13 updates by @dependabot[bot] in #5259
• deps(deps): bump the pip-ops-dependencies group in /ops with 12 updates by @dependabot[bot] in #5251
• ci(deps): bump the github-actions-dependencies group with 2 updates by @dependabot[bot] in #5247
• deps(deps): bump google-cloud-storage from 2.5.0 to 3.10.1 by @dependabot[bot] in #5263
• deps(deps): bump charset-normalizer from 2.1.0 to 3.4.7 by @dependabot[bot] in #5262
• deps(deps): bump pre-commit from 2.21.0 to 4.5.1 by @dependabot[bot] in #5261
• deps(deps): bump protobuf from 5.29.6 to 7.34.1 by @dependabot[bot] in #5260
• deps(deps): bump python-dotenv from 0.20.0 to 1.2.2 in /ops by @dependabot[bot] in #5256
• deps(deps): bump charset-normalizer from 2.1.0 to 3.4.7 in /ops by @dependabot[bot] in #5253
• deps(deps): bump google-cloud-storage from 2.5.0 to 3.10.1 in /ops by @dependabot[bot] in #5255
• deps(deps): bump cachetools from 5.2.0 to 7.0.5 in /ops by @dependabot[bot] in #5252

Full Changelog: v1.8.0...v1.9.0

v1.9.0

Compare

Choose a tag to compare

What's Changed

• deps(deps): bump k8s.io/apimachinery from 0.33.1 to 0.33.2 by @dependabot[bot] in #5072
• add job version to swagger schema by @markkuhn in #5076
• deps(deps): bump golang.org/x/time from 0.11.0 to 0.12.0 by @dependabot[bot] in #5073
• deps(deps): bump github.com/hashicorp/go-retryablehttp from 0.7.7 to 0.7.8 by @dependabot[bot] in #5074
• deps(deps): bump go.opentelemetry.io/otel/trace from 1.36.0 to 1.37.0 by @dependabot[bot] in #5078
• S3 Managed Publisher Tests by @Olg-K in #5069
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc from 1.36.0 to 1.37.0 by @dependabot[bot] in #5080
• deps(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.81.0 to 1.82.0 by @dependabot[bot] in #5081
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.36.0 to 1.37.0 by @dependabot[bot] in #5083
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 1.36.0 to 1.37.0 by @dependabot[bot] in #5084
• Bump github.com/go-viper/mapstructure/v2 from 2.0.0 to 2.3.0 in /test_integration by @dependabot[bot] in #5085
• deps(deps): bump github.com/go-viper/mapstructure/v2 from 2.2.1 to 2.3.0 by @dependabot[bot] in #5086
• deps(deps): bump sigs.k8s.io/yaml from 1.4.0 to 1.5.0 by @dependabot[bot] in #5088
• deps(deps): bump github.com/ipfs/go-ipld-format from 0.6.1 to 0.6.2 by @dependabot[bot] in #5090
• Bump urllib3 from 2.2.1 to 2.5.0 in /integration/airflow by @dependabot[bot] in #5092
• deps(deps): bump github.com/nats-io/nats-server/v2 from 2.11.4 to 2.11.6 by @dependabot[bot] in #5093
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.36.0 to 1.37.0 by @dependabot[bot] in #5094
• deps(deps): bump github.com/aws/aws-sdk-go-v2/feature/s3/manager from 1.17.81 to 1.17.84 by @dependabot[bot] in #5102
• refactor: remove licensing system by @wdbaruni in #5156
• fix swagger by @wdbaruni in #5159
• refactor: remove Expanso-specific analytics tracking by @wdbaruni in #5157
• refactor: remove Expanso enterprise support card from Web UI by @wdbaruni in #5158
• refactor: remove dead license validation code by @wdbaruni in #5160
• refactor: remove remaining license-related code by @wdbaruni in #5161
• deps: consolidate all Dependabot updates (2025-01-11) by @wdbaruni in #5162
• ci: configure Dependabot to group dependency updates by @wdbaruni in #5182
• feat(cli): add profile management for multi-cluster connections by @wdbaruni in #5188
• Remove Expanso cross-reference from README by @aronchick in #5196
• deps: bump webui + python dependencies (toward v1.9.0) by @aronchick in #5241
• chore: remove unmaintained integration/ directory (airflow + flyte) by @aronchick in #5244
• ci: pin coverage job to Go 1.25 for gocovmerge install by @aronchick in #5245
• deps(webui): bump next ^15.5.15, drop stale package-lock.json by @aronchick in #5243
• deps(deps): bump github.com/pion/dtls/v3 from 3.0.6 to 3.0.11 by @dependabot[bot] in #5202
• Bump github.com/moby/spdystream from 0.5.0 to 0.5.1 in /test_integration by @dependabot[bot] in #5239
• deps(deps): bump github.com/golang-jwt/jwt/v5 from 5.2.2 to 5.3.0 by @dependabot[bot] in #5187
• deps(deps): bump github.com/docker/go-connections from 0.5.0 to 0.6.0 by @dependabot[bot] in #5185
• deps(deps): bump github.com/aws/aws-sdk-go-v2/feature/ec2/imds from 1.16.32 to 1.18.17 by @dependabot[bot] in #5184
• chore(deps): bump requests from 2.32.4 to 2.33.0 in /ops by @dependabot[bot] in #5221
• deps(deps): bump github.com/go-jose/go-jose/v4 from 4.1.2 to 4.1.4 by @dependabot[bot] in #5225
• chore(deps): bump pyasn1 from 0.4.8 to 0.6.3 in /ops by @dependabot[bot] in #5213
• deps(deps): bump github.com/ipld/go-ipld-prime from 0.21.0 to 0.22.0 by @dependabot[bot] in #5227
• deps(deps): bump github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream from 1.6.11 to 1.7.8 by @dependabot[bot] in #5228
• chore(deps): bump google.golang.org/grpc from 1.74.2 to 1.79.3 in /test_integration by @dependabot[bot] in #5214
• deps(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.84.0 to 1.97.3 by @dependabot[bot] in #5229
• chore(deps): bump protobuf from 4.25.8 to 5.29.6 in /ops by @dependabot[bot] in #5195
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 1.37.0 to 1.43.0 by @dependabot[bot] in #5230
• chore(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 1.35.0 to 1.43.0 in /test_integration by @dependabot[bot] in #5231
• chore(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.35.0 to 1.43.0 in /test_integration by @dependabot[bot] in #5232
• deps(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.38.0 to 1.43.0 by @dependabot[bot] in #5235
• ci(deps): bump the github-actions group across 1 directory with 11 updates by @dependabot[bot] in #5218
• deps(deps): bump github.com/nats-io/nats-server/v2 from 2.11.6 to 2.12.3 by @dependabot[bot] in #5186
• ci: migrate golangci-lint to v2.5.0 (unblock Static Analysis) by @aronchick in #5246
• chore: configure Dependabot grouped updates and upgrade to Go 1.25.5 by @wdbaruni in #5163
• docs(dev): add moby module migration tracker by @aronchick in #5268
• deps(python-sdk): refresh for security fixes; require Python 3.10+ by @aronchick in #5265
• deps(webui): force transitive fixes for handlebars/tar/minimatch/glob by @aronchick in #5266
• deps: bump libp2p 0.43→0.48, quic-go 0.55→0.59 (security fixes) by @aronchick in #5267
• deps(deps): bump the pip-dependencies group with 13 updates by @dependabot[bot] in #5259
• deps(deps): bump the pip-ops-dependencies group in /ops with 12 updates by @dependabot[bot] in #5251
• ci(deps): bump the github-actions-dependencies group with 2 updates by @dependabot[bot] in #5247
• deps(deps): bump google-cloud-storage from 2.5.0 to 3.10.1 by @dependabot[bot] in #5263
• deps(deps): bump charset-normalizer from 2.1.0 to 3.4.7 by @dependabot[bot] in #5262
• deps(deps): bump pre-commit from 2.21.0 to 4.5.1 by @dependabot[bot] in #5261
• deps(deps): bump protobuf from 5.29.6 to 7.34.1 by @dependabot[bot] in #5260
• deps(deps): bump python-dotenv from 0.20.0 to 1.2.2 in /ops by @dependabot[bot] in #5256
• deps(deps): bump charset-normalizer from 2.1.0 to 3.4.7 in /ops by @dependabot[bot] in #5253
• deps(deps): bump google-cloud-storage from 2.5.0 to 3.10.1 in /ops by @dependabot[bot] in #5255
• deps(deps): bump cachetools from 5.2.0 to 7.0.5 in /ops by @dependabot[bot] in #5252

Full Changelog: v1.8.0...v1.9.0-rc1

v1.9.0-rc1 Pre-release

Pre-release

Compare

Choose a tag to compare

Bacalhau v1.8.0 Release Announcement

We're excited to announce Bacalhau v1.8.0: a groundbreaking release that transforms how you can approach distributed computing at the edge. This new release introduces:

• Intelligent cost optimization through an advanced Splunk integration.
• Enhanced daemon job orchestration for dynamic infrastructure.
• Enterprise-grade improvements—docs, security, and more.
• A completely reimagined job lifecycle management system.

In a nutshell, Bacalhau v1.8.0 delivers the integrations and capabilities that you need to reduce costs, improve operational efficiency, and unlock the full potential of your distributed infrastructure.

Let's dive into it to learn more!

Slash Your Splunk Bill: Intelligent Logging at the Edge

Let's talk about the elephant in the room: logging costs. For too long, you've faced a terrible choice: ship all your raw data to Splunk and watch your budget evaporate, or sample your data and risk missing the one critical event you need.

So, what if there could be an alternative solution? Bacalhau's new Splunk integration offers a third, much smarter path. Instead of moving mountains of data, Bacalhau lets you ship the computation to the data source. This fundamentally changes the cost equation.

With v1.8.0, Bacalhau's compute power can be integrated directly into Splunk so that you can:

• Process data at the source: Deploy smart logging agents that filter, aggregate, and analyze data on the edge, sending only high-signal results to Splunk.
• Fork your data stream: Send critical, processed alerts to Splunk for real-time monitoring while simultaneously archiving the full, compressed raw logs to cheap object storage.
• Query live data without ingestion: Run queries directly on remote nodes to investigate issues in real-time, without moving the data or paying ingestion fees.
• Replay history on demand: Need to analyze old logs? No problem. Use Bacalhau's compute power to pull data from your archive, process it, and analyze it in Splunk.

This isn't a minor tweak. It's a paradigm shift that can cut logging costs by 60-80% while giving you more analytical power. The best part? It all feels native. You use the Splunk dashboards and search queries you already know, while Bacalhau's distributed compute engine works transparently in the background.

Enhanced Daemon Jobs

Bacalhau v1.8.0 strengthens daemon job reliability with enhanced orchestration. The goal is to ensure comprehensive coverage across dynamic infrastructure.

Our developers have beefed up the entire system for the reliability that production environments demand:

• Node discovery is faster.
• Constraint checking is more robust.
• Deployment tracking gives you a clear view of your job's footprint. When a new node spins up in your dynamic infrastructure, you can be confident your daemon job will deploy to it automatically and reliably.

These enhancements are particularly valuable for the Splunk integration, where logging agents must reliably deploy to new infrastructure automatically.

Enterprise-Ready by Default

Rounding out the release are features designed to make Bacalhau seamless in an enterprise environment:

• Managed result storage: With Expanso Cloud, you no longer need to configure your own publisher or manage storage credentials. Job results are automatically and securely stored in our managed infrastructure. Just run your job and fetch your results.
• Documentation overhaul: We've rebuilt our docs from the ground up with task-based guides, architectural deep dives, and real-world examples for things like distributed log processing and edge ML.
• Hardened foundation: We've continued to strengthen security, authentication (with SSO), and reliability to ensure Bacalhau is ready for your most demanding production workloads.

Transformative Job Lifecycle Management

Bacalhau v1.8.0 introduces a fundamental transformation in how you manage computational workflows. We've moved beyond cryptic, auto-generated job IDs to a powerful name-based system that supports versioning, updates, and intelligent rerunning.

Goodbye j-f47ac10b-58cc-4372-a567-0e02b2c3d479

If you've ever felt the pain of managing workflows using nothing but UUIDs, this update is for you. We've completely reimagined job lifecycle management to be intuitive, version-controlled, and built for humans.

Jobs are now identified by meaningful names you define in your spec:

# Before: Cryptic UUID management
bacalhau job describe j-f47ac10b-58cc-4372-a567-0e02b2c3d479

# After: Intuitive name-based operations
bacalhau job describe monthly-sales-report-generator

Advanced Versioning and Dry-Run

Every job submission with an existing name creates a new version. The enhanced --dry-run functionality provides server-side diff previews, showing exactly what will change before applying updates:

# Preview changes with detailed diff
bacalhau job run --dry-run updated-pipeline.yaml

# Work with specific versions
bacalhau job logs data-analysis --version 2
bacalhau job describe ml-model-training --version 1

Intelligent Job Rerunning

The new rerun command eliminates the need to resubmit jobs. This avoids you from creating new versions of existing jobs while preserving history:

# Rerun the latest version
bacalhau job rerun data-processing-pipeline

# Rerun a specific version
bacalhau job rerun ml-training-job --version 3

Also, this versioning system is fully backward compatible: existing workflows using job IDs continue to work while new capabilities are available for adoption at your own pace.

What's next?

Bacalhau v1.8.0 is available now with full backward compatibility. Existing workflows continue to operate unchanged while new capabilities are available for immediate adoption:

• For Splunk Users: The Expanso Splunk application is available through Splunkbase and can be deployed in minutes to start realizing immediate cost savings.
• For Existing Users: Update to v1.8.0 to access enhanced daemon job orchestration, managed result storage, and the new job lifecycle management capabilities.
• For New Users: Our completely rebuilt documentation provides clear pathways for getting started with distributed computing, whether for cost optimization, edge processing, or advanced analytics.

v1.8.0

Compare

Choose a tag to compare

Bacalhau v1.7.0 Release Notes

This release introduces enterprise support options, enhanced partitioning capabilities, improved networking, comprehensive authentication, and significant WebAssembly enhancements.

Enterprise Support through Expanso

• Enterprise support now available through Expanso while maintaining Bacalhau's open source core
• Free tier for everyone supporting up to 5 nodes with all core features
• Enterprise licensing option for organizations requiring professional support

Expanso Cloud Enhancements

• Comprehensive job submission capabilities through the Expanso Cloud web interface
• Library of pre-defined job templates for common use cases:
  • Log processing workflows
  • Data analysis with DuckDB
  • Apache Iceberg operations
  • And more
• Custom template creation capabilities with parameterization
• Simplified complex distributed computing tasks while maintaining flexibility

Enhanced Job Execution with Partitioned Workloads

• Distribution of work across compute nodes with built-in partition management
• Horizontal scaling and parallel processing for improved performance
• Granular failure recovery with automatic retry mechanisms for failed partitions
• Independent partition execution with context through environment variables

S3 Storage Input Partitioning

• Automatic data distribution across multiple executions with graceful failure handling
• Multiple partitioning strategies:
  • Object-Based Distribution: Even distribution without specific grouping
  • Date-Based Partitioning: Parallel processing for time-series analysis
  • Regex Pattern Matching: Distribution by patterns in file paths
  • Substring-Based Partitioning: Organization by customer segments
• Combined partitioned data with shared reference data support

S3 Publishing Enhancements

• Plain encoding support for direct access to job outputs without compression
• Individual file publishing rather than compressed archives
• Efficient access to individual files with no decompression overhead
• Default gzip encoding still available for complete result sets

Enhanced Networking Capabilities

• Networking enabled by default (shifted from opt-in to opt-out)
• Configuration option for restricting network access
• Experimental port mapping support
• Multiple network modes: bridge (default), host, and none

Comprehensive Authentication and Authorization

• Redesigned authentication system with multiple methods:
  • Basic authentication
  • API tokens
  • Single Sign-On (SSO)
• Fine-grained authorization controls
• New CLI commands for authentication management

Host Environment Variable Forwarding

• Access to specified environment variables from the host system
• Secure credential passing through a controlled allowlist mechanism
• Reference host variables using env: prefix in job specifications

Improved WebAssembly Support

• Refactored WASM job specification with better separation of concerns
• Remote modules defined as input sources for alignment with other executors
• HTTP networking support for WebAssembly through new host function implementation
• Configurable network access modes and security controls
• TinyGo-compatible client library for HTTP functionality

Docker DinD Integration

• Docker-in-Docker images for simplified containerized deployment
• Two image variants:
  • Standard base image for client usage and orchestrator nodes
  • DinD image for compute nodes running Docker workloads
• Pre-configured Docker daemon for simple integration with container ecosystems

Performance and Quality of Life Improvements

• Enhanced resource management and more efficient state tracking
• count field now defaults to 1 instead of 0
• NetworkDefault type for automatic networking configuration

Documentation & Resources

Explore the complete release details including FAQs, implementation guides and enterprise licensing information in our comprehensive v1.7.0 documentation. The full documentation includes detailed answers to common questions about partitioning strategies, authentication methods, S3 integration, and enterprise support options.

New Contributors

• @virajbhartiya made their first contribution in #4848
• @haixuanTao made their first contribution in #4857
• @Olg-K made their first contribution in #4873

Full Changelog: v1.6.0...v1.7.0

v1.7.0

Compare

Choose a tag to compare

What's Changed

• Make Authentication Bypass test more robust by @jamlo in #4901
• bacalhau auth info by @jamlo in #4902
• Redact sensitive info from agent config command by @jamlo in #4903
• Modify auth sso login syntax and add logout command by @jamlo in #4904
• Add "bacalhau auth sso token" command by @jamlo in #4905
• Fix SSO Login regression by @jamlo in #4907
• fix regression in not setting log level by @wdbaruni in #4910
• Avoid setting default network config when nil by @wdbaruni in #4911

Full Changelog: v1.7.0-rc1...v1.7.0-rc2

v1.7.0-rc2 Pre-release

Pre-release

Compare

Choose a tag to compare

Bacalhau v1.7.0 Release Notes

This release introduces enterprise support options, enhanced partitioning capabilities, improved networking, comprehensive authentication, and significant WebAssembly enhancements.

Enterprise Support through Expanso

• Enterprise support now available through Expanso while maintaining Bacalhau's open source core
• Free tier for everyone supporting up to 5 nodes with all core features
• Enterprise licensing option for organizations requiring professional support

Expanso Cloud Enhancements

• Comprehensive job submission capabilities through the Expanso Cloud web interface
• Library of pre-defined job templates for common use cases:
  • Log processing workflows
  • Data analysis with DuckDB
  • Apache Iceberg operations
  • And more
• Custom template creation capabilities with parameterization
• Simplified complex distributed computing tasks while maintaining flexibility

Enhanced Job Execution with Partitioned Workloads

• Distribution of work across compute nodes with built-in partition management
• Horizontal scaling and parallel processing for improved performance
• Granular failure recovery with automatic retry mechanisms for failed partitions
• Independent partition execution with context through environment variables

S3 Storage Input Partitioning

• Automatic data distribution across multiple executions with graceful failure handling
• Multiple partitioning strategies:
  • Object-Based Distribution: Even distribution without specific grouping
  • Date-Based Partitioning: Parallel processing for time-series analysis
  • Regex Pattern Matching: Distribution by patterns in file paths
  • Substring-Based Partitioning: Organization by customer segments
• Combined partitioned data with shared reference data support

S3 Publishing Enhancements

• Plain encoding support for direct access to job outputs without compression
• Individual file publishing rather than compressed archives
• Efficient access to individual files with no decompression overhead
• Default gzip encoding still available for complete result sets

Enhanced Networking Capabilities

• Networking enabled by default (shifted from opt-in to opt-out)
• Configuration option for restricting network access
• Experimental port mapping support
• Multiple network modes: bridge (default), host, and none

Comprehensive Authentication and Authorization

• Redesigned authentication system with multiple methods:
  • Basic authentication
  • API tokens
  • Single Sign-On (SSO)
• Fine-grained authorization controls
• New CLI commands for authentication management

Host Environment Variable Forwarding

• Access to specified environment variables from the host system
• Secure credential passing through a controlled allowlist mechanism
• Reference host variables using env: prefix in job specifications

Improved WebAssembly Support

• Refactored WASM job specification with better separation of concerns
• Remote modules defined as input sources for alignment with other executors
• HTTP networking support for WebAssembly through new host function implementation
• Configurable network access modes and security controls
• TinyGo-compatible client library for HTTP functionality

Docker DinD Integration

• Docker-in-Docker images for simplified containerized deployment
• Two image variants:
  • Standard base image for client usage and orchestrator nodes
  • DinD image for compute nodes running Docker workloads
• Pre-configured Docker daemon for simple integration with container ecosystems

Performance and Quality of Life Improvements

• Enhanced resource management and more efficient state tracking
• count field now defaults to 1 instead of 0
• NetworkDefault type for automatic networking configuration

New Contributors

• @virajbhartiya made their first contribution in #4848
• @haixuanTao made their first contribution in #4857
• @Olg-K made their first contribution in #4873

Full Changelog: v1.6.0...v1.7.0-rc1

v1.7.0-rc1 Pre-release

Pre-release

Compare

Choose a tag to compare

Feature Enhancements and Fixes

Important Networking Changes

• Networking Opt-Out Configuration: Added new JobAdmissionControl.RejectNetworkedJobs configuration to allow users to explicitly opt-out of networking. Currently, Bacalhau rejects networking by default and requires users to opt-in using JobAdmissionControl.AcceptNetworkedJobs=true. This new parameter is the first phase of a major change where networking will be enabled by default in v1.7 (planned for release in the coming weeks). Users who need to maintain disabled networking should begin transitioning to the new RejectNetworkedJobs=true configuration now to ensure a smooth upgrade path.

Job Configuration Enhancements

• Default Count Parameter: Fixed a significant usability issue where batch/service jobs would silently fail when no count was specified. The system now automatically sets the count field to 1 when not explicitly provided, eliminating confusion for new users. Explicit count=0 settings are still respected for intentionally stopping jobs.

Docker Image Handling

• Platform Compatibility Verification: Fixed the platform compatibility check for locally cached Docker images, ensuring that jobs correctly identify and utilize compatible images across different environments.

New Contributors

• @haixuanTao made their first contribution in #4857

Full Changelog: [v1.6.4...v1.6.5](v1.6.4...v1.6.5)

v1.6.5

Compare

Choose a tag to compare