Notable Changes

• 🎯 Major fine-tuning improvements. Train with more dataset formats and sources, combine multiple datasets, tune preferences with DPO, focus training on assistant responses, and export portable PEFT LoRA adapters. Fine-tuning is also more reproducible and cache-efficient, with safer GPU access and immutable model snapshots. Existing Alpaca, full-sequence loss, and GGUF behavior remain the defaults. #814 #815 #827 #830 #831 #832 #833 #834 #835 #837 #838
• 🟠 AMD ROCm and Strix Halo support. Build hardware-accelerated inference images for supported AMD GPUs. Thanks @keithmattix for this contribution. #771
• ⚡ Faster builds and smaller images. Project benchmarks show large BuildKit graphs improving by up to 82% and 1,000-file packaging operations by 76–89%. Measured llama.cpp runner images are also 29–38% smaller. #805 #819
• 🚀 Preload models at startup. The new opt-in loadToMemory setting can warm selected LocalAI models when a container starts. #836

What's changed?

Features

• Add AMD ROCm and Strix Halo inference support. #771
• Expand fine-tuning dataset formats, loaders, and multi-dataset support. #827 #830 #831 #832 #833 #834
• Add DPO preference tuning. #835
• Load configured inference models at startup. #836
• Export portable PEFT LoRA adapter bundles. #838

Bug Fixes

• Restore compatibility with the current Unsloth and TRL stack. #814
• Regenerate cached model configurations when switching inference backends. #818
• Harden remote dataset loading, validation, timeouts, and cache handling. #837

Performance Improvements

• Optimize BuildKit graphs, local contexts, and model packaging. #805
• Make Unsloth builds reproducible and cache-aware. #815
• Reduce published inference runner image sizes. #819

Chores

• Update LocalAI to v4.7.1. #813
• Update Unsloth and Unsloth Zoo to 2026.8.3. #828

New Contributors

• @keithmattix made their first contribution in #771

Full Changelog: v0.21.0...v0.22.1

Features

• update LocalAI to v4.0.0 (#750) #750 (Sertaç Özercan)

Bug Fixes

• add org.opencontainers.image.title for filenames (#681) #681 (Sertaç Özercan)
• packager exclude (#701) #701 (Sertaç Özercan)
• enable grammar-constrained function calling for Llama models (#711) #711 (Robbie Cronin)

Documentation

• fix packager docs (#680) #680 (Sertaç Özercan)
• replace AGENTS.md with research-backed CLAUDE.md (#749) #749 (Sertaç Özercan)

Chores

• Prepare v0.20.0 release (#679) #679 (github-actions[bot])
• deps: Bump python from 3.12-slim to 3.14-slim #684 (dependabot[bot])
• deps: Bump python from 3.12-slim to 3.14-slim (#684) #684 (github-actions[bot])
• deps: Bump github.com/containerd/containerd/v2 #687 (dependabot[bot])
• deps: Bump github.com/containerd/containerd/v2 from 2.1.4 to 2.1.5 in the go_modules group across 1 directory (#687) #687 (github-actions[bot])
• deps: Bump github.com/containerd/platforms #688 (dependabot[bot])
• deps: Bump github.com/containerd/platforms from 1.0.0-rc.1 to 1.0.0-rc.2 (#688) #688 (github-actions[bot])
• deps: Bump github.com/moby/buildkit from 0.25.1 to 0.25.2 #690 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.25.1 to 0.25.2 (#690) #690 (github-actions[bot])
• deps: Bump golang.org/x/sync from 0.17.0 to 0.18.0 #689 (dependabot[bot])
• deps: Bump golang.org/x/sync from 0.17.0 to 0.18.0 (#689) #689 (github-actions[bot])
• deps: Bump golang.org/x/crypto #694 (dependabot[bot])
• deps: Bump golang.org/x/crypto from 0.40.0 to 0.45.0 in the go_modules group across 1 directory (#694) #694 (github-actions[bot])
• deps: Bump google.golang.org/grpc from 1.76.0 to 1.77.0 #696 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.76.0 to 1.77.0 (#696) #696 (github-actions[bot])
• deps: Bump github.com/moby/buildkit from 0.25.2 to 0.26.2 #697 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.25.2 to 0.26.2 (#697) #697 (github-actions[bot])
• deps: Bump the actions-all group across 1 directory with 15 updates #699 (dependabot[bot])
• deps: Bump the actions-all group across 1 directory with 15 updates (#699) #699 (github-actions[bot])
• deps: Bump golang from ee420c1 to 7419f54 (#691) #691 (dependabot[bot])
• bump localai v3.8.0 (#704) #704 (Sertaç Özercan)
• deps: Bump kubectl from v1.34.1 to v1.34.2 in /charts/aikit #698 (dependabot[bot])
• deps: Bump kubectl from v1.34.1 to v1.34.2 in /charts/aikit (#698) #698 (github-actions[bot])
• deps: Bump fedora from 41 to 43 #707 (dependabot[bot])
• deps: Bump fedora from 41 to 43 (#707) #707 (github-actions[bot])
• deps: Bump golang from 7419f54 to 5117d68 #708 (dependabot[bot])
• deps: Bump golang from 7419f54 to 5117d68 (#708) #708 (github-actions[bot])
• deps: Bump golang.org/x/sync from 0.18.0 to 0.19.0 #712 (dependabot[bot])
• deps: Bump golang.org/x/sync from 0.18.0 to 0.19.0 (#712) #712 (github-actions[bot])
• deps: Bump github.com/moby/buildkit from 0.26.2 to 0.26.3 #716 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.26.2 to 0.26.3 (#716) #716 (github-actions[bot])
• deps: Bump google.golang.org/grpc from 1.77.0 to 1.78.0 #720 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.77.0 to 1.78.0 (#720) #720 (github-actions[bot])
• deps: Bump the actions-all group across 1 directory with 10 updates #718 (dependabot[bot])
• deps: Bump the actions-all group across 1 directory with 10 updates (#718) #718 (github-actions[bot])
• deps: Bump the actions-all group with 2 updates #721 (dependabot[bot])
• deps: Bump the actions-all group with 2 updates (#721) #721 (github-actions[bot])
• deps: Bump github.com/sirupsen/logrus from 1.9.3 to 1.9.4 #722 (dependabot[bot])
• deps: Bump github.com/sirupsen/logrus from 1.9.3 to 1.9.4 (#722) #722 (github-actions[bot])
• deps: Bump the actions-all group across 1 directory with 6 updates #725 (dependabot[bot])
• deps: Bump the actions-all group across 1 directory with 6 updates (#725) #725 (github-actions[bot])
• deps: Bump the actions-all group with 4 updates #727 (dependabot[bot])
• deps: Bump the actions-all group with 4 updates (#727) #727 (github-actions[bot])
• deps: Bump golang from 5117d68 to 09f53de (#713) #713 (dependabot[bot])
• deps: Bump kubectl from v1.34.2 to v1.35.0 in /charts/aikit (#717) #717 (dependabot[bot])
• deps: Bump golang from 09f53de to 38342f3 #729 (dependabot[bot])
• deps: Bump golang from 09f53de to 38342f3 (#729) #729 (github-actions[bot])
• deps: Bump google.golang.org/grpc from 1.78.0 to 1.79.1 #731 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.78.0 to 1.79.1 (#731) #731 (github-actions[bot])
• deps: Bump the actions-all group across 1 directory with 4 updates #736 (dependabot[bot])
• deps: Bump the actions-all group across 1 directory with 4 updates (#736) #736 (github-actions[bot])
• deps: Bump go.opentelemetry.io/otel/sdk #737 (dependabot[bot])
• deps: Bump go.opentelemetry.io/otel/sdk from 1.39.0 to 1.40.0 in the go_modules group across 1 directory (#737) #737 (github-actions[bot])
• deps: Bump kubectl from v1.35.0 to v1.35.2 in /charts/aikit #738 (dependabot[bot])
• deps: Bump kubectl from v1.35.0 to v1.35.2 in /charts/aikit (#738) #738 (github-actions[bot])
• deps: Bump google.golang.org/grpc from 1.79.1 to 1.79.2 #741 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.79.1 to 1.79.2 (#741) #741 (github-actions[bot])
• deps: Bump golang from 1.25-bookworm to 1.26-bookworm (#732) #732 (dependabot[bot])
• deps: Bump the actions-all group across 1 directory with 14 updates (#742) #742 (dependabot[bot])
• deps: Bump LocalAI from v3.8.0 to v3.12.1 (#743) #743 (Sertaç Özercan)
• update Go to 1.26 (#746) #746 (Sertaç Özercan)
• deps: Bump golang from eae3cdf to c7a82e9 #751 (dependabot[bot])
• deps: Bump golang from eae3cdf to c7a82e9 (#751) #751 (github-actions[bot])
• deps: Bump fedora from 6cd815d to 781b764 #733 (dependabot[bot])
• deps: Bump fedora from 6cd815d to 781b764 (#733) #733 (github-actions[bot])
• deps: Bump github.com/moby/buildkit from 0.26.3 to 0.28.0 (#752) #752 (dependabot[bot])
• deps: Bump the actions-all group with 2 updates (#753) #753 (dependabot[bot])
• deps: Bump golang.org/x/sync from 0.19.0 to 0.20.0 #740 (dependabot[bot])
• deps: Bump golang.org/x/sync from 0.19.0 to 0.20.0 (#740) #740 (github-actions[bot])
• Prepare v0.21.0 release (#755) #755 (github-actions[bot])

Commits

• f7c08a3: Update localai to v3.7.0 (#693) (Robbie Cronin) #693
• 109b14f: Add vLLM backend support (#745) (Sertaç Özercan) #745
• bd7072d: Add runtime images without models (#747) (Sertaç Özercan) #747

Notable Changes

• 📦 Package AI models as OCI artifacts for distribution from local, HTTP, or Hugging Face sources via container registries, supporting both generic OCI format and the CNCF ModelPack specification.
• ✨ Update to LocalAI v3.8.0.

Chores

• cherry pick #704 (#705) #705 (Sertaç Özercan)
• Prepare v0.20.3 release (#706) #706 (github-actions[bot])

Notable Changes

• 📦 Package AI models as OCI artifacts for distribution from local, HTTP, or Hugging Face sources via container registries, supporting both generic OCI format and the CNCF ModelPack specification.
• ✨ Update to LocalAI v3.7.0.

Chores

• Prepare v0.20.2 release (#703) #703 (github-actions[bot])

Commits

• 76ba70a: cherry pick #693 and #701 (#702) (Sertaç Özercan) #702

Notable Changes

📦 Package AI models as OCI artifacts for distribution from local, HTTP, or Hugging Face sources via container registries, supporting both generic OCI format and the CNCF ModelPack specification.

Bug Fixes

• cherry pick #681 (#682) #682 (Sertaç Özercan)

Chores

• Prepare v0.20.1 release (#683) #683 (github-actions[bot])

Notable Changes

📦 Package AI models as OCI artifacts for distribution from local, HTTP, or Hugging Face sources via container registries, supporting both generic OCI format and the CNCF ModelPack specification.

What's changed?

Features

• OCI packager (#649) #649 (Sertaç Özercan)

Bug Fixes

• handle multi meta backends and cpu fallback for cuda (#618) #618 (Sertaç Özercan)

Continuous Integration

• use large runners (#619) #619 (Sertaç Özercan)
• update models on large runners (#626) #626 (Sertaç Özercan)
• mirror localai to ghcr (#644) #644 (Sertaç Özercan)
• pin issue triage action (#669) #669 (Sertaç Özercan)
• pin issue triage action (#670) #670 (Sertaç Özercan)
• pin issue triage action part 3 (#671) #671 (Sertaç Özercan)
• update gh aw (#672) #672 (Sertaç Özercan)

Chores

• Prepare v0.19.0 release (#610) #610 (github-actions[bot])
• deps: Bump the actions-all group with 2 updates #615 (dependabot[bot])
• deps: Bump the actions-all group with 2 updates (#615) #615 (github-actions[bot])
• deps: Bump google.golang.org/grpc from 1.74.2 to 1.75.0 (#617) #617 (dependabot[bot])
• deps: Bump golang from 74908ad to 81dc45d (#616) #616 (dependabot[bot])
• update base (#622) #622 (Sertaç Özercan)
• update version (#634) #634 (Sertaç Özercan)
• deps: Bump kubectl from v1.33.4 to v1.34.0 in /charts/aikit #636 (dependabot[bot])
• deps: Bump kubectl from v1.33.4 to v1.34.0 in /charts/aikit (#636) #636 (github-actions[bot])
• deps: Bump the actions-all group across 1 directory with 2 updates #639 (dependabot[bot])
• deps: Bump the actions-all group across 1 directory with 2 updates (#639) #639 (github-actions[bot])
• deps: Bump golang from 81dc45d to 6ad9415 #640 (dependabot[bot])
• deps: Bump golang from 81dc45d to 6ad9415 (#640) #640 (github-actions[bot])
• deps: Bump golang.org/x/sync from 0.16.0 to 0.17.0 #641 (dependabot[bot])
• deps: Bump golang.org/x/sync from 0.16.0 to 0.17.0 (#641) #641 (github-actions[bot])
• localai v3.5.0 (#648) #648 (Sertaç Özercan)
• deps: Bump the actions-all group across 1 directory with 4 updates (#647) #647 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.75.0 to 1.75.1 #650 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.75.0 to 1.75.1 (#650) #650 (github-actions[bot])
• deps: Bump kubectl from v1.34.0 to v1.34.1 in /charts/aikit (#653) #653 (dependabot[bot])
• deps: Bump golang from 6ad9415 to c4bc074 (#651) #651 (dependabot[bot])
• deps: Bump sigstore/cosign-installer from 3.9.2 to 3.10.0 in the actions-all group (#652) #652 (dependabot[bot])
• deps: Bump golang from c4bc074 to c423747 #657 (dependabot[bot])
• deps: Bump golang from c4bc074 to c423747 (#657) #657 (github-actions[bot])
• deps: Bump the actions-all group across 1 directory with 5 updates (#658) #658 (dependabot[bot])
• localai v3.6.0 (#654) #654 (Sertaç Özercan)
• deps: Bump golang from c423747 to 42d8e9d #661 (dependabot[bot])
• deps: Bump golang from c423747 to 42d8e9d (#661) #661 (github-actions[bot])
• deps: Bump golang from 42d8e9d to 51b6b12 #665 (dependabot[bot])
• deps: Bump golang from 42d8e9d to 51b6b12 (#665) #665 (github-actions[bot])
• deps: Bump github.com/moby/buildkit from 0.25.0 to 0.25.1 (#663) #663 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.75.1 to 1.76.0 (#662) #662 (dependabot[bot])
• deps: Bump the actions-all group across 1 directory with 5 updates (#666) #666 (dependabot[bot])
• deps: Bump golang from 51b6b12 to ee420c1 #676 (dependabot[bot])
• deps: Bump golang from 51b6b12 to ee420c1 (#676) #676 (github-actions[bot])
• Prepare v0.20.0 release (#678) #678 (github-actions[bot])

Commits

• 143559a: Fix release-pr workflow permissions for label creation (#612) (Copilot) #612
• c200b6c: Fix image repository version in Kubernetes docs (#627) (Robbie Cronin) #627
• 186aa23: [BUG] Update Helm chart default image from llama3 to llama3.1 and fix model names in documentation (#629) (Copilot) #629
• 6babe48: Add agentic workflow issue-triage (#667) (Sertaç Özercan) #667
• 62081b6: Add agentic workflow daily-test-improver (#673) (Sertaç Özercan) #673

New Contributors

• @robert-cronin made their first contribution in #627

Full Changelog: v0.19.0...v0.20.0

Chores

• cherry pick #654 and friends (#659) #659 (Sertaç Özercan)
• Prepare v0.19.4 release (#660) #660 (github-actions[bot])

Continuous Integration

• mirror localai to ghcr (#645) #645 (Sertaç Özercan)

Chores

• Prepare v0.19.3 release (#646) #646 (github-actions[bot])

Bug Fixes

• cherry pick #629 (#631) #631 (Sertaç Özercan)

Chores

• Prepare v0.19.2 release (#632) #632 (github-actions[bot])

Bug Fixes

• cherry pick #618 #619 (#620) #620 (Sertaç Özercan)

Chores

• Prepare v0.19.0 release (#609) (#624) #624 (Sertaç Özercan)
• Prepare v0.19.1 release (#625) #625 (github-actions[bot])