PyPI · #48 most downloaded on PyPI

litellm

1.103.0639M downloads/moBerriAI/litellm ↗New releases in your daily digest, changelog included.

Library to easily interface with LLM API providers

Last release today
28 Sep 2026
Ships on a steady schedule
a new release about every 8 days
Nearly every release is documented
notes for 59 of the last 60 stable releases
4 versions withdrawn
withdrawn after publishing
3 years old
1228 releases · first in 2023

Release timeline

1228 releases since 2023

2023202420252026

20232026

One column per quarter.

Releases

1.97.016 Aug 2026
All LiteLLM Docker images are signed with cosign . Every release is signed with the same key introduced in commit 0112e53 .
Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.97.0

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.97.0/cosign.pub \ ghcr.io/berriai/litellm:v1.97.0

Expected output:

The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key

What's Changed

feat(proxy): resolve Cursor thinking/fast model-name suffixes on /cursor/chat/completions by @mateo-berri in #35554

fix(team-callbacks): actually stop logging when disable_logging is called by @yucheng-berri in #35520

refactor(lint): drop redundant !s f-string conversion flags and fix displaced import-group comments by @mateo-berri in #35546

fix(proxy): backfill null user_email on existing users during JWT auth by @devin-ai-integration[bot] in #34588

feat(playground): add non-streaming response toggle by @ryan-crabbe-berri in #35560

feat(teams): apply default organization to new teams from default team settings by @ryan-crabbe-berri in #35540

fix(ui): block Playground page for viewer roles on direct URL access by @ryan-crabbe-berri in #35676

fix(caching): close evicted LLM clients so their connections are reclaimed by @yassin-berriai in #35492

chore(deps): update brace-expansion, postcss, and gitpython to current patch releases by @yuneng-berri in #35692

refactor(ui): rename the create MCP server component to PascalCase by @yuneng-berri in #35686

fix(openai): drop undefined Union from owns_wrapped_http_client annotation by @ryan-crabbe-berri in #35706

fix(openai): drop the undefined Union from owns_wrapped_http_client by @devin-ai-integration[bot] in #35704

chore(ui): note Google's Agent Platform rename in vector store setup by @ryan-crabbe-berri in #28076

fix(proxy): apply key/team router_settings.model_group_alias by @yassin-berriai in #35486

feat(complexity_router): default session affinity off and expose it in the UI by @tin-berri in #35714

fix(datadog): read team callback dd_* params from kwargs instead of blocked dynamic params (#35115 port) by @ryan-crabbe-berri in #35687

refactor(ui): extract the MCP create form's logic and field groups by @yuneng-berri in #35694

test(ui): tier the MCP create tests into unit and integration by @yuneng-berri in #35697

fix(proxy): redact credential headers from request logging copies by @yucheng-berri in #35678

feat(guardrails/rubrik): prompt moderation, response-text blocking, streaming buffer, failure logging by @devin-ai-integration[bot] in #35722

fix(ui): render Responses API request and response in the logs drawer by @yuneng-berri in #35718

fix(ui): hide guardrail review buttons from non-admin users by @ryan-crabbe-berri in #27535

feat(team): custom metadata validation hook for team create and update by @yuneng-berri in #33353

ci(circleci): install a pinned Rust toolchain on the Linux jobs by @yuneng-berri in #35519

fix(bedrock): stop forwarding no-op toolSpec.strict to Converse by @tin-berri in #35688

fix(ui): reject an auto-router keyword rule left empty instead of dropping it by @tin-berri in #35705

fix(guardrails/rubrik): attribute blocked requests to the caller that made them by @yucheng-berri in #35734

fix(responses): forward client headers to the provider on /v1/responses by @devin-ai-integration[bot] in #34531

feat(spend): add net auto-router savings to the cost-optimization dashboard by @tin-berri in #35521

chore(typing): clear basedpyright Any errors in budget reset, access groups, and cache settings by @mateo-berri in #35719

fix(spend): read what a request cost from the record instead of pricing it again by @tin-berri in #35736

perf: install hiredis so redis-py parses replies with its C parser by @Classic298 in #35709

feat(ui): show auto-router savings on the cost-optimization dashboard by @tin-berri in #35522

perf: build log messages lazily so filtered-out log records cost nothing by @Classic298 in #35703

fix(proxy): retry model cost map fetch with Retry-After-aware backoff and keep current map on reload failure by @ryan-crabbe-berri in #35739

feat(otel): stamp service tier attributes on inference spans by @devin-ai-integration[bot] in #35679

fix(proxy): log the model cost map reload failure lazily by @tin-berri in #35750

fix(groq): translate web_search_options to the browser_search tool by @hMED22 in #34971

feat(ui): add admin-configurable user banner by @yuneng-berri in #35729

fix(e2e): make spend-counter redis connection env-driven for non-cluster deployments by @yuneng-berri in #35732

fix(proxy): make /cursor/chat/completions work with Cursor agent mode by @tin-berri in #34029

fix(proxy): propagate user_email and bind api_key on JWT auth attribution paths by @devin-ai-integration[bot] in #34331

chore(build): move the Admin UI toolchain to Node 24 by @yuneng-berri in #35801

test(e2e): vendor API strategy coverage across endpoints by @mubashir1osmani in #34649

chore(deps): upgrade cryptography to 50.0.0 by @yuneng-berri in #35803

test(e2e): cover legacy text /completions endpoint by @mubashir1osmani in #34431

feat(gemini): add gemini-robotics-er-2-preview and gemini-robotics-er-1.6-preview by @devin-ai-integration[bot] in #35555

test(e2e): move load/perf testing out of the main suite and drop the vllm passthrough test by @yuneng-berri in #35820

feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) by @mateo-berri in #35807

chore: bump litellm-proxy-extras 0.4.81 -> 0.4.82, litellm 1.96.0 -> 1.97.0 by @yuneng-berri in #35810

fix(bedrock): drop conflicting tool_choice.type when toolConfig.toolChoice is set by @devin-ai-integration[bot] in #35738

docs(CLAUDE.md): prefer commas over semicolons when replacing em dashes by @mateo-berri in #35825

chore(lint): zero out basedpyright headroom for purely local rules by @mateo-berri in #35828

test(e2e): retry provider-transient statuses at the transport with bounded backoff by @yuneng-berri in #35824

chore(ci): promote internal staging to main by @yuneng-berri in #35836

refactor(ui): route MCP session tokens through the shared storage helper by @yuneng-berri in #35835

docs(helm): replace the classic chart's 128Mi resource example with the documented 4Gi sizing by @yassin-berriai in #35830

fix(proxy): persist periodic reload schedule state so status survives restarts and fires without store_model_in_db by @ryan-crabbe-berri in #35165

fix(router): eagerly fetch Vertex AI deferred stream to surface HTTP errors in _acompletion fallback path by @deepanshululla in #34627

fix(azure_storage): honor AZURE_STORAGE_ENDPOINT_SUFFIX for sovereign clouds by @yucheng-berri in #35806

fix(proxy): apply key_alias/key_hash filters to all /key/list visibility branches by @ryan-crabbe-berri in #35840

fix(proxy): enforce per-model budgets against resolved cursor model variants by @mateo-berri in #35834

feat(ui): reorder Add Auto Router into name + template, with a collapsible detailed config by @tin-berri in #35746

test: repair three failing suites on litellm_internal_staging by @yuneng-berri in #35845

fix(guardrails): scan model output on the /openai/v1/responses alias by @yucheng-berri in #35818

ci: pin Node on the Playwright UI lanes so npm ci meets the engines floor by @yuneng-berri in #35848

fix(pricing): apply OpenAI's gpt-5.6 terra/luna cut to Azure cost map by @mubashir1osmani in #35481

feat(spend): add caller-scoped key/user/team/organization spend report endpoints by @yuneng-berri in #35725

revert: "fix(caching): close evicted LLM clients so their connections are reclaimed (#35492)" by @mateo-berri in #35856

refactor(repositories): add prisma protocol seams and a spend-reset unit of work by @mateo-berri in #35748

perf(streaming): assemble streamed tool-call arguments in linear time by @mateo-berri in #35826

fix(s3_v2): sign S3 object URLs with S3SigV4Auth so encoded paths verify by @devin-ai-integration[bot] in #35726

test(e2e): self-seed the ui suite's password-login users in global setup by @yuneng-berri in #35863

fix(claude-code): create-only skill registration with a PUT update route (LIT-4110) by @ryan-crabbe-berri in #31752

fix(proxy): fix zguard httpcode when block input by @jwang-gif in #31948

fix(lint): pick the merge-aware base so in-progress merges are not blamed for base drift by @mateo-berri in #35868

chore: bump litellm-proxy-extras 0.4.82 -> 0.4.83 by @yuneng-berri in #35877

feat(ui): add Test Routing to the auto router create form by @devin-ai-integration[bot] in #35859

fix(ui): derive auto-router preset tests from the bundled preset JSON by @tin-berri in #35882

revert: "test(e2e): vendor API strategy coverage across endpoints" (#34649) by @yuneng-berri in #35881

chore(deps): bump grpc and golang.org/x modules in the terraform provider by @yuneng-berri in #35844

test(e2e): skip view-backed global spend probes pending LIT-5211 by @yuneng-berri in #35875

fix(lint): move the basedpyright heap flag into the type check gate by @mateo-berri in #35869

chore(ci): promote internal staging to main by @yuneng-berri in #35876

feat(ui): add role capability gating, migrate Tool Policies route by @yuneng-berri in #35812

refactor(ui): inject the fetch client's base url instead of reading it at import by @yuneng-berri in #35802

chore: remove unused .flake8 config and flake8 dev dependency by @mateo-berri in #35888

chore: stop advising pre-commit and bootstrap by @mateo-berri in #35884

fix(auth): name enable_jwt_auth when a JWT-shaped key is rejected by @yassin-berriai in #35831

feat(auto-router): make reminder marker pair configurable by @akapur99 in #35874

fix(UI): update anthropic model presets by @tin-berri in #35896

fix(bootstrap): switch to the dashboard node floor via nvm or fnm by @mateo-berri in #35895

perf(pre-commit): run python, dashboard, and gen-api checks concurrently by @mateo-berri in #35903

feat(spend): derive a default auto-router savings baseline from the hardest tier by @tin-berri in #35907

fix(http_handler): self-heal handler clients closed after cache eviction by @mateo-berri in #35862

fix(cost_tracking): keep OpenAI prompt cache token details through usage reassembly by @devin-ai-integration[bot] in #34812

fix(cost): bill gpt-5.6 prompt cache reads at the cache read rate by @devin-ai-integration[bot] in #34957

fix(batches): account for Responses API usage by @rimysore in #35367

ci: retry Codecov uploads and stop failing jobs on OIDC token flakes by @mateo-berri in #35251

feat(complexity_router): let operators rename the four complexity tiers by @akapur99 in #35893

chore(lint): zero stale ruff and LIT headroom and strip inert type: ignore comments by @mateo-berri in #35928

chore(lint): zero out seven more purely local basedpyright rules by @mateo-berri in #35927

chore(ui): zero stale headroom on local dashboard eslint budgets by @mateo-berri in #35929

fix(managed-files): skip rows without file objects by @rimysore in #35365

fix(router): redact fallback tracebacks at the call site and cover the sync deferred stream by @yassin-berriai in #35843

fix(migrations): recover from an interrupted Prisma toolchain install by @yassin-berriai in #35832

fix(lint): bring basedpyright rule counts back under their budget limits by @mateo-berri in #35962

chore(ui): don't zero out stale headroom except no-console by @mateo-berri in #35964

fix(proxy): give proxy_admin_viewer read parity with proxy_admin by @ryan-crabbe-berri in #35851

refactor(ui): address UI lint budget issues by refactoring UI by @tin-berri in #35960

fix(ci): make the env-key doc gate see get_secret_bool reads by @yassin-berriai in #35833

fix(caching): re-land evicted LLM clien
Note truncated.

1.97.0rc18 Aug 2026pre-release

All LiteLLM Docker images are signed with cosign . Every release is signed with the same key introduced in commit 0112e53 .

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.97.0-rc.1

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.97.0-rc.1/cosign.pub \
  ghcr.io/berriai/litellm:v1.97.0-rc.1

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

fix(azure_sentinel): respect AZURE_AUTHORITY_HOST and derive the Azure Monitor audience per cloud by @yucheng-berri in #36137
fix(bedrock): pass SSE-KMS key through to the batch input-file S3 upload by @devin-ai-integration[bot] in #35148
fix(anthropic adapter): stop indexing choices[0] on choiceless streaming chunks by @devin-ai-integration[bot] in #35314
fix(bedrock): normalize /v1/completions and /v1/responses batch records by @devin-ai-integration[bot] in #35675
fix(proxy): return the real status code when a credential update is rejected by @yucheng-berri in #36166
fix(proxy): improve Headroom /v1/compress HTTP 404 diagnostics by @aayush598 in #35952
fix(proxy): invalidate cached project object on project update and delete by @ryan-crabbe-berri in #36028
feat(proxy): add apply_user_budget_to_team_keys opt-in by @ryan-crabbe-berri in #36102
fix(proxy): stop alerting on health probes that lose the planned engine-restart race by @yassin-berriai in #36141
test(docker): gate the componentized gateway and backend images on an arbitrary-uid offline boot by @yassin-berriai in #36136
fix(http): stop pooled clients persisting cookies on the aiohttp jar too by @yassin-berriai in #36149
fix(router): bound fallback-walk work and error-log volume by @yassin-berriai in #36148
ci: wire credential_endpoints tests into the proxy endpoints job by @cursor[bot] in #36187
docs(keys): document /key/info fields and clarify budget_reset_at is the next reset by @ryan-crabbe-berri in #36127
fix(azure_sentinel): add AZURE_SENTINEL_AUTHORITY_HOST as a Sentinel scoped override by @yucheng-berri in #36165
docs(pr-template): add a User Flow section with authoring instructions by @mateo-berri in #36162
fix(proxy): derive config agent ids from agent_name so grants survive secret rotation by @ryan-crabbe-berri in #36020
chore(ui): regenerate schema.d.ts for the /key/info docstring update by @devin-ai-integration[bot] in #36210
build(deps): bump gitpython to 3.1.58 to clear osv-scan on staging by @devin-ai-integration[bot] in #36212
fix(proxy): deny agent access when key and team grants resolve to nothing by @ryan-crabbe-berri in #36221
build(deps): defer the second pypdf advisory until the 6.15.0 bump by @devin-ai-integration[bot] in #36218
fix(a2a): align agent list annotation and test with the tuple return type by @devin-ai-integration[bot] in #36217
ci: always run the UI API types sync check so it can be required by @devin-ai-integration[bot] in #36213
build(deps): bump nanoid to 3.3.17 in the dashboard lockfile by @devin-ai-integration[bot] in #36227
feat(ui): show user email or alias in usage data export by @ryan-crabbe-berri in #36232
feat(auto-router): track turns per complexity tier (LIT-5302) by @tin-berri in #36209
fix(websearch): restore snippet text in native web_search_tool_result blocks (LIT-5315) by @tin-berri in #36228
fix(proxy): resolve entity access groups in the model listing endpoints by @devin-ai-integration[bot] in #36230
fix(ui): let access groups be a team's only model source, with hover provenance by @ryan-crabbe-berri in #36234
fix(managed_files): return unified output file ids from GET /batches by @mateo-berri in #36049
test(proxy): compare empty agent list to the tuple get_agent_list returns by @devin-ai-integration[bot] in #36225
fix(otel): name the RPC system and upstream on MCP tool-call spans by @yucheng-berri in #35857
fix(guardrails): chunk oversized Bedrock ApplyGuardrail requests instead of failing by @yucheng-berri in #36119
test(e2e): settle control-plane writes across every replica, not just one by @yuneng-berri in #36247
fix(responses): forward allowed_openai_params through the chat completions bridge by @devin-ai-integration[bot] in #35885
test(proxy): assert the copy _add_team_member_budget_table returns by @devin-ai-integration[bot] in #36244
chore(ui): regenerate dashboard api types for tier_turns by @devin-ai-integration[bot] in #36243
refactor(types): declare mirrored pricing fields on ModelInfo by @devin-ai-integration[bot] in #36215
fix(lint): make strict-gate noqas survive base ruff and flag stale ones by @mateo-berri in #36257
fix(vertex_ai): surface real error/status on vertex batch create instead of IndexError 500 by @devin-ai-integration[bot] in #35141
ci: give the remaining pull_request workflows a concurrency group by @devin-ai-integration[bot] in #36252
refactor(lint): graduate zero-violation strict rules and guard the budget ratchet by @mateo-berri in #36161
fix(proxy): enforce require_managed_files on every route that accepts a raw provider id by @devin-ai-integration[bot] in #35551
chore(typing): clear 1.4k basedpyright Any errors across 21 hotspot files by @mateo-berri in #36282
test: roll back live router replay membership between tests by @mateo-berri in #36278
chore(ci): sync main into internal staging by @yuneng-berri in #36288
build(lint): rename make pre-commit to make check with a working-tree fallback by @mateo-berri in #36277
fix(ui): show team BYOK models in team fallback settings by @devin-ai-integration[bot] in #36241
fix(otel): mark v2 server spans as failed for pre-call errors by @devin-ai-integration[bot] in #34546
fix(websearch_interception): bill intercepted searches to the calling key by @devin-ai-integration[bot] in #35708
chore: remove pre-commit rule by @mateo-berri in #36295
docs: clarify guideline priority ordering in CLAUDE.md by @devin-ai-integration[bot] in #36296
feat(router): independent, default-on deployment affinity for the auto-router by @tin-berri in #36146
test: repair stale CircleCI contracts by @yuneng-berri in #36293
chore(ci): promote internal staging to main by @yuneng-berri in #36286
chore: rebuild Admin UI bundle for the 2026-08-08 release by @yuneng-berri in #36297
chore(ci): promote internal staging to main by @yuneng-berri in #36304

New Contributors

@aayush598 made their first contribution in #35952
@cursor[bot] made their first contribution in #36187

Full Changelog: v1.97.0-dev.2...v1.97.0-rc.1

Open source →

1.97.0.dev27 Aug 2026pre-release

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit `0112e53`.

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.97.0-dev.2

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.97.0-dev.2/cosign.pub \
  ghcr.io/berriai/litellm:v1.97.0-dev.2

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

feat(ui): add role capability gating, migrate Tool Policies route by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35812
refactor(ui): inject the fetch client's base url instead of reading it at import by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35802
chore: remove unused .flake8 config and flake8 dev dependency by @mateo-berri in https://github.com/BerriAI/litellm/pull/35888
chore: stop advising pre-commit and bootstrap by @mateo-berri in https://github.com/BerriAI/litellm/pull/35884
fix(auth): name enable_jwt_auth when a JWT-shaped key is rejected by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35831
feat(auto-router): make reminder marker pair configurable by @akapur99 in https://github.com/BerriAI/litellm/pull/35874
fix(UI): update anthropic model presets by @tin-berri in https://github.com/BerriAI/litellm/pull/35896
fix(bootstrap): switch to the dashboard node floor via nvm or fnm by @mateo-berri in https://github.com/BerriAI/litellm/pull/35895
perf(pre-commit): run python, dashboard, and gen-api checks concurrently by @mateo-berri in https://github.com/BerriAI/litellm/pull/35903
feat(spend): derive a default auto-router savings baseline from the hardest tier by @tin-berri in https://github.com/BerriAI/litellm/pull/35907
fix(http_handler): self-heal handler clients closed after cache eviction by @mateo-berri in https://github.com/BerriAI/litellm/pull/35862
fix(cost_tracking): keep OpenAI prompt cache token details through usage reassembly by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34812
fix(cost): bill gpt-5.6 prompt cache reads at the cache read rate by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34957
fix(batches): account for Responses API usage by @rimysore in https://github.com/BerriAI/litellm/pull/35367
ci: retry Codecov uploads and stop failing jobs on OIDC token flakes by @mateo-berri in https://github.com/BerriAI/litellm/pull/35251
feat(complexity_router): let operators rename the four complexity tiers by @akapur99 in https://github.com/BerriAI/litellm/pull/35893
chore(lint): zero stale ruff and LIT headroom and strip inert type: ignore comments by @mateo-berri in https://github.com/BerriAI/litellm/pull/35928
chore(lint): zero out seven more purely local basedpyright rules by @mateo-berri in https://github.com/BerriAI/litellm/pull/35927
chore(ui): zero stale headroom on local dashboard eslint budgets by @mateo-berri in https://github.com/BerriAI/litellm/pull/35929
fix(managed-files): skip rows without file objects by @rimysore in https://github.com/BerriAI/litellm/pull/35365
fix(router): redact fallback tracebacks at the call site and cover the sync deferred stream by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35843
fix(migrations): recover from an interrupted Prisma toolchain install by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35832
fix(lint): bring basedpyright rule counts back under their budget limits by @mateo-berri in https://github.com/BerriAI/litellm/pull/35962
chore(ui): don't zero out stale headroom except no-console by @mateo-berri in https://github.com/BerriAI/litellm/pull/35964
fix(proxy): give proxy_admin_viewer read parity with proxy_admin by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35851
refactor(ui): address UI lint budget issues by refactoring UI by @tin-berri in https://github.com/BerriAI/litellm/pull/35960
fix(ci): make the env-key doc gate see get_secret_bool reads by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35833
fix(caching): re-land evicted LLM client closing (#35492) atop self-healing handlers by @mateo-berri in https://github.com/BerriAI/litellm/pull/35870
fix(proxy): keep the connected DB client when a startup health check fails by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35837
chore(lint): remove litellm/types from the ruff lint exclusion by @mateo-berri in https://github.com/BerriAI/litellm/pull/35926
feat(sgr): make the gateway middleware the source of truth for successful requests by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35717
feat(auto-router): let operators replace the LLM classifier's system prompt by @akapur99 in https://github.com/BerriAI/litellm/pull/35855
fix(docker): bake the pip image's prisma engines at a world-readable path by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35976
fix(auth): return 403 from the OAuth2 enterprise gate by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35838
fix(router): keep custom model_info across a price data reload by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35491
fix(proxy): resolve pass-through credentials live from router deployments by @mateo-berri in https://github.com/BerriAI/litellm/pull/35916
fix(ci): fetch only head and merge-base in lint jobs instead of every branch by @mateo-berri in https://github.com/BerriAI/litellm/pull/35982
fix(autorouter): match CJK keyword_tier_rules that regex word boundaries miss by @akapur99 in https://github.com/BerriAI/litellm/pull/35984
feat(spend): rebuild the auto-router benchmarks backend as a per-session rollup by @tin-berri in https://github.com/BerriAI/litellm/pull/35910
refactor(ui): replace hand-rolled query-param routing with nuqs by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35871
fix(docker): bake the componentized prisma engines at /opt/prisma so any uid can start by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35989
fix(migrations): keep the toolchain heal from raising on an unreadable nodeenv cache by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35986
fix(bedrock): sign Bedrock managed-file S3 requests with S3SigV4Auth by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35983
chore(typing): replace Any seams with real types across responses, proxy, and provider adapters by @mateo-berri in https://github.com/BerriAI/litellm/pull/35809
fix(ai21): resolve the documented AI21_API_KEY instead of a misspelled name by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35985
fix(docker): fail the image build when the generated prisma engine paths drift off /opt/prisma by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35979
fix(jina_ai): resolve the documented JINA_API_KEY as a fallback by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35992
fix(proxy): only treat a recoverable database outage as grounds to serve without one by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35864
fix(ci): make every remaining CI checkout shallow by @mateo-berri in https://github.com/BerriAI/litellm/pull/35997
fix(auto-router): stop the embedding model's context window from failing long requests by @akapur99 in https://github.com/BerriAI/litellm/pull/35956
fix(ci): make the env-key doc gate see bare get_secret and get_secret_str reads by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35996
fix(logging): extend secret redaction to records litellm does not emit directly by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35977
test(utils): pin the register_model replay test to the recorded half by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35994
fix(ci): run every helm test suite, not just the first one per file by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35993
ci: fail the build when a test file or Dockerfile is invoked by no job by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35991
fix(langfuse): stop a collected httpx handler from closing a shared client by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35981
fix(bedrock): grant bedrock:CountTokens in OIDC session policy by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33145
feat(pre-commit): save full lint output to a per-worktree log file by @mateo-berri in https://github.com/BerriAI/litellm/pull/36004
feat(ui): match auto-router preset models against deployments' underlying model IDs by @tin-berri in https://github.com/BerriAI/litellm/pull/35972
fix(core_helpers): map generic 'error' finish_reason to 'stop' by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33972
fix(proxy)!: apply request-parameter checks consistently across body, path and form inputs by @yuneng-berri in https://github.com/BerriAI/litellm/pull/36011
fix: rebuild models_by_provider in add_known_models so cost map reloads reach wildcard expansion by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/36010
feat(complexity_router): report LLM classifier cost per request via routing_decision and x-litellm-classifier-cost header by @tin-berri in https://github.com/BerriAI/litellm/pull/36015
fix(model-prices): correct replicate model key typo by @AkashNaickar in https://github.com/BerriAI/litellm/pull/34800
fix(proxy): register managed batch output files on terminal retrieve by @Souravrajvi0 in https://github.com/BerriAI/litellm/pull/34092
perf(pre-commit): fetch basedpyright base counts from CI artifacts by @mateo-berri in https://github.com/BerriAI/litellm/pull/35970
fix(ui): sync projects list page index to ?page= so back and reload keep the page by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/36003
fix(ui): link project page keys to their virtual key detail by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/36002
refactor(ui): drop unreferenced locals from dashboard route components by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35819
fix(ui): opening a project now pushes ?project= so back and deep links work by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/36001
refactor(ui): drop unreferenced locals from shared dashboard components by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35821
refactor(ui): drop unreferenced locals from tests and narrow destructures by @yuneng-berri in https://github.com/BerriAI/litellm/pull/36025
fix(guardrails): allow litellm_content_filter to run on post_mcp_call by @mateo-berri in https://github.com/BerriAI/litellm/pull/35980
fix(guardrails): scan /v1/messages tool traffic by @mateo-berri in https://github.com/BerriAI/litellm/pull/35999
refactor(ui): drop dead locals and unused React state across the dashboard by @yuneng-berri in https://github.com/BerriAI/litellm/pull/36026
feat(ui): add the auto-router usage tab to cost optimization by @tin-berri in https://github.com/BerriAI/litellm/pull/35995
fix(managed_files): derive unified output file ids deterministically so concurrent registrations converge by @mateo-berri in https://github.com/BerriAI/litellm/pull/36019
fix(proxy): send keepalive pings on anthropic messages SSE streams during upstream silence by @mateo-berri in https://github.com/BerriAI/litellm/pull/36024
fix(managed_files): return unified ids from unscoped file listing by @mateo-berri in https://github.com/BerriAI/litellm/pull/36031
fix(arize_phoenix): lowercase OTLP/gRPC auth metadata key by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34883
fix(auto-router): accept every reminder marker pair a harness emits by @tin-berri in https://github.com/BerriAI/litellm/pull/36029
fix(pricing): sync flex/priority tier keys to dated OpenAI snapshot variants by @mateo-berri in https://github.com/BerriAI/litellm/pull/35923
fix(cost): bill reasoning tokens at the service tier output rate by @mateo-berri in https://github.com/BerriAI/litellm/pull/35925
fix(proxy): include today's UTC bucket when a daily activity range ends at the caller's current day by @tin-berri in https://github.com/BerriAI/litellm/pull/36051
fix: expired-miss share over all measured turns + cost-optimization tab labels by @tin-berri in https://github.com/BerriAI/litellm/pull/36037
fix(router): include Bedrock batch/S3 fields and model in deployment credentials by @mpcusack-altos in https://github.com/BerriAI/litellm/pull/24548
fix(batch): track cost for managed batches with no attributable key/u… by @elinacse in https://github.com/BerriAI/litellm/pull/35468
feat(guardrails): add scan_only_tool_results to scope unified guardrails to tool results by @mateo-berri in https://github.com/BerriAI/litellm/pull/36014
fix(cost): stop token-pricing the placeholder input on file content calls by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35140
fix(proxy): fetch background responses through the router in CheckResponsesCost by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35137
fix(proxy): yaml store_prompts_in_spend_logs should take precedence over DB cached value by @Praveena-617 in https://github.com/BerriAI/litellm/pull/35769
fix(lint): measure the basedpyright budget gate in a gate-owned venv by @mateo-berri in https://github.com/BerriAI/litellm/pull/36050
docs: cap all GitHub comments at 15-25 words, curb semicolon splices by @mateo-berri in https://github.com/BerriAI/litellm/pull/36059
chore(lint): name MappingProxyType in the mutable-collection fix messages by @mateo-berri in https://github.com/BerriAI/litellm/pull/36072
test: roll back runtime model registrations between tests by @mateo-berri in https://github.com/BerriAI/litellm/pull/36039
refactor(types): cut 653 implicit and explicit Any diagnostics across 11 modules by @mateo-berri in https://github.com/BerriAI/litellm/pull/36054
fix(proxy): stop resolving the UI session sentinel team on /search_tools/list by @yuneng-berri in https://github.com/BerriAI/litellm/pull/36061
fix(batches): persist managed file ids for cancelled/failed/expired batches by @mateo-berri in https://github.com/BerriAI/litellm/pull/36048
fix(batches): register managed output files on batch cancel by @mateo-berri in https://github.com/BerriAI/litellm/pull/36034
fix(proxy): allow non-admins to reach /user/daily/activity/aggregated by @yuneng-berri in https://github.com/BerriAI/litellm/pull/36062
fix(anthropic): coerce explicit additionalProperties to false in output_format schema by @dkindlund in https://github.com/BerriAI/litellm/pull/35811
fix(batches): prevent managed file fallbacks by @rimysore in https://github.com/BerriAI/litellm/pull/35371
chore: ignore the mechanical lint and typing sweeps in git blame by @mateo-berri in https://github.com/BerriAI/litellm/pull/36076
fix(proxy): warn at startup when max_budget is set but no database is connected by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/36041
fix(proxy): promote caller metadata trace fields into litellm_metadata by @yucheng-berri in https://github.com/BerriAI/litellm/pull/35866
feat(terraform): sync provider 0.3.0 from the mirror and cut 0.4.0 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/36098
fix(guardrails): honor configured timeout in Zscaler AI Guard by @yucheng-berri in https://github.com/BerriAI/litellm/pull/36110
fix(logging): fall back to litellm_metadata when metadata is empty by @yucheng-berri in https://github.com/BerriAI/litellm/pull/36105
fix(proxy): re-assert the authenticated identity on passthrough requests by @yucheng-berri in https://github.com/BerriAI/litellm/pull/36121
chore: bump litellm-enterprise 0.1.53 -> 0.1.54, litellm-proxy-extras 0.4.83 -> 0.4.84 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/36139
fix(ui): match auto-router preset models against wildcard-expanded model groups by @tin-berri in https://github.com/BerriAI/litellm/pull/36111
test(router): assert the auto-router max_input_chars kwarg by @yuneng-berri in https://github.com/BerriAI/litellm/pull/36109
fix(ui): allow clearing a key's budget reset from the Edit Key form by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/36140
fix(managed_files): skip unparseable rows when listing managed files by @mateo-berri in https://github.com/BerriAI/litellm/pull/36021
fix(a2a): stop writing per-caller headers onto the shared cached httpx client by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35978
build(deps): bump h2 to 4.4.1 and js-yaml to 4.3.1 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/36147
chore: promote staging to main by @mateo-berri in https://github.com/BerriAI/litellm/pull/36057

New Contributors

@rimysore made their first contribution in https://github.com/BerriAI/litellm/pull/35367
@AkashNaickar made their first contribution in https://github.com/BerriAI/litellm/pull/34800
@Souravrajvi0 made their first contribution in https://github.com/BerriAI/litellm/pull/34092
@elinacse made their first contribution in https://github.com/BerriAI/litellm/pull/35468

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.97.0-dev.1...v1.97.0-dev.2

Open source →

1.97.0.dev15 Aug 2026pre-release

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit `0112e53`.

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.97.0-dev.1

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.97.0-dev.1/cosign.pub \
  ghcr.io/berriai/litellm:v1.97.0-dev.1

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

feat(proxy): resolve Cursor thinking/fast model-name suffixes on /cursor/chat/completions by @mateo-berri in https://github.com/BerriAI/litellm/pull/35554
fix(team-callbacks): actually stop logging when disable_logging is called by @yucheng-berri in https://github.com/BerriAI/litellm/pull/35520
refactor(lint): drop redundant !s f-string conversion flags and fix displaced import-group comments by @mateo-berri in https://github.com/BerriAI/litellm/pull/35546
fix(proxy): backfill null user_email on existing users during JWT auth by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34588
feat(playground): add non-streaming response toggle by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35560
feat(teams): apply default organization to new teams from default team settings by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35540
fix(ui): block Playground page for viewer roles on direct URL access by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35676
fix(caching): close evicted LLM clients so their connections are reclaimed by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35492
chore(deps): update brace-expansion, postcss, and gitpython to current patch releases by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35692
refactor(ui): rename the create MCP server component to PascalCase by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35686
fix(openai): drop undefined Union from owns_wrapped_http_client annotation by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35706
fix(openai): drop the undefined Union from owns_wrapped_http_client by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35704
chore(ui): note Google's Agent Platform rename in vector store setup by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/28076
fix(proxy): apply key/team router_settings.model_group_alias by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35486
feat(complexity_router): default session affinity off and expose it in the UI by @tin-berri in https://github.com/BerriAI/litellm/pull/35714
fix(datadog): read team callback dd_* params from kwargs instead of blocked dynamic params (#35115 port) by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35687
refactor(ui): extract the MCP create form's logic and field groups by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35694
test(ui): tier the MCP create tests into unit and integration by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35697
fix(proxy): redact credential headers from request logging copies by @yucheng-berri in https://github.com/BerriAI/litellm/pull/35678
feat(guardrails/rubrik): prompt moderation, response-text blocking, streaming buffer, failure logging by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35722
fix(ui): render Responses API request and response in the logs drawer by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35718
fix(ui): hide guardrail review buttons from non-admin users by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/27535
feat(team): custom metadata validation hook for team create and update by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33353
ci(circleci): install a pinned Rust toolchain on the Linux jobs by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35519
fix(bedrock): stop forwarding no-op toolSpec.strict to Converse by @tin-berri in https://github.com/BerriAI/litellm/pull/35688
fix(ui): reject an auto-router keyword rule left empty instead of dropping it by @tin-berri in https://github.com/BerriAI/litellm/pull/35705
fix(guardrails/rubrik): attribute blocked requests to the caller that made them by @yucheng-berri in https://github.com/BerriAI/litellm/pull/35734
fix(responses): forward client headers to the provider on /v1/responses by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34531
feat(spend): add net auto-router savings to the cost-optimization dashboard by @tin-berri in https://github.com/BerriAI/litellm/pull/35521
chore(typing): clear basedpyright Any errors in budget reset, access groups, and cache settings by @mateo-berri in https://github.com/BerriAI/litellm/pull/35719
fix(spend): read what a request cost from the record instead of pricing it again by @tin-berri in https://github.com/BerriAI/litellm/pull/35736
perf: install hiredis so redis-py parses replies with its C parser by @Classic298 in https://github.com/BerriAI/litellm/pull/35709
feat(ui): show auto-router savings on the cost-optimization dashboard by @tin-berri in https://github.com/BerriAI/litellm/pull/35522
perf: build log messages lazily so filtered-out log records cost nothing by @Classic298 in https://github.com/BerriAI/litellm/pull/35703
fix(proxy): retry model cost map fetch with Retry-After-aware backoff and keep current map on reload failure by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35739
feat(otel): stamp service tier attributes on inference spans by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35679
fix(proxy): log the model cost map reload failure lazily by @tin-berri in https://github.com/BerriAI/litellm/pull/35750
fix(groq): translate web_search_options to the browser_search tool by @hMED22 in https://github.com/BerriAI/litellm/pull/34971
feat(ui): add admin-configurable user banner by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35729
fix(e2e): make spend-counter redis connection env-driven for non-cluster deployments by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35732
fix(proxy): make /cursor/chat/completions work with Cursor agent mode by @tin-berri in https://github.com/BerriAI/litellm/pull/34029
fix(proxy): propagate user_email and bind api_key on JWT auth attribution paths by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34331
chore(build): move the Admin UI toolchain to Node 24 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35801
test(e2e): vendor API strategy coverage across endpoints by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34649
chore(deps): upgrade cryptography to 50.0.0 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35803
test(e2e): cover legacy text /completions endpoint by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34431
feat(gemini): add gemini-robotics-er-2-preview and gemini-robotics-er-1.6-preview by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35555
test(e2e): move load/perf testing out of the main suite and drop the vllm passthrough test by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35820
feat(lint): enforce Final on locals and freeze function parameters (LIT010, LIT011) by @mateo-berri in https://github.com/BerriAI/litellm/pull/35807
chore: bump litellm-proxy-extras 0.4.81 -> 0.4.82, litellm 1.96.0 -> 1.97.0 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35810
fix(bedrock): drop conflicting tool_choice.type when toolConfig.toolChoice is set by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35738
docs(CLAUDE.md): prefer commas over semicolons when replacing em dashes by @mateo-berri in https://github.com/BerriAI/litellm/pull/35825
chore(lint): zero out basedpyright headroom for purely local rules by @mateo-berri in https://github.com/BerriAI/litellm/pull/35828
test(e2e): retry provider-transient statuses at the transport with bounded backoff by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35824
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35836
refactor(ui): route MCP session tokens through the shared storage helper by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35835
docs(helm): replace the classic chart's 128Mi resource example with the documented 4Gi sizing by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35830
fix(proxy): persist periodic reload schedule state so status survives restarts and fires without store_model_in_db by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35165
fix(router): eagerly fetch Vertex AI deferred stream to surface HTTP errors in _acompletion fallback path by @deepanshululla in https://github.com/BerriAI/litellm/pull/34627
fix(azure_storage): honor AZURE_STORAGE_ENDPOINT_SUFFIX for sovereign clouds by @yucheng-berri in https://github.com/BerriAI/litellm/pull/35806
fix(proxy): apply key_alias/key_hash filters to all /key/list visibility branches by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35840
fix(proxy): enforce per-model budgets against resolved cursor model variants by @mateo-berri in https://github.com/BerriAI/litellm/pull/35834
feat(ui): reorder Add Auto Router into name + template, with a collapsible detailed config by @tin-berri in https://github.com/BerriAI/litellm/pull/35746
test: repair three failing suites on litellm_internal_staging by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35845
fix(guardrails): scan model output on the /openai/v1/responses alias by @yucheng-berri in https://github.com/BerriAI/litellm/pull/35818
ci: pin Node on the Playwright UI lanes so npm ci meets the engines floor by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35848
fix(pricing): apply OpenAI's gpt-5.6 terra/luna cut to Azure cost map by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/35481
feat(spend): add caller-scoped key/user/team/organization spend report endpoints by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35725
revert: "fix(caching): close evicted LLM clients so their connections are reclaimed (#35492)" by @mateo-berri in https://github.com/BerriAI/litellm/pull/35856
refactor(repositories): add prisma protocol seams and a spend-reset unit of work by @mateo-berri in https://github.com/BerriAI/litellm/pull/35748
perf(streaming): assemble streamed tool-call arguments in linear time by @mateo-berri in https://github.com/BerriAI/litellm/pull/35826
fix(s3_v2): sign S3 object URLs with S3SigV4Auth so encoded paths verify by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35726
test(e2e): self-seed the ui suite's password-login users in global setup by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35863
fix(claude-code): create-only skill registration with a PUT update route (LIT-4110) by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/31752
fix(proxy): fix zguard httpcode when block input by @jwang-gif in https://github.com/BerriAI/litellm/pull/31948
fix(lint): pick the merge-aware base so in-progress merges are not blamed for base drift by @mateo-berri in https://github.com/BerriAI/litellm/pull/35868
chore: bump litellm-proxy-extras 0.4.82 -> 0.4.83 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35877
feat(ui): add Test Routing to the auto router create form by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35859
fix(ui): derive auto-router preset tests from the bundled preset JSON by @tin-berri in https://github.com/BerriAI/litellm/pull/35882
revert: "test(e2e): vendor API strategy coverage across endpoints" (#34649) by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35881
chore(deps): bump grpc and golang.org/x modules in the terraform provider by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35844
test(e2e): skip view-backed global spend probes pending LIT-5211 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35875
fix(lint): move the basedpyright heap flag into the type check gate by @mateo-berri in https://github.com/BerriAI/litellm/pull/35869
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35876

New Contributors

@hMED22 made their first contribution in https://github.com/BerriAI/litellm/pull/34971

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.96.0-rc.1...v1.97.0-dev.1

Open source →

1.96.09 Aug 2026

All LiteLLM Docker images are signed with cosign . Every release is signed with the same key introduced in commit 0112e53 .

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.96.0

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.96.0/cosign.pub \
  ghcr.io/berriai/litellm:v1.96.0

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

feat(prometheus): add service_tier label to latency and spend metrics by @yassin-berriai in #34966
fix(aiohttp): keep keep-alive connector config when a session is rebuilt by @yassin-berriai in #34962
fix(helm): pin bundled postgres and redis to the bitnamilegacy images by @yassin-berriai in #34963
fix(vertex): decide rawPredict passthrough streaming from the request body by @tin-berri in #34672
fix(anthropic-adapter): translate stop_sequences and disabled thinking for non-Claude targets by @tin-berri in #34589
ci: publish a generated JSON schema for model_prices_and_context_window.json by @mateo-berri in #34816
fix(jwt_auth): allow /v1/messages for JWT teams by default by @devin-ai-integration[bot] in #34222
fix(proxy): skip team model aliases that point at deleted deployments by @mateo-berri in #34993
fix(proxy): report when a model write does not survive the post-write reload by @tin-berri in #34861
fix(proxy): reject model writes that corrupt an auto-router pseudo-model by @tin-berri in #34151
fix(router_strategy): serialize latency for non-chat responses in lowest-latency routing by @mihidumh in #33290
fix(logging): preserve callback order in get_combined_callback_list by @Harsh23Kashyap in #33008
fix(router): honor explicit priority=0 in acompletion by @Harsh23Kashyap in #33214
fix(router_strategy): serialize latency for non-chat responses in lowest-latency routing by @tin-berri in #35048
fix(anthropic-adapter): open the first content block with the real upstream type so reasoning-first streams start with thinking by @Napuh in #34433
test(e2e): poll MCP tools across multi-worker lag by @mubashir1osmani in #35047
fix(scim): stop provisioning nested group ids as internal users by @ryan-crabbe-berri in #34997
chore(typing): clear basedpyright Any errors in proxy management endpoints by @mateo-berri in #35074
fix(ui): size Object Permissions card grid by container width by @ryan-crabbe-berri in #35019
fix(proxy): allow /key/update to identify the key by key_alias by @ryan-crabbe-berri in #34851
feat(ui): split failed requests into their own series on the cache dashboard by @ryan-crabbe-berri in #34862
feat(ui): shareable log links via log_id query param on the logs page by @ryan-crabbe-berri in #34879
fix(ui): show public model names in usage breakdowns by @mateo-berri in #35107
fix(ui): point the navbar and sidebar logos at the dashboard home route by @yuneng-berri in #35041
fix(proxy): stop serving stale team model allowlist after /team/update by @mateo-berri in #34266
feat(ui): deep link team detail page via ?team= query param by @ryan-crabbe-berri in #35112
feat(ui): deep link organization detail page via ?org= query param by @ryan-crabbe-berri in #35117
fix(proxy): resolve named credentials on provider-only batch and files calls by @mateo-berri in #35028
fix(router): drop duplicate Mapping import that fails ruff F811 by @ryan-crabbe-berri in #35122
refactor(rust): make litellm-core the callable messages() SDK; drop the ai-gateway handler by @devin-ai-integration[bot] in #35044
fix(otel): make OTLP export work against Grafana Cloud by @yassin-berriai in #35060
test(e2e): remove the Presidio guardrail suite by @mubashir1osmani in #35129
feat(dashscope): add qwen3.7-plus and qwen3.7-max to the model cost map by @devin-ai-integration[bot] in #35123
feat(ui): link organization teams to their team detail pages by @ryan-crabbe-berri in #35120
fix(tests): assert Content variants are identified by type, not by the discriminator keyword by @yassin-berriai in #35161
fix(mcp): never write discovery results to the row, heal already-stamped rows, and retry failed discovery with backoff by @devin-ai-integration[bot] in #34990
fix(vertex_ai): honor per-model gcs_bucket_name on managed-file read path by @devin-ai-integration[bot] in #34847
feat(cli): read base_url from persistent config file by @ryan-crabbe-berri in #35015
fix(auth): resolve managed batch/file deployment model_id to model name for team access checks by @devin-ai-integration[bot] in #32587
fix(vertex_ai): forward function_call id on Vertex Gemini 3+ tool turns by @ljogeiger in #34603
build(makefile): give local basedpyright runs the node heap CI uses by @mateo-berri in #35173
fix(complexity_router): capture the classifier request body in spend logs by @tin-berri in #35164
test(managed-files): lock in store_unified_file_id idempotency on batch retrieve by @devin-ai-integration[bot] in #32601
fix(vertex_ai): skip context caching when the cached block ends on a model turn by @mateo-berri in #35172
refactor(bedrock): remove the dead BedrockLLM invoke code path by @mateo-berri in #35188
fix(pricing): correct gpt-5.4-mini and gpt-5.4-nano token limits by @mateo-berri in #35182
feat(cookbook): add a Grafana dashboard for the OTel GenAI metrics by @yassin-berriai in #35159
chore(typing): clear basedpyright Any errors in proxy auth, repositories, and openai transforms by @mateo-berri in #35240
fix(batches): calculate cost and usage for completed Vertex AI batches by @mateo-berri in #35186
feat(ui): give auto-routers their own tab on Models + Endpoints by @tin-berri in #35009
refactor(batches): aggregate batch output cost, usage, and models in a single pass by @mateo-berri in #35205
feat(router): record why the auto-router picked a tier in spend logs by @tin-berri in #35016
fix(otel): cap tool-definition attributes so they cannot evict gen_ai.* from the LLM span by @yassin-berriai in #34828
feat(mcp): enforce per-user MCP tool-call entitlements in the auth module by @yassin-berriai in #35146
fix(otel): record the GenAI duration metric on failed requests by @yassin-berriai in #35152
chore: bump litellm 1.95.0 -> 1.96.0 by @yuneng-berri in #35254
fix(pricing): adjust gpt-5.6-terra and gpt-5.6-luna prices according to OpenAI's latest article by @lihugang in #35258
revert(proxy)!: stop enforcing user budget on team keys by @yuneng-berri in #35271
fix(otel): label retrieval and agent metrics correctly and emit gen_ai.provider.name by @yassin-berriai in #35151
test(e2e): align budget e2e with the team-key budget hierarchy by @yuneng-berri in #35276
feat(mcp): scan and mask MCP tool results via post_mcp_call guardrails by @yassin-berriai in #35155
docs(claude): require 15-25 word human-readable replies to AI PR review bots by @devin-ai-integration[bot] in #35266
fix(redis): stop an unreachable Redis from blocking every request by @yassin-berriai in #35273
fix(rate-limits): keep the v3 limiter out of provider-facing metadata on responses routes by @devin-ai-integration[bot] in #35207
docs(pr-template): require e2e proof on all three LLM endpoints when applicable by @mateo-berri in #35280
feat(mcp): manual authorization-code delivery for headless MCP clients by @tin-berri in #34848
feat(db): opt-in REPLICA IDENTITY FULL after prisma migrations by @yassin-berriai in #35267
fix(ui): stop clamping the budgets Budget ID column at 15 characters by @yuneng-berri in #35268
fix(proxy): only enforce budgets on routes that can spend by @ryan-crabbe-berri in #35274
chore(ci): promote internal staging to main by @yuneng-berri in #35285
fix(caching): stamp provider on embedding cache-hit spend logs by @devin-ai-integration[bot] in #35282
fix(proxy): run post_call guardrails on /v1/messages streaming via unified guardrail translation by @mateo-berri in #35260
fix(fireworks_ai): correct Kimi K2.5/K2.6/K2.7 max output token limits by @devin-ai-integration[bot] in #35174
feat(mcp)!: extend keyless gateway OAuth flow to per-server MCP URL paths by @tin-berri in #34856
fix(proxy): request stream usage upstream by default and strip it from client streams by @mateo-berri in #35290
refactor(rate-limits): move the v3 limiter per-request stash off request metadata onto a ContextVar by @mateo-berri in #35278
test(e2e): skip the batch rate-limiter spend-row test pending LIT-5027 by @ryan-crabbe-berri in #35301
fix(guardrails/headroom): stop compressing the turn the model must act on by @tin-berri in #35294
fix(ui): let the internal user and org forms save sub-cent budgets by @ryan-crabbe-berri in #35302
fix(guardrails): serve config guardrails from list and info endpoints without a DB and make their ids stable by @mateo-berri in #35259
fix(anthropic): split mixed stream chunks by payload kind by @yucheng-berri in #35289
fix: give ComplexityRouter LLM classifier prior-turn context (LIT-4981) by @tin-berri in #35185
feat(spend-logs): mark the auto-router's own classifier calls by @tin-berri in #35300
fix(logging): bind litellm_metadata by reference in function_setup so guardrail info reaches spend logs by @yucheng-berri in #35292
feat(s3): support SSE-KMS encryption params on both S3 logging paths by @yucheng-berri in #35291
fix(policy_engine): preserve config-defined policies across DB sync and expose them via list APIs by @mateo-berri in #35263
test: fix order-dependent flake in passthrough guardrail call-type test by @mateo-berri in #35317
fix(pricing): correct gpt-5.6 prices for openai, bedrock, and flex long context by @mubashir1osmani in #35270
fix(cost): bill the fast service tier at the priority rate by @devin-ai-integration[bot] in #35320
fix(responses): map all documented in-stream error codes to real HTTP statuses by @mateo-berri in #35307
test(pricing): cover gpt-5.6 cache-cost plumbing and bedrock_mantle responses billing by @mateo-berri in #35324
chore: promote staging to main by @mateo-berri in #35328
fix(mcp): annotate connected-app reachability on the gateway connect page by @tin-berri in #34867
fix(mcp): recover the tool-name prefix boundary from registered prefixes by @tin-berri in #34673
fix(e2e): exclude skipped tests from coverage-registry numerator by @yuneng-berri in #35327
feat(ui): expose classifier context window fields on Auto-Router screens (LIT-5036) by @tin-berri in #35315
fix(mcp): deny MCP access when a named entitlement cannot be read by @yassin-berriai in #35160
feat(proxy): add generic list handler for /management/v1 by @yuneng-berri in #35308
fix(aiohttp): dispose recycled client sessions deterministically by @yassin-berriai in #33428
test(e2e): skip the three Datadog MCP tool-call tests pending LIT-5052 by @ryan-crabbe-berri in #35380
feat(mcp): source the ID-JAG subject from the user's stored SSO assertion by @yassin-berriai in #35147
test(e2e): skip the throughput SLO load test pending LIT-5054 by @ryan-crabbe-berri in #35381
fix(guardrails): run bedrock guardrail on MCP tool calls in during_mcp_call mode by @yassin-berriai in #35149
fix(tool-management): drop unsupported prisma select kwarg from team lookup by @yuneng-berri in #35293
feat(proxy): add GET /management/v1/budgets by @yuneng-berri in #35310
fix(gemini): do not send duplicate thoughtSignature copies to Gemini by @mgeorgaklis in #35004
feat(ui): show which log rows are the auto-router's own classifier calls by @tin-berri in #35304
fix(ui): nest source object in Claude Code marketplace settings snippet by @devin-ai-integration[bot] in #35322
fix(type-discipline): exempt values frozen in place by tuple/frozenset/MappingProxyType from LIT002 by @mateo-berri in #35325
feat(ui): add sorting, filtering and search to the budgets page by @yuneng-berri in #35309
fix(ui): keep the session view open when selecting a log inside it by @ryan-crabbe-berri in #35399
fix(mcp): enforce tool entitlements on every MCP tool dispatch path by @yassin-berriai in #35156
fix(deps): raise aiohttp floor to 3.14.2 to clear pooled-connection timeouts by

Note truncated.

Open source →

1.96.0rc13 Aug 2026pre-release

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit `0112e53`.

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.96.0-rc.1

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.96.0-rc.1/cosign.pub \
  ghcr.io/berriai/litellm:v1.96.0-rc.1

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

fix(mcp): annotate connected-app reachability on the gateway connect page by @tin-berri in https://github.com/BerriAI/litellm/pull/34867
fix(mcp): recover the tool-name prefix boundary from registered prefixes by @tin-berri in https://github.com/BerriAI/litellm/pull/34673
fix(e2e): exclude skipped tests from coverage-registry numerator by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35327
feat(ui): expose classifier context window fields on Auto-Router screens (LIT-5036) by @tin-berri in https://github.com/BerriAI/litellm/pull/35315
fix(mcp): deny MCP access when a named entitlement cannot be read by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35160
feat(proxy): add generic list handler for /management/v1 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35308
fix(aiohttp): dispose recycled client sessions deterministically by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33428
test(e2e): skip the three Datadog MCP tool-call tests pending LIT-5052 by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35380
feat(mcp): source the ID-JAG subject from the user's stored SSO assertion by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35147
test(e2e): skip the throughput SLO load test pending LIT-5054 by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35381
fix(guardrails): run bedrock guardrail on MCP tool calls in during_mcp_call mode by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35149
fix(tool-management): drop unsupported prisma select kwarg from team lookup by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35293
feat(proxy): add GET /management/v1/budgets by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35310
fix(gemini): do not send duplicate thoughtSignature copies to Gemini by @mgeorgaklis in https://github.com/BerriAI/litellm/pull/35004
feat(ui): show which log rows are the auto-router's own classifier calls by @tin-berri in https://github.com/BerriAI/litellm/pull/35304
fix(ui): nest source object in Claude Code marketplace settings snippet by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35322
fix(type-discipline): exempt values frozen in place by tuple/frozenset/MappingProxyType from LIT002 by @mateo-berri in https://github.com/BerriAI/litellm/pull/35325
feat(ui): add sorting, filtering and search to the budgets page by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35309
fix(ui): keep the session view open when selecting a log inside it by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35399
fix(mcp): enforce tool entitlements on every MCP tool dispatch path by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35156
fix(deps): raise aiohttp floor to 3.14.2 to clear pooled-connection timeouts by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35337
fix(tag-management): drop unsupported prisma select kwarg from key lookup by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35288
fix(proxy): stop model writes 500ing on another pod's delete by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35400
fix(ui): show pass through route selections and match team id substrings in team search by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35319
chore(typing): replace Any kwargs unpacking with validated model parsing by @mateo-berri in https://github.com/BerriAI/litellm/pull/35397
feat(proxy)!: gate all mock testing request params behind a single config flag by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35423
chore(typing): clear 2.4k basedpyright errors across 15 Any hotspot files by @mateo-berri in https://github.com/BerriAI/litellm/pull/35452
fix(proxy): align team member add with existing user provisioning rules by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35435
feat(prometheus): add global exclude_metrics and exclude_labels options by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34201
feat(proxy): let AI API keys read /model/info by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35473
chore(proxy): remove duplicate Sequence import in team endpoints by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35479
fix(a2a): keep config-defined agents registered and accept the documented agents: key by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35163
ci: run unit tests on pushes to main and litellm_internal_staging by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35475
chore: bump litellm-enterprise 0.1.52 -> 0.1.53 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35476
chore(ui): rebuild committed Admin UI bundle by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35484
fix(rate-limit): enforce token limits when the pre-call increment is zero by @shivamrawat1 in https://github.com/BerriAI/litellm/pull/35422
fix(helm): render pod-level securityContext on the migration Job by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35482
fix(router): honor request-level num_retries over a deployment's litellm_params value by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35483
fix(spend): bound each spend-log write statement by payload bytes by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34956
feat(proxy): bound DB statement and lock time via general_settings by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35496
fix(bedrock): cache AssumeRole credentials per attributed identity by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35467
feat(complexity_router): let the classifier see assistant turns and rate what a short reply approves by @tin-berri in https://github.com/BerriAI/litellm/pull/35471
feat(proxy): push config sync to pods via redis pub/sub by @mateo-berri in https://github.com/BerriAI/litellm/pull/35436
test(e2e): derive the throughput SLO per replica and surface locust's error breakdown by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35494
feat(helm): add pod-hardening and migration-Job knobs to the componentized chart by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35489
fix(docker): bake prisma offline in the componentized migrations image by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35485
fix(batches): encode public model group on background-created output file ids by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35406
fix(componentized): honor USE_DDTRACE in the gateway and backend deployments by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35490
fix(helm): give gateway and backend probes an explicit timeoutSeconds by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35497
fix(ci): let the E2E proxy accept the mock testing params its suite sends by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35511
test(proxy): separate the member_add permission gate from the provisioning gate by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35507
test(logging): pin routing_decision and internal_call_origin in the gcs pubsub spend log fixture by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35506
feat(ui): expose the assistant-turn classifier context switch on Auto-Router screens by @tin-berri in https://github.com/BerriAI/litellm/pull/35500
test(proxy): assert _delete_deployment's still-desired id set instead of a delete count by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35505
refactor(complexity_router): drop the tier-rubric override, close the rubric on the window it was given by @tin-berri in https://github.com/BerriAI/litellm/pull/35504
fix(deps): move pydantic-settings into the base dependencies by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35518
refactor(lint): apply every safe ruff autofix and zero 28 strict-rule budgets by @mateo-berri in https://github.com/BerriAI/litellm/pull/35495
build(makefile): swap npm ci for npm install so bootstrap no-ops on unchanged ui deps by @mateo-berri in https://github.com/BerriAI/litellm/pull/35509
fix(team-callbacks): report API-registered callbacks from GET /team/{team_id}/callback by @yucheng-berri in https://github.com/BerriAI/litellm/pull/35512
fix(ui): land general login on the keys dashboard, send MCP consent to /ui/connect by @tin-berri in https://github.com/BerriAI/litellm/pull/35523
build(makefile): run bootstrap before pre-commit lint by @mateo-berri in https://github.com/BerriAI/litellm/pull/35547
chore: rebuild Admin UI bundle by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35550
test(e2e): skip the strict-priority and throughput SLO tests pending LIT-5118 / LIT-5119 by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35575
test(e2e): poll key spend to a deadline in budget reset advances tests by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35572
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35501

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.96.0-dev.2...v1.96.0-rc.1

Open source →

1.96.0.dev231 Jul 2026pre-release

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit `0112e53`.

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.96.0-dev.2

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.96.0-dev.2/cosign.pub \
  ghcr.io/berriai/litellm:v1.96.0-dev.2

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

fix(pricing): adjust gpt-5.6-terra and gpt-5.6-luna prices according to OpenAI's latest article by @lihugang in https://github.com/BerriAI/litellm/pull/35258
fix(caching): stamp provider on embedding cache-hit spend logs by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35282
fix(proxy): run post_call guardrails on /v1/messages streaming via unified guardrail translation by @mateo-berri in https://github.com/BerriAI/litellm/pull/35260
fix(fireworks_ai): correct Kimi K2.5/K2.6/K2.7 max output token limits by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35174
feat(mcp)!: extend keyless gateway OAuth flow to per-server MCP URL paths by @tin-berri in https://github.com/BerriAI/litellm/pull/34856
fix(proxy): request stream usage upstream by default and strip it from client streams by @mateo-berri in https://github.com/BerriAI/litellm/pull/35290
refactor(rate-limits): move the v3 limiter per-request stash off request metadata onto a ContextVar by @mateo-berri in https://github.com/BerriAI/litellm/pull/35278
test(e2e): skip the batch rate-limiter spend-row test pending LIT-5027 by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35301
fix(guardrails/headroom): stop compressing the turn the model must act on by @tin-berri in https://github.com/BerriAI/litellm/pull/35294
fix(ui): let the internal user and org forms save sub-cent budgets by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35302
fix(guardrails): serve config guardrails from list and info endpoints without a DB and make their ids stable by @mateo-berri in https://github.com/BerriAI/litellm/pull/35259
fix(anthropic): split mixed stream chunks by payload kind by @yucheng-berri in https://github.com/BerriAI/litellm/pull/35289
fix: give ComplexityRouter LLM classifier prior-turn context (LIT-4981) by @tin-berri in https://github.com/BerriAI/litellm/pull/35185
feat(spend-logs): mark the auto-router's own classifier calls by @tin-berri in https://github.com/BerriAI/litellm/pull/35300
fix(logging): bind litellm_metadata by reference in function_setup so guardrail info reaches spend logs by @yucheng-berri in https://github.com/BerriAI/litellm/pull/35292
feat(s3): support SSE-KMS encryption params on both S3 logging paths by @yucheng-berri in https://github.com/BerriAI/litellm/pull/35291
fix(policy_engine): preserve config-defined policies across DB sync and expose them via list APIs by @mateo-berri in https://github.com/BerriAI/litellm/pull/35263
test: fix order-dependent flake in passthrough guardrail call-type test by @mateo-berri in https://github.com/BerriAI/litellm/pull/35317
fix(pricing): correct gpt-5.6 prices for openai, bedrock, and flex long context by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/35270
fix(cost): bill the fast service tier at the priority rate by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35320
fix(responses): map all documented in-stream error codes to real HTTP statuses by @mateo-berri in https://github.com/BerriAI/litellm/pull/35307
test(pricing): cover gpt-5.6 cache-cost plumbing and bedrock_mantle responses billing by @mateo-berri in https://github.com/BerriAI/litellm/pull/35324
chore: promote staging to main by @mateo-berri in https://github.com/BerriAI/litellm/pull/35328

New Contributors

@lihugang made their first contribution in https://github.com/BerriAI/litellm/pull/35258

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.96.0-dev.1...v1.96.0-dev.2

Open source →

1.96.0.dev130 Jul 2026pre-release

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit `0112e53`.

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.96.0-dev.1

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.96.0-dev.1/cosign.pub \
  ghcr.io/berriai/litellm:v1.96.0-dev.1

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

feat(prometheus): add service_tier label to latency and spend metrics by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34966
fix(aiohttp): keep keep-alive connector config when a session is rebuilt by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34962
fix(helm): pin bundled postgres and redis to the bitnamilegacy images by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34963
fix(vertex): decide rawPredict passthrough streaming from the request body by @tin-berri in https://github.com/BerriAI/litellm/pull/34672
fix(anthropic-adapter): translate stop_sequences and disabled thinking for non-Claude targets by @tin-berri in https://github.com/BerriAI/litellm/pull/34589
ci: publish a generated JSON schema for model_prices_and_context_window.json by @mateo-berri in https://github.com/BerriAI/litellm/pull/34816
fix(jwt_auth): allow /v1/messages for JWT teams by default by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34222
fix(proxy): skip team model aliases that point at deleted deployments by @mateo-berri in https://github.com/BerriAI/litellm/pull/34993
fix(proxy): report when a model write does not survive the post-write reload by @tin-berri in https://github.com/BerriAI/litellm/pull/34861
fix(proxy): reject model writes that corrupt an auto-router pseudo-model by @tin-berri in https://github.com/BerriAI/litellm/pull/34151
fix(router_strategy): serialize latency for non-chat responses in lowest-latency routing by @mihidumh in https://github.com/BerriAI/litellm/pull/33290
fix(logging): preserve callback order in get_combined_callback_list by @Harsh23Kashyap in https://github.com/BerriAI/litellm/pull/33008
fix(router): honor explicit priority=0 in acompletion by @Harsh23Kashyap in https://github.com/BerriAI/litellm/pull/33214
fix(router_strategy): serialize latency for non-chat responses in lowest-latency routing by @tin-berri in https://github.com/BerriAI/litellm/pull/35048
fix(anthropic-adapter): open the first content block with the real upstream type so reasoning-first streams start with thinking by @Napuh in https://github.com/BerriAI/litellm/pull/34433
test(e2e): poll MCP tools across multi-worker lag by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/35047
fix(scim): stop provisioning nested group ids as internal users by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34997
chore(typing): clear basedpyright Any errors in proxy management endpoints by @mateo-berri in https://github.com/BerriAI/litellm/pull/35074
fix(ui): size Object Permissions card grid by container width by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35019
fix(proxy): allow /key/update to identify the key by key_alias by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34851
feat(ui): split failed requests into their own series on the cache dashboard by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34862
feat(ui): shareable log links via log_id query param on the logs page by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34879
fix(ui): show public model names in usage breakdowns by @mateo-berri in https://github.com/BerriAI/litellm/pull/35107
fix(ui): point the navbar and sidebar logos at the dashboard home route by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35041
fix(proxy): stop serving stale team model allowlist after /team/update by @mateo-berri in https://github.com/BerriAI/litellm/pull/34266
feat(ui): deep link team detail page via ?team= query param by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35112
feat(ui): deep link organization detail page via ?org= query param by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35117
fix(proxy): resolve named credentials on provider-only batch and files calls by @mateo-berri in https://github.com/BerriAI/litellm/pull/35028
fix(router): drop duplicate Mapping import that fails ruff F811 by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35122
refactor(rust): make litellm-core the callable messages() SDK; drop the ai-gateway handler by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35044
fix(otel): make OTLP export work against Grafana Cloud by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35060
test(e2e): remove the Presidio guardrail suite by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/35129
feat(dashscope): add qwen3.7-plus and qwen3.7-max to the model cost map by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35123
feat(ui): link organization teams to their team detail pages by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35120
fix(tests): assert Content variants are identified by type, not by the discriminator keyword by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35161
fix(mcp): never write discovery results to the row, heal already-stamped rows, and retry failed discovery with backoff by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34990
fix(vertex_ai): honor per-model gcs_bucket_name on managed-file read path by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34847
feat(cli): read base_url from persistent config file by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35015
fix(auth): resolve managed batch/file deployment model_id to model name for team access checks by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32587
fix(vertex_ai): forward function_call id on Vertex Gemini 3+ tool turns by @ljogeiger in https://github.com/BerriAI/litellm/pull/34603
build(makefile): give local basedpyright runs the node heap CI uses by @mateo-berri in https://github.com/BerriAI/litellm/pull/35173
fix(complexity_router): capture the classifier request body in spend logs by @tin-berri in https://github.com/BerriAI/litellm/pull/35164
test(managed-files): lock in store_unified_file_id idempotency on batch retrieve by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32601
fix(vertex_ai): skip context caching when the cached block ends on a model turn by @mateo-berri in https://github.com/BerriAI/litellm/pull/35172
refactor(bedrock): remove the dead BedrockLLM invoke code path by @mateo-berri in https://github.com/BerriAI/litellm/pull/35188
fix(pricing): correct gpt-5.4-mini and gpt-5.4-nano token limits by @mateo-berri in https://github.com/BerriAI/litellm/pull/35182
feat(cookbook): add a Grafana dashboard for the OTel GenAI metrics by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35159
chore(typing): clear basedpyright Any errors in proxy auth, repositories, and openai transforms by @mateo-berri in https://github.com/BerriAI/litellm/pull/35240
fix(batches): calculate cost and usage for completed Vertex AI batches by @mateo-berri in https://github.com/BerriAI/litellm/pull/35186
feat(ui): give auto-routers their own tab on Models + Endpoints by @tin-berri in https://github.com/BerriAI/litellm/pull/35009
refactor(batches): aggregate batch output cost, usage, and models in a single pass by @mateo-berri in https://github.com/BerriAI/litellm/pull/35205
feat(router): record why the auto-router picked a tier in spend logs by @tin-berri in https://github.com/BerriAI/litellm/pull/35016
fix(otel): cap tool-definition attributes so they cannot evict gen_ai.* from the LLM span by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34828
feat(mcp): enforce per-user MCP tool-call entitlements in the auth module by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35146
fix(otel): record the GenAI duration metric on failed requests by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35152
chore: bump litellm 1.95.0 -> 1.96.0 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35254
revert(proxy)!: stop enforcing user budget on team keys by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35271
fix(otel): label retrieval and agent metrics correctly and emit gen_ai.provider.name by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35151
test(e2e): align budget e2e with the team-key budget hierarchy by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35276
feat(mcp): scan and mask MCP tool results via post_mcp_call guardrails by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35155
docs(claude): require 15-25 word human-readable replies to AI PR review bots by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35266
fix(redis): stop an unreachable Redis from blocking every request by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35273
fix(rate-limits): keep the v3 limiter out of provider-facing metadata on responses routes by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/35207
docs(pr-template): require e2e proof on all three LLM endpoints when applicable by @mateo-berri in https://github.com/BerriAI/litellm/pull/35280
feat(mcp): manual authorization-code delivery for headless MCP clients by @tin-berri in https://github.com/BerriAI/litellm/pull/34848
feat(db): opt-in REPLICA IDENTITY FULL after prisma migrations by @yassin-berriai in https://github.com/BerriAI/litellm/pull/35267
fix(ui): stop clamping the budgets Budget ID column at 15 characters by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35268
fix(proxy): only enforce budgets on routes that can spend by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/35274
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35285

New Contributors

@Harsh23Kashyap made their first contribution in https://github.com/BerriAI/litellm/pull/33008
@ljogeiger made their first contribution in https://github.com/BerriAI/litellm/pull/34603

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.95.0-rc.1...v1.96.0-dev.1

Open source →

1.95.02 Aug 2026Deprecated

test: replace deprecated gpt-5-codex with gpt-5.3-codex by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34520

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.95.0/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

feat(spend): track prompt compression saved tokens in daily spend aggregates by @tin-berri in https://github.com/BerriAI/litellm/pull/33810
test(e2e): assert the long budget window keeps blocking after the short window resets by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33832
feat(messages): route native Anthropic /messages through Rust behind LITELLM_RUST env var by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33848
test(e2e): cover credential-backed /v1/messages request by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33863
feat(rust): expose Anthropic Messages route (POST /v1/messages) on the axum gateway by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33880
feat(rust): 1:1 port of OpenAI Responses API WebSockets to litellm-rust by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33849
fix(proxy): treat malformed cost-map token limits as absent on /v1/models by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33903
feat(rust): port BaseAWSLLM auth (credential resolution + SigV4) to litellm-core as a base provider by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33888
feat(complexity-router): add return_raw_model_name toggle for response model field by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33875
feat(mcp): always-on aggregate gateway DCR discovery front door by @tin-berri in https://github.com/BerriAI/litellm/pull/33174
fix(langfuse): send v4 ingestion header for otel callback by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33907
feat(ui): add configuration tabs to the Cost Optimization page by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33899
test(e2e): guard destructive spend-log truncate behind an explicit opt-in by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33751
chore(rust): migrate the litellm-rust workspace (core, ai-gateway, python-bridge) from Rust edition 2021 to edition 2024 by @vineetpuranik in https://github.com/BerriAI/litellm/pull/33940
fix(fireworks_ai): restore Content-Type application/json header (fixes 415) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33929
feat(spend): raise /spend/logs/v2 page_size cap to 1000 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33994
feat(mcp): identity-only session tokens for the gateway DCR front door by @tin-berri in https://github.com/BerriAI/litellm/pull/33182
test(e2e): cover key regeneration rotating to a working new key by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34000
test(e2e): cover tag creation persisting for spend categorization by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34018
test(e2e): cover organization deletion removing it from /organization/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34009
perf(bedrock): audio transcription via rust core (py->rust bridge) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33990
chore(ci): retire daily OSS branches in favor of litellm_internal_staging by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34030
test(e2e): cover model update persisting to /model/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34017
test(e2e): cover key block persisting to /key/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34014
test(e2e): cover created team appearing in /team/list by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34015
test(e2e): cover created user appearing in /user/list by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34016
test(e2e): cover team update persistence via /team/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33997
feat(bedrock): forward bedrock_tags to CreateModelInvocationJob for batch jobs by @mateo-berri in https://github.com/BerriAI/litellm/pull/33733
test(e2e): cover model registration persistence in /model/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33996
test(e2e): cover user update persistence via /user/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33998
test(proxy): make model_info endpoint tests hermetic to kill an order/merge-skew flake by @mateo-berri in https://github.com/BerriAI/litellm/pull/34037
chore(e2e): prune the non-deterministic perf.latency SLO coverage cell by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34024
fix(ui): hide guardrail group headers when only one group has entries by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33885
test(e2e): cover model deletion removing it from the catalog by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34006
test(e2e): cover organization update persistence via /organization/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34010
test(e2e): cover team deletion persistence and key revocation by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33999
test(e2e): cover user deletion removing it from user inventory by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34007
test(e2e): cover created key appearing in /key/list inventory by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34008
fix(cache): make in-memory and disk cache increments atomic by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34013
test(e2e): add reliability suite covering fallback, timeout, and cache behavior by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34023
test(true_rabbit): cover passthrough headers, batch assume-role, gemini, vllm, bedrock guardrails, batch rate-limit mapping by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33843
fix(anthropic): only inject cache_control when the request carries none by @tin-berri in https://github.com/BerriAI/litellm/pull/33886
feat(mcp): support MCP servers on the Anthropic /v1/messages API by @tin-berri in https://github.com/BerriAI/litellm/pull/33631
feat(mcp): migrate client_credentials (M2M) onto the v2 resolver arm by @tin-berri in https://github.com/BerriAI/litellm/pull/32259
fix(router): stop custom model_info leaking onto shared backend cost map key by @mateo-berri in https://github.com/BerriAI/litellm/pull/34041
perf(streaming): build per-chunk Delta directly instead of setattr/delattr churn by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33992
refactor(mcp): consolidate exception-tree walkers into one shared faults traversal by @tin-berri in https://github.com/BerriAI/litellm/pull/33183
fix(budget): reset users/teams whose budget_reset_at is NULL by @jyeung-r7 in https://github.com/BerriAI/litellm/pull/33623
perf(core): fast-path SafeAttributeModel.delattr for declared fields by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33993
fix(auth): set budget_reset_at when JWT upsert seeds a budget_duration by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34050
fix(proxy/auth): handle tz-aware temp_budget_expiry by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33840
fix(vertex,azure): model-aware mid-conversation system for Claude /v1/messages by @mateo-berri in https://github.com/BerriAI/litellm/pull/33807
fix(auth): apply temp_budget_increase for cache-hit keys by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33841
fix(agents): allow optional securityScheme fields so /public/agent_hub does not 500 by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33897
build(deps-dev): bump js-yaml to 4.3.0 and brace-expansion to 5.0.7 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34056
refactor(ui): migrate credentials table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34053
fix(cli): stable port and persisted master key for lite autoroute up by @tin-berri in https://github.com/BerriAI/litellm/pull/34026
fix(mcp): return the DCR client's own redirect_uris to stop the /callback self-redirect loop by @tin-berri in https://github.com/BerriAI/litellm/pull/33756
feat: add deepkeep as custom guardrail by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33844
fix(router): propagate capability flags to shared backend cost map key by @mateo-berri in https://github.com/BerriAI/litellm/pull/34047
fix(mcp): add Google Sheets, Drive, Calendar, and Docs to the OpenAPI registry by @tin-berri in https://github.com/BerriAI/litellm/pull/34059
fix(bedrock_mantle): hoist Codex additional_tools input items to top-level tools by @lyb0307 in https://github.com/BerriAI/litellm/pull/33228
fix(bedrock_mantle): gate unsupported service_tier on drop_params for the Responses API by @mateo-berri in https://github.com/BerriAI/litellm/pull/34058
feat(proxy): auto-enable drop_params for Codex user agents by @mateo-berri in https://github.com/BerriAI/litellm/pull/34068
refactor(ui): migrate available teams table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34070
fix(ui): serve /ui/assets from the nginx image instead of SPA fallback by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34066
feat(gemini): day-0 pricing for gemini-3.6-flash and gemini-3.5-flash-lite by @mateo-berri in https://github.com/BerriAI/litellm/pull/34106
refactor(ui): migrate audit logs table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34080
refactor(ui): migrate organizations table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34081
refactor(ui): migrate memory table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34079
refactor(ui): migrate access groups table to shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34078
fix(model_armor): sanitize error details by default by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33908
refactor(ui): migrate agents table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34089
fix(ui): add tooltip to the Active key status badge by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34109
fix(interactions): add queued to the Interaction status enum by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34135
ci(image-scan): match Python packages against CPE data by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34136
chore(deps): bump pypdf to 6.14.2 and pyasn1 to 0.6.4 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34148
feat(budgets): add configurable budget_reset_time of day by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/31007
feat(ui): surface key budget_reset_at in key info and keys table by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34113
fix(a2a): accept semver protocolVersion values like 0.3.0 in agent cards by @mateo-berri in https://github.com/BerriAI/litellm/pull/34154
feat(ui): add block/unblock key action to key info page by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34116
fix(mcp): attach resolved OAuth credentials to OpenAPI spec_path tool calls by @tin-berri in https://github.com/BerriAI/litellm/pull/34063
fix(e2e): use EndpointsClient.proxy after Gateway to ProxyClient rename by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34127
refactor(auth): derive temp budget increase without mutating the token by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34121
test(e2e): add Other suite and Guardrails coverage incl. an MCP tool-call guardrail by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34149
fix(mcp): let an admin-pinned issuer drive OAuth discovery for url-less servers by @tin-berri in https://github.com/BerriAI/litellm/pull/34065
fix(router): stop per-deployment num_retries from double-counting as provider max_retries by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34129
fix(e2e): pin harness Python and surface proxy boot crash output by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34157
fix(proxy): stop save_config from snapshotting environment_variables into the DB by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34119
fix(ui): stop cloning body-carrying requests into stream uploads in fetchClient middleware by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34122
fix(ui): distinguish response cache from provider prompt caching by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34138
fix(ui): bundle provider logos as static imports and unify fallback in Logo component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34125
refactor(ui): migrate inline provider logo lookups to the shared Logo component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34141
test(e2e): cover team management routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34115
test(e2e): cover key management routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34114
test(e2e): cover budget, customer, user and org routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34117
fix(router): honor request-level num_retries over global litellm_settings.num_retries by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34124
test(e2e): cover model, tag and access group routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34118
feat(proxy): make DB config-reload interval configurable via config.yaml and UI by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34130
feat(ui): add controlled row selection to the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34167
feat(mcp): store the enterprise IdP identity assertion at SSO login for EMA egress by @tin-berri in https://github.com/BerriAI/litellm/pull/34072
chore(deps): bump gitpython to 3.1.52 in uv.lock by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34168
feat(ui): add react-hook-form + zod form infrastructure by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34170
chore(tests): replace a customer name and domain with neutral placeholders by @mateo-berri in https://github.com/BerriAI/litellm/pull/34172
refactor(ui): migrate MCP, callback, guardrail, SSO, and search tool logos to the shared Logo component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34169
fix(ui): stop dashboard key-edit form 403ing on non-budget saves by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34112
fix(ui): harden provider logo map typing and bundled asset guard by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34163
fix(proxy): populate user_email on UserAPIKeyAuth for JWT auth by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34174
test(e2e): cover config and misc management routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34120
test(e2e): add Azure AI Foundry and Anthropic /v1/messages coverage for the Rust bridge by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34021
test(ui): run vitest unit tests in GitHub Actions and fix stale key-info tests by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34175
refactor(ui): migrate users and model health checks tables onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34182
fix(ui): restore guardrail_info_helpers exports in GuardrailsPanel test mock by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34197
chore(ui): bump sharp to 0.35.x via npm override by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34193
refactor(ui): migrate Tool Policies table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34176
chore: bump litellm-proxy-extras 0.4.79 -> 0.4.80, litellm 1.94.0 -> 1.95.0 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34199
feat(rust): honor pre-computed Entra ID auth for Azure /messages by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34107
fix(rust): route agentic-hook /messages requests to Python for all stream modes by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34126
fix(e2e): drop httpbin.org from passthrough headers test, use real Anthropic by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34159
test(e2e): cover 12 non-core LLM coverage registry cells by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34123
test(logging): pin compression_savings in the gcs pubsub spend log fixture by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34204
docs: add TLDR section to PR template by @mateo-berri in https://github.com/BerriAI/litellm/pull/34203
(Security) - Prevent potential provider key exposure through URL-valued model destinations and fallbacks by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34189
docs(issue-template): ask for a numbered list of reproduction steps by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34207
test(ui): fix key and credential e2e specs after the overflow menu migrations by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34206
test(e2e): add live A2A agent e2e suite by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34052
fix(ui): reflect REDIS_* env cache config and stop the UI overwriting the stored password by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34160
fix(ui): surface env-var-sourced theme and logging-callback settings by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34156
test(musty_leopard): cover customer chat/messages cost + streaming paths by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34164
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34200
test(e2e): add weekly session-anomaly load test against real providers by @mateo-berri in https://github.com/BerriAI/litellm/pull/34166
fix(bedrock): emit Nova Sonic realtime session.created on connect and session.updated on session.update by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34133
feat(guardrails): add only_scan_new_messages for per-session incremental scanning by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33278
fix(proxy): share CLI SSO login sessions across workers without enable_redis_auth_cache by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33261
test(e2e): move Admin UI Playwright suite to tests/e2e/ui by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34196
fix(scim): use members_with_roles as the source of truth for group membership by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34162
fix(scim): sync team roster and dedup teams for existing-user email upsert by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34183
fix(proxy): raise dashboard session budget default to $1 and make it configurable in config and Admin UI by @tin-berri in https://github.com/BerriAI/litellm/pull/34146
fix(scim): prune deleted user from teams' members_with_roles by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34180
test(e2e): fail the run when a Rust gateway silently serves /messages through Python by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34208
fix(team): make team member add atomic to prevent concurrent-add member loss by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34185
fix(ui): surface SSO and SMTP settings supplied as process env vars by @tin-berri in https://github.com/BerriAI/litellm/pull/33576
fix(scim): parse membership id from filtered PATCH path when value omitted by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34181
fix(ui): remove misleading os.environ tooltip from logging settings by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34305
fix(anthropic): strip uniqueItems + other unsupported array/object constraints from output_format schema by @mateo-berri in https://github.com/BerriAI/litellm/pull/34313
fix(e2e): satisfy basedpyright in test_session_anomaly so the e2e lint gate passes by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34288
refactor(proxy): type the PATCH /team/{team_id} request body by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34195
feat(ui): edit fallback chains from router settings by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32841
fix(mcp): use official Google Drive streamable HTTP MCP server by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34322
refactor(ui): migrate api-reference to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34263
refactor(ui): migrate prompts list page to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34289
refactor(ui): migrate old-usage to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34304
refactor(ui): migrate transform-request to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34303
chore(ui): bump next to 16.2.11 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34329
test(e2e): cover key max_budget blocks on personal, team, and team-member keys by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33895
fix(tests): remove importlib.reload of http_handler that breaks client injection in later tests by @mateo-berri in https://github.com/BerriAI/litellm/pull/34336
test(e2e): require a cache-hit row instead of skipping when absent by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34283
fix(mcp): fall through to an ephemeral DCR mint when passthrough authorize has no client_id by @tin-berri in https://github.com/BerriAI/litellm/pull/33884
ci: run UI unit tests on a 16-core runner by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34330
test(e2e): induce spend failure row deterministically instead of skipping by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34282
chore(ui): add filename, size, JSX-handler, prefer-const, and antd lint rules by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34341
fix(responses): preserve reasoning through prompt hooks by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33422
fix(budget): resolve word-form budget_duration so it no longer silently resets daily by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34250
fix(bedrock): include type in tool_choice disable_parallel_tool_use config for Converse by @mateo-berri in https://github.com/BerriAI/litellm/pull/34347
fix(autoroute): discover models via /v1/models so an AI-API-only key works by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34259
feat(ui): give each Models + Endpoints tab its own path by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34327
feat(organization): add RESTful PATCH /v2/organization/{organization_id} by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32350
refactor(ui): migrate search-tools info view to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34323
fix(docker): bake non_root prisma engines at /opt/prisma so migrations run offline for any uid by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34325
fix(anthropic): strip all remaining output_format schema keywords rejected by Anthropic by @mateo-berri in https://github.com/BerriAI/litellm/pull/34319
fix(sagemaker): forward stream events as they arrive to cut TTFT by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34338
test(e2e): cover key budget_duration resets on personal, team, and team-member keys by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33896
feat(mcp): admit gateway DCR session bearers at the aggregate /mcp scope by @tin-berri in https://github.com/BerriAI/litellm/pull/33190
fix(mcp): log actionable OAuth discovery failures for misconfigured server urls by @tin-berri in https://github.com/BerriAI/litellm/pull/34225
refactor(ui): migrate workflow runs to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34370
refactor(ui): migrate models and endpoints table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34363
test(e2e): drive a real Linear OAuth MCP through chat completions under both ingress headers by @tin-berri in https://github.com/BerriAI/litellm/pull/33787
refactor(ui): migrate request logs table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34343
feat(ui): rebuild Organization Settings on react-hook-form + zod with a dirty-field PATCH by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34324
refactor(e2e): drop require_env, read os.environ where a cred is used by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34413
refactor(mcp): delete unreachable v1 OBO handler and gate REST OAuth on v2 resolver by @tin-berri in https://github.com/BerriAI/litellm/pull/34407
feat(cost-optimization): add spend-by-tool and cache leakage views by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33978
refactor(ui): migrate agents to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34365
refactor(ui): extract shared tab-routing helpers and adopt them in Models + Endpoints by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34435
feat(proxy): add overwrite_user_with_key_hash to stamp outgoing user param with key hash by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34417
fix(ui): find logs by request id across pages and dates (LIT-3981) by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/31743
fix(proxy): reject failed atomic budget reservations under fail_closed_budget_enforcement by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34429
ci: only run CodSpeed benchmarks on backend changes by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34345
fix(cost_tracking): map OpenAI cache_write_tokens for prompt cache creation billing by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34046
fix(proxy): restore atomic user upsert when adding team members by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34457
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34450
fix(ui): keep cache leakage time range picker inline at narrow widths by @tin-berri in https://github.com/BerriAI/litellm/pull/34439
feat(ui): show in the log drawer and session sidebar when an auto-router served a request by @tin-berri in https://github.com/BerriAI/litellm/pull/34434
refactor(ui): migrate memory page to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34366
refactor(ui): migrate budgets, skills, ui-theme to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34465
refactor(ui): migrate access-groups, vector-stores, organizations to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34466
refactor(ui): migrate logging-and-alerts, caching, policies to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34468
feat(ui): standalone /connect route for MCP OAuth, decoupled from Chat UI flag by @tin-berri in https://github.com/BerriAI/litellm/pull/34334
refactor(ui): migrate mcp-servers, tag-management, tool-policies to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34469
test(e2e): pin the a2a bridge agent's Anthropic key so message/send works by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34512
fix(guardrails/model_armor): handle None metadata in post_call _process_response (#34390) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34405
feat(anthropic): add Claude Opus 5 by @mateo-berri in https://github.com/BerriAI/litellm/pull/34518
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34519
test(a2a): assert the property agent returns listings, not just non-empty text by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34515
fix(logging): stop scheduling sync failure_handler concurrently with async_failure_handler by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34306
fix(vertex): incrementally parse accumulated Gemini stream JSON to prevent multi-value wedge by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34320
test: replace deprecated gpt-5-codex with gpt-5.3-codex by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34520
fix(gateway): install bedrock-realtime extra for Nova Sonic realtime by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34426
feat(proxy): add SAML 2.0 SSO for the admin UI by @yassin-berriai in https://github.com/BerriAI/litellm/pull/31429
feat(guardrails): add run_in_parallel opt-in for concurrent pre_call and post_call guardrails by @noahnistler in https://github.com/BerriAI/litellm/pull/33770
fix: handle explicit outputInfo: null in Vertex AI batch response by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34473
fix(otel): keep an MCP tool call in one trace, anchored to its own request by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34537
fix(ui): keep a key's MCP toolsets when saving an edit by @tin-berri in https://github.com/BerriAI/litellm/pull/34452
fix(ui): bind key duration input to one Form.Item so pre-filled expiry submits by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34521
feat(ui): migrate the Create Organization form to shadcn and react-hook-form by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34552
refactor(ui): derive the dashboard object_permission type from the generated schema by @tin-berri in https://github.com/BerriAI/litellm/pull/34454
test(e2e): cover MCP access-group tool selection at key creation by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34480
test: remove tests that mutation analysis proved assert nothing by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34475
fix(ui): keep entity usage tabs aligned with their panels by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34573
fix(guardrails): stop reporting a no-op guardrail as applied on passthrough by @tin-berri in https://github.com/BerriAI/litellm/pull/34411
fix(proxy): return 400 instead of 500 for chat completions without messages by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34547
fix(guardrails): keep guardrail information in spend logs when the caller sends its own metadata by @tin-berri in https://github.com/BerriAI/litellm/pull/34458
fix(responses): strip include_usage from stream_options instead of dropping the param by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34549
fix(guardrails): add /v1/messages support for Straiker plugin by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34548
fix(proxy/batches): resolve managed unified input_file_id to storage_url with ownership check before dispatch by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34474
fix(guardrails): derive tokens_saved when Headroom compression service omits it by @tin-berri in https://github.com/BerriAI/litellm/pull/34578
refactor(ui): migrate routing groups table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34571
fix(proxy): attribute org spend for team-linked credentials minted without org_id by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34577
fix(proxy/batches): make managed-file resolution additive, restore fall-back for missing-row and lookup errors by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34584
fix(bedrock-mantle): backfill usage on non-streaming /v1/messages responses by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34446
fix(proxy): cap /v1/tool/spend window at 30 days and bound every SpendLogs read by @tin-berri in https://github.com/BerriAI/litellm/pull/34582
feat(passthrough): record cost and usage reported by the upstream target by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34590
fix(logs): scope and bound the End User filter on the logs page by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34579
feat(ui): deep-link virtual key detail view via ?key= query param by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34591
revert(ui): return Models + Endpoints tabs to in-memory routing, keep the ?model drill-in by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34629
fix(proxy): merge model-level guardrails before pre_call_hook by @hclsys in https://github.com/BerriAI/litellm/pull/29654
fix(router): don't cool down parent deployment on advisor sub-call failure by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33792
test(e2e): cover /vllm chat passthrough against a hosted backend by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34432
test(e2e): point four suites at models the providers still serve by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34567
test(e2e): make the bedrock guardrail test match the guardrail it points at by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34568
fix(otel): stamp an MCP tool failure on the request that carried it by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34551
test(e2e): set reasoning_effort=none for gpt-5.6 chat tool calls by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34569
test(e2e): cover /v1/images/edits by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34476
chore(deps): bump gitpython and postcss to advisory-clear versions by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34634
fix(proxy): hash caller-supplied key in key update audit log object_id by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34632
test(e2e): cover /openai chat passthrough cost logging by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34470
fix(proxy): global max_budget ignores budget_duration; enforce against the resettable proxy budget row by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33732
fix(mcp): use a toolset row's stored tool name as written by @tin-berri in https://github.com/BerriAI/litellm/pull/34559
fix(auth): route JWT default-team into memberships instead of the create payload by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33082
ci: drop the docker SERVER_ROOT_PATH e2e job for a unit test by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34642
test: stop bedrock tool acompletion tests from making real network calls by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34644
fix(proxy): stop litellm/proxy from shadowing installed packages on sys.path by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34656
fix(cost-optimization): swap methodology Collapse for a shadcn HoverCard by @tin-berri in https://github.com/BerriAI/litellm/pull/34598
fix(ci): scope UI lint to the files a PR actually changed by @mateo-berri in https://github.com/BerriAI/litellm/pull/34600
fix(mcp): stop leaking upstream server credentials in tool-call 403 by @tin-berri in https://github.com/BerriAI/litellm/pull/34340
fix(batches): paginate managed batch list by unified_object_id cursor by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34192
fix(e2e): stop tests from breaking the shared proxy for every suite after them by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34664
fix(cost-optimization): anchor the savings line at a $0 range start by @tin-berri in https://github.com/BerriAI/litellm/pull/34453
fix(bedrock): stop replaying expired Google OIDC tokens to STS on guardrail auth by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34637
chore: bump litellm-enterprise 0.1.51 -> 0.1.52, litellm-proxy-extras 0.4.80 -> 0.4.81 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34669
chore(ui): rebuild Next.js build artifacts by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34671
fix(azure_ai): advertise 1M context window for Claude Opus 4.6+ on Foundry by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34556
feat(mcp): send RFC 8707 resource indicators on upstream OAuth legs by @tin-berri in https://github.com/BerriAI/litellm/pull/34265
fix(guardrails): resolve judge_model credentials via lazy Router lookup in llm_as_a_judge by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34509
style(ui): match MCP Servers tabs to the dashboard's line tab pattern by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34685
fix(ui): center vertical toolbar dividers by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34684
fix(ui): restore the Add MCP Server dialog size and header spacing by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34679
fix(ui): truncate long team names in the models table team dropdown by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34689
fix(e2e/ui): resolve dashboard base URL from env instead of hardcoding localhost by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34739
chore(deps): bump gitpython to 3.1.55 and brace-expansion to 5.0.8 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34798
fix(guardrails): preserve cache_control breakpoints in compresr write-back by @tin-berri in https://github.com/BerriAI/litellm/pull/34660
fix(install): pass an explicit Python version request to uv tool install by @tin-berri in https://github.com/BerriAI/litellm/pull/34750
refactor(management): move the logs end-user filter onto /management/v1 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34691
fix: match exact class in callback dedup so a custom subclass does not block a built-in logger by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34804
fix(prometheus): populate cache write token metrics for OpenAI-style usage by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34803
fix: backport the management/v1 end-user filter and four dashboard fixes onto rc/1.95.0 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34811
chore(typing): clear 2.7k basedpyright Any errors across 15 hotspot files by @mateo-berri in https://github.com/BerriAI/litellm/pull/34745
test(e2e): stop racing control-plane writes across the mcp, a2a, guardrail and passthrough suites by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34833
fix(ui): validate default team values in Default User Settings by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34815
fix(proxy): sanitize per-key callback config out of logged metadata by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32583
fix(proxy): roll up tool spend daily instead of scanning SpendLogs by @tin-berri in https://github.com/BerriAI/litellm/pull/34675
fix(responses_bridge): keep one chat completion id per stream and always stream completed responses by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34539
fix(guardrails): compress content-parts messages in headroom guardrail (Anthropic traffic) by @tin-berri in https://github.com/BerriAI/litellm/pull/34586
fix(router): release the pre-routing strategy slot when a deployment is replaced or deleted by @shivamrawat1 in https://github.com/BerriAI/litellm/pull/34564
fix(guardrails): classify all 4xx HTTPException guardrail blocks as intervened by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33821
chore: rebuild Admin UI bundle for release by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34859
test: unstale the reasoning-effort grid count and the responses bridge test by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34868
test(e2e): realign Admin UI specs with the MCP dialog and keyless landing by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34870
test(e2e): unblock the ui suite, fix the mcp registration race, park two known product bugs by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34853
test(e2e): make MCP and prometheus e2e tests robust to data-plane sync lag by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34854
Fix cache leakage card layout to keep date picker on right by @tin-berri in https://github.com/BerriAI/litellm/pull/34885
fix(gateway): route /a2a through the gateway component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34958
fix(e2e): poll for both spend rows before asserting the cache-hit contract by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34968
test(e2e): skip passthrough headers test until stage can route custom paths to provider creds by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34980
feat(ui): mark Cost Optimization as beta in the left nav by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34984
fix(proxy): avoid DB outage during planned RDS IAM rotation by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34749
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34864
test(e2e): bound the post-/model/new servable wait at 40s by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35020
test(e2e): poll MCP tools across multi-worker lag (#35047) by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35049
chore(release): backport #35271 to rc/1.95.0 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35299
chore(release): sync rc/1.95.0 with the v1.95.0-rc.1 main SHA by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35414
fix(ui): land general login on the keys dashboard, send MCP consent to /ui/connect (backport #35523 to rc/1.95.0) by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35552

New Contributors

@vineetpuranik made their first contribution in https://github.com/BerriAI/litellm/pull/33940
@jyeung-r7 made their first contribution in https://github.com/BerriAI/litellm/pull/33623
@lyb0307 made their first contribution in https://github.com/BerriAI/litellm/pull/33228

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.94.0...v1.95.0

Open source →

1.95.0rc31 Aug 2026pre-release

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit `0112e53`.

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0-rc.3

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.95.0-rc.3/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0-rc.3

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

chore(ci): promote internal staging to main by @mateo-berri in https://github.com/BerriAI/litellm/pull/32884
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33308
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33425
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33491
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33640
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33868
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34200
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34450
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34519
fix(azure_ai): advertise 1M context window for Claude Opus 4.6+ on Foundry by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34556
feat(mcp): send RFC 8707 resource indicators on upstream OAuth legs by @tin-berri in https://github.com/BerriAI/litellm/pull/34265
fix(guardrails): resolve judge_model credentials via lazy Router lookup in llm_as_a_judge by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34509
style(ui): match MCP Servers tabs to the dashboard's line tab pattern by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34685
fix(ui): center vertical toolbar dividers by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34684
fix(ui): restore the Add MCP Server dialog size and header spacing by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34679
fix(ui): truncate long team names in the models table team dropdown by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34689
fix(e2e/ui): resolve dashboard base URL from env instead of hardcoding localhost by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34739
chore(deps): bump gitpython to 3.1.55 and brace-expansion to 5.0.8 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34798
fix(guardrails): preserve cache_control breakpoints in compresr write-back by @tin-berri in https://github.com/BerriAI/litellm/pull/34660
fix(install): pass an explicit Python version request to uv tool install by @tin-berri in https://github.com/BerriAI/litellm/pull/34750
refactor(management): move the logs end-user filter onto /management/v1 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34691
fix: match exact class in callback dedup so a custom subclass does not block a built-in logger by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34804
fix(prometheus): populate cache write token metrics for OpenAI-style usage by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34803
chore(typing): clear 2.7k basedpyright Any errors across 15 hotspot files by @mateo-berri in https://github.com/BerriAI/litellm/pull/34745
test(e2e): stop racing control-plane writes across the mcp, a2a, guardrail and passthrough suites by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34833
fix(ui): validate default team values in Default User Settings by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34815
fix(proxy): sanitize per-key callback config out of logged metadata by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32583
fix(proxy): roll up tool spend daily instead of scanning SpendLogs by @tin-berri in https://github.com/BerriAI/litellm/pull/34675
fix(responses_bridge): keep one chat completion id per stream and always stream completed responses by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34539
fix(guardrails): compress content-parts messages in headroom guardrail (Anthropic traffic) by @tin-berri in https://github.com/BerriAI/litellm/pull/34586
fix(router): release the pre-routing strategy slot when a deployment is replaced or deleted by @shivamrawat1 in https://github.com/BerriAI/litellm/pull/34564
fix(guardrails): classify all 4xx HTTPException guardrail blocks as intervened by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33821
chore: rebuild Admin UI bundle for release by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34859
test: unstale the reasoning-effort grid count and the responses bridge test by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34868
test(e2e): realign Admin UI specs with the MCP dialog and keyless landing by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34870
test(e2e): unblock the ui suite, fix the mcp registration race, park two known product bugs by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34853
test(e2e): make MCP and prometheus e2e tests robust to data-plane sync lag by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34854
Fix cache leakage card layout to keep date picker on right by @tin-berri in https://github.com/BerriAI/litellm/pull/34885
fix(gateway): route /a2a through the gateway component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34958
fix(e2e): poll for both spend rows before asserting the cache-hit contract by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34968
test(e2e): skip passthrough headers test until stage can route custom paths to provider creds by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34980
feat(ui): mark Cost Optimization as beta in the left nav by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34984
fix(proxy): avoid DB outage during planned RDS IAM rotation by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34749
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34864
test(e2e): bound the post-/model/new servable wait at 40s by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35020
test(e2e): poll MCP tools across multi-worker lag (#35047) by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35049
chore(release): sync rc/1.95.0 with the v1.95.0-rc.1 main SHA by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35414

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.95.0-rc.2...v1.95.0-rc.3

Open source →

1.95.0rc231 Jul 2026pre-releaseDeprecated

test: replace deprecated gpt-5-codex with gpt-5.3-codex by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34520

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0-rc.2

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.95.0-rc.2/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0-rc.2

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

test(e2e): lower realtime server-VAD threshold to 0.5 by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/32710
fix(guardrails): mask credentials embedded in guardrail_response before persist (LIT-4314) by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32687
feat: add Meta Model API provider and muse-spark-1.1 (day-0) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32701
feat(models): add Azure GPT-5.6 (sol/terra/luna) pricing and metadata by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32678
ci: skip backend unit tests on ui-only PRs without stranding required checks by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32532
refactor(ui): colocate cost-tracking and prompts components into _components/ by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32716
refactor(ui): colocate tag-management and vector-stores views, keeping the shared selectors by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32719
refactor(ui): colocate the policies view, keeping PolicySelector shared by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32720
test: add /v1/messages to supported_endpoints schema enum by @tin-berri in https://github.com/BerriAI/litellm/pull/32739
fix(spend-logs): honor store_prompts_in_spend_logs for guardrail_information (LIT-4314) by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32688
fix(spend): sum multi-round session cost in logs UI by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32796
refactor(ui): colocate agents and guardrails views, keeping shared selectors and types by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32728
fix(mcp): stop persisting the DCR client onto true_passthrough and oauth_delegate server rows by @tin-berri in https://github.com/BerriAI/litellm/pull/32735
fix(e2e): batch credentials wiring and compose harness for live proxy suite by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/32744
feat(mcp): add dcr_bridge column and plumbing for client-forwarded auth modes by @tin-berri in https://github.com/BerriAI/litellm/pull/32745
chore(ui): make knip trustworthy and enforce dead-code in CI by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32727
build(pre-commit): regenerate eslint-metrics.json instead of failing on drift by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32717
feat(mcp): relay upstream 401 on client-forwarded pass-through tool calls by @tin-berri in https://github.com/BerriAI/litellm/pull/32556
feat(ui): add shared composable DataTable component by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32680
fix(mcp): fail closed and surface semantic filter context window errors by @tin-berri in https://github.com/BerriAI/litellm/pull/32715
refactor(ui): colocate the skills view, keeping the AIHub-shared skill components by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32803
feat(mcp): dcr_bridge authorize and token relay redirect handling with mandatory S256 by @tin-berri in https://github.com/BerriAI/litellm/pull/32747
ci(ui): move frontend lint into its own "UI Lint" workflow by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32810
feat(mcp): dcr_bridge discovery facade and register relay by @tin-berri in https://github.com/BerriAI/litellm/pull/32753
feat(mcp): add sealed envelope module for dcr_bridge client-held credentials by @tin-berri in https://github.com/BerriAI/litellm/pull/32748
fix(bedrock): keep mid-conversation system messages in place for Claude Invoke by @mateo-berri in https://github.com/BerriAI/litellm/pull/32578
fix(proxy): add coordination_redis routes to component allowlist by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32823
docs: point OSS contributors at the daily OSS branch by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32830
fix(proxy): build redis usage cache from REDIS_* env when cache backend is not Redis by @yassin-berriai in https://github.com/BerriAI/litellm/pull/32635
refactor(ui): full-height sidebar shell with content-scoped top bar by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32793
feat(otel): emit the gen_ai.client.operation.exception event on failed LLM calls by @yassin-berriai in https://github.com/BerriAI/litellm/pull/32655
feat(proxy): configure the coordination redis independently of the response cache by @yassin-berriai in https://github.com/BerriAI/litellm/pull/32661
feat(deploy): make coordination redis a first-class chart and terraform surface by @yassin-berriai in https://github.com/BerriAI/litellm/pull/32662
feat(mcp): add dcr_bridge envelope consumer helpers by @tin-berri in https://github.com/BerriAI/litellm/pull/32794
fix(proxy): match multi-mode guardrail_mode without false-COMPLIANT by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32832
fix(mcp): merge credentials within the client-forwarded class on an auth-type switch by @tin-berri in https://github.com/BerriAI/litellm/pull/32815
ci: authorize the expression package (MIT) in liccheck.ini by @tin-berri in https://github.com/BerriAI/litellm/pull/32847
fix(redis): only use SSLConnection when ssl is truthy in connection pool kwargs by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32825
refactor(ui): convert caching page charts to shadcn/recharts by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32721
fix: strip trailing slash from --base-url in lite CLI by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/32845
feat(router): add LLM-based classifier option to complexity router by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/32169
fix(bedrock): add jp.anthropic.claude-opus-4-8 to model cost map by @mateo-berri in https://github.com/BerriAI/litellm/pull/32840
fix(responses): preserve reasoning_tokens through chat->responses usage translation by @mateo-berri in https://github.com/BerriAI/litellm/pull/32837
fix(bedrock): gate in-place system role messages on model support for Claude Invoke by @mateo-berri in https://github.com/BerriAI/litellm/pull/32831
fix(responses-api): raise APIError on in-stream error events; widen ErrorEventError.param to accept dict by @mateo-berri in https://github.com/BerriAI/litellm/pull/32835
fix(prometheus): skip budget metric DB/cache lookups when gauges are NoOpMetric by @mateo-berri in https://github.com/BerriAI/litellm/pull/32834
fix(anthropic): strip @version suffix in _model_map_lookup_candidates so @default Vertex AI models resolve to adaptive thinking by @mateo-berri in https://github.com/BerriAI/litellm/pull/32833
fix(datadog): split log batches proactively under intake payload limits by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32860
fix(anthropic): translate adaptive thinking/effort to pre-4.6 model support by @mateo-berri in https://github.com/BerriAI/litellm/pull/32867
test(models): assert capability fields on regional Azure gpt-5.6 entries by @mateo-berri in https://github.com/BerriAI/litellm/pull/32875
fix(bedrock): flag mapped Claude 4.8+ entries with supports_mid_conversation_system by @mateo-berri in https://github.com/BerriAI/litellm/pull/32882
fix(mcp): rework the dashboard credential-field lifecycle so the OAuth app is upstream-scoped by @tin-berri in https://github.com/BerriAI/litellm/pull/32752
feat(ui): root the gateway breadcrumb in the AI Gateway selector by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32886
feat(ui): dcr_bridge toggle for client-forwarded MCP auth modes by @tin-berri in https://github.com/BerriAI/litellm/pull/32804
feat(ui): add filter drawer, column visibility, and search to the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32856
feat(ui): typed openapi-fetch foundation (fetchClient) + first typed caller (useCustomers) by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/29884
test(e2e): cover Langfuse logging.yaml P0 logs_spend cells by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/32857
refactor(ui): use TanStack Pacer debounce for the team keys search by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32919
fix(mcp): strip scheme default port from get_request_base_url netloc by @tin-berri in https://github.com/BerriAI/litellm/pull/32921
fix(mcp): re-register DCR client when proxy origin no longer matches its registered redirect_uri by @tin-berri in https://github.com/BerriAI/litellm/pull/32527
refactor(fallback-generalizations): split rules into routing and provider-neutral capability kinds by @mateo-berri in https://github.com/BerriAI/litellm/pull/32873
test(e2e): drop vertex from pipecat tool smoke and remove key models dropdown suite by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/32925
ci: gate tests/e2e on zero basedpyright errors in pre-commit and lint CI by @mateo-berri in https://github.com/BerriAI/litellm/pull/32918
fix(rate-limit-v3): populate x-ratelimit-* remaining/limit values in standard_logging_object for streaming by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32711
test: remove live OpenAI fine-tuning job-creation test blocked by platform wind-down by @mateo-berri in https://github.com/BerriAI/litellm/pull/32933
feat(team): add RESTful PATCH /team/{team_id} with JSON merge patch semantics by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32883
chore(ui): remove eslint-metrics.json lint-count snapshot by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32930
feat: add lite auth print-token for Claude Code apiKeyHelper support by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/32846
refactor(ui): convert activity metrics charts to shadcn/recharts by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32726
feat(ui): extend topnav border across the sidebar header by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32920
fix(anthropic): thread real provider through capability probes instead of pinning anthropic by @mateo-berri in https://github.com/BerriAI/litellm/pull/32874
feat(auto_router): keyword tier overrides and semantic keyword matching for the complexity router by @mateo-berri in https://github.com/BerriAI/litellm/pull/32859
feat(auto_router): keyword tier overrides and semantic keyword matching for the complexity router by @akapur99 in https://github.com/BerriAI/litellm/pull/32829
feat(ui): add redesigned sidebar account menu by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32931
fix(guardrails): filter Add-Guardrail mode dropdown per provider by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32712
feat(complexity_router): log the cause of each routing decision by @akapur99 in https://github.com/BerriAI/litellm/pull/32943
feat(mcp): admit dcr_bridge oauth_delegate clients via a single envelope bearer by @tin-berri in https://github.com/BerriAI/litellm/pull/32824
refactor(ui): convert user agent and per-user usage charts to shadcn/recharts by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32725
docs(anthropic): clarify the Opus 4.5 branch in adaptive-effort translation by @akapur99 in https://github.com/BerriAI/litellm/pull/32876
fix(proxy): enforce budget and cost tracking for Dashscope tiered pricing by @shivamrawat1 in https://github.com/BerriAI/litellm/pull/32942
refactor(ui): extract a shared CopyButton and fix the sidebar copy confirmation by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32945
refactor(ui): convert entity usage and usage page charts to shadcn/recharts by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32729
feat(guardrails): add pre_mcp_call support to Content Filter by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32936
refactor(e2e): bucket rate limits, budgets, and spend tracking under quota_management by @mateo-berri in https://github.com/BerriAI/litellm/pull/32928
chore: bump litellm-proxy-extras 0.4.75 -> 0.4.76 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32957
feat(proxy): add expires filter to GET /key/list by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32953
refactor(ui): colocate the usage view, keeping the shared usage components by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32952
chore(ui): rebuild committed admin dashboard bundle for rc release by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32960
refactor(ui): convert projects page chart to shadcn/recharts by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32722
feat(ui): working Test Connection for the complexity auto router by @akapur99 in https://github.com/BerriAI/litellm/pull/32950
fix(xecguard): use StandardLoggingGuardrailInformation in logging hook by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32911
feat(ui): adopt openapi-react-query ($api) and convert useCustomers by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32949
refactor(ui): colocate the mcp-servers view, keeping the shared mcp_tools surface by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32968
refactor(ui): convert endpoint usage charts to shadcn/recharts by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32723
fix(proxy-auth): stop unrecognized model namespaces slipping through provider wildcard keys by @mateo-berri in https://github.com/BerriAI/litellm/pull/32979
feat(router): random-pick multi-model complexity tiers by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/32967
fix(xecguard): sanitize scan result before recording it for logging by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32935
fix(auto_router): filter embedding models in complexity tab dropdowns, require all tiers, inline validation by @akapur99 in https://github.com/BerriAI/litellm/pull/32978
fix(anthropic): translate raw adaptive thinking for pre-4.6 models on chat completions and Bedrock Converse by @akapur99 in https://github.com/BerriAI/litellm/pull/32944
feat(router): add Router(plugins=[...]) routing-plugin pipeline by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/32972
feat(router): soft-floor adaptive mode for complexity router by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/32947
docs(github): add QA runbook section to the PR template by @mateo-berri in https://github.com/BerriAI/litellm/pull/32965
fix(model_cost): add supports_reasoning: false to Gemini image generation models by @mateo-berri in https://github.com/BerriAI/litellm/pull/32836
build(dev-env): add make bootstrap and unprovisioned-checkout preflight to pre-commit by @mateo-berri in https://github.com/BerriAI/litellm/pull/32981
ci(ui): report only error-level knip findings in CI by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32971
feat(batches): track cost for unmanaged Bedrock batches, generalize the flag by @Sameerlite in https://github.com/BerriAI/litellm/pull/32315
fix(guardrails): walk custom_tool_call_output items in _content_utils by @yucheng-berri in https://github.com/BerriAI/litellm/pull/32969
fix: show and allow editing team model aliases after team creation by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33047
chore(deps): bump pillow to 12.3.0 to resolve osv-scan CVEs by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33093
feat(mcp): mint gateway-bound envelope at the token endpoint for dcr_bridge oauth_delegate by @tin-berri in https://github.com/BerriAI/litellm/pull/32828
fix(mcp): surface rejected delegate-auth upstream tokens as connect-time 401 by @tin-berri in https://github.com/BerriAI/litellm/pull/32741
fix(proxy): track unauthenticated pass-through requests in spend logs by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32410
feat(lasso): send source.type for Used By attribution by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33090
fix(responses): continue MCP gateway tool turns from the final response and surface failures by @thibault-linktree in https://github.com/BerriAI/litellm/pull/33025
fix(responses): continue MCP gateway tool turns from the final response and surface failures by @tin-berri in https://github.com/BerriAI/litellm/pull/33099
fix(completion): forward aws credential kwargs into litellm_params so the responses bridge keeps WIF auth by @mateo-berri in https://github.com/BerriAI/litellm/pull/32956
fix(ui): respect litellm_key_header_name in BYOK credential save and workflow runs fetches by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33103
refactor(ui): standardize debounce waits behind shared DEBOUNCE_WAIT_MS constant by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33040
feat(ui): rebuild the Virtual Keys table on the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32991
fix: redact async complete streaming response for custom callbacks by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33106
build(ui): bump @tanstack/react-pacer from 0.2.0 to 0.22.1 by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33041
fix(ui): address Virtual Keys redesign review nits by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33112
fix(openai/responses): clamp max_output_tokens below API minimum by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33098
fix(prometheus): read v3 rate limiter remaining values for per-key model gauges by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33119
fix(ui): drop w-full from page-content wrappers to remove 32px horizontal overflow by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33118
refactor(ui): migrate straightforward value debounces to react-pacer by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33042
feat(mcp): interactive SSO sign-in for dcr_bridge oauth_delegate DCR clients by @tin-berri in https://github.com/BerriAI/litellm/pull/32946
test(proxy): add regression tests for management_endpoints edge cases by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32976
fix(auto-router): correct Responses API tool_choice shape and propagate alias litellm_params by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/32974
fix(ui): render the sidebar scrollbar with shadcn ScrollArea by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33124
refactor(ui): migrate callback debounce sites to react-pacer with regression tests by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33043
chore: add CODEOWNERS for ui and proxy UI build artifacts by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33131
feat(mcp): client-held refresh envelope for the dcr_bridge oauth_delegate flow by @tin-berri in https://github.com/BerriAI/litellm/pull/32980
feat(ui): rebuild the Teams table on the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33128
fix(mcp): relay upstream OAuth token and DCR rejections instead of a generic 500 by @tin-berri in https://github.com/BerriAI/litellm/pull/33113
fix(keys): persist key_type so the UI shows correct key scope instead of "All Proxy Models" by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33115
feat(router): opt-in session affinity for complexity router by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/33126
feat(prometheus): expose video duration and image count consumption metrics by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33138
test(e2e): otel trace completeness on /chat/completions by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33132
fix(sso): paginate through all pages when fetching service principal group assignments by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33149
test(e2e): otel trace completeness on /v1/messages by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33133
feat(ui): add adaptive routing settings to Auto-Router v2 by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/33146
refactor(mcp): extract the dcr_bridge token flow into bridge_token_flow.py by @tin-berri in https://github.com/BerriAI/litellm/pull/33141
chore: bump litellm 1.93.0 -> 1.94.0, litellm-enterprise 0.1.49 -> 0.1.50, litellm-proxy-extras 0.4.76 -> 0.4.77 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33229
fix(proxy): route master key to team-scoped models by @kunal2002 in https://github.com/BerriAI/litellm/pull/32926
chore(deps): pin httplib2 and setuptools transitive floors by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33233
feat(ui): left-anchor the Create Key and Create Team CTAs by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33248
fix(anthropic/passthrough): drop incompatible temperature when downgrading adaptive thinking for pre-4.6 models by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33244
fix(guardrails): run apply_guardrail-style model-level pre_call guardrails at deployment hook by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33136
fix(proxy)!: enforce user budget on team keys (read-time + reservation) with UI opt-out by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32005
fix(e2e): bound spend-log snapshots to a /spend/logs/v2 window by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33265
test(e2e): cover key rpm/tpm rate limiting, window reset, and pacing headers by @mateo-berri in https://github.com/BerriAI/litellm/pull/32914
fix(anthropic): use native output capability by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/33235
fix(ci): retry setup-uv installs to survive transient manifest fetch failures by @mateo-berri in https://github.com/BerriAI/litellm/pull/33279
fix(proxy): never log raw virtual keys in key insertion debug output by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33268
fix(bedrock_mantle): route xai.grok-4.3 via /openai/v1 frontier path by @marty-sullivan in https://github.com/BerriAI/litellm/pull/33027
feat(pricing): add gemini-omni-flash-preview with video output token pricing by @mateo-berri in https://github.com/BerriAI/litellm/pull/33274
fix(auth): scope the JWT enterprise gate to actual JWTs by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33296
fix(s3): sanitize slashes in response-id-derived object key file name by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33271
refactor(ui): migrate guardrails table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33303
feat(guardrails): streaming text transformation in generic_guardrail_api by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33110
test(e2e): cover model-aware mid-conversation system handling on Bedrock Invoke /v1/messages by @mateo-berri in https://github.com/BerriAI/litellm/pull/32963
test(claude_code): move the Claude Code compatibility matrix under tests/e2e by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32548
chore(ci): sync litellm_internal_staging into daily OSS branch by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33337
feat(bedrock guardrails): add resource-less InvokeGuardrailChecks (detect-only) mode by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33299
Revert "chore(ci): sync litellm_internal_staging into daily OSS branch" by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33339
fix(websearch): intercept web search on the Responses API by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33129
fix(anthropic-adapter): drop empty content_block_delta events by @mateo-berri in https://github.com/BerriAI/litellm/pull/33315
fix(mcp): persist discovered OAuth endpoints and keep last known good on failed re-discovery by @tin-berri in https://github.com/BerriAI/litellm/pull/33286
test(e2e): otel trace completeness on streaming chat, messages, and responses (LIT-3787) by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33234
feat(router): resolve auto-router routing plugins from proxy YAML config by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/33251
test(e2e): failed request error span carries the full untruncated message and status (LIT-4179) by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33304
refactor(ui): migrate tags table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33314
fix(cli): surface actionable CLI SSO errors when CLI and proxy versions skew by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33309
feat(bedrock_mantle): add GPT-5.6 sol/terra/luna to model cost map by @mateo-berri in https://github.com/BerriAI/litellm/pull/33412
chore(codeowners): exempt generated schema.d.ts from UI ownership by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33411
feat(proxy): push-based OTLP billable-request metering for enterprise deployments by @yassin-berriai in https://github.com/BerriAI/litellm/pull/31592
fix(mcp): cap per-user OAuth token cache TTL at the token's own lifetime by @tin-berri in https://github.com/BerriAI/litellm/pull/33346
feat(ui): move Caching out of Experimental into Developer Tools by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33432
chore(ci): merge daily internal staging branch by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33335
feat(guardrails): add Compresr guardrail for query-aware context compression by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33295
fix(logging): preserve callback order in get_combined_callback_list by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33005
fix(logging): redact assistant tool call arguments in spend logs by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33111
fix(anthropic): honor messages request timeout by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33418
fix(llm_guard): apply sanitized prompt returned by moderation API to request by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33331
fix(logging): stop pinning large request payloads past request end by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33455
feat(guardrails): forward optional metadata on POST /guardrails/apply_guardrail by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33067
build: raise requires-python cap to <3.15 so Python 3.14 installs current releases by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33438
feat(ui): add reusable BetaBadge and use it for Projects sidebar item by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33449
fix(mcp): discover missing OAuth scopes and token_url when authorization_url is set manually by @tin-berri in https://github.com/BerriAI/litellm/pull/33317
feat(ui): show exact license expiration date in usage cards by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33478
test(claude_code): rename misleading REPO_ROOT to SUITE_ROOT in test_v0_layout by @mateo-berri in https://github.com/BerriAI/litellm/pull/33472
build(deps): update ddtrace to the 4.x line by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33484
fix(complexity_router): return empty dict from _classifier_call_metadata when metadata is absent by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33452
fix(ui/chat): resolve chat routes at render time so navigation works under server_root_path by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33446
fix(key management): enforce minimum custom key length and mask short keys in key_name by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33462
chore(ui): remove unmounted UsageIndicator and the Hide Usage Indicator flag by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33482
test(e2e/claude_code): add passthrough matrix row for the big-3 clouds and Anthropic API by @mateo-berri in https://github.com/BerriAI/litellm/pull/33473
fix(ui): stop sending the complexity-router pseudo-model to /health/test_connection by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/33498
feat(cli): add lite up/down to ambiently route Claude Code through the proxy by @krrish-berri-2 in https://github.com/BerriAI/litellm/pull/33231
feat(complexity_router): enable session_affinity by default by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33500
fix(anthropic): stop 500 on combined thinking+signature streaming chunk by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33505
feat(autoroute): prompt for semantic keywords per tier in configure wizard by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33508
fix(cli/anthropic): unblock lite autoroute proxy deps, adaptive thinking, and thinking+signature streaming by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33507
test(ocr): use mistral-document-ai-2512 in azure_ai OCR tests by @mateo-berri in https://github.com/BerriAI/litellm/pull/33489
fix(guardrails): show YAML-defined guardrails in the Guardrail Monitor by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32853
refactor(ui): migrate policies, deleted keys, deleted teams, budgets, and search tools tables onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33357
refactor(ui): migrate vector stores, prompts, and skills tables onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33343
test(e2e): datadog log delivery for successful chat, messages, and responses (LIT-4447) by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33415
fix(cli): make CLI output ASCII-only so it doesn't crash legacy Windows consoles by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33465
fix: remove dead user-cache lookup with None key in spend-update path by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33555
feat(helm): add per-component PodDisruptionBudget and topologySpreadConstraints to componentized chart by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33430
fix(e2e/claude_code): unblock stage collection, align proxy env names, register compat models by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33433
fix(mcp): index authed request-time tools missing from the semantic filter startup index by @tin-berri in https://github.com/BerriAI/litellm/pull/33318
fix(streaming): use provider-reported usage cost for OpenRouter streams by @mateo-berri in https://github.com/BerriAI/litellm/pull/32255
feat(mcp): issuer-anchored OAuth discovery (RFC 8414 §3.3) to close the authorization-server mix-up by @tin-berri in https://github.com/BerriAI/litellm/pull/33450
feat(logging): add user and team level spend and budget to StandardLoggingPayload metadata by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33459
fix(router): cast model_info cost values to float in _set_model_group_info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33556
chore(e2e): establish litellm_e2e_staging integration line by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33502
fix(ui): navigate to /ui/login/ with trailing slash via hard navigation by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33561
feat(logging): add structured budget fields to budget rejection failure logs by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33460
fix(streaming): surface upstream connection resets instead of empty 200 streams by @mateo-berri in https://github.com/BerriAI/litellm/pull/33222
fix(proxy_cli): reap orphaned prisma query-engine processes when a worker dies by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33424
test(reasoning_effort_grid): enable azure fable-5 and opus-4-8 grid cells by @mateo-berri in https://github.com/BerriAI/litellm/pull/33485
build(deps): bump uvicorn lock to 0.51.0 so worker health-check and jitter flags take effect by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33574
fix(proxy): coerce default_internal_user_params.max_budget to float on config load by @yassin-berriai in https://github.com/BerriAI/litellm/pull/32434
fix(router): honor per-request routing_strategy from key/team router_settings by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33429
fix(redis): honor ssl value instead of key presence when building async connection pool by @yassin-berriai in https://github.com/BerriAI/litellm/pull/32590
fix(langfuse_otel): build per-request OTLP exporter from key and team dynamic Langfuse credentials by @yassin-berriai in https://github.com/BerriAI/litellm/pull/32437
ci: run zizmor and proxy-db unit tests on PRs targeting litellm_ branches by @mateo-berri in https://github.com/BerriAI/litellm/pull/33568
fix(router): apply team/key enable_tag_filtering to tag routing by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33436
feat(proxy): add disable_auto_add_proxy_admin_to_teams flag by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33563
fix(proxy): stop stale auth cache re-publish to Redis so key updates propagate across replicas by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33565
feat(e2e): emit structured E2E_RESULT lines for package status history by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33578
chore: bump litellm-enterprise 0.1.50 -> 0.1.51, litellm-proxy-extras 0.4.77 -> 0.4.78 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33571
fix(docker): restore litellm-proxy-extras source dir in runtime images by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33592
feat(ui): require embedding model for semantic auto router by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33313
feat(scim): ingest and round-trip SCIM entitlements and roles user attributes by @tin-berri in https://github.com/BerriAI/litellm/pull/33587
refactor(ui): migrate 5 simple tables onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33548
fix(model_armor): restore reference attachments via skip_unscannable_attachments and remove the attachment count cap by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33554
fix(mcp): keep the MCP reference intact when the semantic filter narrows tools by @tin-berri in https://github.com/BerriAI/litellm/pull/33584
fix(sso): stop enforcing UI session budget on CLI login tokens by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33312
test: e2e staging leftovers by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33613
test(e2e/claude_code): add GPT-5.6 Sol/Terra/Luna columns for OpenAI, Azure OpenAI, and Bedrock Mantle by @mateo-berri in https://github.com/BerriAI/litellm/pull/33474
test(e2e): otel streaming spans record a real ttft below span duration by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33588
fix(mcp): make the preemptive-401 OAuth challenge decision mode-aware by @tin-berri in https://github.com/BerriAI/litellm/pull/33586
fix(ui): show all teams in policy attachment form for admins by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33628
refactor(ui): migrate AI Hub, public hub, and MCP Toolsets tables onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33629
test(e2e): datadog log delivery for streamed routes, read back from the real datadog api by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33566
fix(vertex_ai): surface Gemini grounding toolUsePromptTokenCount in Usage by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33533
test(e2e): harness fixes for stage job green (skips + router/UI/budget) by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33634
fix(router): resolve prompt cache minimum per model instead of a flat 1024 by @tin-berri in https://github.com/BerriAI/litellm/pull/33637
fix(logging): classify async anthropic_messages and generate_content as async by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33589
fix(ui): remove Chat item from dashboard leftnav by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33647
fix(router): tag-aware pre-routing strategy selection for shared model_name by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33691
fix(proxy): enforce max_parallel_requests as a per-slot concurrency gauge by @yassin-berriai in https://github.com/BerriAI/litellm/pull/32441
fix(proxy): stop treating upstream model body field as a LiteLLM model on auth-enforced pass-through routes by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33710
fix(mcp): expand toolset grants in shared permission primitives so tools/call honors them by @tin-berri in https://github.com/BerriAI/litellm/pull/33612
feat(complexity-router): user-triggered escalation keywords by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33656
fix(fireworks_ai): bill prompt-cache hits at cache_read rate by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33714
fix(pricing): mark realtime-only gpt-realtime models as mode realtime by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33728
fix(rag): track LLM completion usage and spend for /v1/rag/query by @yassin-berriai in https://github.com/BerriAI/litellm/pull/32438
feat(anthropic): add enable_anthropic_prompt_caching for automatic cache_control injection by @tin-berri in https://github.com/BerriAI/litellm/pull/33573
fix(anthropic): self-heal on missing thinking-signature errors from Bedrock/Vertex by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33719
fix(proxy): resolve router_settings.plugins dotted paths and load plugins from installed packages by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33644
test(e2e): budget refusals are 429 for bare keys and team caps block every team key by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33632
feat(router): add router plugin reference catalog by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33746
test(e2e): assert an org budget block is a 429 naming the organization by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33638
fix(proxy): bill partial streamed spend when the client disconnects mid-stream by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33736
test(e2e): delete unreferenced Grafana panel docs by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33743
docs(tests/e2e): align skip-vs-fail docs with the hard-fail contract and scope the no-unit-tests rule by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33755
refactor(e2e): replace bespoke result reporter with standard JUnit report by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33758
test(e2e): user budget across keys and team member budget isolation by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33745
refactor(e2e): remove bob_the_builder; drive remediation from a Grafana alert (provisioned outside the repo) by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33749
feat(mcp): per-server outcomes for aggregate tools/list and truthful single-server REST statuses by @tin-berri in https://github.com/BerriAI/litellm/pull/33153
test(e2e): mcp suite for key-without-access denial by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33752
chore(ci): merge oss branch by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33784
chore(ci): merge oss branch - July 17th by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33793
fix(ui): migrate tag deletion to shared DeleteResourceModal by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33795
build(rust): raise pyo3 to 0.29 so the native bridge compiles on Python 3.14 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33798
chore(guardrails): remove docstring from singulr module for consistency by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33800
fix(ui): stop credential edit from persisting the masked api key by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33797
build(deps): allow redisvl, pypdf, and openapi-core on Python 3.14 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33801
test(proxy): make streaming-cancel mocks awaitable for the disconnect slot release by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33802
test(e2e): a member's team budget cuts off only that member's key by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33718
test(e2e): a user's max_budget follows the person across personal and team keys by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33762
test(e2e): skip flaky OpenAI GPT cells; raise multi-window max_tokens by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33799
chore: remove accidentally committed dist tarball and ignore dist/ by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33805
fix(passthrough): stop classifying plain 'predict'/'search' paths as Vertex by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33658
build(deps): bump mcp lock to 1.28.1 to clear image-scan findings by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33803
test(pricing): pin the realtime mode assertion to the bundled cost map by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33806
fix(proxy): derive session id from Anthropic metadata.user_id for session affinity by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33723
test(e2e): budget reset diagonal for team, org, user, and #32005 team-member keys by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33771
fix(proxy): source /v1/models token limits from the cost map instead of Router.get_model_group_info by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33721
fix(fireworks_ai): correct glm-5p2 prompt-cache read price to $0.14/1M by @tin-berri in https://github.com/BerriAI/litellm/pull/33796
feat(proxy): add x-litellm-model-name response header with deployment model string by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33698
feat: add Straiker guardrail integration by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33781
fix(vertex_ai): exclude Gemini Google Search grounding tokens from input token billing by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33742
feat(fireworks_ai): map litellm session id to x-session-affinity header for prompt caching by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33717
feat(ui): configure Anthropic automatic prompt caching from the Admin UI by @tin-berri in https://github.com/BerriAI/litellm/pull/33581
fix(router): enforce context-window pre-call checks for Responses API input by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33706
fix(otel): restore proxy-level error.* attributes on v2 failure spans (LIT-4179) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33664
fix(mcp): persist config.yaml DCR clients in a server-scoped store so refresh survives token expiry by @tin-berri in https://github.com/BerriAI/litellm/pull/33768
refactor(ui): consolidate Add/Edit credential modals into one CredentialModal by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32572
feat(mcp): add ID-JAG (identity assertion authorization grant) support for MCP egress by @yassin-berriai in https://github.com/BerriAI/litellm/pull/31516
refactor(ui): migrate policy attachments table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33827
docs(litellm-rust): add provider coding standards by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33833
test(e2e): rename Gateway to ProxyClient and expose it as a session-scoped pytest fixture by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33750
feat(messages): route Azure Anthropic /messages through Rust behind rust:true by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33616
test(e2e): add Locust throughput load test that runs last by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33748
fix(proxy): resolve team wildcard credentials for vector store files by @shivamrawat1 in https://github.com/BerriAI/litellm/pull/33649
refactor(e2e): fold claude_code HTTP probes onto shared ProxyClient methods by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33760
test(e2e): harden stage flakes for batches, UI, and MCP by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33831
fix(e2e): migrate load suite from e2e_gateway to ProxyClient by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33839
chore(e2e): remove tests/e2e/docker-compose.yml by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33837
test(e2e): cover /v1/responses openai basic nonstream and stream by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33830
test(e2e): cover /v1/responses openai cost_logged and tool_use by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33835
test(e2e): cover /v1/responses OpenAI vision and Anthropic basic by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33838
test(e2e): spendlog cost for streaming /v1/messages via responses bridge by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33753
fix(docker): bake prisma CLI and engines at a fixed path so fresh-DB migrations work for any uid offline by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33853
feat(chat-ui): add personal Logs view scoped to the current user by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33829
chore: bump litellm-proxy-extras 0.4.78 -> 0.4.79 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33855
docs(litellm-rust): require the official Rust Style Guide in agent rules by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33867
fix(router): treat malformed configured token limits as absent on /v1/models by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33864
chore: rebuild admin UI bundle for the rc release by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33857
docs(rust): add provider abstraction standards by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33865
feat(spend): track prompt compression saved tokens in daily spend aggregates by @tin-berri in https://github.com/BerriAI/litellm/pull/33810
test(e2e): assert the long budget window keeps blocking after the short window resets by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33832
feat(messages): route native Anthropic /messages through Rust behind LITELLM_RUST env var by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33848
test(e2e): cover credential-backed /v1/messages request by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33863
feat(rust): expose Anthropic Messages route (POST /v1/messages) on the axum gateway by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33880
feat(rust): 1:1 port of OpenAI Responses API WebSockets to litellm-rust by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33849
fix(proxy): treat malformed cost-map token limits as absent on /v1/models by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33903
feat(rust): port BaseAWSLLM auth (credential resolution + SigV4) to litellm-core as a base provider by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33888
feat(complexity-router): add return_raw_model_name toggle for response model field by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33875
feat(mcp): always-on aggregate gateway DCR discovery front door by @tin-berri in https://github.com/BerriAI/litellm/pull/33174
fix(langfuse): send v4 ingestion header for otel callback by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33907
feat(ui): add configuration tabs to the Cost Optimization page by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33899
test(e2e): guard destructive spend-log truncate behind an explicit opt-in by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33751
chore(rust): migrate the litellm-rust workspace (core, ai-gateway, python-bridge) from Rust edition 2021 to edition 2024 by @vineetpuranik in https://github.com/BerriAI/litellm/pull/33940
fix(fireworks_ai): restore Content-Type application/json header (fixes 415) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33929
feat(spend): raise /spend/logs/v2 page_size cap to 1000 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33994
feat(mcp): identity-only session tokens for the gateway DCR front door by @tin-berri in https://github.com/BerriAI/litellm/pull/33182
test(e2e): cover key regeneration rotating to a working new key by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34000
test(e2e): cover tag creation persisting for spend categorization by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34018
test(e2e): cover organization deletion removing it from /organization/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34009
perf(bedrock): audio transcription via rust core (py->rust bridge) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33990
chore(ci): retire daily OSS branches in favor of litellm_internal_staging by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34030
test(e2e): cover model update persisting to /model/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34017
test(e2e): cover key block persisting to /key/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34014
test(e2e): cover created team appearing in /team/list by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34015
test(e2e): cover created user appearing in /user/list by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34016
test(e2e): cover team update persistence via /team/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33997
feat(bedrock): forward bedrock_tags to CreateModelInvocationJob for batch jobs by @mateo-berri in https://github.com/BerriAI/litellm/pull/33733
test(e2e): cover model registration persistence in /model/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33996
test(e2e): cover user update persistence via /user/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33998
test(proxy): make model_info endpoint tests hermetic to kill an order/merge-skew flake by @mateo-berri in https://github.com/BerriAI/litellm/pull/34037
chore(e2e): prune the non-deterministic perf.latency SLO coverage cell by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34024
fix(ui): hide guardrail group headers when only one group has entries by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33885
test(e2e): cover model deletion removing it from the catalog by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34006
test(e2e): cover organization update persistence via /organization/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34010
test(e2e): cover team deletion persistence and key revocation by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33999
test(e2e): cover user deletion removing it from user inventory by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34007
test(e2e): cover created key appearing in /key/list inventory by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34008
fix(cache): make in-memory and disk cache increments atomic by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34013
test(e2e): add reliability suite covering fallback, timeout, and cache behavior by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34023
test(true_rabbit): cover passthrough headers, batch assume-role, gemini, vllm, bedrock guardrails, batch rate-limit mapping by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33843
fix(anthropic): only inject cache_control when the request carries none by @tin-berri in https://github.com/BerriAI/litellm/pull/33886
feat(mcp): support MCP servers on the Anthropic /v1/messages API by @tin-berri in https://github.com/BerriAI/litellm/pull/33631
feat(mcp): migrate client_credentials (M2M) onto the v2 resolver arm by @tin-berri in https://github.com/BerriAI/litellm/pull/32259
fix(router): stop custom model_info leaking onto shared backend cost map key by @mateo-berri in https://github.com/BerriAI/litellm/pull/34041
perf(streaming): build per-chunk Delta directly instead of setattr/delattr churn by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33992
refactor(mcp): consolidate exception-tree walkers into one shared faults traversal by @tin-berri in https://github.com/BerriAI/litellm/pull/33183
fix(budget): reset users/teams whose budget_reset_at is NULL by @jyeung-r7 in https://github.com/BerriAI/litellm/pull/33623
perf(core): fast-path SafeAttributeModel.delattr for declared fields by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33993
fix(auth): set budget_reset_at when JWT upsert seeds a budget_duration by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34050
fix(proxy/auth): handle tz-aware temp_budget_expiry by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33840
fix(vertex,azure): model-aware mid-conversation system for Claude /v1/messages by @mateo-berri in https://github.com/BerriAI/litellm/pull/33807
fix(auth): apply temp_budget_increase for cache-hit keys by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33841
fix(agents): allow optional securityScheme fields so /public/agent_hub does not 500 by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33897
build(deps-dev): bump js-yaml to 4.3.0 and brace-expansion to 5.0.7 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34056
refactor(ui): migrate credentials table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34053
fix(cli): stable port and persisted master key for lite autoroute up by @tin-berri in https://github.com/BerriAI/litellm/pull/34026
fix(mcp): return the DCR client's own redirect_uris to stop the /callback self-redirect loop by @tin-berri in https://github.com/BerriAI/litellm/pull/33756
feat: add deepkeep as custom guardrail by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33844
fix(router): propagate capability flags to shared backend cost map key by @mateo-berri in https://github.com/BerriAI/litellm/pull/34047
fix(mcp): add Google Sheets, Drive, Calendar, and Docs to the OpenAPI registry by @tin-berri in https://github.com/BerriAI/litellm/pull/34059
fix(bedrock_mantle): hoist Codex additional_tools input items to top-level tools by @lyb0307 in https://github.com/BerriAI/litellm/pull/33228
fix(bedrock_mantle): gate unsupported service_tier on drop_params for the Responses API by @mateo-berri in https://github.com/BerriAI/litellm/pull/34058
feat(proxy): auto-enable drop_params for Codex user agents by @mateo-berri in https://github.com/BerriAI/litellm/pull/34068
refactor(ui): migrate available teams table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34070
fix(ui): serve /ui/assets from the nginx image instead of SPA fallback by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34066
feat(gemini): day-0 pricing for gemini-3.6-flash and gemini-3.5-flash-lite by @mateo-berri in https://github.com/BerriAI/litellm/pull/34106
refactor(ui): migrate audit logs table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34080
refactor(ui): migrate organizations table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34081
refactor(ui): migrate memory table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34079
refactor(ui): migrate access groups table to shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34078
fix(model_armor): sanitize error details by default by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33908
refactor(ui): migrate agents table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34089
fix(ui): add tooltip to the Active key status badge by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34109
fix(interactions): add queued to the Interaction status enum by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34135
ci(image-scan): match Python packages against CPE data by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34136
chore(deps): bump pypdf to 6.14.2 and pyasn1 to 0.6.4 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34148
feat(budgets): add configurable budget_reset_time of day by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/31007
feat(ui): surface key budget_reset_at in key info and keys table by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34113
fix(a2a): accept semver protocolVersion values like 0.3.0 in agent cards by @mateo-berri in https://github.com/BerriAI/litellm/pull/34154
feat(ui): add block/unblock key action to key info page by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34116
fix(mcp): attach resolved OAuth credentials to OpenAPI spec_path tool calls by @tin-berri in https://github.com/BerriAI/litellm/pull/34063
fix(e2e): use EndpointsClient.proxy after Gateway to ProxyClient rename by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34127
refactor(auth): derive temp budget increase without mutating the token by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34121
test(e2e): add Other suite and Guardrails coverage incl. an MCP tool-call guardrail by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34149
fix(mcp): let an admin-pinned issuer drive OAuth discovery for url-less servers by @tin-berri in https://github.com/BerriAI/litellm/pull/34065
fix(router): stop per-deployment num_retries from double-counting as provider max_retries by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34129
fix(e2e): pin harness Python and surface proxy boot crash output by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34157
fix(proxy): stop save_config from snapshotting environment_variables into the DB by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34119
fix(ui): stop cloning body-carrying requests into stream uploads in fetchClient middleware by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34122
fix(ui): distinguish response cache from provider prompt caching by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34138
fix(ui): bundle provider logos as static imports and unify fallback in Logo component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34125
refactor(ui): migrate inline provider logo lookups to the shared Logo component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34141
test(e2e): cover team management routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34115
test(e2e): cover key management routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34114
test(e2e): cover budget, customer, user and org routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34117
fix(router): honor request-level num_retries over global litellm_settings.num_retries by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34124
test(e2e): cover model, tag and access group routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34118
feat(proxy): make DB config-reload interval configurable via config.yaml and UI by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34130
feat(ui): add controlled row selection to the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34167
feat(mcp): store the enterprise IdP identity assertion at SSO login for EMA egress by @tin-berri in https://github.com/BerriAI/litellm/pull/34072
chore(deps): bump gitpython to 3.1.52 in uv.lock by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34168
feat(ui): add react-hook-form + zod form infrastructure by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34170
chore(tests): replace a customer name and domain with neutral placeholders by @mateo-berri in https://github.com/BerriAI/litellm/pull/34172
refactor(ui): migrate MCP, callback, guardrail, SSO, and search tool logos to the shared Logo component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34169
fix(ui): stop dashboard key-edit form 403ing on non-budget saves by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34112
fix(ui): harden provider logo map typing and bundled asset guard by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34163
fix(proxy): populate user_email on UserAPIKeyAuth for JWT auth by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34174
test(e2e): cover config and misc management routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34120
test(e2e): add Azure AI Foundry and Anthropic /v1/messages coverage for the Rust bridge by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34021
test(ui): run vitest unit tests in GitHub Actions and fix stale key-info tests by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34175
refactor(ui): migrate users and model health checks tables onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34182
fix(ui): restore guardrail_info_helpers exports in GuardrailsPanel test mock by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34197
chore(ui): bump sharp to 0.35.x via npm override by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34193
refactor(ui): migrate Tool Policies table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34176
chore: bump litellm-proxy-extras 0.4.79 -> 0.4.80, litellm 1.94.0 -> 1.95.0 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34199
feat(rust): honor pre-computed Entra ID auth for Azure /messages by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34107
fix(rust): route agentic-hook /messages requests to Python for all stream modes by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34126
fix(e2e): drop httpbin.org from passthrough headers test, use real Anthropic by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34159
test(e2e): cover 12 non-core LLM coverage registry cells by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34123
test(logging): pin compression_savings in the gcs pubsub spend log fixture by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34204
docs: add TLDR section to PR template by @mateo-berri in https://github.com/BerriAI/litellm/pull/34203
(Security) - Prevent potential provider key exposure through URL-valued model destinations and fallbacks by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34189
docs(issue-template): ask for a numbered list of reproduction steps by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34207
test(ui): fix key and credential e2e specs after the overflow menu migrations by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34206
test(e2e): add live A2A agent e2e suite by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34052
fix(ui): reflect REDIS_* env cache config and stop the UI overwriting the stored password by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34160
fix(ui): surface env-var-sourced theme and logging-callback settings by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34156
test(musty_leopard): cover customer chat/messages cost + streaming paths by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34164
test(e2e): add weekly session-anomaly load test against real providers by @mateo-berri in https://github.com/BerriAI/litellm/pull/34166
fix(bedrock): emit Nova Sonic realtime session.created on connect and session.updated on session.update by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34133
feat(guardrails): add only_scan_new_messages for per-session incremental scanning by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33278
fix(proxy): share CLI SSO login sessions across workers without enable_redis_auth_cache by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33261
test(e2e): move Admin UI Playwright suite to tests/e2e/ui by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34196
fix(scim): use members_with_roles as the source of truth for group membership by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34162
fix(scim): sync team roster and dedup teams for existing-user email upsert by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34183
fix(proxy): raise dashboard session budget default to $1 and make it configurable in config and Admin UI by @tin-berri in https://github.com/BerriAI/litellm/pull/34146
fix(scim): prune deleted user from teams' members_with_roles by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34180
test(e2e): fail the run when a Rust gateway silently serves /messages through Python by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34208
fix(team): make team member add atomic to prevent concurrent-add member loss by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34185
fix(ui): surface SSO and SMTP settings supplied as process env vars by @tin-berri in https://github.com/BerriAI/litellm/pull/33576
fix(scim): parse membership id from filtered PATCH path when value omitted by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34181
fix(ui): remove misleading os.environ tooltip from logging settings by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34305
fix(anthropic): strip uniqueItems + other unsupported array/object constraints from output_format schema by @mateo-berri in https://github.com/BerriAI/litellm/pull/34313
fix(e2e): satisfy basedpyright in test_session_anomaly so the e2e lint gate passes by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34288
refactor(proxy): type the PATCH /team/{team_id} request body by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34195
feat(ui): edit fallback chains from router settings by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32841
fix(mcp): use official Google Drive streamable HTTP MCP server by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34322
refactor(ui): migrate api-reference to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34263
refactor(ui): migrate prompts list page to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34289
refactor(ui): migrate old-usage to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34304
refactor(ui): migrate transform-request to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34303
chore(ui): bump next to 16.2.11 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34329
test(e2e): cover key max_budget blocks on personal, team, and team-member keys by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33895
fix(tests): remove importlib.reload of http_handler that breaks client injection in later tests by @mateo-berri in https://github.com/BerriAI/litellm/pull/34336
test(e2e): require a cache-hit row instead of skipping when absent by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34283
fix(mcp): fall through to an ephemeral DCR mint when passthrough authorize has no client_id by @tin-berri in https://github.com/BerriAI/litellm/pull/33884
ci: run UI unit tests on a 16-core runner by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34330
test(e2e): induce spend failure row deterministically instead of skipping by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34282
chore(ui): add filename, size, JSX-handler, prefer-const, and antd lint rules by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34341
fix(responses): preserve reasoning through prompt hooks by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33422
fix(budget): resolve word-form budget_duration so it no longer silently resets daily by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34250
fix(bedrock): include type in tool_choice disable_parallel_tool_use config for Converse by @mateo-berri in https://github.com/BerriAI/litellm/pull/34347
fix(autoroute): discover models via /v1/models so an AI-API-only key works by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34259
feat(ui): give each Models + Endpoints tab its own path by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34327
feat(organization): add RESTful PATCH /v2/organization/{organization_id} by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32350
refactor(ui): migrate search-tools info view to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34323
fix(docker): bake non_root prisma engines at /opt/prisma so migrations run offline for any uid by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34325
fix(anthropic): strip all remaining output_format schema keywords rejected by Anthropic by @mateo-berri in https://github.com/BerriAI/litellm/pull/34319
fix(sagemaker): forward stream events as they arrive to cut TTFT by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34338
test(e2e): cover key budget_duration resets on personal, team, and team-member keys by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33896
feat(mcp): admit gateway DCR session bearers at the aggregate /mcp scope by @tin-berri in https://github.com/BerriAI/litellm/pull/33190
fix(mcp): log actionable OAuth discovery failures for misconfigured server urls by @tin-berri in https://github.com/BerriAI/litellm/pull/34225
refactor(ui): migrate workflow runs to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34370
refactor(ui): migrate models and endpoints table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34363
test(e2e): drive a real Linear OAuth MCP through chat completions under both ingress headers by @tin-berri in https://github.com/BerriAI/litellm/pull/33787
refactor(ui): migrate request logs table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34343
feat(ui): rebuild Organization Settings on react-hook-form + zod with a dirty-field PATCH by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34324
refactor(e2e): drop require_env, read os.environ where a cred is used by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34413
refactor(mcp): delete unreachable v1 OBO handler and gate REST OAuth on v2 resolver by @tin-berri in https://github.com/BerriAI/litellm/pull/34407
feat(cost-optimization): add spend-by-tool and cache leakage views by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33978
refactor(ui): migrate agents to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34365
refactor(ui): extract shared tab-routing helpers and adopt them in Models + Endpoints by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34435
feat(proxy): add overwrite_user_with_key_hash to stamp outgoing user param with key hash by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34417
fix(ui): find logs by request id across pages and dates (LIT-3981) by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/31743
fix(proxy): reject failed atomic budget reservations under fail_closed_budget_enforcement by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34429
ci: only run CodSpeed benchmarks on backend changes by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34345
fix(cost_tracking): map OpenAI cache_write_tokens for prompt cache creation billing by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34046
fix(proxy): restore atomic user upsert when adding team members by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34457
fix(ui): keep cache leakage time range picker inline at narrow widths by @tin-berri in https://github.com/BerriAI/litellm/pull/34439
feat(ui): show in the log drawer and session sidebar when an auto-router served a request by @tin-berri in https://github.com/BerriAI/litellm/pull/34434
refactor(ui): migrate memory page to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34366
refactor(ui): migrate budgets, skills, ui-theme to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34465
refactor(ui): migrate access-groups, vector-stores, organizations to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34466
refactor(ui): migrate logging-and-alerts, caching, policies to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34468
feat(ui): standalone /connect route for MCP OAuth, decoupled from Chat UI flag by @tin-berri in https://github.com/BerriAI/litellm/pull/34334
refactor(ui): migrate mcp-servers, tag-management, tool-policies to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34469
test(e2e): pin the a2a bridge agent's Anthropic key so message/send works by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34512
fix(guardrails/model_armor): handle None metadata in post_call _process_response (#34390) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34405
feat(anthropic): add Claude Opus 5 by @mateo-berri in https://github.com/BerriAI/litellm/pull/34518
test(a2a): assert the property agent returns listings, not just non-empty text by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34515
fix(logging): stop scheduling sync failure_handler concurrently with async_failure_handler by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34306
fix(vertex): incrementally parse accumulated Gemini stream JSON to prevent multi-value wedge by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34320
test: replace deprecated gpt-5-codex with gpt-5.3-codex by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34520
fix(gateway): install bedrock-realtime extra for Nova Sonic realtime by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34426
feat(proxy): add SAML 2.0 SSO for the admin UI by @yassin-berriai in https://github.com/BerriAI/litellm/pull/31429
feat(guardrails): add run_in_parallel opt-in for concurrent pre_call and post_call guardrails by @noahnistler in https://github.com/BerriAI/litellm/pull/33770
fix: handle explicit outputInfo: null in Vertex AI batch response by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34473
fix(otel): keep an MCP tool call in one trace, anchored to its own request by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34537
fix(ui): keep a key's MCP toolsets when saving an edit by @tin-berri in https://github.com/BerriAI/litellm/pull/34452
fix(ui): bind key duration input to one Form.Item so pre-filled expiry submits by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34521
feat(ui): migrate the Create Organization form to shadcn and react-hook-form by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34552
refactor(ui): derive the dashboard object_permission type from the generated schema by @tin-berri in https://github.com/BerriAI/litellm/pull/34454
test(e2e): cover MCP access-group tool selection at key creation by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34480
test: remove tests that mutation analysis proved assert nothing by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34475
fix(ui): keep entity usage tabs aligned with their panels by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34573
fix(guardrails): stop reporting a no-op guardrail as applied on passthrough by @tin-berri in https://github.com/BerriAI/litellm/pull/34411
fix(proxy): return 400 instead of 500 for chat completions without messages by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34547
fix(guardrails): keep guardrail information in spend logs when the caller sends its own metadata by @tin-berri in https://github.com/BerriAI/litellm/pull/34458
fix(responses): strip include_usage from stream_options instead of dropping the param by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34549
fix(guardrails): add /v1/messages support for Straiker plugin by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34548
fix(proxy/batches): resolve managed unified input_file_id to storage_url with

Note truncated.

Open source →

1.95.0rc129 Jul 2026pre-releaseDeprecated

test: replace deprecated gpt-5-codex with gpt-5.3-codex by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34520

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0-rc.1

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.95.0-rc.1/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0-rc.1

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

fix(ui): keep cache leakage time range picker inline at narrow widths by @tin-berri in https://github.com/BerriAI/litellm/pull/34439
feat(ui): show in the log drawer and session sidebar when an auto-router served a request by @tin-berri in https://github.com/BerriAI/litellm/pull/34434
refactor(ui): migrate memory page to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34366
refactor(ui): migrate budgets, skills, ui-theme to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34465
refactor(ui): migrate access-groups, vector-stores, organizations to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34466
refactor(ui): migrate logging-and-alerts, caching, policies to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34468
feat(ui): standalone /connect route for MCP OAuth, decoupled from Chat UI flag by @tin-berri in https://github.com/BerriAI/litellm/pull/34334
refactor(ui): migrate mcp-servers, tag-management, tool-policies to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34469
test(e2e): pin the a2a bridge agent's Anthropic key so message/send works by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34512
fix(guardrails/model_armor): handle None metadata in post_call _process_response (#34390) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34405
feat(anthropic): add Claude Opus 5 by @mateo-berri in https://github.com/BerriAI/litellm/pull/34518
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34519
test(a2a): assert the property agent returns listings, not just non-empty text by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34515
fix(logging): stop scheduling sync failure_handler concurrently with async_failure_handler by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34306
fix(vertex): incrementally parse accumulated Gemini stream JSON to prevent multi-value wedge by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34320
test: replace deprecated gpt-5-codex with gpt-5.3-codex by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34520
fix(gateway): install bedrock-realtime extra for Nova Sonic realtime by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34426
feat(proxy): add SAML 2.0 SSO for the admin UI by @yassin-berriai in https://github.com/BerriAI/litellm/pull/31429
feat(guardrails): add run_in_parallel opt-in for concurrent pre_call and post_call guardrails by @noahnistler in https://github.com/BerriAI/litellm/pull/33770
fix: handle explicit outputInfo: null in Vertex AI batch response by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34473
fix(otel): keep an MCP tool call in one trace, anchored to its own request by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34537
fix(ui): keep a key's MCP toolsets when saving an edit by @tin-berri in https://github.com/BerriAI/litellm/pull/34452
fix(ui): bind key duration input to one Form.Item so pre-filled expiry submits by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34521
feat(ui): migrate the Create Organization form to shadcn and react-hook-form by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34552
refactor(ui): derive the dashboard object_permission type from the generated schema by @tin-berri in https://github.com/BerriAI/litellm/pull/34454
test(e2e): cover MCP access-group tool selection at key creation by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34480
test: remove tests that mutation analysis proved assert nothing by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34475
fix(ui): keep entity usage tabs aligned with their panels by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34573
fix(guardrails): stop reporting a no-op guardrail as applied on passthrough by @tin-berri in https://github.com/BerriAI/litellm/pull/34411
fix(proxy): return 400 instead of 500 for chat completions without messages by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34547
fix(guardrails): keep guardrail information in spend logs when the caller sends its own metadata by @tin-berri in https://github.com/BerriAI/litellm/pull/34458
fix(responses): strip include_usage from stream_options instead of dropping the param by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34549
fix(guardrails): add /v1/messages support for Straiker plugin by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34548
fix(proxy/batches): resolve managed unified input_file_id to storage_url with ownership check before dispatch by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34474
fix(guardrails): derive tokens_saved when Headroom compression service omits it by @tin-berri in https://github.com/BerriAI/litellm/pull/34578
refactor(ui): migrate routing groups table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34571
fix(proxy): attribute org spend for team-linked credentials minted without org_id by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34577
fix(proxy/batches): make managed-file resolution additive, restore fall-back for missing-row and lookup errors by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34584
fix(bedrock-mantle): backfill usage on non-streaming /v1/messages responses by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34446
fix(proxy): cap /v1/tool/spend window at 30 days and bound every SpendLogs read by @tin-berri in https://github.com/BerriAI/litellm/pull/34582
feat(passthrough): record cost and usage reported by the upstream target by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34590
fix(logs): scope and bound the End User filter on the logs page by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34579
feat(ui): deep-link virtual key detail view via ?key= query param by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34591
revert(ui): return Models + Endpoints tabs to in-memory routing, keep the ?model drill-in by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34629
fix(proxy): merge model-level guardrails before pre_call_hook by @hclsys in https://github.com/BerriAI/litellm/pull/29654
fix(router): don't cool down parent deployment on advisor sub-call failure by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33792
test(e2e): cover /vllm chat passthrough against a hosted backend by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34432
test(e2e): point four suites at models the providers still serve by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34567
test(e2e): make the bedrock guardrail test match the guardrail it points at by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34568
fix(otel): stamp an MCP tool failure on the request that carried it by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34551
test(e2e): set reasoning_effort=none for gpt-5.6 chat tool calls by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34569
test(e2e): cover /v1/images/edits by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34476
chore(deps): bump gitpython and postcss to advisory-clear versions by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34634
fix(proxy): hash caller-supplied key in key update audit log object_id by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34632
test(e2e): cover /openai chat passthrough cost logging by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34470
fix(proxy): global max_budget ignores budget_duration; enforce against the resettable proxy budget row by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33732
fix(mcp): use a toolset row's stored tool name as written by @tin-berri in https://github.com/BerriAI/litellm/pull/34559
fix(auth): route JWT default-team into memberships instead of the create payload by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33082
ci: drop the docker SERVER_ROOT_PATH e2e job for a unit test by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34642
test: stop bedrock tool acompletion tests from making real network calls by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34644
fix(proxy): stop litellm/proxy from shadowing installed packages on sys.path by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34656
fix(cost-optimization): swap methodology Collapse for a shadcn HoverCard by @tin-berri in https://github.com/BerriAI/litellm/pull/34598
fix(ci): scope UI lint to the files a PR actually changed by @mateo-berri in https://github.com/BerriAI/litellm/pull/34600
fix(mcp): stop leaking upstream server credentials in tool-call 403 by @tin-berri in https://github.com/BerriAI/litellm/pull/34340
fix(batches): paginate managed batch list by unified_object_id cursor by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34192
fix(e2e): stop tests from breaking the shared proxy for every suite after them by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34664
fix(cost-optimization): anchor the savings line at a $0 range start by @tin-berri in https://github.com/BerriAI/litellm/pull/34453
fix(bedrock): stop replaying expired Google OIDC tokens to STS on guardrail auth by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34637
chore: bump litellm-enterprise 0.1.51 -> 0.1.52, litellm-proxy-extras 0.4.80 -> 0.4.81 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34669
chore(ui): rebuild Next.js build artifacts by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34671
fix(azure_ai): advertise 1M context window for Claude Opus 4.6+ on Foundry by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34556
feat(mcp): send RFC 8707 resource indicators on upstream OAuth legs by @tin-berri in https://github.com/BerriAI/litellm/pull/34265
fix(guardrails): resolve judge_model credentials via lazy Router lookup in llm_as_a_judge by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34509
style(ui): match MCP Servers tabs to the dashboard's line tab pattern by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34685
fix(ui): center vertical toolbar dividers by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34684
fix(ui): restore the Add MCP Server dialog size and header spacing by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34679
fix(ui): truncate long team names in the models table team dropdown by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34689
fix(e2e/ui): resolve dashboard base URL from env instead of hardcoding localhost by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34739
chore(deps): bump gitpython to 3.1.55 and brace-expansion to 5.0.8 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34798
fix(guardrails): preserve cache_control breakpoints in compresr write-back by @tin-berri in https://github.com/BerriAI/litellm/pull/34660
fix(install): pass an explicit Python version request to uv tool install by @tin-berri in https://github.com/BerriAI/litellm/pull/34750
refactor(management): move the logs end-user filter onto /management/v1 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34691
fix: match exact class in callback dedup so a custom subclass does not block a built-in logger by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34804
fix(prometheus): populate cache write token metrics for OpenAI-style usage by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34803
chore(typing): clear 2.7k basedpyright Any errors across 15 hotspot files by @mateo-berri in https://github.com/BerriAI/litellm/pull/34745
test(e2e): stop racing control-plane writes across the mcp, a2a, guardrail and passthrough suites by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34833
fix(ui): validate default team values in Default User Settings by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34815
fix(proxy): sanitize per-key callback config out of logged metadata by @yuneng-berri in https://github.com/BerriAI/litellm/pull/32583
fix(proxy): roll up tool spend daily instead of scanning SpendLogs by @tin-berri in https://github.com/BerriAI/litellm/pull/34675
fix(responses_bridge): keep one chat completion id per stream and always stream completed responses by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34539
fix(guardrails): compress content-parts messages in headroom guardrail (Anthropic traffic) by @tin-berri in https://github.com/BerriAI/litellm/pull/34586
fix(router): release the pre-routing strategy slot when a deployment is replaced or deleted by @shivamrawat1 in https://github.com/BerriAI/litellm/pull/34564
fix(guardrails): classify all 4xx HTTPException guardrail blocks as intervened by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33821
chore: rebuild Admin UI bundle for release by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34859
test: unstale the reasoning-effort grid count and the responses bridge test by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34868
test(e2e): realign Admin UI specs with the MCP dialog and keyless landing by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34870
test(e2e): unblock the ui suite, fix the mcp registration race, park two known product bugs by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34853
test(e2e): make MCP and prometheus e2e tests robust to data-plane sync lag by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34854
Fix cache leakage card layout to keep date picker on right by @tin-berri in https://github.com/BerriAI/litellm/pull/34885
fix(gateway): route /a2a through the gateway component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34958
fix(e2e): poll for both spend rows before asserting the cache-hit contract by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34968
test(e2e): skip passthrough headers test until stage can route custom paths to provider creds by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34980
feat(ui): mark Cost Optimization as beta in the left nav by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34984
fix(proxy): avoid DB outage during planned RDS IAM rotation by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34749
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34864
test(e2e): bound the post-/model/new servable wait at 40s by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35020
test(e2e): poll MCP tools across multi-worker lag (#35047) by @yuneng-berri in https://github.com/BerriAI/litellm/pull/35049

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.95.0-dev.2...v1.95.0-rc.1

Open source →

1.95.0.dev224 Jul 2026pre-release

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit `0112e53`.

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0-dev.2

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.95.0-dev.2/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0-dev.2

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

test(e2e): add weekly session-anomaly load test against real providers by @mateo-berri in https://github.com/BerriAI/litellm/pull/34166
fix(bedrock): emit Nova Sonic realtime session.created on connect and session.updated on session.update by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34133
feat(guardrails): add only_scan_new_messages for per-session incremental scanning by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33278
fix(proxy): share CLI SSO login sessions across workers without enable_redis_auth_cache by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33261
test(e2e): move Admin UI Playwright suite to tests/e2e/ui by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34196
fix(scim): use members_with_roles as the source of truth for group membership by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34162
fix(scim): sync team roster and dedup teams for existing-user email upsert by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34183
fix(proxy): raise dashboard session budget default to $1 and make it configurable in config and Admin UI by @tin-berri in https://github.com/BerriAI/litellm/pull/34146
fix(scim): prune deleted user from teams' members_with_roles by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34180
test(e2e): fail the run when a Rust gateway silently serves /messages through Python by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34208
fix(team): make team member add atomic to prevent concurrent-add member loss by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34185
fix(ui): surface SSO and SMTP settings supplied as process env vars by @tin-berri in https://github.com/BerriAI/litellm/pull/33576
fix(scim): parse membership id from filtered PATCH path when value omitted by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34181
fix(ui): remove misleading os.environ tooltip from logging settings by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34305
fix(anthropic): strip uniqueItems + other unsupported array/object constraints from output_format schema by @mateo-berri in https://github.com/BerriAI/litellm/pull/34313
fix(e2e): satisfy basedpyright in test_session_anomaly so the e2e lint gate passes by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34288
refactor(proxy): type the PATCH /team/{team_id} request body by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34195
feat(ui): edit fallback chains from router settings by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/32841
fix(mcp): use official Google Drive streamable HTTP MCP server by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34322
refactor(ui): migrate api-reference to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34263
refactor(ui): migrate prompts list page to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34289
refactor(ui): migrate old-usage to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34304
refactor(ui): migrate transform-request to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34303
chore(ui): bump next to 16.2.11 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34329
test(e2e): cover key max_budget blocks on personal, team, and team-member keys by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33895
fix(tests): remove importlib.reload of http_handler that breaks client injection in later tests by @mateo-berri in https://github.com/BerriAI/litellm/pull/34336
test(e2e): require a cache-hit row instead of skipping when absent by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34283
fix(mcp): fall through to an ephemeral DCR mint when passthrough authorize has no client_id by @tin-berri in https://github.com/BerriAI/litellm/pull/33884
ci: run UI unit tests on a 16-core runner by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34330
test(e2e): induce spend failure row deterministically instead of skipping by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34282
chore(ui): add filename, size, JSX-handler, prefer-const, and antd lint rules by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34341
fix(responses): preserve reasoning through prompt hooks by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33422
fix(budget): resolve word-form budget_duration so it no longer silently resets daily by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34250
fix(bedrock): include type in tool_choice disable_parallel_tool_use config for Converse by @mateo-berri in https://github.com/BerriAI/litellm/pull/34347
fix(autoroute): discover models via /v1/models so an AI-API-only key works by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34259
feat(ui): give each Models + Endpoints tab its own path by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34327
feat(organization): add RESTful PATCH /v2/organization/{organization_id} by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/32350
refactor(ui): migrate search-tools info view to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34323
fix(docker): bake non_root prisma engines at /opt/prisma so migrations run offline for any uid by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34325
fix(anthropic): strip all remaining output_format schema keywords rejected by Anthropic by @mateo-berri in https://github.com/BerriAI/litellm/pull/34319
fix(sagemaker): forward stream events as they arrive to cut TTFT by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34338
test(e2e): cover key budget_duration resets on personal, team, and team-member keys by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33896
feat(mcp): admit gateway DCR session bearers at the aggregate /mcp scope by @tin-berri in https://github.com/BerriAI/litellm/pull/33190
fix(mcp): log actionable OAuth discovery failures for misconfigured server urls by @tin-berri in https://github.com/BerriAI/litellm/pull/34225
refactor(ui): migrate workflow runs to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34370
refactor(ui): migrate models and endpoints table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34363
test(e2e): drive a real Linear OAuth MCP through chat completions under both ingress headers by @tin-berri in https://github.com/BerriAI/litellm/pull/33787
refactor(ui): migrate request logs table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34343
feat(ui): rebuild Organization Settings on react-hook-form + zod with a dirty-field PATCH by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34324
refactor(e2e): drop require_env, read os.environ where a cred is used by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34413
refactor(mcp): delete unreachable v1 OBO handler and gate REST OAuth on v2 resolver by @tin-berri in https://github.com/BerriAI/litellm/pull/34407
feat(cost-optimization): add spend-by-tool and cache leakage views by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33978
refactor(ui): migrate agents to shadcn by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34365
refactor(ui): extract shared tab-routing helpers and adopt them in Models + Endpoints by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34435
feat(proxy): add overwrite_user_with_key_hash to stamp outgoing user param with key hash by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34417
fix(ui): find logs by request id across pages and dates (LIT-3981) by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/31743
fix(proxy): reject failed atomic budget reservations under fail_closed_budget_enforcement by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34429
ci: only run CodSpeed benchmarks on backend changes by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34345
fix(cost_tracking): map OpenAI cache_write_tokens for prompt cache creation billing by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34046
fix(proxy): restore atomic user upsert when adding team members by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34457
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34450

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.95.0-dev.1...v1.95.0-dev.2

Open source →

1.95.0.dev122 Jul 2026pre-release

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit `0112e53`.

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0-dev.1

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.95.0-dev.1/cosign.pub \
  ghcr.io/berriai/litellm:v1.95.0-dev.1

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

feat(spend): track prompt compression saved tokens in daily spend aggregates by @tin-berri in https://github.com/BerriAI/litellm/pull/33810
test(e2e): assert the long budget window keeps blocking after the short window resets by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/33832
feat(messages): route native Anthropic /messages through Rust behind LITELLM_RUST env var by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33848
test(e2e): cover credential-backed /v1/messages request by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33863
feat(rust): expose Anthropic Messages route (POST /v1/messages) on the axum gateway by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33880
feat(rust): 1:1 port of OpenAI Responses API WebSockets to litellm-rust by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33849
fix(proxy): treat malformed cost-map token limits as absent on /v1/models by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33903
feat(rust): port BaseAWSLLM auth (credential resolution + SigV4) to litellm-core as a base provider by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33888
feat(complexity-router): add return_raw_model_name toggle for response model field by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33875
feat(mcp): always-on aggregate gateway DCR discovery front door by @tin-berri in https://github.com/BerriAI/litellm/pull/33174
fix(langfuse): send v4 ingestion header for otel callback by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33907
feat(ui): add configuration tabs to the Cost Optimization page by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33899
test(e2e): guard destructive spend-log truncate behind an explicit opt-in by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33751
chore(rust): migrate the litellm-rust workspace (core, ai-gateway, python-bridge) from Rust edition 2021 to edition 2024 by @vineetpuranik in https://github.com/BerriAI/litellm/pull/33940
fix(fireworks_ai): restore Content-Type application/json header (fixes 415) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33929
feat(spend): raise /spend/logs/v2 page_size cap to 1000 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33994
feat(mcp): identity-only session tokens for the gateway DCR front door by @tin-berri in https://github.com/BerriAI/litellm/pull/33182
test(e2e): cover key regeneration rotating to a working new key by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34000
test(e2e): cover tag creation persisting for spend categorization by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34018
test(e2e): cover organization deletion removing it from /organization/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34009
perf(bedrock): audio transcription via rust core (py->rust bridge) by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33990
chore(ci): retire daily OSS branches in favor of litellm_internal_staging by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34030
test(e2e): cover model update persisting to /model/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34017
test(e2e): cover key block persisting to /key/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34014
test(e2e): cover created team appearing in /team/list by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34015
test(e2e): cover created user appearing in /user/list by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34016
test(e2e): cover team update persistence via /team/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33997
feat(bedrock): forward bedrock_tags to CreateModelInvocationJob for batch jobs by @mateo-berri in https://github.com/BerriAI/litellm/pull/33733
test(e2e): cover model registration persistence in /model/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33996
test(e2e): cover user update persistence via /user/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33998
test(proxy): make model_info endpoint tests hermetic to kill an order/merge-skew flake by @mateo-berri in https://github.com/BerriAI/litellm/pull/34037
chore(e2e): prune the non-deterministic perf.latency SLO coverage cell by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34024
fix(ui): hide guardrail group headers when only one group has entries by @yuneng-berri in https://github.com/BerriAI/litellm/pull/33885
test(e2e): cover model deletion removing it from the catalog by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34006
test(e2e): cover organization update persistence via /organization/info by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34010
test(e2e): cover team deletion persistence and key revocation by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33999
test(e2e): cover user deletion removing it from user inventory by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34007
test(e2e): cover created key appearing in /key/list inventory by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34008
fix(cache): make in-memory and disk cache increments atomic by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34013
test(e2e): add reliability suite covering fallback, timeout, and cache behavior by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34023
test(true_rabbit): cover passthrough headers, batch assume-role, gemini, vllm, bedrock guardrails, batch rate-limit mapping by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/33843
fix(anthropic): only inject cache_control when the request carries none by @tin-berri in https://github.com/BerriAI/litellm/pull/33886
feat(mcp): support MCP servers on the Anthropic /v1/messages API by @tin-berri in https://github.com/BerriAI/litellm/pull/33631
feat(mcp): migrate client_credentials (M2M) onto the v2 resolver arm by @tin-berri in https://github.com/BerriAI/litellm/pull/32259
fix(router): stop custom model_info leaking onto shared backend cost map key by @mateo-berri in https://github.com/BerriAI/litellm/pull/34041
perf(streaming): build per-chunk Delta directly instead of setattr/delattr churn by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33992
refactor(mcp): consolidate exception-tree walkers into one shared faults traversal by @tin-berri in https://github.com/BerriAI/litellm/pull/33183
fix(budget): reset users/teams whose budget_reset_at is NULL by @jyeung-r7 in https://github.com/BerriAI/litellm/pull/33623
perf(core): fast-path SafeAttributeModel.delattr for declared fields by @yassin-berriai in https://github.com/BerriAI/litellm/pull/33993
fix(auth): set budget_reset_at when JWT upsert seeds a budget_duration by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34050
fix(proxy/auth): handle tz-aware temp_budget_expiry by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33840
fix(vertex,azure): model-aware mid-conversation system for Claude /v1/messages by @mateo-berri in https://github.com/BerriAI/litellm/pull/33807
fix(auth): apply temp_budget_increase for cache-hit keys by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33841
fix(agents): allow optional securityScheme fields so /public/agent_hub does not 500 by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/33897
build(deps-dev): bump js-yaml to 4.3.0 and brace-expansion to 5.0.7 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34056
refactor(ui): migrate credentials table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34053
fix(cli): stable port and persisted master key for lite autoroute up by @tin-berri in https://github.com/BerriAI/litellm/pull/34026
fix(mcp): return the DCR client's own redirect_uris to stop the /callback self-redirect loop by @tin-berri in https://github.com/BerriAI/litellm/pull/33756
feat: add deepkeep as custom guardrail by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33844
fix(router): propagate capability flags to shared backend cost map key by @mateo-berri in https://github.com/BerriAI/litellm/pull/34047
fix(mcp): add Google Sheets, Drive, Calendar, and Docs to the OpenAPI registry by @tin-berri in https://github.com/BerriAI/litellm/pull/34059
fix(bedrock_mantle): hoist Codex additional_tools input items to top-level tools by @lyb0307 in https://github.com/BerriAI/litellm/pull/33228
fix(bedrock_mantle): gate unsupported service_tier on drop_params for the Responses API by @mateo-berri in https://github.com/BerriAI/litellm/pull/34058
feat(proxy): auto-enable drop_params for Codex user agents by @mateo-berri in https://github.com/BerriAI/litellm/pull/34068
refactor(ui): migrate available teams table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34070
fix(ui): serve /ui/assets from the nginx image instead of SPA fallback by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34066
feat(gemini): day-0 pricing for gemini-3.6-flash and gemini-3.5-flash-lite by @mateo-berri in https://github.com/BerriAI/litellm/pull/34106
refactor(ui): migrate audit logs table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34080
refactor(ui): migrate organizations table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34081
refactor(ui): migrate memory table onto shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34079
refactor(ui): migrate access groups table to shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34078
fix(model_armor): sanitize error details by default by @yucheng-berri in https://github.com/BerriAI/litellm/pull/33908
refactor(ui): migrate agents table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34089
fix(ui): add tooltip to the Active key status badge by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34109
fix(interactions): add queued to the Interaction status enum by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34135
ci(image-scan): match Python packages against CPE data by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34136
chore(deps): bump pypdf to 6.14.2 and pyasn1 to 0.6.4 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34148
feat(budgets): add configurable budget_reset_time of day by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/31007
feat(ui): surface key budget_reset_at in key info and keys table by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34113
fix(a2a): accept semver protocolVersion values like 0.3.0 in agent cards by @mateo-berri in https://github.com/BerriAI/litellm/pull/34154
feat(ui): add block/unblock key action to key info page by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34116
fix(mcp): attach resolved OAuth credentials to OpenAPI spec_path tool calls by @tin-berri in https://github.com/BerriAI/litellm/pull/34063
fix(e2e): use EndpointsClient.proxy after Gateway to ProxyClient rename by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34127
refactor(auth): derive temp budget increase without mutating the token by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34121
test(e2e): add Other suite and Guardrails coverage incl. an MCP tool-call guardrail by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34149
fix(mcp): let an admin-pinned issuer drive OAuth discovery for url-less servers by @tin-berri in https://github.com/BerriAI/litellm/pull/34065
fix(router): stop per-deployment num_retries from double-counting as provider max_retries by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34129
fix(e2e): pin harness Python and surface proxy boot crash output by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34157
fix(proxy): stop save_config from snapshotting environment_variables into the DB by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34119
fix(ui): stop cloning body-carrying requests into stream uploads in fetchClient middleware by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34122
fix(ui): distinguish response cache from provider prompt caching by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34138
fix(ui): bundle provider logos as static imports and unify fallback in Logo component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34125
refactor(ui): migrate inline provider logo lookups to the shared Logo component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34141
test(e2e): cover team management routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34115
test(e2e): cover key management routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34114
test(e2e): cover budget, customer, user and org routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34117
fix(router): honor request-level num_retries over global litellm_settings.num_retries by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34124
test(e2e): cover model, tag and access group routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34118
feat(proxy): make DB config-reload interval configurable via config.yaml and UI by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34130
feat(ui): add controlled row selection to the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34167
feat(mcp): store the enterprise IdP identity assertion at SSO login for EMA egress by @tin-berri in https://github.com/BerriAI/litellm/pull/34072
chore(deps): bump gitpython to 3.1.52 in uv.lock by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34168
feat(ui): add react-hook-form + zod form infrastructure by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34170
chore(tests): replace a customer name and domain with neutral placeholders by @mateo-berri in https://github.com/BerriAI/litellm/pull/34172
refactor(ui): migrate MCP, callback, guardrail, SSO, and search tool logos to the shared Logo component by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34169
fix(ui): stop dashboard key-edit form 403ing on non-budget saves by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34112
fix(ui): harden provider logo map typing and bundled asset guard by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34163
fix(proxy): populate user_email on UserAPIKeyAuth for JWT auth by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34174
test(e2e): cover config and misc management routes for Management/UI coverage by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34120
test(e2e): add Azure AI Foundry and Anthropic /v1/messages coverage for the Rust bridge by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34021
test(ui): run vitest unit tests in GitHub Actions and fix stale key-info tests by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34175
refactor(ui): migrate users and model health checks tables onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34182
fix(ui): restore guardrail_info_helpers exports in GuardrailsPanel test mock by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34197
chore(ui): bump sharp to 0.35.x via npm override by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34193
refactor(ui): migrate Tool Policies table onto the shared DataTable by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34176
chore: bump litellm-proxy-extras 0.4.79 -> 0.4.80, litellm 1.94.0 -> 1.95.0 by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34199
feat(rust): honor pre-computed Entra ID auth for Azure /messages by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34107
fix(rust): route agentic-hook /messages requests to Python for all stream modes by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34126
fix(e2e): drop httpbin.org from passthrough headers test, use real Anthropic by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34159
test(e2e): cover 12 non-core LLM coverage registry cells by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34123
test(logging): pin compression_savings in the gcs pubsub spend log fixture by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34204
docs: add TLDR section to PR template by @mateo-berri in https://github.com/BerriAI/litellm/pull/34203
(Security) - Prevent potential provider key exposure through URL-valued model destinations and fallbacks by @yucheng-berri in https://github.com/BerriAI/litellm/pull/34189
docs(issue-template): ask for a numbered list of reproduction steps by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/34207
test(ui): fix key and credential e2e specs after the overflow menu migrations by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34206
test(e2e): add live A2A agent e2e suite by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/34052
fix(ui): reflect REDIS_* env cache config and stop the UI overwriting the stored password by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34160
fix(ui): surface env-var-sourced theme and logging-callback settings by @yassin-berriai in https://github.com/BerriAI/litellm/pull/34156
test(musty_leopard): cover customer chat/messages cost + streaming paths by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/34164
chore(ci): promote internal staging to main by @yuneng-berri in https://github.com/BerriAI/litellm/pull/34200

New Contributors

@vineetpuranik made their first contribution in https://github.com/BerriAI/litellm/pull/33940
@jyeung-r7 made their first contribution in https://github.com/BerriAI/litellm/pull/33623
@lyb0307 made their first contribution in https://github.com/BerriAI/litellm/pull/33228

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.94.0-rc.1...v1.95.0-dev.1

Open source →