PyPI · #301 most downloaded on PyPI

langsmith

0.14.0114M downloads/molangchain-ai/langsmith-sdk ↗New releases in your daily digest, changelog included.

Client library to connect to the LangSmith Observability and Evaluation Platform.

Last release today
21 Sep 2026
Ships on a steady schedule
a new release about every 9 days
Nearly every release is documented
notes for 59 of the last 60 stable releases
9 versions withdrawn
withdrawn after publishing
3 years old
532 releases · first in 2023

Release timeline

532 releases since 2023

2023202420252026

20232026

One column per quarter.

Releases

0.3.442 Jun 2025
feat(python,js): Add run tree method for setting usage by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1746
What's Changed

feat(python,js): Add run tree method for setting usage by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1746

release(py): 0.3.44 by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1765

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.43...v0.3.44
Open source →
0.3.4329 May 2025
fix(js): Make feedback for evaluator traces using evaluatedBy for jestlike runs apply to root runs by @jacoblee93 in https://github.com/langchain-ai/l
What's Changed

fix(js): Make feedback for evaluator traces using evaluatedBy for jestlike runs apply to root runs by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1718

fix(py): lock h11>0.16 by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1721

fix(frontend): Adds retry for tracing info call by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1724

feat(js) Add function to get Group Runs by @tendev-eoghan in https://github.com/langchain-ai/langsmith-sdk/pull/1675

fix(js): Store dotted order for runs separately in case OTEL export happens in multiple batches by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1709

fix(js): Upgrade vite devdep by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1729

fix(js): invalid type of wrapOpenAI when non-stream create is invoked by @dqbd in https://github.com/langchain-ai/langsmith-sdk/pull/1732

fix(js): avoid throwing in hot path when caller ignores exception by @benjamincburns in https://github.com/langchain-ai/langsmith-sdk/pull/1733

fix(js): Use streaming body in fetch in _sendMultipartRequest by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1728

fix(js): Narrow overly broad traceable type by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1738

feat(js): Log additional context around serialization errors by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1737

release(js): 0.3.29 by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1739

chore(py): update py + poetry setup in CI by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1743

fix(js): fix JS int tests by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1734

feat(js): Allow direct getting and setting of metadata on run trees by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1747

Remove default for fetching child_run_ids from the SDK by @akira in https://github.com/langchain-ai/langsmith-sdk/pull/1730

fix(py): Trace evaluate args more nicely by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1701

feat(py): create_feedback with trace_id only by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1753

New Contributors

@tendev-eoghan made their first contribution in https://github.com/langchain-ai/langsmith-sdk/pull/1675

@benjamincburns made their first contribution in https://github.com/langchain-ai/langsmith-sdk/pull/1733

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.42...v0.3.43

0.3.423 May 2025

fix(js): Trace AI SDK OTEL exported images as base64 by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1712

What's Changed

fix(js): Trace AI SDK OTEL exported images as base64 by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1712
release(js): 0.3.25 by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1713
feat: allow syncing indexed dataset by @samnoyes in https://github.com/langchain-ai/langsmith-sdk/pull/1714

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.41...v0.3.42

Open source →

0.3.412 May 2025

Hide metadata in update_run by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1711

What's Changed

Hide metadata in update_run by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1711

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.40...v0.3.41

Open source →

0.3.402 May 2025

Add hide_metadata support by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1704

What's Changed

Add hide_metadata support by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1704
fix(js): Fix AI SDK tracing when nested in AI SDK tool calls by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1708
Add RunTree.set() support by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1710

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.39...v0.3.40

Open source →

0.3.3930 Apr 2025

fix(js): Reduce JS integration test concurrency by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1698

What's Changed

fix(js): Reduce JS integration test concurrency by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1698
feat(js): Adds support for @opentelemetry/sdk-trace-node@2 along with backcompat shim by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1703
feat(py): Adds python-dotenv as a dev dep for convenient testing by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1702
feat: support rubric_instructions for annotation queues in the SDK by @samnoyes in https://github.com/langchain-ai/langsmith-sdk/pull/1705

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.38...v0.3.39

Open source →

0.3.3828 Apr 2025

fix[python]: Correct client reference counting in compression thread by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1700

What's Changed

fix[python]: Correct client reference counting in compression thread by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1700

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.37...v0.3.38

Open source →

0.3.3725 Apr 2025

feat[python]: OTel context propagation by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1693

What's Changed

feat[python]: OTel context propagation by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1693

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.36...v0.3.37

Open source →

0.3.37rc025 Apr 2025pre-release

packaging: remove Python upper bound by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1691

What's Changed

packaging: remove Python upper bound by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1691
release v0.3.36 by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1696

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.35...v0.3.37rc0

Open source →

0.3.3625 Apr 2025

packaging: remove Python upper bound by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1691

What's Changed

packaging: remove Python upper bound by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1691
release v0.3.36 by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1696

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.35...v0.3.36

Open source →

0.3.3525 Apr 2025

feat(py): support metadata in target func by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1694

What's Changed

feat(py): support metadata in target func by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1694

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.34...v0.3.35

Open source →

0.3.3424 Apr 2025

lint: upgrade to Python 3.9+ syntax by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1679

What's Changed

lint: upgrade to Python 3.9+ syntax by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1679
feat(js): Allow .concurrent, throw error when nesting describe blocks in Jestlike runners by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1688
fix(py): try/except writing to multiple endpoints by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1684
chore[python]: Add additional debug logging to background threads by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1689

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.33...v0.3.34

Open source →

0.3.3321 Apr 2025

Make __version__ a constant by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1669

What's Changed

Make version a constant by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1669
feat(js): Adds JS debug mode that logs output request URLs and responses by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1673
feat(js): Allow async functions in client hideInputs and hideOutputs by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1674
chore(py): fix integration test by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1677
chore[python]: Set dotted order for openai agents sdk integration by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1676

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.32...v0.3.33

Open source →

0.3.3217 Apr 2025

docs: enforce newlines when signature exceeds char threshold by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1661

What's Changed

docs: enforce newlines when signature exceeds char threshold by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1661
docs: fix docs links in python/README.md and README.md by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1662
docs[fix]: -e install langsmith so api refs are available by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1663
Revert "docs[fix]: -e install langsmith so api refs are available" (no longer using rtd) by @sydney-runkle in https://github.com/langchain-ai/langsmith-sdk/pull/1665
fix(js): include project/session name in distributed tracing by @dqbd in https://github.com/langchain-ai/langsmith-sdk/pull/1667
feat(py,js): Allow logging feedback from nested traceables within pytest and jestlike tests by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1668

New Contributors

@sydney-runkle made their first contribution in https://github.com/langchain-ai/langsmith-sdk/pull/1661

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.31...v0.3.32

Open source →

0.3.3115 Apr 2025

fix(js): Raise proper error if multipart upload fails by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1651

What's Changed

fix(js): Raise proper error if multipart upload fails by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1651
patch[python, js]: Update runs with project name by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1659

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.30...v0.3.31

Open source →

0.3.3010 Apr 2025

patch[python]: Use multipart EP for feedback creation by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1655

What's Changed

patch[python]: Use multipart EP for feedback creation by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1655

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.29...v0.3.30

Open source →

0.3.2910 Apr 2025

fix(py,js): clarify deployment err by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1652

What's Changed

fix(py,js): clarify deployment err by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1652
fix(js): Adds warning log when trying to run Jestlike runner in JSDom env by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1644
add fallbacks for create/update examples by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1653
chore: bump python sdk to 0.3.29 by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1654

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.28...v0.3.29

Open source →

0.3.29rc010 Apr 2025pre-release

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.28...v0.3.29rc0

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.28...v0.3.29rc0

Open source →

0.3.289 Apr 2025

patch(python): Don't throw warning for missing API key in otel mode by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1647

What's Changed

patch(python): Don't throw warning for missing API key in otel mode by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1647
fix openai tool call chunk accumulation by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1648
patch[python]: Don't shut down compression thread if drain fails by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1650

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.27...v0.3.28

Open source →

0.3.28rc29 Apr 2025pre-release

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.28rc1...v0.3.28rc2

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.28rc1...v0.3.28rc2

Open source →

0.3.28rc18 Apr 2025pre-release

patch(python): Don't throw warning for missing API key in otel mode by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1647

What's Changed

patch(python): Don't throw warning for missing API key in otel mode by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1647

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.27...v0.3.28rc1

Open source →

0.3.278 Apr 2025

patch[python]: Add debug logging for batch requests to LangSmith by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1635

What's Changed

patch[python]: Add debug logging for batch requests to LangSmith by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1635

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.26...v0.3.27

Open source →

0.3.27rc18 Apr 2025pre-release

patch[python]: Don't set metadata values if the value is None by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1641

What's Changed

patch[python]: Don't set metadata values if the value is None by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1641
Pull prompt in async client. by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1642

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.25rc2...v0.3.27rc1

Open source →

0.3.268 Apr 2025

Pull prompt in async client. by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1642

What's Changed

Pull prompt in async client. by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1642

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.25...v0.3.26

Open source →

0.3.257 Apr 2025

fix(py): drop traceable serialized data by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1634

What's Changed

fix(py): drop traceable serialized data by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1634
patch[python]: Don't set metadata values if the value is None by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1641

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.24...v0.3.25

Open source →

0.3.25rc24 Apr 2025pre-release

fix(py): drop traceable serialized data by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1634

What's Changed

fix(py): drop traceable serialized data by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1634

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.24...v0.3.25rc2

Open source →

0.3.25rc14 Apr 2025pre-release

fix(py): drop traceable serialized data by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1634

What's Changed

fix(py): drop traceable serialized data by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1634

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.24...v0.3.25rc1

Open source →

0.3.243 Apr 2025

Add group id thread tracing for OpenAI Agents SDK by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1584

What's Changed

Add group id thread tracing for OpenAI Agents SDK by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1584

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.23...v0.3.24

Open source →

0.3.232 Apr 2025

patch[python]: Accept langsmith_extras for OpenAI Agents tracing by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1627

What's Changed

patch[python]: Accept langsmith_extras for OpenAI Agents tracing by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1627

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.22...v0.3.23

Open source →

0.3.221 Apr 2025

fix(py): Always upload multipart inputs and outputs parts even if falsey by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1623

What's Changed

fix(py): Always upload multipart inputs and outputs parts even if falsey by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1623

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.21...v0.3.22

Open source →

0.3.211 Apr 2025

Cache retry config by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1622

What's Changed

Cache retry config by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1622

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.20...v0.3.21

Open source →

0.3.2031 Mar 2025

chore(py): fix vcr test issue by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1610

What's Changed

chore(py): fix vcr test issue by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1610
Simplify traceback by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1611
fix(python): Properly respect max_concurrency for aevaluate by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1613
fix(py): serialize langchain objects in testing.log_outputs, fix rich display table [LS-3237] by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1609
release(py): 0.3.20 by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1621

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.19...v0.3.20

Open source →

0.3.1926 Mar 2025

fix delete examples [LS-3226] by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1597

What's Changed

fix delete examples [LS-3226] by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1597
chore(js): update dev deps by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1602
feat(vercel): add support for list of tools of ai sdk by @dqbd in https://github.com/langchain-ai/langsmith-sdk/pull/1604
fix(py): loosen openai-agents extra by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1606
release(py): 0.3.19 by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1607

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.18...v0.3.19

Open source →

0.3.1819 Mar 2025

Create OTel Exporter for LangChain tracing by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1568

What's Changed

Create OTel Exporter for LangChain tracing by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1568
Fix setting otel tracing provider by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1594
patch[python]: bump version 0.3.18 by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1595

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.17...v0.3.18

Open source →

0.3.18rc119 Mar 2025pre-release

Create OTel Exporter for LangChain tracing by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1568

What's Changed

Create OTel Exporter for LangChain tracing by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1568

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.17...v0.3.18rc1

Open source →

0.3.1719 Mar 2025

docs: wrap_openai nit by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1590

What's Changed

docs: wrap_openai nit by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1590
Unset parent_run in run_tree by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1591

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.16...v0.3.17

Open source →

0.3.1619 Mar 2025

fix(py): openai agents tracing nits by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1576

What's Changed

fix(py): openai agents tracing nits by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1576
fix(py): openai agents tracing nits by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1577
feat(py): OpenAI Responses API support by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1571
fix(py): openai agents docstring by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1581
ci: Use a git script instead of changed-files by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1587
release(py): 0.3.16 by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1589

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.15...v0.3.16

Open source →

0.3.1514 Mar 2025

docs(python): Update get_test_results docstring by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1575

What's Changed

docs(python): Update get_test_results docstring by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1575
Support Tracing OpenAI Agents SDK by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1572

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.14...v0.3.15

Open source →

0.3.1414 Mar 2025

fix(py): robustify url construction by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1558

What's Changed

fix(py): robustify url construction by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1558
chore(py): reduce list run test flake by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1559
release(js): 0.3.13 by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1561
Don't nest pydantic by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1564
fix(js): Avoid sampling non-root child runs that were previously filtered by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1573
fix(python): Avoid sampling non-root child runs that were previously filtered by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1574

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.13...v0.3.14

Open source →

0.3.14rc112 Mar 2025pre-release

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.14rc0...v0.3.14rc1

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.14rc0...v0.3.14rc1

Open source →

0.3.14rc012 Mar 2025pre-release

fix(py): robustify url construction by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1558

What's Changed

fix(py): robustify url construction by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1558
chore(py): reduce list run test flake by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1559
release(js): 0.3.13 by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1561
Don't nest pydantic by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1564

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.13...v0.3.14rc0

Open source →

0.3.137 Mar 2025

add wrap_anthropic by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1464

What's Changed

add wrap_anthropic by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1464
fix, add slash to urls by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1556
version bump 0.3.13 by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1557

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.12...v0.3.13

Open source →

0.3.126 Mar 2025Deprecated

chore: upgrade ubuntu 20.04->22.04 for deprecation by @bvs-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1513

What's Changed

chore: upgrade ubuntu 20.04->22.04 for deprecation by @bvs-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1513
trace sync evaluators correctly with aevaluate by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1541
chore(py): fix integration tests by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1543
Fix evaluator errors by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1538
fix: use go backend instead of python backend for example functions by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1488
release(js): 0.3.12 by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1546
chore(py): add integration test caching by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1547
fix(python,js): Round feedback scores with more than 4 decimal places by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1548
fix, don't append v1 if it is already in the api url by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1552
Fix 'unexpected keyword argument "config"' error in traceable decorator by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1553
patch[python]: Release 0.3.12 by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1554

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.11...v0.3.12

Open source →

0.3.1125 Feb 2025

fix(py): specify 'packaging' dependency by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1533

What's Changed

fix(py): specify 'packaging' dependency by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1533
refactor(py): add multipart to create/update_examples by @agola11 in https://github.com/langchain-ai/langsmith-sdk/pull/1477
fix(py): integration tests patch by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1535
feat(js): Allow evaluators to return arrays of results by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1536
feat(py): suppoer traceable(process_chunk=) by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1537

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.10...v0.3.11

Open source →

0.3.11rc125 Feb 2025pre-release

fix(py): specify 'packaging' dependency by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1533

What's Changed

fix(py): specify 'packaging' dependency by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1533
refactor(py): add multipart to create/update_examples by @agola11 in https://github.com/langchain-ai/langsmith-sdk/pull/1477
fix(py): integration tests patch by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1535
feat(js): Allow evaluators to return arrays of results by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1536

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.10...v0.3.11-rc.1

Open source →

0.3.1021 Feb 2025

support kwargs in evaluators by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1532

What's Changed

support **kwargs in evaluators by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1532

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.9...v0.3.10

Open source →

0.3.921 Feb 2025

fix(js): Add new tok event by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1512

What's Changed

fix(js): Add new tok event by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1512
feat(js): Allow jestlike evaluators to return arrays of feedback, minor refactoring by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1514
fix(js): Fix evaluator config override by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1515
allow keyword args for evaluators by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1525
bump version by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1528

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.8...v0.3.9

Open source →

0.3.89 Feb 2025

Debug log the serialization issues by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1495

What's Changed

Debug log the serialization issues by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1495

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.7...v0.3.8

Open source →

0.3.78 Feb 2025

feat(js): Allow overriding test suite name for Jest test suites, automatically set environment on project metadata by @jacoblee93 in https://github.co

What's Changed

feat(js): Allow overriding test suite name for Jest test suites, automatically set environment on project metadata by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1492
fix(js): Fix git tagging for Vitest by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1494
docs: ✏️ Fix typo in client function list_examples by @danielvdao in https://github.com/langchain-ai/langsmith-sdk/pull/1457
fix(js): Bump Vitest devdep by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1496
fix(py): Fix unit test by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1497
fix(py): Fix output_keys by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1498
release(py): 0.3.7 by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1500

New Contributors

@danielvdao made their first contribution in https://github.com/langchain-ai/langsmith-sdk/pull/1457

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.6...v0.3.7

Open source →

0.3.65 Feb 2025

patch(js): utf-8 encode multipart parts by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1487

What's Changed

patch(js): utf-8 encode multipart parts by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1487
feat(py): Increase concurrency for pytest evals, fix output rendering nits by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1489
patch[python]: Release 0.3.6 by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1491

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.5...v0.3.6

Open source →

0.3.54 Feb 2025

fix(py): fix dataset created_at by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1485

What's Changed

fix(py): fix dataset created_at by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1485
python[patch]: Release 0.3.5 by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1486

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.4...v0.3.5

Open source →

0.3.431 Jan 2025Breaking

[BREAKING CHANGE]: Renamed pytest evals plugin CLI option from --output to --langsmith-output

What's Changed

fix(js): Evals link should use user-defined endpoint by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1476
fix(js): Fix multiple datasets in same test file for Vitest, improve reporter output by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1475
fix(py): Tag pytest experiments by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1481
fix(py): Rename CLI arg for pytest plugin from --output to --langsmith-output to avoid conflict by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1482
release(py): 0.3.4 by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1483

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.3...v0.3.4

Open source →

0.3.330 Jan 2025

docs: update readme env vars by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1468

What's Changed

docs: update readme env vars by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1468
feat(github): Allow release from non-main branches by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1471
python[patch]: fix example link [LS-2764] by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1473
python[patch]: Release 0.3.3 by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1474

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.2...v0.3.3

Open source →

0.3.3rc030 Jan 2025pre-release

docs: update readme env vars by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1468

What's Changed

docs: update readme env vars by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1468
feat(github): Allow release from non-main branches by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1471

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.2...v0.3.3rc0

Open source →

0.3.227 Jan 2025

Fix some typos in comments in langsmith/client.py by @msabramo in https://github.com/langchain-ai/langsmith-sdk/pull/1447

What's Changed

Fix some typos in comments in langsmith/client.py by @msabramo in https://github.com/langchain-ai/langsmith-sdk/pull/1447
infra: fix release workflow tagging by @efriis in https://github.com/langchain-ai/langsmith-sdk/pull/1455
infra: fix py integration test by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1445
Compress create feedback by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1452
fix(js): Handle undefined values in object equality checks by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1460
python[patch]: remove experiment end time by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1463
python[patch]: Release 0.3.2 by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1466

New Contributors

@msabramo made their first contribution in https://github.com/langchain-ai/langsmith-sdk/pull/1447

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.1...v0.3.2

Open source →

0.3.122 Jan 2025

python[patch]: set pyproject.toml project.version by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1446

What's Changed

python[patch]: set pyproject.toml project.version by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1446
docs: Update preferred env vars in READMEs and CI by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1444
python[patch]: add ls_runner metadata by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1449
python[patch]: fix pytest integration example syncing by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1450

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.0...v0.3.1

Open source →

0.3.1rc123 Jan 2025pre-release

Fix some typos in comments in langsmith/client.py by @msabramo in https://github.com/langchain-ai/langsmith-sdk/pull/1447

What's Changed

Fix some typos in comments in langsmith/client.py by @msabramo in https://github.com/langchain-ai/langsmith-sdk/pull/1447

New Contributors

@msabramo made their first contribution in https://github.com/langchain-ai/langsmith-sdk/pull/1447

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.3.1...v0.3.1rc1

Open source →

0.3.022 Jan 2025

feat(js): Vitest/Jest evals by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1343

What's Changed

feat(js): Vitest/Jest evals by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1343
Add python annotation queue async methods by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1396
chore: remove docker-compose from cli by @langchain-infra in https://github.com/langchain-ai/langsmith-sdk/pull/1437
fix(js): Narrow evaluator types, fix example id generation by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1438
fix(js): Separate Jest suites into separate tables when reporting by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1443
python[minor]: Release 0.3.0 by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1439

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.2.11...v0.3.0

Open source →

0.2.1117 Jan 2025

feat(js): Add method to get size of annotation queue by @tendev-liam in https://github.com/langchain-ai/langsmith-sdk/pull/1377

What's Changed

feat(js): Add method to get size of annotation queue by @tendev-liam in https://github.com/langchain-ai/langsmith-sdk/pull/1377
feat(js): Add method to delete a run from an annotation queue by @tendev-liam in https://github.com/langchain-ai/langsmith-sdk/pull/1376
infra: allow non-main py release by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1388
Delete examples bulk by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1279
infra: fix py release inputs by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1389
fix(vercel): nested runs being unflattened, incorrect inheritance behavior of user runId / traceable by @dqbd in https://github.com/langchain-ai/langsmith-sdk/pull/1383
release(js): 0.2.15 by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1382
docs: update api ref deps by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1393
Add safer accessors to delta objects by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1385
fix(python): Fix flaky openai parse tests by @angus-langchain in https://github.com/langchain-ai/langsmith-sdk/pull/1400
Include user info in read feedback by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1386
make LANGSMITH_PROJECT work by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1404
Make pydantic model serialization consistent regardless of surrogates. by @obi1kenobi in https://github.com/langchain-ai/langsmith-sdk/pull/1405
python[patch]: update OpenAI prompt test by @baskaryan in https://github.com/langchain-ai/langsmith-sdk/pull/1407
add mime type to attachment info by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1341
surface mime type when passing attachments to user by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1409
Serialize pydantic and other tricky objects correctly from Rust. by @obi1kenobi in https://github.com/langchain-ai/langsmith-sdk/pull/1392
Implement streaming multipart zstd compression. by @obi1kenobi in https://github.com/langchain-ai/langsmith-sdk/pull/1413
Re-vendor pyo3 at the v0.23.4 commit by @obi1kenobi in https://github.com/langchain-ai/langsmith-sdk/pull/1421
feat(js): Add API refs build by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1423
Switch PyO3 to streaming zstd-compressed multipart Rust client. by @obi1kenobi in https://github.com/langchain-ai/langsmith-sdk/pull/1414
Remove async and non-streaming blocking clients. by @obi1kenobi in https://github.com/langchain-ai/langsmith-sdk/pull/1419
fix(js): Fix reflection in JS API refs by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1426
typo in benchmarking script by @isahers1 in https://github.com/langchain-ai/langsmith-sdk/pull/1427
Support parent=false to prune trees by @hinthornw in https://github.com/langchain-ai/langsmith-sdk/pull/1429

New Contributors

@tendev-liam made their first contribution in https://github.com/langchain-ai/langsmith-sdk/pull/1377

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.2.10...v0.2.11

Open source →

0.2.11rc1520 Jan 2025pre-release

feat(js): Vitest/Jest evals by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1343

What's Changed

feat(js): Vitest/Jest evals by @jacoblee93 in https://github.com/langchain-ai/langsmith-sdk/pull/1343

Full Changelog: https://github.com/langchain-ai/langsmith-sdk/compare/v0.2.11...v0.2.11rc15

Open source →

Your coding agent can read these notes before it upgrades. Set up the MCP server →