github.com/pkoukk/tiktoken-go

Releases

1. v0.1.9-0.20260512074532-200cf60c816f12 May 2026pre-release

   Nothing published for this version

2. v0.1.9-0.20260308130406-666803a508e98 Mar 2026pre-release

   Nothing published for this version

3. v0.1.810 Sept 2025
   Release notes

   What's Changed

   • feat: support for gpt-4.1 and gpt-4.5 models by @kuzminT in #61
   • Removes deprecated methods by @kuzminT in #62
   • use rlock when getEncoding by @justadogistaken in #59

   New Contributors

   • @kuzminT made their first contribution in #61
   • @justadogistaken made their first contribution in #59

   Full Changelog: v0.1.7...v0.1.8

   Open source →
4. v0.1.8-0.20250719230256-b111d230acb419 Jul 2025pre-release

   Nothing published for this version

5. v0.1.8-0.20250711001434-632140be331311 Jul 2025pre-release

   Nothing published for this version

6. v0.1.8-0.20250408064443-e0742e8145868 Apr 2025pre-release

   Nothing published for this version

7. v0.1.721 May 2024
   Release notes

   What's Changed

   • feat: add support for latest embedding models by @matthiasthomas in #43
   • feat: support o200k_base (gpt-4o) by @WqyJh in #47

   New Contributors

   • @matthiasthomas made their first contribution in #43
   • @WqyJh made their first contribution in #47

   Full Changelog: v0.1.6...v0.1.7

   Open source →
8. v0.1.7-0.20240521090836-7defbfc0edae21 May 2024pre-release

   Nothing published for this version

9. v0.1.7-0.20240515111405-175c72f02b1815 May 2024pre-release

   Nothing published for this version

10. v0.1.7-0.20240201214713-14e35cc3947c1 Feb 2024pre-release

    Nothing published for this version

11. v0.1.68 Sept 2023

    Nothing published for this version

12. v0.1.6-0.20230908081636-475cdcdb453a8 Sept 2023pre-release

    Nothing published for this version

13. v0.1.6-0.20230905173153-caab340cf0085 Sept 2023pre-release

    Nothing published for this version

14. v0.1.513 Jul 2023
    Release notes

    Fix the issue of excessive memory consumption when initializing Encoding with multiple goroutines.

    Open source →
15. v0.1.5-0.20230713065224-4f571fcebf8b13 Jul 2023pre-release

    Nothing published for this version

16. v0.1.5-0.20230713064253-32d90bfc39ef13 Jul 2023pre-release

    Nothing published for this version

17. v0.1.5-0.20230628092237-e87301fe7bb928 Jun 2023pre-release

    Nothing published for this version

18. v0.1.5-0.20230628081222-f360d8f8a01928 Jun 2023pre-release

    Nothing published for this version

19. v0.1.5-0.20230628073354-84c50135d07e28 Jun 2023pre-release

    Nothing published for this version

20. v0.1.427 Jun 2023

    Nothing published for this version

21. v0.1.4-0.20230627093019-6b3f51c9b5ea27 Jun 2023pre-release

    Nothing published for this version

22. v0.1.4-0.20230627092445-47c012b72ff527 Jun 2023pre-release

    Nothing published for this version

23. v0.1.4-0.20230627082733-589226ea79a227 Jun 2023pre-release

    Nothing published for this version

24. v0.1.4-0.20230627074601-541648494f6d27 Jun 2023pre-release

    Nothing published for this version

25. v0.1.4-0.20230627072225-97b6b4d4032c27 Jun 2023pre-release

    Nothing published for this version

26. v0.1.4-0.20230620015851-ba5a966c105e20 Jun 2023pre-release

    Nothing published for this version

27. v0.1.4-0.20230619125657-0770aa32bf4019 Jun 2023pre-release

    Nothing published for this version

28. v0.1.316 Jun 2023
    Release notes

    Merge pull request #25 from pkoukk/enhance_safe-get-encoding

    enhancement: thread safe for get encoding

    Open source →
29. v0.1.3-0.20230616091220-77200b669ba616 Jun 2023pre-release

    Nothing published for this version

30. v0.1.3-0.20230606072524-9fda5e9252be6 Jun 2023pre-release

    Nothing published for this version

31. v0.1.3-0.20230606023956-f2ca9a48c9d26 Jun 2023pre-release

    Nothing published for this version

32. v0.1.22 Jun 2023
    Release notes

    Merge barnch of Optimize encodeNative by @bakks

    Open source →
33. v0.1.2-0.20230602014805-017b58e254f02 Jun 2023pre-release

    Nothing published for this version

34. v0.1.2-0.20230512030219-03647ca046a112 May 2023pre-release

    Nothing published for this version

35. v0.1.2-0.20230506035356-8b3f9476ca266 May 2023pre-release

    Nothing published for this version

36. v0.1.119 Apr 2023
    Release notes

    Fix bugs of special tokens
    Add support for gpt-3.5-turobo-* and gpt-4-*

    Open source →
37. v0.1.1-0.20230419015404-9d1c14918e8b19 Apr 2023pre-release

    Nothing published for this version

38. v0.1.1-0.20230419015348-39595a77569b19 Apr 2023pre-release

    Nothing published for this version

39. v0.1.1-0.20230418101013-cae80938948018 Apr 2023pre-release

    Nothing published for this version

40. v0.1.1-0.20230418100813-0a14607415ed18 Apr 2023pre-release

    Nothing published for this version

41. v0.1.1-0.20230414104727-0a49ece2b28814 Apr 2023pre-release

    Nothing published for this version

42. v0.1.1-0.20230414100656-dd996d728f5b14 Apr 2023pre-release

    Nothing published for this version

43. v0.1.1-0.20230410085148-20fd9122fbb610 Apr 2023pre-release

    Nothing published for this version

44. v0.1.1-0.20230410080739-eb45b82397d310 Apr 2023pre-release

    Nothing published for this version

45. v0.1.1-0.20230404085618-deaae49516ab4 Apr 2023pre-release

    Nothing published for this version

46. v0.1.1-0.20230403112227-1d948c8bf4623 Apr 2023pre-release

    Nothing published for this version

47. v0.1.030 Mar 2023

    Nothing published for this version

48. v0.0.0-20230713065224-4f571fcebf8b13 Jul 2023pre-release

    Nothing published for this version

49. v0.0.0-20230419015404-9d1c14918e8b19 Apr 2023pre-release

    Nothing published for this version

50. v0.0.0-20230418101013-cae80938948018 Apr 2023pre-release

    Nothing published for this version

51. v0.0.0-20230414100656-dd996d728f5b14 Apr 2023pre-release

    Nothing published for this version

52. v0.0.0-20230404085618-deaae49516ab4 Apr 2023pre-release

    Nothing published for this version

53. v0.0.0-20230330063401-ce4f2152420630 Mar 2023pre-release

    Nothing published for this version

54. v0.0.0-20230324104152-12d08d8436f624 Mar 2023pre-release

    Nothing published for this version

55. v0.0.0-20230310022724-03f8612cb97010 Mar 2023pre-release

    Nothing published for this version

56. v0.0.0-20230308103135-85a338c773ce8 Mar 2023pre-release

    Nothing published for this version