github.com/pemistahl/lingua-go
v1.4.0
#1309 most downloaded on Go modules
pemistahl/lingua-go
What this package is like to depend on
Last release 2 years ago
no release in 18 months
Release timing varies
gaps range from 2 weeks to 7 months
Nearly every release is documented
notes for 17 of 17 stable releases
Nothing withdrawn
no release was ever pulled
5 years old
51 releases · first in 2021
0 releases in the last 12 months
see the full history below
Release timeline
51 releases · Jun 2021 to Dec 2024Releases
latest 51-
v1.4.1-0.20241217152257-a440fc12f15b17 Dec 2024 pre-releaseNothing published for this version
-
v1.4.1-0.20241204055805-89e1e957523e04 Dec 2024 pre-releaseNothing published for this version
-
v1.4.1-0.20241203200501-61573219f4a803 Dec 2024 pre-releaseNothing published for this version
-
v1.4.1-0.20240808151414-f74cc62e2df208 Aug 2024 pre-releaseNothing published for this version
-
v1.4.1-0.20240807181638-1caca9acffd807 Aug 2024 pre-releaseNothing published for this version
-
v1.4.1-0.20240119091236-0c3ba798a34e19 Jan 2024 pre-releaseNothing published for this version
-
v1.4.1-0.20231207143350-b30f17c2a08107 Dec 2023 pre-releaseNothing published for this version
-
v1.4.005 Sep 2023Release notes
Open source →Features
- The new functions
GetIsoCode639_1FromValue()andGetIsoCode639_3FromValue()have been introduced to return the properIsoCode639_1andIsoCode639_3for a given name string. (#44)
Changes
- The functions
GetLanguageFromIsoCode639_1()andGetLanguageFromIsoCode639_3()now correctly returnUnknowninstead of-1if a language cannot be found for the given iso code. (#44)
Bug Fixes
- The method
LanguageDetector.DetectMultipleLanguagesOf()returned wrong values for start and end indices for texts consisting of only a single word. This has been fixed. (#43)
Release notes
Open source →Features
- The new functions
GetIsoCode639_1FromValue()andGetIsoCode639_3FromValue()have been introduced to return the properIsoCode639_1andIsoCode639_3for a given name string. (#44)
Changes
- The functions
GetLanguageFromIsoCode639_1()andGetLanguageFromIsoCode639_3()now correctly returnUnknowninstead of-1if a language cannot be found for the given iso code. (#44)
Bug Fixes
- The method
LanguageDetector.DetectMultipleLanguagesOf()returned wrong values for start and end indices for texts consisting of only a single word. This has been fixed. (#43)
- The new functions
-
v1.3.5-0.20230904181828-cba77649846904 Sep 2023 pre-releaseNothing published for this version
-
v1.3.5-0.20230702072220-cf22a0757dbb02 Jul 2023 pre-releaseNothing published for this version
-
v1.3.409 Jun 2023Release notes
Open source →Bug Fixes
- When trying to detect multiple languages in a text consisting of only a single word, a panic occurred. This has been fixed. (#41)
Release notes
Open source →Bug Fixes
- When trying to detect multiple languages in a text consisting of only a single word, a panic occurred. This has been fixed. (#41)
-
v1.3.4-0.20230403090455-ba5312412eab03 Apr 2023 pre-releaseNothing published for this version
-
v1.3.4-0.20230402205445-2913e92db22002 Apr 2023 pre-releaseNothing published for this version
-
v1.3.303 Feb 2023Release notes
Open source →Bug Fixes
- For long input texts, a panic occurred while computing the confidence values due to an accidental division by zero. This has been fixed. (#27)
Release notes
Open source →Bug Fixes
- For long input texts, a panic occurred while computing the confidence values due to an accidental division by zero. This has been fixed. (#27)
-
v1.3.3-0.20230201080647-5e6f2232a83e01 Feb 2023 pre-releaseNothing published for this version
-
v1.3.230 Jan 2023Release notes
Open source →Improvements
- After applying some internal optimizations, language detection is now faster, at least between 20% and 30%, approximately. For long input texts, the speed improvement is greater than for short input texts.
Release notes
Open source →Improvements
- After applying some internal optimizations, language detection is now faster, at least between 20% and 30%, approximately. For long input texts, the speed improvement is greater than for short input texts.
-
v1.3.108 Jan 2023Release notes
Open source →Bug Fixes
- For long input texts, an error occurred while computing the confidence values due to numerical underflow when converting probabilities. This has been fixed.
Release notes
Open source →Bug Fixes
- For long input texts, an error occurred while computing the confidence values due to numerical underflow when converting probabilities. This has been fixed.
-
v1.3.001 Jan 2023Release notes
Open source →Improvements
- The min-max normalization method for the confidence values has been replaced with applying the softmax function. This gives more realistic probabilities. (#25)
Release notes
Open source →Improvements
- The min-max normalization method for the confidence values has been replaced with applying the softmax function. This gives more realistic probabilities. (#25)
-
v1.2.3-0.20221231232011-88e76d63b20b31 Dec 2022 pre-releaseNothing published for this version
-
v1.2.227 Dec 2022Release notes
Open source →Bug Fixes
- Under certain circumstances, calling the method
LanguageDetector.DetectMultipleLanguagesOf()caused an index error. This has been fixed.
Release notes
Open source →Bug Fixes
- Under certain circumstances, calling the method
LanguageDetector.DetectMultipleLanguagesOf()caused an index error. This has been fixed.
- Under certain circumstances, calling the method
-
v1.2.113 Dec 2022Release notes
Open source →Bug Fixes
- A misconfiguration in a
go.modfile caused errors when trying to download the library via thego getcommand. This has been fixed. Thanks to @benstigsen for the pointer. (#23)
Release notes
Open source →Bug Fixes
- A misconfiguration in a
go.modfile caused errors when trying to download the library via thego getcommand. This has been fixed. (#23)
- A misconfiguration in a
-
v1.2.012 Dec 2022Release notes
Open source →Features
- The new method
LanguageDetector.DetectMultipleLanguagesOf()has been introduced. It allows to detect multiple languages in mixed-language text. (#9)
Release notes
Open source →Features
- The new method
LanguageDetector.DetectMultipleLanguagesOf()has been introduced. It allows to detect multiple languages in mixed-language text. (#9)
- The new method
-
v1.1.2-0.20221209224908-20dc1d9087f009 Dec 2022 pre-releaseNothing published for this version
-
v1.1.2-0.20221205215850-d39b8cc269a005 Dec 2022 pre-releaseNothing published for this version
-
v1.1.122 Nov 2022Release notes
Open source →Documentation
- Some documentation mistakes have been fixed and missing information has been added.
Release notes
Open source →Documentation
- Some documentation mistakes have been fixed and missing information has been added.
-
v1.1.1-0.20221121234757-fcd98b98d30721 Nov 2022 pre-releaseNothing published for this version
-
v1.1.021 Nov 2022Release notes
Open source →Features
-
The new method
LanguageDetectorBuilder.WithLowAccuracyMode()has been introduced. By activating it, detection accuracy for short text is reduced in favor of a smaller memory footprint and faster detection performance. (#17) -
The new method
LanguageDetector.ComputeLanguageConfidence()has been introduced. It allows to retrieve the confidence value for one specific language only, given the input text. (#19)
Improvements
-
The computation of the confidence values has been revised and the min-max normalization algorithm is now applied to the values, making them better comparable by behaving more like real probabilities. (#16)
-
The language models are now serialized as protocol buffers instead of json. Thanks to this change, they are now loaded into memory twice as fast as before. (#22)
Bug Fixes
- The unigram counts in the statistics engine were not retrieved correctly. This has been fixed, producing more correct detection results. (#14)
Compatibility
- The lowest supported Go version is 1.18 now. Older versions are no longer compatible with this library.
Miscellaneous
- The library now has a fresh and colorful new logo. Why? Well, why not? (-:
-
-
v1.0.6-0.20221120222141-38293fcea86e20 Nov 2022 pre-releaseNothing published for this version
-
v1.0.6-0.20221118111246-7e95fabda0ba18 Nov 2022 pre-releaseNothing published for this version
-
v1.0.6-0.20221117122512-58a9c71054a117 Nov 2022 pre-releaseNothing published for this version
-
v1.0.6-0.20221114095946-8508880e12af14 Nov 2022 pre-releaseNothing published for this version
-
v1.0.6-0.20221108210748-64a36543336e08 Nov 2022 pre-releaseNothing published for this version
-
v1.0.6-0.20221104152837-2461dfedfd1504 Nov 2022 pre-releaseNothing published for this version
-
v1.0.6-0.20220927082100-ed8aa58b3e3027 Sep 2022 pre-releaseNothing published for this version
-
v1.0.6-0.20220825123052-5808b69dab6f25 Aug 2022 pre-releaseNothing published for this version
-
v1.0.6-0.20220420181131-d8d50322ad3e20 Apr 2022 pre-releaseNothing published for this version
-
v1.0.6-0.20220407110258-162bc5e070e707 Apr 2022 pre-releaseNothing published for this version
-
v1.0.6-0.20211228112516-d5d9063557a528 Dec 2021 pre-releaseNothing published for this version
-
v1.0.525 Dec 2021Release notes
Open source →Bug Fixes
- The character â was erroneously not treated as a possible indicator for French.
Improvements
- The dependencies to the other language detectors which are used for
the accuracy comparisons were always downloaded together with the main
library. They are only needed when you want to update the accuracy reports,
therefore the
cmd/subdirectory now contains its own Go module that defines those dependencies. They have now been removed from the main library. Thanks to @dim and @BoeingX for identifying this problem. (#8)
-
v1.0.5-0.20211128185520-a48ae29b739828 Nov 2021 pre-releaseNothing published for this version
-
v1.0.428 Nov 2021Release notes
Open source →Bug Fixes
- It was possible to include
lingua.Unknownin the set of input languages for building the language detector. It is only meant as a return value, so it is now automatically removed from the set of input languages. Thanks to @marians for identifying this problem. (#7)
- It was possible to include
-
v1.0.320 Oct 2021 -
v1.0.213 Oct 2021Release notes
Open source →Bug Fixes
- In very rare cases, the language returned by the detector was non-deterministic. This has been fixed. Big thanks to @FilipAlexander for identifying this problem. (#6)
-
v1.0.127 Jun 2021Release notes
Open source →Bug Fixes
- The language models were not embedded into the compiled binary. This resulted in problems when trying to use Lingua within a Docker container, for instance. Big thanks to @dsxack for identifying this problem and providing a fix. (#2 #3)
-
v1.0.021 Jun 2021Release notes
Open source →This is the very first release of the Go implementation of Lingua. Enjoy! :-)
-
v0.0.0-20241204055805-89e1e957523e04 Dec 2024 pre-releaseNothing published for this version
-
v0.0.0-20241203200501-61573219f4a803 Dec 2024 pre-releaseNothing published for this version
-
v0.0.0-20240808151414-f74cc62e2df208 Aug 2024 pre-releaseNothing published for this version
-
v0.0.0-20240119091236-0c3ba798a34e19 Jan 2024 pre-releaseNothing published for this version
-
v0.0.0-20231207143350-b30f17c2a08107 Dec 2023 pre-releaseNothing published for this version
-
v0.0.0-20210621140039-fce4229c2d8321 Jun 2021 pre-releaseNothing published for this version