mecab-python3

This is a test release for M1 wheels. As I do not have an M1 Mac, help testing is needed.

You can install the release like this:

pip install mecab-python3==1.0.8a1

If it works, please let me know in https://github.com/SamuraiT/mecab-python3/issues/84.

This release includes a minor change to debugging output on failed initialization. It's common to forget to install a dictionary with mecab-python3, this just makes that failure state more apparent.

Some build-related changes added since the last release are also included.

This release adds Python 3.11 wheels. There are no other changes.

This release adds wheels for Python 3.10. There are no other changes.

These changes are partly based on changes made to fugashi, so thanks again to @lambdadog for help with that.

This is a minor release with a few small improvements.

Most commits in this release are related to generating wheels and have no effect on the library in use. Thanks to @odidev for adding aarch64 support (#66).

One change is that errors at initialization time now throw a RuntimeError instead of writing directly to stdout. Thanks to @eggplants for pointing out that the current behavior was undesirable (#67).

A small documentation change is a note about the top-level MeCab.VERSION attribute. This refers to the version of the MeCab binary, not this package, and so it's been 0.996 for years, and is not likely to be useful. It's being kept around now for compatibility purposes. Thanks to @rggdmonk for pointing this out (#68).

This release reflects builds moving off of Travis and on to Github Actions.

If you are using Python 3 you should see no changes. Support for Python 2 is dropped.

Wheels have always been built on Travis; when they were first set up Github Actions didn't exist. Travis will be closing down the .org domain builds were using soon, and their pricing plan is changing in a way that could potentially affect builds. Since builds aren't terribly complicated anyway they have been migrated to Github Actions.

A side effect of this is that Github Actions has no support for Python 2. Since Python 2 met end of life a while ago, support was maintained as long as it was zero effort. It would no longer be zero effort so the time has come to remove it. If you need Python 2 I suggest you get a new job, but you can keep using v1.0.2.

This is the 1.0 release of mecab-python3, and it comes with a few exciting changes.

• Windows wheels are finally available #31
• Unidic can be installed via pip #38
• Spaces in Tagger arguments are supported #43
• Command-line scripts are included

This means that on any platform you should be able to install a working MeCab and dictionary with just pip install mecab-python3[unidic-lite]. You can then use mecab-py on the command line just like you'd use the mecab binary.

One change that can break existing library usages is that the bundled IPAdic has been removed. If you need IPAdic you'll need to install it from source.

If you have any trouble with the new release please don't hesitate to open an issue. There is currently an unconfirmed report that it doesn't work on Conda on Windows (#46), but with more information we should be able to fix that if it's actually a problem.

Thanks for using this package, and happy tokenizing.

This is a first alpha for a full 1.0 version release. :snake: :confetti_ball:

This pulls together some relatively large changes. In most cases they shouldn't affect usage, or should make the library significantly easier to install, but depending your expectations they may break existing installs. Given that the upstream MeCab is unlikely to ever see another release tracking its version doesn't really make sense, so this is a chance to start fresh. :wind_chime:

Removal of bundled IPAdic :books: :no_good:

This was bundled to make installation easier, but it happened without warning, which caused some confusion. IPAdic is old and should not be used in general; if you do want to use it it's not hard to install. Removing a bundled dictionary means that system MeCab settings, if present, will be used. This is a breaking change if you relied on the bundled dictionary. The bundled dictionary was released with version 0.996.1, released November 2018; the previous 0.7 did not include it.

Support for Windows wheels :package:

The scripts @chezou wrote for fugashi Windows builds worked for this repo with only minor changes. Currently this is only Windows x64 though I'm not sure that's a problem. This could use more testing too.

Support for PyPI dictionaries :books: :+1:

unidic-lite and unidic-py package the actively maintained Unidic dictionary for easy use. While mecab-python3 supports all Mecab dictionaries, as it always has, Unidic is recommended, and now it's easier to use than ever. This also opens the door for other dictionaries being packaged for PyPI distribution.

As far as I'm aware this build is stable and free of issues, but it needs more testing. If you use this alpha version it would be great to hear if it worked or if you had issues.

This release adjusts the version numbering policy. We will, from now on, keep the first two components of the version number in sync with the version number of upstream MeCab that provided the SWIG interface definition file (MeCab.i) and increment the third component only when we make changes to the packaging.

There are no significant code changes since the 0.8 series.