sumire.tokenizer package
========================

Submodules
----------

sumire.tokenizer.auto module
----------------------------

.. automodule:: sumire.tokenizer.auto
   :members:
   :undoc-members:
   :show-inheritance:

sumire.tokenizer.base module
----------------------------

.. automodule:: sumire.tokenizer.base
   :members:
   :undoc-members:
   :show-inheritance:

sumire.tokenizer.jumanpp module
-------------------------------

.. automodule:: sumire.tokenizer.jumanpp
   :members:
   :undoc-members:
   :show-inheritance:

sumire.tokenizer.mecab module
-----------------------------

.. automodule:: sumire.tokenizer.mecab
   :members:
   :undoc-members:
   :show-inheritance:

sumire.tokenizer.spacy\_ginza module
------------------------------------

.. automodule:: sumire.tokenizer.spacy_ginza
   :members:
   :undoc-members:
   :show-inheritance:

sumire.tokenizer.spm module
---------------------------

.. automodule:: sumire.tokenizer.spm
   :members:
   :undoc-members:
   :show-inheritance:

sumire.tokenizer.sudachi module
-------------------------------

.. automodule:: sumire.tokenizer.sudachi
   :members:
   :undoc-members:
   :show-inheritance:

Module contents
---------------

.. automodule:: sumire.tokenizer
   :members:
   :undoc-members:
   :show-inheritance: