Metadata-Version: 2.4
Name: tokie
Version: 0.0.3
Classifier: Programming Language :: Rust
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Text Processing
Summary: Blazingly fast tokenizer — 50x faster, 10x smaller, 100% accurate
License: MIT OR Apache-2.0
Requires-Python: >=3.9
