Metadata-Version: 2.2
Name: PolyScribe
Version: 0.2.1a1
Summary: Custom C++20 tokenizer.
Keywords: Tokenizer,Artificial Intelligence,Machine Learning,Tranformer,Dataset,Natural Language Processing,Parsing
Author: DracoRooks
License: MIT
Classifier: Development Status :: 2 - Pre-Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: Programming Language :: C++
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Programming Language :: Python :: 3.14
Classifier: Topic :: Scientific/Engineering
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Software Development
Classifier: Topic :: Software Development :: Libraries
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: Text Processing :: Linguistic
Classifier: License :: OSI Approved :: MIT License
Project-URL: Repository, https://github.com/DracoRooks/Scribe.git
Project-URL: Documentation, https://polyscribe.readthedocs.io/en/latest/
Requires-Python: >=3.10
Description-Content-Type: text/markdown

A custom, fast and versatile C++20 tokenizer.

Semantic Versoning in this project follows the rules in [SemVer](https://semver.org/).
