lindera/lindera
A multilingual morphological analysis library.
A star delta has been computed for 62,252 of 63,107 tracked repositories in this period, and only those can be ranked in it.
A repository missing here has not been measured far enough back yet. That does not mean it did not move.
Star counts measured between 07:57 and 10:04 (BKK).
A multilingual morphological analysis library.
A tiny neural-network framework in pure Go with AVX2 SIMD kernels (GOEXPERIMENT=simd)
Ready-made tokenizer library for working with GPT and tiktoken
Solves basic Russian NLP tasks, API for lower level Natasha projects
Parser Building Toolkit for JavaScript
🎤 vibrato: Viterbi-based accelerated tokenizer
A micro-library of stream components for building custom JSON and JSONC processing pipelines with a minimal memory footprint — parse, filter, and transform JSON far larger than available memory with a SAX-inspired token API, on Node.js or Web Streams.
A multilingual command line sentence tokenizer in Golang
exact tokenizers ids, as fast as the hardware allows
That's all 9 repositories in this period.