A lightweight Rust library for training GPT-style BPE tokenizers. The tiktoken library is excellent for inference but doesn't support training. The HuggingFace tokenizers library supports training but ...
A robust, single-node key-value store built in Rust. It utilizes an append-only log for data persistence and an in-memory hash map for fast retrieval. This project serves as an educational ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results