Home /Data and ops /jev-curate
jev-curate
Sifts Parquet and JSONL training data at more than 1,500 rows a second.
From the readme
jev-curate High-Throughput Synthetic & Pretraining Dataset Sifter Powered by TypeSafe AI (Jev) By Akash Priyadarshi Why jev-curate • Quickstart • CLI Reference • Python API • Architecture • Non-Goals • Ecosystem Why jev-curate? Cleaning 10M to 1B rows of synthetic reasoning data, instruction tuning pairs, or web-scraped corpora …
cargo add jev-curateDetails
- Section
- Data and ops
- owner
- AkashPriyadarshii
- stars
- 4
- forks
- 0
- pushed
- 2026-09-18
- Language
- Rust
- License
- MIT
What it is
- Form
- CLI
- Host agent
- Standalone
- Audience
- Researchers
Maturity
Docs
reports measured numbers