From 2a251f141963ccc9725d056592775d7b31182026 Mon Sep 17 00:00:00 2001 From: Sahil Kumar Singh Date: Sun, 28 Jun 2026 12:34:02 +0530 Subject: [PATCH] perf: parallel tokenization via num_proc --- CHANGELOG.md | 1 + 1 file changed, 1 insertion(+) diff --git a/CHANGELOG.md b/CHANGELOG.md index 060d7fc..ec5eadd 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -201,3 +201,4 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 ### Removed - Untracked `__pycache__`, `build/`, and `dist/` from the git repository. +- patch 232: perf: parallel tokenization via num_proc