Patch delays - #148

Merged

YaphetKG merged 13 commits into

Sep 17, 2026

Commits on Sep 3, 2026

perf(crawl): thread the crawl over input files, drop the crawlspace
YaphetKG
committed
be8b39c
bump roger
YaphetKG
committed
c9ed8f8

Commits on Sep 5, 2026

fix(bulkload): strip bare \r from node description/name

YaphetKG
and
claude
committed
5b0f4f6

Commits on Sep 6, 2026

perf(storage): gzip crawl-stage .txt/.jsonl artifacts

YaphetKG
and
claude
committed
69774c3

Commits on Sep 7, 2026

perf(storage): drop gzip to level 6, level 9 was throttling crawl pods

YaphetKG
and
claude
committed
f78aec4
perf(crawl): give the crawl task its own cpu limit

YaphetKG
and
claude
committed
cd9ecc9
perf(crawl): bump crawl_cpu default to 4 cores

YaphetKG
and
claude
committed
f00c10f
perf(crawl): skip files already crawled by an earlier try

YaphetKG
and
claude
committed
b96c9f9
tools: add gzip_artifacts.py to retroactively compress old annotation output

YaphetKG
and
claude
committed
213fe63

Commits on Sep 10, 2026

perf(crawl): make crawl resumable now that it has a skip check

YaphetKG
and
claude
committed
2883baf
perf(crawl): bump crawl_file_workers and crawl_cpu to 8

YaphetKG
and
claude
committed
0d2a8d8

Commits on Sep 14, 2026

fix(crawl): skip a corrupted file instead of failing the whole task

YaphetKG
and
claude
committed
f6ed27d

Commits on Sep 15, 2026

fix(indexing): size index_variables_task, it OOMKilled on bdc-recover

YaphetKG
and
claude
committed
9f6d5a7