[PERF]: Improve the performance of `plc.io.parquet.read_parquet` with prefetched parquet file metadata. - #23558

Merged

rapids-bot[bot] merged 34 commits into

NVIDIA:mainfrom

TomAugspurger:tom/parquet-metadata-gil-perf

Aug 17, 2026

Commits on Aug 6, 2026

Commits on Aug 7, 2026

Merge branch 'main' into tom/parquet-metadata-gil-perf
TomAugspurger
authored
fd8ce79
prefetch only parquet types
TomAugspurger
committed
3491475
Executor-dependent default
TomAugspurger
committed
c076a1e
user option fixes
TomAugspurger
committed
a8bb6fb
fix
TomAugspurger
committed
5b6717f
disable for use_rapidsmpf_native
TomAugspurger
committed
14f7258

Commits on Aug 10, 2026

merge conflict
Matt711
committed
77f3793

Commits on Aug 11, 2026

Merge branch 'main' into tom/parquet-metadata-gil-perf
Matt711
authored
fe11cd9
revert commit 3: dont read page indices
Matt711
committed
aebf8a0

Commits on Aug 12, 2026

move helper function from C++ to Cython (verbatim)
Matt711
committed
f9490ac
properly handle unspecified prefetch meta in parquet options
Matt711
committed
5e864ac
turn on for cloud-only
Matt711
committed
3c1d78b
Merge branch 'main' into tom/parquet-metadata-gil-perf
Matt711
authored
98fbdd8
pre-commit
Matt711
committed
93bccd7
remove copyright change
Matt711
committed
df0b4d4
Merge branch 'main' into tom/parquet-metadata-gil-perf
Matt711
authored
8b7563a

Commits on Aug 13, 2026

default is Unspecified for prefetching with streaming engine
Matt711
committed
ad20e44
add a test for ParquetOptions w/o setting prefetching default
Matt711
committed
74cda45
fix tests because we fallback now if metadata is not prefetched
Matt711
committed
0af3e32
test remote_only=True
Matt711
committed
4c55108
docs, small fixes
Matt711
committed
071bd04
revert unnecessary changes
Matt711
committed
ea351a6
remove copy_parquet_metadatas
Matt711
committed
d84b230
more doc strings fixes
Matt711
committed
420469a
trigger github update
Matt711
committed
813740f
Merge branch 'main' into tom/parquet-metadata-gil-perf
Matt711
authored
b545203
Merge branch 'main' into tom/parquet-metadata-gil-perf
Matt711
authored
ccb3154

Commits on Aug 14, 2026

Merge branch 'main' into tom/parquet-metadata-gil-perf
Matt711
authored
cdb65fe

Commits on Aug 16, 2026

docs
Matt711
committed
d4ecace