Skip to content

refactor: Use ChunkCodecLibLzma for XZ compression + set default size params for all codecs - #71

Merged
icweaver merged 3 commits into
JuliaAstro:mainfrom
nhz2:chunkcodecliblzma
Aug 27, 2026
Merged

icweaver merged 3 commits into
JuliaAstro:mainfrom
nhz2:chunkcodecliblzma

Conversation

@nhz2

@nhz2 nhz2 commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

ChunkCodecLibLzma has a stable API now, allows setting a preset (this is what liblzma calls compression level), and removes the extra copy when compressing.

I have the preset at the default of UInt32(6), but this can be increased to UInt32(9) for more compression.

Also, since the decompressed size is already known, I'm passing it as a max_size and size_hint to decode for better memory usage.

@codecov

codecov Bot commented Aug 25, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 100.00%. Comparing base (c18e875) to head (e862e3a).

Additional details and impacted files
@@            Coverage Diff            @@
##              main       #71   +/-   ##
=========================================
  Coverage   100.00%   100.00%           
=========================================
  Files            1         1           
  Lines          589       589           
=========================================
  Hits           589       589           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@icweaver

Copy link
Copy Markdown
Member

This looks great, thanks Nathan. Also, cool, I see you're at UMD. I was raised in the area, Go Terps!

@icweaver icweaver changed the title Use ChunkCodecLibLzma for XZ compression refactor: Use ChunkCodecLibLzma for XZ compression + set default size params for all codecs Aug 27, 2026
@icweaver
icweaver merged commit 4637d58 into JuliaAstro:main Aug 27, 2026
13 checks passed
@nhz2
nhz2 deleted the chunkcodecliblzma branch August 27, 2026 04:21
icweaver referenced this pull request Sep 19, 2026
I need a release so that #68
is incorporated in a publicly installable version for collaborators.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants