[WIP] GPU support in PEPSKit

[kshyatt]

cc @dartsushi see the boundarymps/vumps.jl for test/cuda to get started

[codecov]

Codecov Report

❌ Patch coverage is 40.29851% with 40 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
src/environments/suweight.jl	0.00%	10 Missing ⚠️
src/environments/ctmrg_environments.jl	66.66%	6 Missing ⚠️
ext/PEPSKitAdaptExt.jl	0.00%	3 Missing ⚠️
src/operators/localoperator.jl	0.00%	3 Missing ⚠️
src/operators/models.jl	0.00%	3 Missing ⚠️
src/operators/transfermatrix.jl	62.50%	3 Missing ⚠️
src/algorithms/optimization/peps_optimization.jl	0.00%	2 Missing ⚠️
src/networks/local_sandwich.jl	0.00%	2 Missing ⚠️
src/states/infinitepartitionfunction.jl	0.00%	2 Missing ⚠️
src/states/infinitepeps.jl	50.00%	2 Missing ⚠️
... and 4 more

Files with missing lines	Coverage Δ
src/algorithms/contractions/localoperator.jl	74.80% <ø> (-21.66%)	⬇️
src/algorithms/ctmrg/ctmrg.jl	81.69% <ø> (-6.47%)	⬇️
src/algorithms/select_algorithm.jl	18.51% <100.00%> (-58.41%)	⬇️
src/environments/vumps_environments.jl	100.00% <100.00%> (ø)
src/utility/svd.jl	52.42% <ø> (-14.08%)	⬇️
src/algorithms/ctmrg/gaugefix.jl	0.00% <0.00%> (-93.58%)	⬇️
src/algorithms/toolbox.jl	46.15% <66.66%> (-50.77%)	⬇️
src/networks/tensors.jl	46.34% <50.00%> (-31.71%)	⬇️
src/utility/util.jl	23.65% <0.00%> (-45.17%)	⬇️
src/algorithms/optimization/peps_optimization.jl	0.00% <0.00%> (-94.74%)	⬇️
... and 9 more

... and 51 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[dartsushi]

You are awesome! I will try it out tomorrow

[kshyatt]

OK, I think the main blocker here is QuantumKitHub/TensorOperations.jl#298,

[kshyatt]

An additional problem is that the timeevol/j1j2_finiteT test is very slow. I'll look into why.

[kshyatt]

And it would also make sense to set a lot of this up like the GPUArrays testsuite, where we just pass a list of array types to adapt to, to avoid the massive code explosion here.

[kshyatt]

OK this diff just got a whole lot less crazy. I didn't add GPU tests for types or examples but can do so if others prefer.

[kshyatt]

I'm making a few more updates to get CI to play nicely on top of the testsuite changes, and this is also waiting on an MPSKit tag. But then I think we're good to go!

[kshyatt]

OK, I think the main blocker here is now the MPSKit tag that's needed, as well as the very long ROCm CI queue 😛

[kshyatt]

I think this is ready for folks to start having a look @Yue-Zhengyuan @leburgel @pbrehmer <3. Happy to explain anything I can!