Repository navigation

[feature] Multi-GPU support - #17

Closed

yoshikisd wants to merge 125 commits into

cdtools-developers:masterfrom

yoshikisd:feature/multi-gpu

Closed

[feature] Multi-GPU support#17
yoshikisd wants to merge 125 commits into
cdtools-developers:masterfrom
yoshikisd:feature/multi-gpu

Commits on Feb 23, 2025
Commits on Feb 24, 2025
- Created fancy_ptycho_multi_gpu_ddp_speed_test.py to compare reconstruction speed and losses as a function of GPU counts
  yoshikisd
  committed
  1eb8704
Commits on Feb 27, 2025
Commits on Mar 1, 2025
- Created new module cdtools.tools.distributed for multi-GPU applications
  yoshikisd
  committed
  902d272
- Spawning handled by cdtools.tools.distributed module in multi-gpu example script
  yoshikisd
  committed
  aedc035
Commits on Mar 2, 2025
Commits on Mar 3, 2025
Commits on Mar 8, 2025
Commits on Mar 10, 2025
- Removed scheduler from the multi gpu speed test script
  yoshikisd
  committed
  4783915
- Cleaned up the multi gpu speed test
  yoshikisd
  committed
  77eb21a
- Fixed the path in the multi GPU speed test (again)
  yoshikisd
  committed
  3e1bb17
Commits on Mar 11, 2025
- Cleaned up fancy_ptycho_multi_gpu_ddp.py
  yoshikisd
  committed
  5b11dc5
- Removed barrier statement from CDIModel
  yoshikisd
  committed
  00e0413
Commits on Mar 12, 2025
- Fix for unintended GPU usage; added ability to define which GPUs to use for multi-GPU reconstruction
  yoshikisd
  committed
  dd07c4b
Commits on Mar 13, 2025
- Fixed discrepancy between user-specified batch_size and effective batch_size in multi-GPU reconstructions.
  yoshikisd
  committed
  464ed5a
- Fixed list type hint error for Python 3.8
  yoshikisd
  committed
  8f1ee06
Commits on Apr 13, 2025
- Merge branch 'cdtools-developers:master' into feature/multi-gpu
  yoshikisd
  authored
  a82e9fc
Commits on Apr 28, 2025
- Switched DDP with all_reduce implementation for distributive computing
  yoshikisd
  committed
  c29d28c
- Changed name of multi-gpu speed test. Added gold balls example to the speed test. Added speed-up versus GPU count plot
  yoshikisd
  committed
  10e4d74
Commits on May 9, 2025
- Created Reconstructor class to enable separation of optimization loops from CDIModel
  yoshikisd
  committed
  7763520
- Added comment to adam.py to highlight similarities to CDIModel.AD_optimize
  yoshikisd
  committed
  c610e87
Commits on May 10, 2025
Commits on May 12, 2025
Commits on May 28, 2025
- Merge branch 'cdtools-developers:master' into feature/multi-gpu
  yoshikisd
  authored
  f690237
Commits on Jun 10, 2025
Commits on Jun 12, 2025
- Separated LBFGS from CDIModel into a Reconstructor subclass
  yoshikisd
  committed
  9341355
- Separated SGD from CDIModel into a Reconstructor subclass
  yoshikisd
  committed
  4232906
- Removed CDIModel.AD_optimize
  yoshikisd
  committed
  ce67800
Commits on Jun 13, 2025
- Merge branch 'cdtools-developers:master' into feature/multi-gpu
  yoshikisd
  authored
  29198bd
- Cleaned up model and reconstructor docs
  yoshikisd
  committed
  a2967d4
Commits on Jun 14, 2025
Commits on Jun 15, 2025
Commits on Jun 16, 2025
- rank==0 check implemented for several CDIModel file and figure saving/plotting methods
  yoshikisd
  committed
  f80989d
- Removed rank==0 check for CDIModel.report
  yoshikisd
  committed
  3f4fe57
Commits on Jun 17, 2025
Commits on Jun 20, 2025
- Distributive methods support GPU ID selection
  yoshikisd
  committed
  f2d618b
- Single-node multi-worker enforced in cdt-torchrun
  yoshikisd
  committed
  664b0b2
Commits on Jun 27, 2025
- refactored cdt-torchrun to use runpy
  yoshikisd
  committed
  400e5ef
- tidied up wrap_single_gpu_script
  yoshikisd
  committed
  526afdb
Commits on Jun 30, 2025
- Fix to synchronize RNG seed for multi-gpu
  yoshikisd
  committed
  f7e4c2c
Commits on Jul 4, 2025
Commits on Jul 5, 2025
- Depracated spawn-based distributed methods
  yoshikisd
  committed
  037151d
- Depracated torchrunner from distributed
  yoshikisd
  committed
  7a16bbc
Commits on Jul 7, 2025
Commits on Jul 11, 2025
- Altered the seed synchronization step and reorganized bits of the scripts
  yoshikisd
  committed
  564f499
- Record the time when each CDIModel.loss_history value is stored
  yoshikisd
  committed
  2dbb307
- Created speed test decorator, changed speed test environ variables, and cleaned up documentation in distributed
  yoshikisd
  committed
  54691fb
- Rearranged distributed.py
  yoshikisd
  committed
  7c59d66
- Updated the documentation in distributed.py
  yoshikisd
  committed
  ce9541a
- Got rid of unused imports in CDIModel
  yoshikisd
  committed
  5a523cf
- Added CDIModel import to distributed
  yoshikisd
  committed
  6bd7187
Commits on Jul 16, 2025
Commits on Jul 17, 2025
- Linted and updated documentation on distributed.py
  yoshikisd
  committed
  919c236
- Got rid of some print statements from distributed.py
  yoshikisd
  committed
  5ab3ab6
- Linted Reconstructors
  yoshikisd
  committed
  5de4e37
- Linted single_to_multi_gpu.py
  yoshikisd
  committed
  be6abcd
- Linted test_reconstructors.py
  yoshikisd
  committed
  d4ec9ee
- Linted multi gpu tests and test scripts
  yoshikisd
  committed
  27f2d54
- Linted and cleaned up the distributed speed test examples
  yoshikisd
  committed
  976e94c
- Added LBFGS and RPI pytest
  yoshikisd
  committed
  7e850fe
- Cleaned up and refactored parts of test_Adam_gold_balls
  yoshikisd
  committed
  5a6c66f
- Added pytest for the SGD Reconstructor
  yoshikisd
  committed
  01ebaf2
Commits on Jul 18, 2025
Commits on Nov 4, 2025
- Merge branch 'master' into feature/multi-gpu
  yoshikisd
  authored
  22db614

Commits

Commits on Feb 23, 2025

Commits on Feb 24, 2025

Commits on Feb 27, 2025

Commits on Mar 1, 2025

Commits on Mar 2, 2025

Commits on Mar 3, 2025

Commits on Mar 8, 2025

Commits on Mar 10, 2025

Commits on Mar 11, 2025

Commits on Mar 12, 2025

Commits on Mar 13, 2025

Commits on Apr 13, 2025

Commits on Apr 28, 2025

Commits on May 9, 2025

Commits on May 10, 2025

Commits on May 12, 2025

Commits on May 28, 2025

Commits on Jun 10, 2025

Commits on Jun 12, 2025

Commits on Jun 13, 2025

Commits on Jun 14, 2025

Commits on Jun 15, 2025

Commits on Jun 16, 2025

Commits on Jun 17, 2025

Commits on Jun 20, 2025

Commits on Jun 27, 2025

Commits on Jun 30, 2025

Commits on Jul 4, 2025

Commits on Jul 5, 2025

Commits on Jul 7, 2025

Commits on Jul 11, 2025

Commits on Jul 16, 2025

Commits on Jul 17, 2025