Is there any plan for DP, TP, EP, CP?

[hkxIron]

Is there any plan for DP, TP, EP, CP?

[23Uday]

Just to add FSDP2 to that list.

[kiankyars]

Thanks for asking. The data parallelism course is going to be published soon; it’s called microDDP.

For now, micropp will stay focused on pipeline parallelism. DP/FSDP-style material should land in microDDP rather than being folded into this repo. I do not currently have a plan to add TP, EP, or CP here.