- A simple note for how to start multi-node-training on slurm scheduler with PyTorch.
- Useful especially when scheduler is too busy that you cannot get multiple GPUs allocated, or you need more than 4 GPUs for a single job.
- Requirement: Have to use PyTorch DistributedDataParallel(DDP) for this purpose.
- Warning: might need to re-factor your own code.
- Warning: might be secretly condemned by your colleagues because using too many GPUs.
zhuolun zzhuolun
TengdaHan
/ ddp_notes.md
Last active
December 4, 2025 16:26
Multi-node-training on slurm with PyTorch
jadarve
/ readEXR.py
Last active
August 20, 2024 07:18
Extract RGB and depth channels from exr images.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import numpy as np | |
| import OpenEXR as exr | |
| import Imath | |
| def readEXR(filename): | |
| """Read color + depth data from EXR image file. | |
| Parameters | |
| ---------- | |
| filename : str |
ddeveloperr
/ fast_push.txt
Last active
June 7, 2025 14:49
How to avoid Git push: username, password in my terminal ?
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Problem: Every push prompt me to input username and password. | |
| I would like to avoid it for every push, but how to configure to avoid it? | |
| Answer: Using SSH authentication on terminal. | |
| 1. Generate an SSH key | |
| Linux/Mac | |
| Open terminal to create ssh keys: |