https://addons.mozilla.org/en-US/firefox/addon/ublock-origin/
Make sure the following options are off:
Disable pre-fetching
ezyang
/ gist:dbb48a060630143634eb1e07cb92da16
Created
July 8, 2025 20:50
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import torch | |
| from torch import nn | |
| from torch.distributed.tensor.placement_types import Replicate, Shard | |
| from torch.testing._internal.distributed.fake_pg import FakeStore | |
| import torch.distributed as dist | |
| from torch.distributed.device_mesh import init_device_mesh | |
| from torch.distributed.tensor import DTensor, Replicate | |
| world_size = 4 |
