mrq 39bc019142 actually save per-rank sampler states		2024-06-01 09:46:32 -05:00
..
emb
engines
ext
models
utils	actually save per-rank sampler states	2024-06-01 09:46:32 -05:00
__init__.py
__main__.py
config.py	actually don't default to compute split losses, test bitnet model doesn't seem to be doing things right (despite debug printouts showing theyre roughly the same logit/loss sequences, could just be bitnet linears being not up to par on actual models)	2024-06-01 09:12:51 -05:00
data.py	split sampler dict by global_rank, also handle splitting dataset paths by global_rank if sampler_type == path (because I do not trust DistributedSampler) (need to test)	2024-06-01 09:29:49 -05:00
export.py
inference.py
plot.py
samplers.py
train.py
webui.py