deviandice/DL-Art-School
1
0
Fork 0
forked from mrq/DL-Art-School
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,917 Commits 1 Branch 0 Tags 5.6 MiB
0316063e2d
Commit Graph

30 Commits

Author SHA1 Message Date
James Betker
0316063e2d . 2022-06-10 15:37:02 -06:00
James Betker
ee2827dee9 Debug warmup state 2022-06-10 15:23:31 -06:00
James Betker
d98b895307 loss aware fix and report gumbel temperature 2022-06-09 21:56:47 -06:00
James Betker
07bdd865dc some checks 2022-06-09 21:46:32 -06:00
James Betker
34005367fd setup for partial channel diffusion 2022-06-09 21:41:20 -06:00
James Betker
a9387179db add channel loss balancing 2022-06-03 15:19:23 -06:00
James Betker
e0bf3a0ddc Save myself some time in the future 2022-05-20 17:18:35 -06:00
James Betker
ab5acead0e add exp loss for diffusion models 2022-05-15 21:50:38 -06:00
James Betker
9b90472e15 feed direct inputs into gd 2022-03-26 08:36:19 -06:00
James Betker
f87e10ffef Make deterministic sampler work with distributed training & microbatches 2022-03-04 11:50:50 -07:00
James Betker
2d1cb83c1d Add a deterministic timestep sampler, with provisions to employ it every n steps 2022-03-04 10:40:14 -07:00
James Betker
62c8ed9a29 move speech utils 2021-12-16 20:47:37 -07:00
James Betker
76f86c0e47 gaussian_diffusion: support fp16 2021-12-12 19:52:21 -07:00
James Betker
9191201f05 asd 2021-12-07 09:55:39 -07:00
James Betker
ef15a39841 fix gdi bug? 2021-12-07 09:53:48 -07:00
James Betker
47fe032a3d Try to make diffusion validator more reproducible 2021-11-24 09:38:10 -07:00
James Betker
c30a38cdf1 Undo baseline GDI changes 2021-11-18 20:02:09 -07:00
James Betker
d016a2fbad Go back to vanilla flavor of diffusion 2021-10-17 17:32:46 -06:00
James Betker
6f48674647 Support diffusion models with extra return values & inference in diffusion_dvae 2021-09-16 10:53:46 -06:00
James Betker
92e7e57f81 Update diffusion_noise_surfer to support audio 2021-09-01 08:34:47 -06:00
James Betker
96e90e7047 Add support for a gaussian-diffusion-based wave tacotron 2021-07-26 16:27:31 -06:00
James Betker
e7890dc0ba Misc fixes for diffusion nets 2021-06-21 10:38:07 -06:00
James Betker
68cbbed886 Add some cool diffusion testing scripts 2021-06-16 16:26:36 -06:00
James Betker
5b4f86293f Add FID evaluator for diffusion models 2021-06-14 09:14:30 -06:00
James Betker
65c474eecf Various changes to fix testing 2021-06-11 15:31:10 -06:00
James Betker
7c5478bc2c Formatting issue with gdi 2021-06-06 16:35:37 -06:00
James Betker
692e9c417b Support diffusion unet 2021-06-06 13:57:22 -06:00
James Betker
80d4404367 A few fixes: 
- Output better prediction of xstart from eps
- Support LossAwareSampler
- Support AdamW
 2021-06-05 13:40:32 -06:00
James Betker
bf811f80c1 GD mods & fixes 
- Report variational loss separately
- Report model prediction from injector
- Log these things
- Use respacing like guided diffusion
 2021-06-04 17:13:16 -06:00
James Betker
6084915af8 Support gaussian diffusion models 
Adds support for GD models, courtesy of some maths from openai.

Also:
- Fixes requirement for eval{} even when it isn't being used
- Adds support for denormalizing an imagenet norm
 2021-06-02 21:47:32 -06:00