Commit Graph

33 Commits

Author SHA1 Message Date
James Betker
27a9b1b750 rename perplexity->log perplexity 2022-07-28 09:48:40 -06:00
James Betker
cfe907f13f i like this better 2022-07-28 02:33:23 -06:00
James Betker
d44ed5d12d probably too harsh on ninfs 2022-07-28 01:33:54 -06:00
James Betker
4509cfc705 track logperp for diffusion evals 2022-07-28 01:30:44 -06:00
James Betker
19eb939ccf gd perplexity
# Conflicts:
#	codes/trainer/eval/music_diffusion_fid.py
2022-07-28 00:25:05 -06:00
James Betker
dbebe18602 Fix ts=0 with new formulation 2022-07-20 12:12:33 -06:00
James Betker
9a37f3ba42 reminder to future self 2022-07-20 10:19:15 -06:00
James Betker
cb24bef406 ddim_with_guidance 2022-07-17 18:24:43 -06:00
James Betker
f46d6645da tfdpcv5 updates 2022-07-12 21:48:18 -06:00
James Betker
72c0e4b56b Fix rounding warning 2022-07-11 17:02:59 -06:00
James Betker
3edca1a906 Rescale causal scale along with timestep spacing 2022-07-09 22:09:25 -06:00
James Betker
f28cefdfe2 another fix for causal diffusion in inference 2022-07-09 15:29:47 -06:00
James Betker
8657d4d060 fix causal diffusion masking for low timesteps 2022-07-09 09:43:54 -06:00
James Betker
694400a45b implement causal sampling for standard p_sampling 2022-07-09 08:01:03 -06:00
James Betker
b99af89c8f Support causal diffusion in inference 2022-07-08 14:27:19 -06:00
James Betker
7b4dcbf136 Support causal diffusion! 2022-07-08 12:30:05 -06:00
James Betker
5f575b5d3c
Add causal timestep adjustments 2022-07-07 15:17:47 -06:00
James Betker
4a1f3aba31 come on guys... :(( 2022-06-21 20:12:54 -06:00
James Betker
24e60bd510 report quantile losses for diffusion 2022-06-21 20:04:16 -06:00
James Betker
6e57eaa186 fix bug 2022-06-09 21:52:57 -06:00
James Betker
34005367fd setup for partial channel diffusion 2022-06-09 21:41:20 -06:00
James Betker
a9387179db add channel loss balancing 2022-06-03 15:19:23 -06:00
James Betker
1177c35dec music fid updates 2022-05-08 18:49:39 -06:00
James Betker
db0c3340ac Implement guidance-free diffusion in eval
And a few other fixes
2022-03-01 11:49:36 -07:00
James Betker
2134f06516 Implement conditioning-free diffusion at the eval level 2022-02-27 15:11:42 -07:00
James Betker
83798887a8 Mods to support unet diffusion vocoder with conditioning 2021-10-13 21:23:18 -06:00
James Betker
f78ce9d924 Get diffusion_dvae ready for prime time! 2021-09-16 22:43:10 -06:00
James Betker
6f48674647 Support diffusion models with extra return values & inference in diffusion_dvae 2021-09-16 10:53:46 -06:00
James Betker
398185e109 More work on wave-diffusion 2021-07-27 05:36:17 -06:00
James Betker
96e90e7047 Add support for a gaussian-diffusion-based wave tacotron 2021-07-26 16:27:31 -06:00
James Betker
80d4404367 A few fixes:
- Output better prediction of xstart from eps
- Support LossAwareSampler
- Support AdamW
2021-06-05 13:40:32 -06:00
James Betker
bf811f80c1 GD mods & fixes
- Report variational loss separately
- Report model prediction from injector
- Log these things
- Use respacing like guided diffusion
2021-06-04 17:13:16 -06:00
James Betker
6084915af8 Support gaussian diffusion models
Adds support for GD models, courtesy of some maths from openai.

Also:
- Fixes requirement for eval{} even when it isn't being used
- Adds support for denormalizing an imagenet norm
2021-06-02 21:47:32 -06:00