James Betker
27a9b1b750
rename perplexity->log perplexity
2022-07-28 09:48:40 -06:00
James Betker
cfe907f13f
i like this better
2022-07-28 02:33:23 -06:00
James Betker
d44ed5d12d
probably too harsh on ninfs
2022-07-28 01:33:54 -06:00
James Betker
4509cfc705
track logperp for diffusion evals
2022-07-28 01:30:44 -06:00
James Betker
19eb939ccf
gd perplexity
...
# Conflicts:
# codes/trainer/eval/music_diffusion_fid.py
2022-07-28 00:25:05 -06:00
James Betker
dbebe18602
Fix ts=0 with new formulation
2022-07-20 12:12:33 -06:00
James Betker
9a37f3ba42
reminder to future self
2022-07-20 10:19:15 -06:00
James Betker
cb24bef406
ddim_with_guidance
2022-07-17 18:24:43 -06:00
James Betker
f46d6645da
tfdpcv5 updates
2022-07-12 21:48:18 -06:00
James Betker
72c0e4b56b
Fix rounding warning
2022-07-11 17:02:59 -06:00
James Betker
3edca1a906
Rescale causal scale along with timestep spacing
2022-07-09 22:09:25 -06:00
James Betker
f28cefdfe2
another fix for causal diffusion in inference
2022-07-09 15:29:47 -06:00
James Betker
8657d4d060
fix causal diffusion masking for low timesteps
2022-07-09 09:43:54 -06:00
James Betker
694400a45b
implement causal sampling for standard p_sampling
2022-07-09 08:01:03 -06:00
James Betker
b99af89c8f
Support causal diffusion in inference
2022-07-08 14:27:19 -06:00
James Betker
7b4dcbf136
Support causal diffusion!
2022-07-08 12:30:05 -06:00
James Betker
5f575b5d3c
Add causal timestep adjustments
2022-07-07 15:17:47 -06:00
James Betker
4a1f3aba31
come on guys... :((
2022-06-21 20:12:54 -06:00
James Betker
24e60bd510
report quantile losses for diffusion
2022-06-21 20:04:16 -06:00
James Betker
6e57eaa186
fix bug
2022-06-09 21:52:57 -06:00
James Betker
34005367fd
setup for partial channel diffusion
2022-06-09 21:41:20 -06:00
James Betker
a9387179db
add channel loss balancing
2022-06-03 15:19:23 -06:00
James Betker
1177c35dec
music fid updates
2022-05-08 18:49:39 -06:00
James Betker
db0c3340ac
Implement guidance-free diffusion in eval
...
And a few other fixes
2022-03-01 11:49:36 -07:00
James Betker
2134f06516
Implement conditioning-free diffusion at the eval level
2022-02-27 15:11:42 -07:00
James Betker
83798887a8
Mods to support unet diffusion vocoder with conditioning
2021-10-13 21:23:18 -06:00
James Betker
f78ce9d924
Get diffusion_dvae ready for prime time!
2021-09-16 22:43:10 -06:00
James Betker
6f48674647
Support diffusion models with extra return values & inference in diffusion_dvae
2021-09-16 10:53:46 -06:00
James Betker
398185e109
More work on wave-diffusion
2021-07-27 05:36:17 -06:00
James Betker
96e90e7047
Add support for a gaussian-diffusion-based wave tacotron
2021-07-26 16:27:31 -06:00
James Betker
80d4404367
A few fixes:
...
- Output better prediction of xstart from eps
- Support LossAwareSampler
- Support AdamW
2021-06-05 13:40:32 -06:00
James Betker
bf811f80c1
GD mods & fixes
...
- Report variational loss separately
- Report model prediction from injector
- Log these things
- Use respacing like guided diffusion
2021-06-04 17:13:16 -06:00
James Betker
6084915af8
Support gaussian diffusion models
...
Adds support for GD models, courtesy of some maths from openai.
Also:
- Fixes requirement for eval{} even when it isn't being used
- Adds support for denormalizing an imagenet norm
2021-06-02 21:47:32 -06:00