|
|
6676c89c0e
|
I sucked off the hyptothetical wizard again, just using BNB's ADAM optimizer nets HUGE savings, but I don't know the output costs, will need to test
|
2023-02-23 02:42:17 +00:00 |
|
|
|
4427d7fb84
|
initial conversion (errors out)
|
2023-02-22 23:07:05 +00:00 |
|
James Betker
|
27a9b1b750
|
rename perplexity->log perplexity
|
2022-07-28 09:48:40 -06:00 |
|
James Betker
|
cfe907f13f
|
i like this better
|
2022-07-28 02:33:23 -06:00 |
|
James Betker
|
d44ed5d12d
|
probably too harsh on ninfs
|
2022-07-28 01:33:54 -06:00 |
|
James Betker
|
4509cfc705
|
track logperp for diffusion evals
|
2022-07-28 01:30:44 -06:00 |
|
James Betker
|
19eb939ccf
|
gd perplexity
# Conflicts:
# codes/trainer/eval/music_diffusion_fid.py
|
2022-07-28 00:25:05 -06:00 |
|
James Betker
|
f8108cfdb2
|
update environment and fix a bunch of deps
|
2022-07-24 23:43:25 -06:00 |
|
James Betker
|
dbebe18602
|
Fix ts=0 with new formulation
|
2022-07-20 12:12:33 -06:00 |
|
James Betker
|
9a37f3ba42
|
reminder to future self
|
2022-07-20 10:19:15 -06:00 |
|
James Betker
|
cb24bef406
|
ddim_with_guidance
|
2022-07-17 18:24:43 -06:00 |
|
James Betker
|
f46d6645da
|
tfdpcv5 updates
|
2022-07-12 21:48:18 -06:00 |
|
James Betker
|
72c0e4b56b
|
Fix rounding warning
|
2022-07-11 17:02:59 -06:00 |
|
James Betker
|
3edca1a906
|
Rescale causal scale along with timestep spacing
|
2022-07-09 22:09:25 -06:00 |
|
James Betker
|
f28cefdfe2
|
another fix for causal diffusion in inference
|
2022-07-09 15:29:47 -06:00 |
|
James Betker
|
8657d4d060
|
fix causal diffusion masking for low timesteps
|
2022-07-09 09:43:54 -06:00 |
|
James Betker
|
694400a45b
|
implement causal sampling for standard p_sampling
|
2022-07-09 08:01:03 -06:00 |
|
James Betker
|
b99af89c8f
|
Support causal diffusion in inference
|
2022-07-08 14:27:19 -06:00 |
|
James Betker
|
7b4dcbf136
|
Support causal diffusion!
|
2022-07-08 12:30:05 -06:00 |
|
James Betker
|
5f575b5d3c
|
Add causal timestep adjustments
|
2022-07-07 15:17:47 -06:00 |
|
James Betker
|
4a1f3aba31
|
come on guys... :((
|
2022-06-21 20:12:54 -06:00 |
|
James Betker
|
24e60bd510
|
report quantile losses for diffusion
|
2022-06-21 20:04:16 -06:00 |
|
James Betker
|
6e57eaa186
|
fix bug
|
2022-06-09 21:52:57 -06:00 |
|
James Betker
|
34005367fd
|
setup for partial channel diffusion
|
2022-06-09 21:41:20 -06:00 |
|
James Betker
|
a9387179db
|
add channel loss balancing
|
2022-06-03 15:19:23 -06:00 |
|
James Betker
|
1177c35dec
|
music fid updates
|
2022-05-08 18:49:39 -06:00 |
|
James Betker
|
b0d2827fad
|
flat0
|
2022-03-24 11:30:40 -06:00 |
|
James Betker
|
29b2921222
|
move diffusion vocoder
|
2022-03-08 15:51:05 -07:00 |
|
James Betker
|
79e5692388
|
Fix distributed bug
|
2022-03-04 11:58:53 -07:00 |
|
James Betker
|
f87e10ffef
|
Make deterministic sampler work with distributed training & microbatches
|
2022-03-04 11:50:50 -07:00 |
|
James Betker
|
2d1cb83c1d
|
Add a deterministic timestep sampler, with provisions to employ it every n steps
|
2022-03-04 10:40:14 -07:00 |
|
James Betker
|
db0c3340ac
|
Implement guidance-free diffusion in eval
And a few other fixes
|
2022-03-01 11:49:36 -07:00 |
|
James Betker
|
2134f06516
|
Implement conditioning-free diffusion at the eval level
|
2022-02-27 15:11:42 -07:00 |
|
James Betker
|
7b4544b83a
|
Add an experimental unet_diffusion_tts to perform experiments on
|
2022-01-18 08:38:24 -07:00 |
|
James Betker
|
937045cb63
|
Fixes
|
2021-12-18 16:45:38 -07:00 |
|
James Betker
|
5a664aa56e
|
misc
|
2021-12-11 08:17:26 -07:00 |
|
James Betker
|
f2a31702b5
|
Clean stuff up, move more things into arch_util
|
2021-10-20 21:19:25 -06:00 |
|
James Betker
|
1d0b44ebc2
|
More tweaks to diffusion-vocoder
|
2021-10-15 11:51:17 -06:00 |
|
James Betker
|
83798887a8
|
Mods to support unet diffusion vocoder with conditioning
|
2021-10-13 21:23:18 -06:00 |
|
James Betker
|
0396a9d2ca
|
Increase baseline codes recording across all dvae models
|
2021-09-30 08:09:07 -06:00 |
|
James Betker
|
ac57cdc794
|
Add scheduling to quantizer, enable cudnn_benchmarking to be disabled
|
2021-09-24 17:01:36 -06:00 |
|
James Betker
|
3e64e847c2
|
Gumbel quantizer
|
2021-09-23 23:32:03 -06:00 |
|
James Betker
|
c5297ccec6
|
Add dvae balancing heuristic
|
2021-09-23 21:19:36 -06:00 |
|
James Betker
|
e24c619387
|
Fix
|
2021-09-23 16:07:58 -06:00 |
|
James Betker
|
6833048bf7
|
Alterations to diffusion_dvae so it can be used directly on spectrograms
|
2021-09-23 15:56:25 -06:00 |
|
James Betker
|
5c8d266d4f
|
chk
|
2021-09-17 09:15:36 -06:00 |
|
James Betker
|
a6544f1684
|
More checkpointing fixes
|
2021-09-16 23:12:43 -06:00 |
|
James Betker
|
94899d88f3
|
Fix overuse of checkpointing
|
2021-09-16 23:00:28 -06:00 |
|
James Betker
|
f78ce9d924
|
Get diffusion_dvae ready for prime time!
|
2021-09-16 22:43:10 -06:00 |
|
James Betker
|
6f48674647
|
Support diffusion models with extra return values & inference in diffusion_dvae
|
2021-09-16 10:53:46 -06:00 |
|
