Commit Graph

1378 Commits

Author SHA1 Message Date
James Betker
7a10c3fed8 commit my own version of vq, with a fix for cosine similarity and support for masking 2022-07-18 10:12:17 -06:00
James Betker
cb24bef406 ddim_with_guidance 2022-07-17 18:24:43 -06:00
James Betker
20ef9cc6b4 iq checkin
yeah - I'm at it again...
2022-07-17 18:24:33 -06:00
James Betker
e13b1adfdb :< 2022-07-14 21:52:23 -06:00
James Betker
51291ab070 Some additional context regularization in tfd 2022-07-14 21:49:47 -06:00
James Betker
fa352e2744 also some good assert text 2022-07-14 21:26:22 -06:00
James Betker
4d53c66602 simplify span selecting logic in tfdpc 2022-07-14 21:25:03 -06:00
James Betker
4d5688be47 fix compatibility 2022-07-13 21:28:20 -06:00
James Betker
def70cd444 Merge remote-tracking branch 'origin/master' 2022-07-13 21:26:59 -06:00
James Betker
711c53c1f0 music script 2022-07-13 21:26:55 -06:00
James Betker
15831b2576 some stuff 2022-07-13 21:26:25 -06:00
James Betker
e23c322089 uhh2.0 2022-07-12 22:48:46 -06:00
James Betker
ebfe72d502 fix obo 2022-07-12 22:28:20 -06:00
James Betker
f46d6645da tfdpcv5 updates 2022-07-12 21:48:18 -06:00
James Betker
72c0e4b56b Fix rounding warning 2022-07-11 17:02:59 -06:00
James Betker
3edca1a906 Rescale causal scale along with timestep spacing 2022-07-09 22:09:25 -06:00
James Betker
f28cefdfe2 another fix for causal diffusion in inference 2022-07-09 15:29:47 -06:00
James Betker
8657d4d060 fix causal diffusion masking for low timesteps 2022-07-09 09:43:54 -06:00
James Betker
694400a45b implement causal sampling for standard p_sampling 2022-07-09 08:01:03 -06:00
James Betker
b99af89c8f Support causal diffusion in inference 2022-07-08 14:27:19 -06:00
James Betker
7b4dcbf136 Support causal diffusion! 2022-07-08 12:30:05 -06:00
James Betker
611316faab
Merge pull request #9 from neonbjb:causal
Add causal timestep adjustments
2022-07-07 15:18:19 -06:00
James Betker
5f575b5d3c
Add causal timestep adjustments 2022-07-07 15:17:47 -06:00
James Betker
28d5b6a80a optionally disable checkpointing in x_transformers (and make it so with the cond_encoder in tfdpc_v5) 2022-07-06 16:55:57 -06:00
James Betker
48270272e7 Use corner alignment for linear interpolation in TFDPC and TFD12
I noticed from experimentation that when this is not enabled, the interpolation edges are "sticky",
which is to say there is more variance in the center of the interpolation than at the edges.
2022-07-06 16:45:03 -06:00
James Betker
5816a4595e ugh 2022-07-05 11:14:09 -06:00
James Betker
7440e43531 Fix some bugs 2022-07-05 10:37:47 -06:00
James Betker
2b128730e7 Improve conditioning separation logic 2022-07-05 10:30:28 -06:00
James Betker
802998674e Fix another edge case 2022-07-04 16:47:57 -06:00
James Betker
455943779b Fix bug in conditioning segment fetching 2022-07-04 08:16:14 -06:00
James Betker
e5859acff7 Rework tfdpc_v5 further.. 2022-07-03 18:19:01 -06:00
James Betker
58f26b1900 mods to support cheater ar prior in tfd12 2022-07-03 17:54:22 -06:00
James Betker
286918c581 conditioning masking is random 2022-07-01 21:43:30 -06:00
James Betker
1953887122 Add conditoning_masking to tfdpcv5 2022-07-01 00:44:40 -06:00
James Betker
f5c246b879 AR cheater gen & centroid injector 2022-06-28 23:52:54 -06:00
James Betker
ee3b426dae Ffix tfdpc_v5 conditioning 2022-06-27 14:06:09 -06:00
James Betker
0278576f37 Update mdf to be compatible with cheater_gen 2022-06-27 10:11:23 -06:00
James Betker
69b614e08a tfdpc5 2022-06-26 19:46:57 -06:00
James Betker
d0f2560396 fix 2022-06-25 21:22:08 -06:00
James Betker
f12f0200d6 tfdpc_v4
parametric efficiency improvements and lets try feeding the timestep into the conditioning encoder
2022-06-25 21:17:00 -06:00
James Betker
42de09d983 tfdpc_v3 inference 2022-06-25 21:16:13 -06:00
James Betker
b210e5025c Le encoder shalt always be frozen. 2022-06-23 11:34:46 -06:00
James Betker
4a1f3aba31 come on guys... :(( 2022-06-21 20:12:54 -06:00
James Betker
24e60bd510 report quantile losses for diffusion 2022-06-21 20:04:16 -06:00
James Betker
3330fa2c10 tfdpc_v3 2022-06-20 15:37:48 -06:00
James Betker
2209b4f301 tfdpc2 2022-06-20 09:36:21 -06:00
James Betker
0e5a3f4712 We don't need that encoder either.. 2022-06-19 23:24:42 -06:00
James Betker
56c4a00e71 whoops 2022-06-19 23:22:30 -06:00
James Betker
a659cd865c All the stuff needed for cheater latent generation 2022-06-19 23:12:52 -06:00
James Betker
c5ea2bee52 More mods 2022-06-19 22:30:46 -06:00