Commit Graph

2152 Commits

Author SHA1 Message Date
James Betker
a073fbfcb8 force tf32 to be enabled (torch 1.12 disables it) 2022-07-16 13:59:07 -06:00
James Betker
438dcaccc5 misc 2022-07-16 13:58:52 -06:00
James Betker
e13b1adfdb :< 2022-07-14 21:52:23 -06:00
James Betker
51291ab070 Some additional context regularization in tfd 2022-07-14 21:49:47 -06:00
James Betker
7170ccdfa9 Merge branch 'baktfd' 2022-07-14 21:38:45 -06:00
James Betker
3b12d348fc mdf: provide conditioning margin 2022-07-14 21:38:14 -06:00
James Betker
fa352e2744 also some good assert text 2022-07-14 21:26:22 -06:00
James Betker
4d53c66602 simplify span selecting logic in tfdpc 2022-07-14 21:25:03 -06:00
James Betker
4d5688be47 fix compatibility 2022-07-13 21:28:20 -06:00
James Betker
def70cd444 Merge remote-tracking branch 'origin/master' 2022-07-13 21:26:59 -06:00
James Betker
711c53c1f0 music script 2022-07-13 21:26:55 -06:00
James Betker
15831b2576 some stuff 2022-07-13 21:26:25 -06:00
James Betker
e23c322089 uhh2.0 2022-07-12 22:48:46 -06:00
James Betker
ebfe72d502 fix obo 2022-07-12 22:28:20 -06:00
James Betker
f46d6645da tfdpcv5 updates 2022-07-12 21:48:18 -06:00
James Betker
ce82eb6022 update MDF for ar prior diffusion 2022-07-11 17:03:56 -06:00
James Betker
72c0e4b56b Fix rounding warning 2022-07-11 17:02:59 -06:00
James Betker
3edca1a906 Rescale causal scale along with timestep spacing 2022-07-09 22:09:25 -06:00
James Betker
b432d7c7de mdf: re-allow p_sample_loop 2022-07-09 15:35:09 -06:00
James Betker
f28cefdfe2 another fix for causal diffusion in inference 2022-07-09 15:29:47 -06:00
James Betker
8657d4d060 fix causal diffusion masking for low timesteps 2022-07-09 09:43:54 -06:00
James Betker
79a5b54e57 :( 2022-07-09 08:15:02 -06:00
James Betker
99adc846c7 Restore causal decoding 2022-07-09 08:11:08 -06:00
James Betker
5138d61767 Restore old MDF functionality for cheater gen 2022-07-09 08:01:32 -06:00
James Betker
694400a45b implement causal sampling for standard p_sampling 2022-07-09 08:01:03 -06:00
James Betker
55b9f31825 fix mel outputs 2022-07-08 19:51:12 -06:00
James Betker
b99af89c8f Support causal diffusion in inference 2022-07-08 14:27:19 -06:00
James Betker
ba1699cee2 Improve mdf 2022-07-08 12:30:22 -06:00
James Betker
7b4dcbf136 Support causal diffusion! 2022-07-08 12:30:05 -06:00
James Betker
78bba690de auto grad "lr" scaling 2022-07-08 00:38:25 -06:00
James Betker
e5d97dfd56 misc 2022-07-08 00:37:53 -06:00
James Betker
611316faab
Merge pull request #9 from neonbjb:causal
Add causal timestep adjustments
2022-07-07 15:18:19 -06:00
James Betker
5f575b5d3c
Add causal timestep adjustments 2022-07-07 15:17:47 -06:00
James Betker
28d5b6a80a optionally disable checkpointing in x_transformers (and make it so with the cond_encoder in tfdpc_v5) 2022-07-06 16:55:57 -06:00
James Betker
48270272e7 Use corner alignment for linear interpolation in TFDPC and TFD12
I noticed from experimentation that when this is not enabled, the interpolation edges are "sticky",
which is to say there is more variance in the center of the interpolation than at the edges.
2022-07-06 16:45:03 -06:00
James Betker
5816a4595e ugh 2022-07-05 11:14:09 -06:00
James Betker
7440e43531 Fix some bugs 2022-07-05 10:37:47 -06:00
James Betker
2b128730e7 Improve conditioning separation logic 2022-07-05 10:30:28 -06:00
James Betker
802998674e Fix another edge case 2022-07-04 16:47:57 -06:00
James Betker
808a1a4a31 eval cheater_ar 2022-07-04 08:50:09 -06:00
James Betker
bac9a8b728 Make MDF compatible with ar_prior models 2022-07-04 08:38:47 -06:00
James Betker
455943779b Fix bug in conditioning segment fetching 2022-07-04 08:16:14 -06:00
James Betker
e5859acff7 Rework tfdpc_v5 further.. 2022-07-03 18:19:01 -06:00
James Betker
47f04ff5c2 Merge branch 'master' of https://github.com/neonbjb/DL-Art-School
# Conflicts:
#	codes/models/audio/music/transformer_diffusion12.py
2022-07-03 17:54:52 -06:00
James Betker
6cc0405c7c generate longer mels? 2022-07-03 17:54:32 -06:00
James Betker
58f26b1900 mods to support cheater ar prior in tfd12 2022-07-03 17:54:22 -06:00
James Betker
9c069fc2f2 mods to support cheater ar prior in tfd12 2022-07-03 17:53:44 -06:00
James Betker
286918c581 conditioning masking is random 2022-07-01 21:43:30 -06:00
James Betker
e06ee1b6f3 music_joiner script 2022-07-01 00:44:48 -06:00
James Betker
1953887122 Add conditoning_masking to tfdpcv5 2022-07-01 00:44:40 -06:00