deviandice/DL-Art-School
1
0
Fork 0
forked from mrq/DL-Art-School
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,139 Commits 1 Branch 0 Tags 5.6 MiB
master
Commit Graph

2099 Commits

Author SHA1 Message Date
James Betker
3edca1a906 Rescale causal scale along with timestep spacing 2022-07-09 22:09:25 -06:00
James Betker
b432d7c7de mdf: re-allow p_sample_loop 2022-07-09 15:35:09 -06:00
James Betker
f28cefdfe2 another fix for causal diffusion in inference 2022-07-09 15:29:47 -06:00
James Betker
8657d4d060 fix causal diffusion masking for low timesteps 2022-07-09 09:43:54 -06:00
James Betker
79a5b54e57 :( 2022-07-09 08:15:02 -06:00
James Betker
99adc846c7 Restore causal decoding 2022-07-09 08:11:08 -06:00
James Betker
5138d61767 Restore old MDF functionality for cheater gen 2022-07-09 08:01:32 -06:00
James Betker
694400a45b implement causal sampling for standard p_sampling 2022-07-09 08:01:03 -06:00
James Betker
55b9f31825 fix mel outputs 2022-07-08 19:51:12 -06:00
James Betker
b99af89c8f Support causal diffusion in inference 2022-07-08 14:27:19 -06:00
James Betker
ba1699cee2 Improve mdf 2022-07-08 12:30:22 -06:00
James Betker
7b4dcbf136 Support causal diffusion! 2022-07-08 12:30:05 -06:00
James Betker
78bba690de auto grad "lr" scaling 2022-07-08 00:38:25 -06:00
James Betker
e5d97dfd56 misc 2022-07-08 00:37:53 -06:00
James Betker
611316faab
Merge pull request #9 from neonbjb:causal 
Add causal timestep adjustments
 2022-07-07 15:18:19 -06:00
James Betker
5f575b5d3c
Add causal timestep adjustments 2022-07-07 15:17:47 -06:00
James Betker
28d5b6a80a optionally disable checkpointing in x_transformers (and make it so with the cond_encoder in tfdpc_v5) 2022-07-06 16:55:57 -06:00
James Betker
48270272e7 Use corner alignment for linear interpolation in TFDPC and TFD12 
I noticed from experimentation that when this is not enabled, the interpolation edges are "sticky",
which is to say there is more variance in the center of the interpolation than at the edges.
 2022-07-06 16:45:03 -06:00
James Betker
5816a4595e ugh 2022-07-05 11:14:09 -06:00
James Betker
7440e43531 Fix some bugs 2022-07-05 10:37:47 -06:00
James Betker
2b128730e7 Improve conditioning separation logic 2022-07-05 10:30:28 -06:00
James Betker
802998674e Fix another edge case 2022-07-04 16:47:57 -06:00
James Betker
808a1a4a31 eval cheater_ar 2022-07-04 08:50:09 -06:00
James Betker
bac9a8b728 Make MDF compatible with ar_prior models 2022-07-04 08:38:47 -06:00
James Betker
455943779b Fix bug in conditioning segment fetching 2022-07-04 08:16:14 -06:00
James Betker
e5859acff7 Rework tfdpc_v5 further.. 2022-07-03 18:19:01 -06:00
James Betker
6cc0405c7c generate longer mels? 2022-07-03 17:54:32 -06:00
James Betker
58f26b1900 mods to support cheater ar prior in tfd12 2022-07-03 17:54:22 -06:00
James Betker
286918c581 conditioning masking is random 2022-07-01 21:43:30 -06:00
James Betker
e06ee1b6f3 music_joiner script 2022-07-01 00:44:48 -06:00
James Betker
1953887122 Add conditoning_masking to tfdpcv5 2022-07-01 00:44:40 -06:00
James Betker
4c3413d008 Support aac datatypes 2022-07-01 00:44:20 -06:00
James Betker
f5c246b879 AR cheater gen & centroid injector 2022-06-28 23:52:54 -06:00
James Betker
43ea259228 Fix MDF for cosine schedule 2022-06-28 17:29:21 -06:00
James Betker
861aa0e139 clustering script and injector 2022-06-28 17:07:56 -06:00
James Betker
ee3b426dae Ffix tfdpc_v5 conditioning 2022-06-27 14:06:09 -06:00
James Betker
0278576f37 Update mdf to be compatible with cheater_gen 2022-06-27 10:11:23 -06:00
James Betker
69b614e08a tfdpc5 2022-06-26 19:46:57 -06:00
James Betker
d0f2560396 fix 2022-06-25 21:22:08 -06:00
James Betker
f12f0200d6 tfdpc_v4 
parametric efficiency improvements and lets try feeding the timestep into the conditioning encoder
 2022-06-25 21:17:00 -06:00
James Betker
42de09d983 tfdpc_v3 inference 2022-06-25 21:16:13 -06:00
James Betker
7a9c4310e8 support reading cheaters directly 2022-06-23 11:39:10 -06:00
James Betker
b210e5025c Le encoder shalt always be frozen. 2022-06-23 11:34:46 -06:00
James Betker
aeff1a4cc7 divided by zero 2022-06-21 20:26:19 -06:00
James Betker
f0117150d0 produce correct clip_lengths.. 2022-06-21 20:21:12 -06:00
James Betker
4a1f3aba31 come on guys... :(( 2022-06-21 20:12:54 -06:00
James Betker
fcfb3a1525 fix 2022-06-21 20:09:59 -06:00
James Betker
24e60bd510 report quantile losses for diffusion 2022-06-21 20:04:16 -06:00
James Betker
1394213f1e allow variable size crops 2022-06-21 19:48:07 -06:00
James Betker
3330fa2c10 tfdpc_v3 2022-06-20 15:37:48 -06:00
James Betker
2209b4f301 tfdpc2 2022-06-20 09:36:21 -06:00
James Betker
0e5a3f4712 We don't need that encoder either.. 2022-06-19 23:24:42 -06:00
James Betker
56c4a00e71 whoops 2022-06-19 23:22:30 -06:00
James Betker
a659cd865c All the stuff needed for cheater latent generation 2022-06-19 23:12:52 -06:00
James Betker
c5ea2bee52 More mods 2022-06-19 22:30:46 -06:00
James Betker
691ed196da fix codes 2022-06-19 21:29:40 -06:00
James Betker
b9f53a3ff9 don't populate gn5 2022-06-19 21:07:13 -06:00
James Betker
a5d2123daa more cleanup 2022-06-19 21:04:51 -06:00
James Betker
fef1066687 couple more alterations 2022-06-19 20:58:24 -06:00
James Betker
02ead8c05c update params 2022-06-19 20:47:06 -06:00
James Betker
ff8b0533ac gen3 waveform 2022-06-19 19:23:48 -06:00
James Betker
b19b0a74da Merge branch 'master' of https://github.com/neonbjb/DL-Art-School 2022-06-19 18:56:27 -06:00
James Betker
0b9588708c rrdb-inspired waveform gen 2022-06-19 18:56:17 -06:00
James Betker
f425afc965 permute codes 2022-06-19 18:00:30 -06:00
James Betker
90b232f965 gen_long_mels 2022-06-19 17:54:37 -06:00
James Betker
8c8efbe131 fix code_emb 2022-06-19 17:54:08 -06:00
James Betker
368dca18b1 mdf fixes + support for tfd-based waveform gen 2022-06-19 15:07:24 -06:00
James Betker
cb7569ee5e resample real inputs for music_diffusion_fid 2022-06-18 10:40:48 -06:00
James Betker
c000e489fa . 2022-06-17 09:40:11 -06:00
James Betker
7ca532c7cc handle unused encoder parameters 2022-06-17 09:37:07 -06:00
James Betker
e025183bfb and the other ones.. 
really need to unify this file better.
 2022-06-17 09:30:25 -06:00
James Betker
3081c893d4 Don't augment grad scale when the grad don't exist! 2022-06-17 09:27:04 -06:00
James Betker
3efd64ed7a expand codes before the code converters for cheater latents 2022-06-17 09:20:29 -06:00
James Betker
f70b16214d allow more interesting code interpolation 2022-06-17 09:12:44 -06:00
James Betker
87a86ae6a8 integrate tfd12 with cheater network 2022-06-17 09:08:56 -06:00
James Betker
9d7ce42630 add tanh to the end of the latent thingy 2022-06-16 20:31:23 -06:00
James Betker
b7758f25a9 and fix 2022-06-16 20:06:27 -06:00
James Betker
e3287c9d95 Reduce severity of gpt_music reduction 2022-06-16 20:05:05 -06:00
James Betker
41abf776d9 better downsampler 2022-06-16 15:19:08 -06:00
James Betker
28d95e3141 gptmusic work 2022-06-16 15:09:47 -06:00
James Betker
781c43c1fc Clean up old TFD models 2022-06-15 16:49:06 -06:00
James Betker
34d9d5f202 adf for ar-latent tfd 2022-06-15 16:41:08 -06:00
James Betker
157d5d56c3 another debugging fix 2022-06-15 09:19:34 -06:00
James Betker
6fc86bbbe7 get rid of unused param 2022-06-15 09:14:06 -06:00
James Betker
3757ff9526 uv back to tortoise days 2022-06-15 09:04:41 -06:00
James Betker
b51ff8a176 whoops! 2022-06-15 09:01:20 -06:00
James Betker
ff5c03b460 tfd12 with ar prior 2022-06-15 08:58:02 -06:00
James Betker
3f10ce275b some tfd12 fixes to support multivae 2022-06-14 23:53:50 -06:00
James Betker
fae05229ec asdf 2022-06-14 21:52:22 -06:00
James Betker
804b365d5f make adf compatible with 7 gpus 2022-06-14 21:49:26 -06:00
James Betker
6bc19d1328 multivqvae tfd12 2022-06-14 15:58:18 -06:00
James Betker
d29ea0df5e Update ADF to be compatible with classical mel spectrograms 2022-06-14 15:19:52 -06:00
James Betker
c68669e1e1 uv2 add alignment head 2022-06-14 15:18:58 -06:00
James Betker
7ff1fbe2be channel clipper 2022-06-13 20:37:35 -06:00
James Betker
47330d603b Pretrained vqvae option for tfd12.. 2022-06-13 11:19:33 -06:00
James Betker
1fde3e5a08 more reworks 2022-06-13 08:40:23 -06:00
James Betker
7a36668870 whoops! 2022-06-12 21:11:34 -06:00
James Betker
efabcf5008 When ema is on CPU, only update every 10 steps. 2022-06-12 18:34:58 -06:00
James Betker
fc3a7ed5e3 tfd12 2022-06-12 18:09:59 -06:00
James Betker
798166015a provide conditioning ijnput as mel_norm 2022-06-12 14:51:56 -06:00
James Betker
0c95be1624 Fix MDF evaluator for current generation of 2022-06-12 14:41:06 -06:00
James Betker
a3da7f186e add tfd audio diffusion 2022-06-12 13:59:22 -06:00
James Betker
11e70dde14 update tfd11 2022-06-11 17:53:27 -06:00
James Betker
5c6c8f6904 back to convs? 2022-06-11 15:26:10 -06:00
James Betker
b684622b06 tfd10 2022-06-11 14:06:19 -06:00
James Betker
2a787ec910 more mods 2022-06-11 11:44:33 -06:00
James Betker
999a140f9f whoops 2022-06-11 11:22:34 -06:00
James Betker
00b9f332ee rework arch 2022-06-11 11:17:16 -06:00
James Betker
36b5e89a69 Rework the diet blocks a bit 2022-06-11 08:28:10 -06:00
James Betker
0dd3883662 one last update.. 2022-06-11 08:06:29 -06:00
James Betker
41170f97e9 one more adjustment 2022-06-11 08:01:46 -06:00
James Betker
df0cdf1a4f tfd9 returns with some optimizations 2022-06-11 08:00:09 -06:00
James Betker
acfe9cf880 fp16 2022-06-10 22:39:15 -06:00
James Betker
aca9024d9b qcodes 2022-06-10 16:23:08 -06:00
James Betker
38a00f29c0 now theres deprecation warnings, fml 2022-06-10 15:41:39 -06:00
James Betker
561a6b8ff7 damn this sucks 2022-06-10 15:38:59 -06:00
James Betker
0316063e2d . 2022-06-10 15:37:02 -06:00
James Betker
dca16e6447 . 2022-06-10 15:35:36 -06:00
James Betker
ee2827dee9 Debug warmup state 2022-06-10 15:23:31 -06:00
James Betker
6d85fe05f6 :/ oh well. 2022-06-10 15:17:41 -06:00
James Betker
33178e89c4 harharhack 2022-06-10 15:13:24 -06:00
James Betker
7198bd8bd0 forgot other customizations I want to keep 2022-06-10 15:09:05 -06:00
James Betker
8f40108f5b lets try a different tact 2022-06-10 14:51:59 -06:00
James Betker
2158383fa4 Revert previous changes 2022-06-10 14:34:05 -06:00
James Betker
89bd40d39f eval bug fix 2022-06-10 13:51:06 -06:00
James Betker
84469f3538 get rid of encoder checkpointing 2022-06-10 10:50:34 -06:00
James Betker
97b32dd39d try to make tfd8 be able to be trained e2e in quantizer mode 2022-06-10 10:40:56 -06:00
James Betker
e78c4b422c tfd8 2022-06-10 09:24:41 -06:00
James Betker
d98b895307 loss aware fix and report gumbel temperature 2022-06-09 21:56:47 -06:00
James Betker
6e57eaa186 fix bug 2022-06-09 21:52:57 -06:00
James Betker
07bdd865dc some checks 2022-06-09 21:46:32 -06:00
James Betker
34005367fd setup for partial channel diffusion 2022-06-09 21:41:20 -06:00
James Betker
47b34f5cb9 mup work checkin 2022-06-09 21:15:09 -06:00
James Betker
e67e82be2d misc 2022-06-09 21:14:48 -06:00
James Betker
16936881e5 allow freezing the upper quantizer 2022-06-08 18:30:22 -06:00
James Betker
43f225c35c debug gumbel temperature 2022-06-08 12:12:08 -06:00
James Betker
91be38cba3 . 2022-06-08 11:54:46 -06:00
James Betker
dee2b72786 checkpointing bugs, smh 2022-06-08 11:53:10 -06:00
James Betker
c61cd64bc9 network updates 2022-06-08 09:26:59 -06:00
James Betker
5a54d7db11 unet with ar prior 2022-06-07 17:52:36 -06:00
James Betker
5028703b3d ci not required 2022-06-06 09:26:25 -06:00
James Betker
08597bfaf5 fix 2022-06-06 09:21:58 -06:00
James Betker
49568ee16f some updates 2022-06-06 09:13:47 -06:00
James Betker
602df0abbc revert changes to dietattentionblock 2022-06-05 10:06:17 -06:00
James Betker
51d1908e94 update 2022-06-05 09:35:43 -06:00
James Betker
f9ebcf11d8 fix2 2022-06-05 01:31:37 -06:00
James Betker
aac92b01b3 fix 2022-06-05 01:27:28 -06:00
James Betker
38d8b17d18 tfd8 gets real verbose grad norm metrics 2022-06-04 23:09:54 -06:00
James Betker
0a9d4d4afc bunch of new stuff 2022-06-04 22:23:08 -06:00
James Betker
8f8b189025 Support legacy vqvae quantizer in music_quantizer 2022-06-04 10:16:24 -06:00