Commit Graph

1276 Commits

Author SHA1 Message Date
James Betker
8f40108f5b lets try a different tact 2022-06-10 14:51:59 -06:00
James Betker
2158383fa4 Revert previous changes 2022-06-10 14:34:05 -06:00
James Betker
89bd40d39f eval bug fix 2022-06-10 13:51:06 -06:00
James Betker
84469f3538 get rid of encoder checkpointing 2022-06-10 10:50:34 -06:00
James Betker
97b32dd39d try to make tfd8 be able to be trained e2e in quantizer mode 2022-06-10 10:40:56 -06:00
James Betker
e78c4b422c tfd8 2022-06-10 09:24:41 -06:00
James Betker
d98b895307 loss aware fix and report gumbel temperature 2022-06-09 21:56:47 -06:00
James Betker
6e57eaa186 fix bug 2022-06-09 21:52:57 -06:00
James Betker
34005367fd setup for partial channel diffusion 2022-06-09 21:41:20 -06:00
James Betker
47b34f5cb9 mup work checkin 2022-06-09 21:15:09 -06:00
James Betker
e67e82be2d misc 2022-06-09 21:14:48 -06:00
James Betker
16936881e5 allow freezing the upper quantizer 2022-06-08 18:30:22 -06:00
James Betker
43f225c35c debug gumbel temperature 2022-06-08 12:12:08 -06:00
James Betker
91be38cba3 . 2022-06-08 11:54:46 -06:00
James Betker
dee2b72786 checkpointing bugs, smh 2022-06-08 11:53:10 -06:00
James Betker
c61cd64bc9 network updates 2022-06-08 09:26:59 -06:00
James Betker
5a54d7db11 unet with ar prior 2022-06-07 17:52:36 -06:00
James Betker
5028703b3d ci not required 2022-06-06 09:26:25 -06:00
James Betker
08597bfaf5 fix 2022-06-06 09:21:58 -06:00
James Betker
49568ee16f some updates 2022-06-06 09:13:47 -06:00
James Betker
602df0abbc revert changes to dietattentionblock 2022-06-05 10:06:17 -06:00
James Betker
51d1908e94 update 2022-06-05 09:35:43 -06:00
James Betker
f9ebcf11d8 fix2 2022-06-05 01:31:37 -06:00
James Betker
aac92b01b3 fix 2022-06-05 01:27:28 -06:00
James Betker
38d8b17d18 tfd8 gets real verbose grad norm metrics 2022-06-04 23:09:54 -06:00
James Betker
0a9d4d4afc bunch of new stuff 2022-06-04 22:23:08 -06:00
James Betker
8f8b189025 Support legacy vqvae quantizer in music_quantizer 2022-06-04 10:16:24 -06:00
James Betker
a9387179db add channel loss balancing 2022-06-03 15:19:23 -06:00
James Betker
40ba802104 padding 2022-06-03 12:09:59 -06:00
James Betker
581bc7ac5c udmc update 2022-06-03 12:02:22 -06:00
James Betker
9d8c2bddb1 classical unet for music 2022-06-03 11:03:14 -06:00
James Betker
2f4d990ad1 tfd7 2022-06-02 09:27:40 -06:00
James Betker
b2a83efe50 a few fixes 2022-06-01 16:35:15 -06:00
James Betker
712e0e82f7 fix bug 2022-06-01 14:21:44 -06:00
James Betker
de54be5570 propagate diversity loss 2022-06-01 14:18:50 -06:00
James Betker
4c6ef42b38 freeze quantizer until step 2022-06-01 08:06:05 -06:00
James Betker
64b6ae2f4a fix 2022-06-01 01:01:32 -06:00
James Betker
1ac02acdc3 tfd7 2022-06-01 00:50:40 -06:00
James Betker
e8cb93a4e9 fix size issues 2022-05-31 21:23:26 -06:00
James Betker
8a1b8e3e62 add checkpointing 2022-05-31 21:09:05 -06:00
James Betker
c0db85bf4f music quantizer 2022-05-31 21:06:54 -06:00
James Betker
29b55d42a5 one more 2022-05-30 16:33:49 -06:00
James Betker
71cf654957 fix unused parameters 2022-05-30 16:31:40 -06:00
James Betker
f7d237a50a train quantizer with diffusion 2022-05-30 16:25:33 -06:00
James Betker
136021bf8d tfd6 2022-05-30 09:09:42 -06:00
James Betker
eab1162d2b hmm.. 2022-05-29 22:32:25 -06:00
James Betker
2e72fddaeb td_tts_2 2022-05-29 22:22:14 -06:00
James Betker
536c8558ae fix 2022-05-28 22:32:38 -06:00
James Betker
da367da411 df5 2022-05-28 22:30:23 -06:00
James Betker
6b43915eb8 support projecting to vectors 2022-05-28 22:27:45 -06:00