deviandice/DL-Art-School
1
0
Fork 0
forked from mrq/DL-Art-School
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,914 Commits 1 Branch 0 Tags 5.6 MiB
6d85fe05f6
Commit Graph

1880 Commits

Author SHA1 Message Date
James Betker
29b55d42a5 one more 2022-05-30 16:33:49 -06:00
James Betker
71cf654957 fix unused parameters 2022-05-30 16:31:40 -06:00
James Betker
f7d237a50a train quantizer with diffusion 2022-05-30 16:25:33 -06:00
James Betker
136021bf8d tfd6 2022-05-30 09:09:42 -06:00
James Betker
eab1162d2b hmm.. 2022-05-29 22:32:25 -06:00
James Betker
2e72fddaeb td_tts_2 2022-05-29 22:22:14 -06:00
James Betker
27f347cdd3 gotta project that shit! 2022-05-28 23:19:36 -06:00
James Betker
536c8558ae fix 2022-05-28 22:32:38 -06:00
James Betker
da367da411 df5 2022-05-28 22:30:23 -06:00
James Betker
6b43915eb8 support projecting to vectors 2022-05-28 22:27:45 -06:00
James Betker
86694aef4e tfd5 2022-05-28 22:27:04 -06:00
James Betker
b6b4f10e1b ... 2022-05-28 10:59:03 -06:00
James Betker
0d3b831cf9 big fatty 2022-05-28 10:55:43 -06:00
James Betker
76aeba7843 fail gracefully from mfd 2022-05-27 20:24:16 -06:00
James Betker
f691f5faa1 f 2022-05-27 13:47:05 -06:00
James Betker
031769150d clip adf test dataset 2022-05-27 13:42:52 -06:00
James Betker
31dec016e0 adf 2022-05-27 12:28:04 -06:00
James Betker
b4269af61b fix circular deps 2022-05-27 11:44:27 -06:00
James Betker
34ee1d0bc3 mdf 2022-05-27 11:40:47 -06:00
James Betker
490d39b967 some stuff 2022-05-27 11:40:31 -06:00
James Betker
5efeee6b97 fix type bug 2022-05-27 11:19:30 -06:00
James Betker
0659fe3d1e tfd3 mods 2022-05-27 11:16:26 -06:00
James Betker
bed3df4888 propagate type 2022-05-27 11:12:03 -06:00
James Betker
c46da0285c Move stuff around 2022-05-27 11:06:58 -06:00
James Betker
9852599b34 tfd5 - with clvp! 2022-05-27 09:49:10 -06:00
James Betker
3db862dd32 adf update 2022-05-27 09:25:53 -06:00
James Betker
8587a18717 fd fix 2022-05-26 20:19:09 -06:00
James Betker
dd13b883ac td4 2022-05-26 14:56:03 -06:00
James Betker
1dbe0b6b2e a 2022-05-26 10:13:27 -06:00
James Betker
aa653115f1 tfd3 2022-05-26 10:09:11 -06:00
James Betker
36c68692a6 forgot to add rotary embeddings 2022-05-26 09:25:42 -06:00
James Betker
8ce48f04ff transformer diffusion 2 2022-05-26 09:08:35 -06:00
James Betker
56f19a23cd fix nh 2022-05-25 12:31:56 -06:00
James Betker
52a20f3aa3 und10 2022-05-25 12:19:21 -06:00
James Betker
00e133afa9 support not_ew too 2022-05-25 08:58:23 -06:00
James Betker
5188866bd5 facepalm 2022-05-24 14:55:51 -06:00
James Betker
8b4b5ffa72 slight rework 2022-05-24 14:38:37 -06:00
James Betker
48aab2babe ressurect ctc code gen with some cool new ideas 2022-05-24 14:02:33 -06:00
James Betker
65b441d74e transformer diffusion 2022-05-24 14:02:05 -06:00
James Betker
1e1bbe1a27 whoops 2022-05-23 12:28:36 -06:00
James Betker
560b83e770 default to residual encoder 2022-05-23 12:24:00 -06:00
James Betker
f432bdf7ae deeper resblock encoder 2022-05-23 11:46:40 -06:00
James Betker
bb36bb4db5 ugh it never ends 2022-05-23 10:58:28 -06:00
James Betker
5d13d38119 allow opt states to be reset 2022-05-23 10:54:37 -06:00
James Betker
f4a97ca0a7 and this 2022-05-23 10:38:28 -06:00
James Betker
874de1775d Update mdf spectral 2022-05-23 10:37:15 -06:00
James Betker
36dd4eb61f no grads for mel injectors 2022-05-23 10:34:53 -06:00
James Betker
dc471f5c6d residual features 2022-05-23 09:58:30 -06:00
James Betker
1f521d6a1d add reconstruction loss to m2v 2022-05-23 09:28:41 -06:00
James Betker
1d758c3bc8 try and make repeated failures recover better 2022-05-23 08:50:27 -06:00
James Betker
2270c89fdc . 2022-05-23 08:47:15 -06:00
James Betker
40f844657b tolong 2022-05-23 08:27:54 -06:00
James Betker
9f16b25ce5 introduce prepadlength 2022-05-23 08:21:27 -06:00
James Betker
10f4a742bd reintroduce attention masks 2022-05-23 08:16:04 -06:00
James Betker
2da8f8a666 fmp 2022-05-23 07:06:25 -06:00
James Betker
68c0afcbcc m2v frequency masking 2022-05-23 07:04:12 -06:00
James Betker
4093e38717 revert flat diffusion back... 2022-05-22 23:10:58 -06:00
James Betker
8f28404645 another fix 2022-05-22 21:32:43 -06:00
James Betker
41809a6330 Add 8x dim reductor 2022-05-22 20:23:16 -06:00
James Betker
07f7be24ce :/ 2022-05-22 20:00:55 -06:00
James Betker
c0bc466aad mdf for shortened mel test 2022-05-22 19:29:20 -06:00
James Betker
1095248caf Revert "retest" 
This reverts commit ed7768c73b.
 2022-05-22 19:23:01 -06:00
James Betker
2798bfab8c Revert "update mdf for legacy try" 
This reverts commit 693b19ea3b.
 2022-05-22 19:22:44 -06:00
James Betker
693b19ea3b update mdf for legacy try 2022-05-22 16:37:02 -06:00
James Betker
ed7768c73b retest 2022-05-22 16:30:09 -06:00
James Betker
2dd0b9e6e9 mel_head should be optional 2022-05-22 12:25:45 -06:00
James Betker
37640e9759 Squelch annoying warning 2022-05-22 12:12:40 -06:00
James Betker
0c60f22197 fix unused parameters 2022-05-22 08:16:31 -06:00
James Betker
57d6f6d366 Big rework of flat_diffusion 
Back to the drawing board, boys. Time to waste some resources catching bugs....
 2022-05-22 08:09:33 -06:00
James Betker
db38672dae precompute diffusion embeddings for from_codes 2022-05-22 06:45:57 -06:00
James Betker
ea21a8b107 Update music_diffusion_fid to support waveform diffusion from codes 2022-05-22 05:23:54 -06:00
James Betker
e0bf3a0ddc Save myself some time in the future 2022-05-20 17:18:35 -06:00
James Betker
be937d202e new attempt 2022-05-20 17:04:22 -06:00
James Betker
968660c248 another update 2022-05-20 11:25:00 -06:00
James Betker
28f950b7d3 fix 2022-05-20 11:18:52 -06:00
James Betker
b317c68ac9 fix 2022-05-20 11:12:53 -06:00
James Betker
3121bc4e43 flat diffusion 2022-05-20 11:01:48 -06:00
James Betker
e9fb2ead9a m2v stuff 2022-05-20 11:01:17 -06:00
James Betker
c9c16e3b01 misc updates 2022-05-19 13:39:32 -06:00
James Betker
10378fc37f make codebooks specifiable 2022-05-18 11:07:12 -06:00
James Betker
efc2657b48 fiddle with init 2022-05-18 10:56:01 -06:00
James Betker
208a703080 use gelu act 2022-05-18 09:34:01 -06:00
James Betker
b2b37453df make the codebook bigger 2022-05-17 20:58:56 -06:00
James Betker
9a9c3cafba Make feature encoder a bit more descriptive 2022-05-17 18:14:52 -06:00
James Betker
ee364f4eeb just take the mean... 2022-05-17 18:09:23 -06:00
James Betker
6130391a85 fix div 2022-05-17 18:04:20 -06:00
James Betker
7213ad2b89 Do grad reduction 2022-05-17 17:59:40 -06:00
James Betker
7c82e18c6c darn mpi 2022-05-17 17:16:09 -06:00
James Betker
88ec0512f7 Scale losses 2022-05-17 17:12:20 -06:00
James Betker
a6397ce84a Fix incorrect projections 2022-05-17 16:53:52 -06:00
James Betker
c37fc3b4ed m2v grad norm groups 2022-05-17 16:29:36 -06:00
James Betker
c1bdb4f9a1 degrade gumbel softmax over time 2022-05-17 16:23:04 -06:00
James Betker
3853f37257 stable layernorm 2022-05-17 16:07:03 -06:00
James Betker
6a2c29f596 Fix inverted logic 2022-05-17 15:39:07 -06:00
James Betker
519151d83f m2v 2022-05-17 15:37:59 -06:00
James Betker
d1de94d75c Stash mel2vec work (gonna throw it all away..) 2022-05-17 12:35:01 -06:00
James Betker
8202b9f39c some stuff 2022-05-15 21:50:54 -06:00
James Betker
ab5acead0e add exp loss for diffusion models 2022-05-15 21:50:38 -06:00
James Betker
ee218ab9b7 uv3 2022-05-13 17:57:47 -06:00
James Betker
eb64d18075 Fix phoneme tokenizer 2022-05-13 17:56:26 -06:00