Commit Graph

1205 Commits

Author SHA1 Message Date
James Betker
1e1bbe1a27 whoops 2022-05-23 12:28:36 -06:00
James Betker
560b83e770 default to residual encoder 2022-05-23 12:24:00 -06:00
James Betker
f432bdf7ae deeper resblock encoder 2022-05-23 11:46:40 -06:00
James Betker
dc471f5c6d residual features 2022-05-23 09:58:30 -06:00
James Betker
1f521d6a1d add reconstruction loss to m2v 2022-05-23 09:28:41 -06:00
James Betker
2270c89fdc . 2022-05-23 08:47:15 -06:00
James Betker
40f844657b tolong 2022-05-23 08:27:54 -06:00
James Betker
10f4a742bd reintroduce attention masks 2022-05-23 08:16:04 -06:00
James Betker
68c0afcbcc m2v frequency masking 2022-05-23 07:04:12 -06:00
James Betker
4093e38717 revert flat diffusion back... 2022-05-22 23:10:58 -06:00
James Betker
8f28404645 another fix 2022-05-22 21:32:43 -06:00
James Betker
41809a6330 Add 8x dim reductor 2022-05-22 20:23:16 -06:00
James Betker
1095248caf Revert "retest"
This reverts commit ed7768c73b.
2022-05-22 19:23:01 -06:00
James Betker
ed7768c73b retest 2022-05-22 16:30:09 -06:00
James Betker
2dd0b9e6e9 mel_head should be optional 2022-05-22 12:25:45 -06:00
James Betker
0c60f22197 fix unused parameters 2022-05-22 08:16:31 -06:00
James Betker
57d6f6d366 Big rework of flat_diffusion
Back to the drawing board, boys. Time to waste some resources catching bugs....
2022-05-22 08:09:33 -06:00
James Betker
be937d202e new attempt 2022-05-20 17:04:22 -06:00
James Betker
968660c248 another update 2022-05-20 11:25:00 -06:00
James Betker
28f950b7d3 fix 2022-05-20 11:18:52 -06:00
James Betker
b317c68ac9 fix 2022-05-20 11:12:53 -06:00
James Betker
3121bc4e43 flat diffusion 2022-05-20 11:01:48 -06:00
James Betker
e9fb2ead9a m2v stuff 2022-05-20 11:01:17 -06:00
James Betker
c9c16e3b01 misc updates 2022-05-19 13:39:32 -06:00
James Betker
10378fc37f make codebooks specifiable 2022-05-18 11:07:12 -06:00
James Betker
efc2657b48 fiddle with init 2022-05-18 10:56:01 -06:00
James Betker
208a703080 use gelu act 2022-05-18 09:34:01 -06:00
James Betker
b2b37453df make the codebook bigger 2022-05-17 20:58:56 -06:00
James Betker
9a9c3cafba Make feature encoder a bit more descriptive 2022-05-17 18:14:52 -06:00
James Betker
ee364f4eeb just take the mean... 2022-05-17 18:09:23 -06:00
James Betker
6130391a85 fix div 2022-05-17 18:04:20 -06:00
James Betker
7213ad2b89 Do grad reduction 2022-05-17 17:59:40 -06:00
James Betker
7c82e18c6c darn mpi 2022-05-17 17:16:09 -06:00
James Betker
88ec0512f7 Scale losses 2022-05-17 17:12:20 -06:00
James Betker
a6397ce84a Fix incorrect projections 2022-05-17 16:53:52 -06:00
James Betker
c37fc3b4ed m2v grad norm groups 2022-05-17 16:29:36 -06:00
James Betker
c1bdb4f9a1 degrade gumbel softmax over time 2022-05-17 16:23:04 -06:00
James Betker
3853f37257 stable layernorm 2022-05-17 16:07:03 -06:00
James Betker
519151d83f m2v 2022-05-17 15:37:59 -06:00
James Betker
d1de94d75c Stash mel2vec work (gonna throw it all away..) 2022-05-17 12:35:01 -06:00
James Betker
ee218ab9b7 uv3 2022-05-13 17:57:47 -06:00
James Betker
3d7e2a2846 fix collection 2022-05-11 21:50:05 -06:00
James Betker
ba2b71796a k 2022-05-11 21:20:06 -06:00
James Betker
efa737b685 re-add distributed collect to clvp 2022-05-11 21:14:18 -06:00
James Betker
545453077e uv3 2022-05-09 15:36:22 -06:00
James Betker
96a5cc66ee uv3 2022-05-09 15:35:51 -06:00
James Betker
b42b4e18de clean up unified voice
- remove unused code
- fix inference model to use the terms "prior" and "posterior" to properly define the modeling order (they were inverted before)
- default some settings I never intend to change in the future
2022-05-09 14:45:49 -06:00
James Betker
1177c35dec music fid updates 2022-05-08 18:49:39 -06:00
James Betker
7812c23c7a revert fill_gaps back to old masking behavior 2022-05-08 00:10:19 -06:00
James Betker
58ed27d7a8 new gap_filler 2022-05-07 12:44:23 -06:00