1801 Commits

Author	SHA1	Message	Date
James Betker	aa653115f1	tfd3	2022-05-26 10:09:11 -06:00
James Betker	36c68692a6	forgot to add rotary embeddings	2022-05-26 09:25:42 -06:00
James Betker	8ce48f04ff	transformer diffusion 2	2022-05-26 09:08:35 -06:00
James Betker	56f19a23cd	fix nh	2022-05-25 12:31:56 -06:00
James Betker	52a20f3aa3	und10	2022-05-25 12:19:21 -06:00
James Betker	00e133afa9	support not_ew too	2022-05-25 08:58:23 -06:00
James Betker	5188866bd5	facepalm	2022-05-24 14:55:51 -06:00
James Betker	8b4b5ffa72	slight rework	2022-05-24 14:38:37 -06:00
James Betker	48aab2babe	ressurect ctc code gen with some cool new ideas	2022-05-24 14:02:33 -06:00
James Betker	65b441d74e	transformer diffusion	2022-05-24 14:02:05 -06:00
James Betker	1e1bbe1a27	whoops	2022-05-23 12:28:36 -06:00
James Betker	560b83e770	default to residual encoder	2022-05-23 12:24:00 -06:00
James Betker	f432bdf7ae	deeper resblock encoder	2022-05-23 11:46:40 -06:00
James Betker	bb36bb4db5	ugh it never ends	2022-05-23 10:58:28 -06:00
James Betker	5d13d38119	allow opt states to be reset	2022-05-23 10:54:37 -06:00
James Betker	f4a97ca0a7	and this	2022-05-23 10:38:28 -06:00
James Betker	874de1775d	Update mdf spectral	2022-05-23 10:37:15 -06:00
James Betker	36dd4eb61f	no grads for mel injectors	2022-05-23 10:34:53 -06:00
James Betker	dc471f5c6d	residual features	2022-05-23 09:58:30 -06:00
James Betker	1f521d6a1d	add reconstruction loss to m2v	2022-05-23 09:28:41 -06:00
James Betker	1d758c3bc8	try and make repeated failures recover better	2022-05-23 08:50:27 -06:00
James Betker	2270c89fdc	.	2022-05-23 08:47:15 -06:00
James Betker	40f844657b	tolong	2022-05-23 08:27:54 -06:00
James Betker	9f16b25ce5	introduce prepadlength	2022-05-23 08:21:27 -06:00
James Betker	10f4a742bd	reintroduce attention masks	2022-05-23 08:16:04 -06:00
James Betker	2da8f8a666	fmp	2022-05-23 07:06:25 -06:00
James Betker	68c0afcbcc	m2v frequency masking	2022-05-23 07:04:12 -06:00
James Betker	4093e38717	revert flat diffusion back...	2022-05-22 23:10:58 -06:00
James Betker	8f28404645	another fix	2022-05-22 21:32:43 -06:00
James Betker	41809a6330	Add 8x dim reductor	2022-05-22 20:23:16 -06:00
James Betker	07f7be24ce	:/	2022-05-22 20:00:55 -06:00
James Betker	c0bc466aad	mdf for shortened mel test	2022-05-22 19:29:20 -06:00
James Betker	1095248caf	Revert "retest" ... This reverts commit ed7768c73b.	2022-05-22 19:23:01 -06:00
James Betker	2798bfab8c	Revert "update mdf for legacy try" ... This reverts commit 693b19ea3b.	2022-05-22 19:22:44 -06:00
James Betker	693b19ea3b	update mdf for legacy try	2022-05-22 16:37:02 -06:00
James Betker	ed7768c73b	retest	2022-05-22 16:30:09 -06:00
James Betker	2dd0b9e6e9	mel_head should be optional	2022-05-22 12:25:45 -06:00
James Betker	37640e9759	Squelch annoying warning	2022-05-22 12:12:40 -06:00
James Betker	0c60f22197	fix unused parameters	2022-05-22 08:16:31 -06:00
James Betker	57d6f6d366	Big rework of flat_diffusion ... Back to the drawing board, boys. Time to waste some resources catching bugs....	2022-05-22 08:09:33 -06:00
James Betker	db38672dae	precompute diffusion embeddings for from_codes	2022-05-22 06:45:57 -06:00
James Betker	ea21a8b107	Update music_diffusion_fid to support waveform diffusion from codes	2022-05-22 05:23:54 -06:00
James Betker	e0bf3a0ddc	Save myself some time in the future	2022-05-20 17:18:35 -06:00
James Betker	be937d202e	new attempt	2022-05-20 17:04:22 -06:00
James Betker	968660c248	another update	2022-05-20 11:25:00 -06:00
James Betker	28f950b7d3	fix	2022-05-20 11:18:52 -06:00
James Betker	b317c68ac9	fix	2022-05-20 11:12:53 -06:00
James Betker	3121bc4e43	flat diffusion	2022-05-20 11:01:48 -06:00
James Betker	e9fb2ead9a	m2v stuff	2022-05-20 11:01:17 -06:00
James Betker	c9c16e3b01	misc updates	2022-05-19 13:39:32 -06:00