18 Commits

Author	SHA1	Message	Date
James Betker	3121bc4e43	flat diffusion	2022-05-20 11:01:48 -06:00
James Betker	c9c16e3b01	misc updates	2022-05-19 13:39:32 -06:00
James Betker	10378fc37f	make codebooks specifiable	2022-05-18 11:07:12 -06:00
James Betker	efc2657b48	fiddle with init	2022-05-18 10:56:01 -06:00
James Betker	208a703080	use gelu act	2022-05-18 09:34:01 -06:00
James Betker	b2b37453df	make the codebook bigger	2022-05-17 20:58:56 -06:00
James Betker	9a9c3cafba	Make feature encoder a bit more descriptive	2022-05-17 18:14:52 -06:00
James Betker	ee364f4eeb	just take the mean...	2022-05-17 18:09:23 -06:00
James Betker	6130391a85	fix div	2022-05-17 18:04:20 -06:00
James Betker	7213ad2b89	Do grad reduction	2022-05-17 17:59:40 -06:00
James Betker	7c82e18c6c	darn mpi	2022-05-17 17:16:09 -06:00
James Betker	88ec0512f7	Scale losses	2022-05-17 17:12:20 -06:00
James Betker	a6397ce84a	Fix incorrect projections	2022-05-17 16:53:52 -06:00
James Betker	c37fc3b4ed	m2v grad norm groups	2022-05-17 16:29:36 -06:00
James Betker	c1bdb4f9a1	degrade gumbel softmax over time	2022-05-17 16:23:04 -06:00
James Betker	3853f37257	stable layernorm	2022-05-17 16:07:03 -06:00
James Betker	519151d83f	m2v	2022-05-17 15:37:59 -06:00
James Betker	d1de94d75c	Stash mel2vec work (gonna throw it all away..)	2022-05-17 12:35:01 -06:00