11 Commits

Author	SHA1	Message	Date
James Betker	ee364f4eeb	just take the mean...	2022-05-17 18:09:23 -06:00
James Betker	6130391a85	fix div	2022-05-17 18:04:20 -06:00
James Betker	7213ad2b89	Do grad reduction	2022-05-17 17:59:40 -06:00
James Betker	7c82e18c6c	darn mpi	2022-05-17 17:16:09 -06:00
James Betker	88ec0512f7	Scale losses	2022-05-17 17:12:20 -06:00
James Betker	a6397ce84a	Fix incorrect projections	2022-05-17 16:53:52 -06:00
James Betker	c37fc3b4ed	m2v grad norm groups	2022-05-17 16:29:36 -06:00
James Betker	c1bdb4f9a1	degrade gumbel softmax over time	2022-05-17 16:23:04 -06:00
James Betker	3853f37257	stable layernorm	2022-05-17 16:07:03 -06:00
James Betker	519151d83f	m2v	2022-05-17 15:37:59 -06:00
James Betker	d1de94d75c	Stash mel2vec work (gonna throw it all away..)	2022-05-17 12:35:01 -06:00