1035 Commits

Author	SHA1	Message	Date
James Betker	77c18b53b3	Cap grad booster	2022-03-04 10:40:24 -07:00
James Betker	2d1cb83c1d	Add a deterministic timestep sampler, with provisions to employ it every n steps	2022-03-04 10:40:14 -07:00
James Betker	58019a2ce3	audio diffusion fid updates	2022-03-03 21:53:32 -07:00
James Betker	998c53ad4f	w2v_matcher mods	2022-03-03 21:52:51 -07:00
James Betker	9029e4f20c	Add a base-wrapper	2022-03-03 21:52:28 -07:00
James Betker	6873ad6660	Support functionality	2022-03-03 21:52:16 -07:00
James Betker	6af5d129ce	Add experimental gradient boosting into tts7	2022-03-03 21:51:40 -07:00
James Betker	7ea84f1ac3	asdf	2022-03-03 13:43:44 -07:00
James Betker	3cd6c7f428	Get rid of unused codes in vq	2022-03-03 13:41:38 -07:00
James Betker	619da9ea28	Get rid of discretization loss	2022-03-03 13:36:25 -07:00
James Betker	beb7c8a39d	asdf	2022-03-01 21:41:31 -07:00
James Betker	70fa780edb	Add mechanism to export grad norms	2022-03-01 20:19:52 -07:00
James Betker	d9f8f92840	Codified fp16	2022-03-01 15:46:04 -07:00
James Betker	45ab444c04	Rework minicoder to always checkpoint	2022-03-01 14:09:18 -07:00
James Betker	db0c3340ac	Implement guidance-free diffusion in eval ... And a few other fixes	2022-03-01 11:49:36 -07:00
James Betker	2134f06516	Implement conditioning-free diffusion at the eval level	2022-02-27 15:11:42 -07:00
James Betker	436fe24822	Add conditioning-free guidance	2022-02-27 15:00:06 -07:00
James Betker	ac920798bb	misc	2022-02-27 14:49:11 -07:00
James Betker	dbc74e96b2	w2v_matcher	2022-02-27 14:48:23 -07:00
James Betker	42879d7296	w2v_wrapper ramping dropout mode ... this is an experimental feature that needs some testing	2022-02-27 14:47:51 -07:00
James Betker	c375287db9	Re-instate autocasting	2022-02-25 11:06:18 -07:00
James Betker	34ee32a90e	get rid of autocasting in tts7	2022-02-24 21:53:51 -07:00
James Betker	ea500ad42a	Use clustered masking in udtts7	2022-02-24 07:57:26 -07:00
James Betker	7201b4500c	default text_to_sequence cleaners	2022-02-21 19:14:22 -07:00
James Betker	ba7f54c162	w2v: new inference function	2022-02-21 19:13:03 -07:00
James Betker	38802a96c8	remove timesteps from cond calculation	2022-02-21 12:32:21 -07:00
James Betker	668876799d	unet_diffusion_tts7	2022-02-20 15:22:38 -07:00
James Betker	0872e17e60	unified_voice mods	2022-02-19 20:37:35 -07:00
James Betker	7b12799370	Reformat mel_text_clip for use in eval	2022-02-19 20:37:26 -07:00
James Betker	baf7b65566	Attempt to make w2v play with DDP AND checkpointing	2022-02-18 18:47:11 -07:00
James Betker	f3776f1992	reset ctc loss from "mean" to "sum"	2022-02-17 22:00:58 -07:00
James Betker	2b20da679c	make spec_augment a parameter	2022-02-17 20:22:05 -07:00
James Betker	e1d71e1bd5	w2v_wrapper: get rid of ctc attention mask	2022-02-15 20:54:40 -07:00
James Betker	79e8f36d30	Convert CLIP models into new folder	2022-02-15 20:53:07 -07:00
James Betker	2bdb515068	A few mods to make wav2vec2 trainable with DDP on DLAS	2022-02-15 06:28:54 -07:00
James Betker	52b61b9f77	Update scripts and attempt to figure out how UnifiedVoice could be used to produce CTC codes	2022-02-13 20:48:06 -07:00
James Betker	a4f1641eea	Add & refine WER evaluator for w2v	2022-02-13 20:47:29 -07:00
James Betker	29534180b2	w2v fine tuner	2022-02-12 20:00:59 -07:00
James Betker	3252972057	ctc_code_gen mods	2022-02-12 19:59:54 -07:00
James Betker	302ac8652d	Undo mask during training	2022-02-11 09:35:12 -07:00
James Betker	618a20412a	new rev of ctc_code_gen with surrogate LM loss	2022-02-10 23:09:57 -07:00
James Betker	820a29f81e	ctc code gen mods	2022-02-10 09:44:01 -07:00
James Betker	ac9417b956	ctc_code_gen: mask out all padding tokens	2022-02-09 17:26:30 -07:00
James Betker	ddb77ef502	ctc_code_gen: use a mean() on the ConditioningEncoder	2022-02-09 14:26:44 -07:00
James Betker	9e9ae328f2	mild updates	2022-02-08 23:51:17 -07:00
James Betker	ff35d13b99	Use non-uniform noise in diffusion_tts6	2022-02-08 07:27:41 -07:00
James Betker	34fbb78671	Straight CtcCodeGenerator as an encoder	2022-02-07 15:46:46 -07:00
James Betker	65a546c4d7	Fix for tts6	2022-02-05 16:00:14 -07:00
James Betker	5ae816bead	ctc gen checkin	2022-02-05 15:59:53 -07:00
James Betker	bb3d1ab03d	More cleanup	2022-02-04 11:06:17 -07:00