James Betker
|
0604060580
|
Finish up mods for next version of GptAsrHf
|
2021-11-20 21:33:49 -07:00 |
|
James Betker
|
14f3155ec4
|
misc
|
2021-11-20 17:45:14 -07:00 |
|
James Betker
|
555b7e52ad
|
Add rev2 of GptAsrHf
|
2021-11-18 20:02:24 -07:00 |
|
James Betker
|
1287915f3c
|
Fix dvae test failure
|
2021-11-18 00:58:36 -07:00 |
|
James Betker
|
019acfa4c5
|
Allow flat dvae
|
2021-11-18 00:53:42 -07:00 |
|
James Betker
|
f3db41f125
|
Fix code logging
|
2021-11-18 00:34:37 -07:00 |
|
James Betker
|
79367f753d
|
Fix error & add nonfinite warning
|
2021-11-09 23:58:41 -07:00 |
|
James Betker
|
c584320cf3
|
Fix gpt_asr_hf distillation
|
2021-11-07 21:53:21 -07:00 |
|
James Betker
|
a367ea3fda
|
Add script for computing attention for gpt_asr
|
2021-11-07 18:42:06 -07:00 |
|
James Betker
|
756b4dad09
|
Working gpt_asr_hf inference - and it's a beast!
|
2021-11-06 21:47:15 -06:00 |
|
James Betker
|
596a62fe01
|
Apply fix to gpt_asr_hf and prep it for inference
Fix is that we were predicting two characters in advance, not next character
|
2021-11-04 10:09:24 -06:00 |
|
James Betker
|
993bd52d42
|
Add spec_augment injector
|
2021-11-01 18:43:11 -06:00 |
|
James Betker
|
4cff774b0e
|
Reduce complexity of the encoder for gpt_asr_hf
|
2021-11-01 17:02:28 -06:00 |
|
James Betker
|
da55ca0438
|
gpt_asr using the huggingfaces transformer
|
2021-11-01 17:00:22 -06:00 |
|
James Betker
|
83cccef9d8
|
Condition on full signal
|
2021-10-30 19:58:34 -06:00 |
|
James Betker
|
df45a9dec2
|
Fix inference mode for lucidrains_gpt
|
2021-10-30 16:59:18 -06:00 |
|
James Betker
|
92fe8b4dd9
|
ffffpt2
|
2021-10-29 17:29:49 -06:00 |
|
James Betker
|
95ca88efce
|
Fix feedforward
|
2021-10-29 17:27:51 -06:00 |
|
James Betker
|
b476516340
|
Check in backing changes (which may have broken something?)
|
2021-10-29 17:22:33 -06:00 |
|
James Betker
|
986fc9628d
|
Check in GPT with new inference methods (but not the backing code..)
|
2021-10-29 17:21:40 -06:00 |
|
James Betker
|
58494b0888
|
Add support for distilling gpt_asr
|
2021-10-27 13:10:07 -06:00 |
|
James Betker
|
5d714bc566
|
Add deepspeech model and support for decoding with it
|
2021-10-27 13:09:46 -06:00 |
|
James Betker
|
3a9d1c53ea
|
Rework conditioning inputs provided
|
2021-10-26 10:46:33 -06:00 |
|
James Betker
|
43e389aac6
|
Add time_embed_dim_multiplier
|
2021-10-26 08:55:55 -06:00 |
|
James Betker
|
ba6e46c02a
|
Further simplify diffusion_vocoder and make noise_surfer work
|
2021-10-26 08:54:30 -06:00 |
|
James Betker
|
0ee1c67ce5
|
Rework how conditioning inputs are applied to DiffusionVocoder
|
2021-10-24 09:08:58 -06:00 |
|
James Betker
|
06ea6191a9
|
Initial implementation of audio_with_noise dataset
|
2021-10-21 16:45:19 -06:00 |
|
James Betker
|
0dee15f875
|
base DVAE & vector_quantizer
|
2021-10-20 21:19:38 -06:00 |
|
James Betker
|
f2a31702b5
|
Clean stuff up, move more things into arch_util
|
2021-10-20 21:19:25 -06:00 |
|
James Betker
|
a6f0f854b9
|
Fix codes when inferring from dvae
|
2021-10-17 22:51:17 -06:00 |
|
James Betker
|
d016a2fbad
|
Go back to vanilla flavor of diffusion
|
2021-10-17 17:32:46 -06:00 |
|
James Betker
|
23da073037
|
Norm decoder outputs now
|
2021-10-16 09:07:10 -06:00 |
|
James Betker
|
0edc98f6c4
|
Throw out the idea of conditioning on discrete codes. Oh well :(
|
2021-10-16 09:02:01 -06:00 |
|
James Betker
|
62c8c5d93e
|
Zero out spectrogram code inputs initially.
|
2021-10-15 12:10:11 -06:00 |
|
James Betker
|
1d0b44ebc2
|
More tweaks to diffusion-vocoder
|
2021-10-15 11:51:17 -06:00 |
|
James Betker
|
3b19581f9a
|
Allow num_resblocks to specified per-level
|
2021-10-14 11:26:04 -06:00 |
|
James Betker
|
83798887a8
|
Mods to support unet diffusion vocoder with conditioning
|
2021-10-13 21:23:18 -06:00 |
|
James Betker
|
33120cb35c
|
Add norming to discretization_loss
|
2021-10-06 17:10:50 -06:00 |
|
James Betker
|
f2977d360c
|
Allow attention_dim in channel attention to be specified, add converter
|
2021-10-05 17:29:38 -06:00 |
|
James Betker
|
9c0d7288ea
|
Discretization loss attempt
|
2021-10-04 20:59:21 -06:00 |
|
James Betker
|
66f99a159c
|
Rev2
|
2021-10-03 15:20:50 -06:00 |
|
James Betker
|
09f373e3b1
|
Add dvae with channel attention
|
2021-10-03 10:52:01 -06:00 |
|
James Betker
|
0396a9d2ca
|
Increase baseline codes recording across all dvae models
|
2021-09-30 08:09:07 -06:00 |
|
James Betker
|
f84ccbdfb2
|
Fix quantizer with balancing_heuristic
|
2021-09-29 14:46:05 -06:00 |
|
James Betker
|
4914c526dc
|
More cleanup
|
2021-09-29 14:24:49 -06:00 |
|
James Betker
|
6e550edfe3
|
Attentive dvae
|
2021-09-29 14:17:29 -06:00 |
|
James Betker
|
55b58fb67f
|
Clean up codebase
Remove stuff that I'm likely not going to use again (or generally failed experiments)
|
2021-09-29 09:21:44 -06:00 |
|
James Betker
|
4d1a42e944
|
Add switchnorm to gumbel_quantizer
|
2021-09-24 18:49:25 -06:00 |
|
James Betker
|
ac57cdc794
|
Add scheduling to quantizer, enable cudnn_benchmarking to be disabled
|
2021-09-24 17:01:36 -06:00 |
|
James Betker
|
3e64e847c2
|
Gumbel quantizer
|
2021-09-23 23:32:03 -06:00 |
|