James Betker
|
746392f35c
|
Fix DS
|
2021-12-25 15:28:59 -07:00 |
|
James Betker
|
736c2626ee
|
build in character tokenizer
|
2021-12-25 15:21:01 -07:00 |
|
James Betker
|
b595c62893
|
One way decoder for decoding from mel codes
|
2021-12-25 12:18:00 -07:00 |
|
James Betker
|
ab9cafa572
|
Make tokenization configs more configurable
|
2021-12-25 12:17:50 -07:00 |
|
James Betker
|
52410fd9d9
|
256-bpe tokenizer
|
2021-12-25 08:52:08 -07:00 |
|
James Betker
|
8e26400ce2
|
Add inference for unified gpt
|
2021-12-24 13:27:06 -07:00 |
|
James Betker
|
ead2a74bf0
|
Add debug_failures flag
|
2021-12-23 16:12:16 -07:00 |
|
James Betker
|
9677f7084c
|
dataset mod
|
2021-12-23 15:21:30 -07:00 |
|
James Betker
|
8b19c37409
|
UnifiedGptVoice!
|
2021-12-23 15:20:26 -07:00 |
|
James Betker
|
5bc9772cb0
|
grand: support validation mode
|
2021-12-23 15:03:20 -07:00 |
|
James Betker
|
e55d949855
|
GrandConjoinedDataset
|
2021-12-23 14:32:33 -07:00 |
|
James Betker
|
b9de8a8eda
|
More fixes
|
2021-12-22 19:21:29 -07:00 |
|
James Betker
|
191e0130ee
|
Another fix
|
2021-12-22 18:30:50 -07:00 |
|
James Betker
|
6c6daa5795
|
Build a bigger, better tokenizer
|
2021-12-22 17:46:18 -07:00 |
|
James Betker
|
c737632eae
|
Train and use a bespoke tokenizer
|
2021-12-22 15:06:14 -07:00 |
|
James Betker
|
66bc60aeff
|
Re-add start_text_token
|
2021-12-22 14:10:35 -07:00 |
|
James Betker
|
a9629f7022
|
Try out using the GPT tokenizer rather than nv_tacotron
This results in a significant compression of the text domain, I'm curious what the
effect on speech quality will be.
|
2021-12-22 14:03:18 -07:00 |
|
James Betker
|
ced81a760b
|
restore nv_tacotron
|
2021-12-22 13:48:53 -07:00 |
|
James Betker
|
7bf4f9f580
|
duplicate nvtacotron
|
2021-12-22 13:48:30 -07:00 |
|
James Betker
|
7ae7d423af
|
VoiceCLIP model
|
2021-12-22 13:44:11 -07:00 |
|
James Betker
|
09f7f3e615
|
Remove obsolete lucidrains DALLE stuff, re-create it in a dedicated folder
|
2021-12-22 13:44:02 -07:00 |
|
James Betker
|
a42b94ab72
|
gpt_tts_hf inference fixes
|
2021-12-22 13:22:15 -07:00 |
|
James Betker
|
48e3ee9a5b
|
Shuffle conditioning inputs along the positional axis to reduce fitting on prosody and other positional information
The mels should still retain some short-range positional information the model can use
for tone and frequencies, for example.
|
2021-12-20 19:05:56 -07:00 |
|
James Betker
|
53858b2055
|
Fix gpt_tts_hf inference
|
2021-12-20 17:45:26 -07:00 |
|
James Betker
|
712d746e9b
|
gpt_tts: format conditioning inputs more for contextual voice clues and less for prosidy
also support single conditional inputs
|
2021-12-19 17:42:29 -07:00 |
|
James Betker
|
c813befd53
|
Remove dedicated positioning embeddings
|
2021-12-19 09:01:31 -07:00 |
|
James Betker
|
b4ddcd7111
|
More inference improvements
|
2021-12-19 09:01:19 -07:00 |
|
James Betker
|
f9c45d70f0
|
Fix mel terminator
|
2021-12-18 17:18:06 -07:00 |
|
James Betker
|
937045cb63
|
Fixes
|
2021-12-18 16:45:38 -07:00 |
|
James Betker
|
9b9f7ea61b
|
GptTtsHf: Make the input/target placement easier to reason about
|
2021-12-17 10:24:14 -07:00 |
|
James Betker
|
2fb4213a3e
|
More lossy fixes
|
2021-12-17 10:01:42 -07:00 |
|
James Betker
|
dee34f096c
|
Add use_gpt_tts script
|
2021-12-16 23:28:54 -07:00 |
|
James Betker
|
9e8a9bf6ca
|
Various fixes to gpt_tts_hf
|
2021-12-16 23:28:44 -07:00 |
|
James Betker
|
62c8ed9a29
|
move speech utils
|
2021-12-16 20:47:37 -07:00 |
|
James Betker
|
e7957e4897
|
Make loss accumulator for logs accumulate better
|
2021-12-12 22:23:17 -07:00 |
|
James Betker
|
4f8c4d130c
|
gpt_tts_hf: pad mel tokens with an <end_of_sequence> token.
|
2021-12-12 20:04:50 -07:00 |
|
James Betker
|
76f86c0e47
|
gaussian_diffusion: support fp16
|
2021-12-12 19:52:21 -07:00 |
|
James Betker
|
aa7cfd1edf
|
Add support for mel norms across the channel dim
|
2021-12-12 19:52:08 -07:00 |
|
James Betker
|
8917c02a4d
|
gpt_tts_hf inference first pass
|
2021-12-12 19:51:44 -07:00 |
|
James Betker
|
63bf135b93
|
Support norms
|
2021-12-11 08:30:49 -07:00 |
|
James Betker
|
959979086d
|
fix
|
2021-12-11 08:18:00 -07:00 |
|
James Betker
|
5a664aa56e
|
misc
|
2021-12-11 08:17:26 -07:00 |
|
James Betker
|
d610540ce5
|
mel norm computation script
|
2021-12-11 08:16:50 -07:00 |
|
James Betker
|
306274245b
|
Also do dynamic range compression across mel
|
2021-12-10 20:06:24 -07:00 |
|
James Betker
|
faf55684b8
|
Use slaney norm in the mel filterbank computation
|
2021-12-10 20:04:52 -07:00 |
|
James Betker
|
b2d8fbcfc0
|
build a better speech synthesis toolset
|
2021-12-09 22:59:56 -07:00 |
|
James Betker
|
32cfcf3684
|
Turn off optimization in find_faulty_files
|
2021-12-09 09:02:09 -07:00 |
|
James Betker
|
a66a2bf91b
|
Update find_faulty_files
|
2021-12-09 09:00:00 -07:00 |
|
James Betker
|
9191201f05
|
asd
|
2021-12-07 09:55:39 -07:00 |
|
James Betker
|
ef15a39841
|
fix gdi bug?
|
2021-12-07 09:53:48 -07:00 |
|
James Betker
|
6ccff3f49f
|
Record codes more often
|
2021-12-07 09:22:45 -07:00 |
|
James Betker
|
d0b2f931bf
|
Add feature to diffusion vocoder where the spectrogram conditioning layers can be re-trained apart from the rest of the model
|
2021-12-07 09:22:30 -07:00 |
|
James Betker
|
662920bde3
|
Log codes when simply fetching codebook_indices
|
2021-12-06 09:21:43 -07:00 |
|
James Betker
|
380a5d5475
|
gdi..
|
2021-12-03 08:53:09 -07:00 |
|
James Betker
|
101a01f744
|
Fix dvae codes issue
|
2021-12-02 23:28:36 -07:00 |
|
James Betker
|
31fc693a8a
|
dafsdf
|
2021-12-02 22:55:36 -07:00 |
|
James Betker
|
040d998922
|
maasd
|
2021-12-02 22:53:48 -07:00 |
|
James Betker
|
cc10e7e7e8
|
Add tsv loader
|
2021-12-02 22:43:07 -07:00 |
|
James Betker
|
702607556d
|
nv_tacotron_dataset: allow it to load conditioning signals
|
2021-12-02 22:14:44 -07:00 |
|
James Betker
|
07b0124712
|
GptTtsHf!
|
2021-12-02 21:48:42 -07:00 |
|
James Betker
|
85542ec547
|
One last fix for gpt_asr_hf2
|
2021-12-02 21:19:28 -07:00 |
|
James Betker
|
68e9db12b5
|
Add interleaving and direct injectors
|
2021-12-02 21:04:49 -07:00 |
|
James Betker
|
04454ee63a
|
Add evaluation logic for gpt_asr_hf2
|
2021-12-02 21:04:36 -07:00 |
|
James Betker
|
47fe032a3d
|
Try to make diffusion validator more reproducible
|
2021-11-24 09:38:10 -07:00 |
|
James Betker
|
5956eb757c
|
ffffff
|
2021-11-24 00:19:47 -07:00 |
|
James Betker
|
f1ed0588e3
|
another fix
|
2021-11-24 00:11:21 -07:00 |
|
James Betker
|
7a3c4a4fc6
|
Fix lr quantizer decode
|
2021-11-24 00:01:26 -07:00 |
|
James Betker
|
3f6ecfe0db
|
q fix
|
2021-11-23 23:50:27 -07:00 |
|
James Betker
|
d9747fe623
|
Integrate with lr_quantizer
|
2021-11-23 19:48:22 -07:00 |
|
James Betker
|
82d0e7720e
|
Add choke to lucidrains_dvae
|
2021-11-23 18:53:37 -07:00 |
|
James Betker
|
934395d4b8
|
A few fixes for gpt_asr_hf2
|
2021-11-23 09:29:29 -07:00 |
|
James Betker
|
3b5c3d85d8
|
Allow specification of wandb run name
|
2021-11-22 17:31:29 -07:00 |
|
James Betker
|
01e635168b
|
whoops
|
2021-11-22 17:24:13 -07:00 |
|
James Betker
|
973f47c525
|
misc nonfunctional
|
2021-11-22 17:16:39 -07:00 |
|
James Betker
|
3125ca38f5
|
Further wandb logs
|
2021-11-22 16:40:19 -07:00 |
|
James Betker
|
19c80bf7a7
|
Improve wandb logging
|
2021-11-22 16:40:05 -07:00 |
|
James Betker
|
0604060580
|
Finish up mods for next version of GptAsrHf
|
2021-11-20 21:33:49 -07:00 |
|
James Betker
|
14f3155ec4
|
misc
|
2021-11-20 17:45:14 -07:00 |
|
James Betker
|
687e0746b3
|
Add Torch-derived MelSpectrogramInjector
|
2021-11-18 20:02:45 -07:00 |
|
James Betker
|
555b7e52ad
|
Add rev2 of GptAsrHf
|
2021-11-18 20:02:24 -07:00 |
|
James Betker
|
c30a38cdf1
|
Undo baseline GDI changes
|
2021-11-18 20:02:09 -07:00 |
|
James Betker
|
1287915f3c
|
Fix dvae test failure
|
2021-11-18 00:58:36 -07:00 |
|
James Betker
|
019acfa4c5
|
Allow flat dvae
|
2021-11-18 00:53:42 -07:00 |
|
James Betker
|
f3db41f125
|
Fix code logging
|
2021-11-18 00:34:37 -07:00 |
|
James Betker
|
f36bab95dd
|
Audio resample injector
|
2021-11-10 20:06:33 -07:00 |
|
James Betker
|
79367f753d
|
Fix error & add nonfinite warning
|
2021-11-09 23:58:41 -07:00 |
|
James Betker
|
5d5558893a
|
Merge remote-tracking branch 'origin/master'
|
2021-11-08 20:10:49 -07:00 |
|
James Betker
|
d43f25cc20
|
Update losses
|
2021-11-08 20:10:07 -07:00 |
|
James Betker
|
c584320cf3
|
Fix gpt_asr_hf distillation
|
2021-11-07 21:53:21 -07:00 |
|
James Betker
|
9b3c3b1227
|
use sets instead of list ops
|
2021-11-07 20:45:57 -07:00 |
|
James Betker
|
722d3dbdc2
|
f
|
2021-11-07 18:52:05 -07:00 |
|
James Betker
|
18b1de9b2c
|
Add exclusion_lists to unsupervised_audio_dataset
|
2021-11-07 18:46:47 -07:00 |
|
James Betker
|
9b693b0a54
|
Fixes to filter_clips_hifreq
|
2021-11-07 18:42:22 -07:00 |
|
James Betker
|
a367ea3fda
|
Add script for computing attention for gpt_asr
|
2021-11-07 18:42:06 -07:00 |
|
James Betker
|
3c0f2fbb21
|
Add filtration script for finding resampled clips (or phone calls)
|
2021-11-07 14:16:11 -07:00 |
|
James Betker
|
756b4dad09
|
Working gpt_asr_hf inference - and it's a beast!
|
2021-11-06 21:47:15 -06:00 |
|
James Betker
|
596a62fe01
|
Apply fix to gpt_asr_hf and prep it for inference
Fix is that we were predicting two characters in advance, not next character
|
2021-11-04 10:09:24 -06:00 |
|
James Betker
|
fd14746bf8
|
badtimes
|
2021-11-03 00:33:38 -06:00 |
|
James Betker
|
2fa80486de
|
tacotron_dataset: recover gracefully
|
2021-11-03 00:31:50 -06:00 |
|
James Betker
|
af51d00dee
|
Load wav files from voxpopuli instead of oggs
|
2021-11-02 09:32:26 -06:00 |
|