James Betker
|
3c242403f5
|
adjust location of pre-optimizer step so I can visualize the new grad norms
|
2022-03-04 08:56:42 -07:00 |
|
James Betker
|
58019a2ce3
|
audio diffusion fid updates
|
2022-03-03 21:53:32 -07:00 |
|
James Betker
|
6873ad6660
|
Support functionality
|
2022-03-03 21:52:16 -07:00 |
|
James Betker
|
70fa780edb
|
Add mechanism to export grad norms
|
2022-03-01 20:19:52 -07:00 |
|
James Betker
|
db0c3340ac
|
Implement guidance-free diffusion in eval
And a few other fixes
|
2022-03-01 11:49:36 -07:00 |
|
James Betker
|
2134f06516
|
Implement conditioning-free diffusion at the eval level
|
2022-02-27 15:11:42 -07:00 |
|
James Betker
|
ac920798bb
|
misc
|
2022-02-27 14:49:11 -07:00 |
|
James Betker
|
f458f5d8f1
|
abort early if losses reach nan too much, and save the model
|
2022-02-24 20:55:30 -07:00 |
|
James Betker
|
18dc62453f
|
Don't step if NaN losses are encountered.
|
2022-02-24 17:45:08 -07:00 |
|
James Betker
|
7c17c8e674
|
gurgl
|
2022-02-23 21:28:24 -07:00 |
|
James Betker
|
81017d9696
|
put frechet_distance on cuda
|
2022-02-23 21:21:13 -07:00 |
|
James Betker
|
9a7bbf33df
|
f
|
2022-02-23 18:03:38 -07:00 |
|
James Betker
|
b7319ab518
|
Support vocoder type diffusion in audio_diffusion_fid
|
2022-02-23 17:25:16 -07:00 |
|
James Betker
|
58f6c9805b
|
adf
|
2022-02-22 23:12:58 -07:00 |
|
James Betker
|
03752c1cd6
|
Report NaN
|
2022-02-22 23:09:37 -07:00 |
|
James Betker
|
6313a94f96
|
eval: integrate a n-gram language model into decoding
|
2022-02-21 19:12:34 -07:00 |
|
James Betker
|
7b12799370
|
Reformat mel_text_clip for use in eval
|
2022-02-19 20:37:26 -07:00 |
|
James Betker
|
bcba65c539
|
DataParallel Fix
|
2022-02-19 20:36:35 -07:00 |
|
James Betker
|
34001ad765
|
et
|
2022-02-18 18:52:33 -07:00 |
|
James Betker
|
a813fbed9c
|
Update to evaluator
|
2022-02-17 17:30:33 -07:00 |
|
James Betker
|
79e8f36d30
|
Convert CLIP models into new folder
|
2022-02-15 20:53:07 -07:00 |
|
James Betker
|
8f767b8b4f
|
...
|
2022-02-15 07:08:17 -07:00 |
|
James Betker
|
29e07913a8
|
Fix
|
2022-02-15 06:58:11 -07:00 |
|
James Betker
|
dd585df772
|
LAMB optimizer
|
2022-02-15 06:48:13 -07:00 |
|
James Betker
|
2bdb515068
|
A few mods to make wav2vec2 trainable with DDP on DLAS
|
2022-02-15 06:28:54 -07:00 |
|
James Betker
|
52b61b9f77
|
Update scripts and attempt to figure out how UnifiedVoice could be used to produce CTC codes
|
2022-02-13 20:48:06 -07:00 |
|
James Betker
|
a4f1641eea
|
Add & refine WER evaluator for w2v
|
2022-02-13 20:47:29 -07:00 |
|
James Betker
|
e16af944c0
|
BSO fix
|
2022-02-12 20:01:04 -07:00 |
|
James Betker
|
15fd60aad3
|
Allow EMA training to be disabled
|
2022-02-12 20:00:23 -07:00 |
|
James Betker
|
102142d1eb
|
f
|
2022-02-11 11:05:13 -07:00 |
|
James Betker
|
40b08a52d0
|
dafuk
|
2022-02-11 11:01:31 -07:00 |
|
James Betker
|
f6a7f12cad
|
Remove broken evaluator
|
2022-02-11 11:00:29 -07:00 |
|
James Betker
|
46b97049dc
|
Fix eval
|
2022-02-11 10:59:32 -07:00 |
|
James Betker
|
5175b7d91a
|
training sweeper checkin
|
2022-02-11 10:46:37 -07:00 |
|
James Betker
|
d1d1ae32a1
|
audio diffusion frechet distance measurement!
|
2022-02-10 22:55:46 -07:00 |
|
James Betker
|
23a310b488
|
Fix BSO
|
2022-02-10 20:54:51 -07:00 |
|
James Betker
|
1e28e02f98
|
BSO improvement to make it work with distributed optimizers
|
2022-02-10 09:53:13 -07:00 |
|
James Betker
|
836eb08afb
|
Update BSO to use the proper step size
|
2022-02-10 09:44:15 -07:00 |
|
James Betker
|
3d946356f8
|
batch_size_optimizer works. sweet! no more tuning batch sizes.
|
2022-02-09 14:26:23 -07:00 |
|
James Betker
|
18938248e4
|
Add batch_size_optimizer support
|
2022-02-08 23:51:31 -07:00 |
|
James Betker
|
de1a1d501a
|
Move audio injectors into their own file
|
2022-02-03 21:42:37 -07:00 |
|
James Betker
|
fbea6e8eac
|
Adjustments to diffusion networks
|
2022-01-30 16:14:06 -07:00 |
|
James Betker
|
798ed7730a
|
i like wasting time
|
2022-01-24 18:12:08 -07:00 |
|
James Betker
|
fc09cff4b3
|
angry
|
2022-01-24 18:09:29 -07:00 |
|
James Betker
|
cc0d9f7216
|
Fix
|
2022-01-24 18:05:45 -07:00 |
|
James Betker
|
3a9e3a9db3
|
consolidate state
|
2022-01-24 17:59:31 -07:00 |
|
James Betker
|
dfef34ba39
|
Load ema to cpu memory if specified
|
2022-01-24 15:08:29 -07:00 |
|
James Betker
|
49edffb6ad
|
Revise device mapping
|
2022-01-24 15:08:13 -07:00 |
|
James Betker
|
33511243d5
|
load model state dicts into the correct device
it's not clear to me that this will make a huge difference, but it's a good idea anyways
|
2022-01-24 14:40:09 -07:00 |
|
James Betker
|
3e16c509f6
|
Misc fixes
|
2022-01-24 14:31:43 -07:00 |
|