James Betker
611316faab
Merge pull request #9 from neonbjb:causal
...
Add causal timestep adjustments
2022-07-07 15:18:19 -06:00
James Betker
5f575b5d3c
Add causal timestep adjustments
2022-07-07 15:17:47 -06:00
James Betker
28d5b6a80a
optionally disable checkpointing in x_transformers (and make it so with the cond_encoder in tfdpc_v5)
2022-07-06 16:55:57 -06:00
James Betker
48270272e7
Use corner alignment for linear interpolation in TFDPC and TFD12
...
I noticed from experimentation that when this is not enabled, the interpolation edges are "sticky",
which is to say there is more variance in the center of the interpolation than at the edges.
2022-07-06 16:45:03 -06:00
James Betker
5816a4595e
ugh
2022-07-05 11:14:09 -06:00
James Betker
7440e43531
Fix some bugs
2022-07-05 10:37:47 -06:00
James Betker
2b128730e7
Improve conditioning separation logic
2022-07-05 10:30:28 -06:00
James Betker
802998674e
Fix another edge case
2022-07-04 16:47:57 -06:00
James Betker
455943779b
Fix bug in conditioning segment fetching
2022-07-04 08:16:14 -06:00
James Betker
e5859acff7
Rework tfdpc_v5 further..
2022-07-03 18:19:01 -06:00
James Betker
58f26b1900
mods to support cheater ar prior in tfd12
2022-07-03 17:54:22 -06:00
James Betker
286918c581
conditioning masking is random
2022-07-01 21:43:30 -06:00
James Betker
1953887122
Add conditoning_masking to tfdpcv5
2022-07-01 00:44:40 -06:00
James Betker
f5c246b879
AR cheater gen & centroid injector
2022-06-28 23:52:54 -06:00
James Betker
ee3b426dae
Ffix tfdpc_v5 conditioning
2022-06-27 14:06:09 -06:00
James Betker
0278576f37
Update mdf to be compatible with cheater_gen
2022-06-27 10:11:23 -06:00
James Betker
69b614e08a
tfdpc5
2022-06-26 19:46:57 -06:00
James Betker
d0f2560396
fix
2022-06-25 21:22:08 -06:00
James Betker
f12f0200d6
tfdpc_v4
...
parametric efficiency improvements and lets try feeding the timestep into the conditioning encoder
2022-06-25 21:17:00 -06:00
James Betker
42de09d983
tfdpc_v3 inference
2022-06-25 21:16:13 -06:00
James Betker
b210e5025c
Le encoder shalt always be frozen.
2022-06-23 11:34:46 -06:00
James Betker
4a1f3aba31
come on guys... :((
2022-06-21 20:12:54 -06:00
James Betker
24e60bd510
report quantile losses for diffusion
2022-06-21 20:04:16 -06:00
James Betker
3330fa2c10
tfdpc_v3
2022-06-20 15:37:48 -06:00
James Betker
2209b4f301
tfdpc2
2022-06-20 09:36:21 -06:00
James Betker
0e5a3f4712
We don't need that encoder either..
2022-06-19 23:24:42 -06:00
James Betker
56c4a00e71
whoops
2022-06-19 23:22:30 -06:00
James Betker
a659cd865c
All the stuff needed for cheater latent generation
2022-06-19 23:12:52 -06:00
James Betker
c5ea2bee52
More mods
2022-06-19 22:30:46 -06:00
James Betker
691ed196da
fix codes
2022-06-19 21:29:40 -06:00
James Betker
b9f53a3ff9
don't populate gn5
2022-06-19 21:07:13 -06:00
James Betker
a5d2123daa
more cleanup
2022-06-19 21:04:51 -06:00
James Betker
fef1066687
couple more alterations
2022-06-19 20:58:24 -06:00
James Betker
02ead8c05c
update params
2022-06-19 20:47:06 -06:00
James Betker
ff8b0533ac
gen3 waveform
2022-06-19 19:23:48 -06:00
James Betker
b19b0a74da
Merge branch 'master' of https://github.com/neonbjb/DL-Art-School
2022-06-19 18:56:27 -06:00
James Betker
0b9588708c
rrdb-inspired waveform gen
2022-06-19 18:56:17 -06:00
James Betker
f425afc965
permute codes
2022-06-19 18:00:30 -06:00
James Betker
8c8efbe131
fix code_emb
2022-06-19 17:54:08 -06:00
James Betker
c000e489fa
.
2022-06-17 09:40:11 -06:00
James Betker
7ca532c7cc
handle unused encoder parameters
2022-06-17 09:37:07 -06:00
James Betker
e025183bfb
and the other ones..
...
really need to unify this file better.
2022-06-17 09:30:25 -06:00
James Betker
3081c893d4
Don't augment grad scale when the grad don't exist!
2022-06-17 09:27:04 -06:00
James Betker
3efd64ed7a
expand codes before the code converters for cheater latents
2022-06-17 09:20:29 -06:00
James Betker
f70b16214d
allow more interesting code interpolation
2022-06-17 09:12:44 -06:00
James Betker
87a86ae6a8
integrate tfd12 with cheater network
2022-06-17 09:08:56 -06:00
James Betker
9d7ce42630
add tanh to the end of the latent thingy
2022-06-16 20:31:23 -06:00
James Betker
b7758f25a9
and fix
2022-06-16 20:06:27 -06:00
James Betker
e3287c9d95
Reduce severity of gpt_music reduction
2022-06-16 20:05:05 -06:00
James Betker
41abf776d9
better downsampler
2022-06-16 15:19:08 -06:00
