James Betker
b203a7dc97
And remove unused parameters
2022-07-19 15:05:12 -06:00
James Betker
17a07b2e33
readd one mdf function
2022-07-19 15:04:36 -06:00
James Betker
c00398e955
scope attention in tfd13 as well
2022-07-19 14:59:43 -06:00
James Betker
b157b28c7b
tfd14
...
hopefully this helps address the positional dependencies of tfd12
2022-07-19 13:30:05 -06:00
James Betker
4597447178
add assertions to mel generator script
2022-07-19 11:23:54 -06:00
James Betker
1b6fe88bcb
spit out overages in GDI
2022-07-19 11:19:59 -06:00
James Betker
73d7211a4c
fix script
2022-07-19 11:17:43 -06:00
James Betker
6b1cfe8e66
ugh
2022-07-19 11:14:20 -06:00
James Betker
da9e47ca0e
new bounds for MEL normalization and multi-resolution SR in MDF
2022-07-19 11:11:46 -06:00
James Betker
eecb534e66
a few fixes to multiresolution sr
2022-07-19 11:11:15 -06:00
James Betker
2fb85526bc
mdf cleanup
2022-07-19 09:57:05 -06:00
James Betker
4aa840a494
be more stringent on min and max ranges in GDI.. this is gonna break somethings probably
2022-07-19 09:14:08 -06:00
James Betker
eab7dc339d
iq checkin
...
who knows where I'm going with this.. I don't even know sometimes..
2022-07-19 09:13:27 -06:00
James Betker
625d7b6f38
music joiner checkin
2022-07-18 18:40:25 -06:00
James Betker
0824708dc7
iq checkin
2022-07-18 18:40:14 -06:00
James Betker
df27b98730
ddp doesnt like dropout on checkpointed values
2022-07-18 17:17:04 -06:00
James Betker
8d7692c1e0
uh
2022-07-18 17:15:27 -06:00
James Betker
c959e530cb
good ole ddp..
2022-07-18 17:13:45 -06:00
James Betker
cf57c352c8
Another fix
2022-07-18 17:09:13 -06:00
James Betker
83a4ef4149
default to use input for conditioning & add preprocessed input to GDI
2022-07-18 17:01:19 -06:00
James Betker
1b4d9567f3
tfd13 for multi-resolution superscaling
2022-07-18 16:36:22 -06:00
James Betker
1b648abd7c
iq2
2022-07-18 10:12:23 -06:00
James Betker
7a10c3fed8
commit my own version of vq, with a fix for cosine similarity and support for masking
2022-07-18 10:12:17 -06:00
James Betker
4ce5c31705
music_joiner update for new big cosine model
2022-07-17 18:24:56 -06:00
James Betker
cb24bef406
ddim_with_guidance
2022-07-17 18:24:43 -06:00
James Betker
20ef9cc6b4
iq checkin
...
yeah - I'm at it again...
2022-07-17 18:24:33 -06:00
James Betker
a073fbfcb8
force tf32 to be enabled (torch 1.12 disables it)
2022-07-16 13:59:07 -06:00
James Betker
438dcaccc5
misc
2022-07-16 13:58:52 -06:00
James Betker
e13b1adfdb
:<
2022-07-14 21:52:23 -06:00
James Betker
51291ab070
Some additional context regularization in tfd
2022-07-14 21:49:47 -06:00
James Betker
7170ccdfa9
Merge branch 'baktfd'
2022-07-14 21:38:45 -06:00
James Betker
3b12d348fc
mdf: provide conditioning margin
2022-07-14 21:38:14 -06:00
James Betker
fa352e2744
also some good assert text
2022-07-14 21:26:22 -06:00
James Betker
4d53c66602
simplify span selecting logic in tfdpc
2022-07-14 21:25:03 -06:00
James Betker
4d5688be47
fix compatibility
2022-07-13 21:28:20 -06:00
James Betker
def70cd444
Merge remote-tracking branch 'origin/master'
2022-07-13 21:26:59 -06:00
James Betker
711c53c1f0
music script
2022-07-13 21:26:55 -06:00
James Betker
15831b2576
some stuff
2022-07-13 21:26:25 -06:00
James Betker
e23c322089
uhh2.0
2022-07-12 22:48:46 -06:00
James Betker
ebfe72d502
fix obo
2022-07-12 22:28:20 -06:00
James Betker
f46d6645da
tfdpcv5 updates
2022-07-12 21:48:18 -06:00
James Betker
ce82eb6022
update MDF for ar prior diffusion
2022-07-11 17:03:56 -06:00
James Betker
72c0e4b56b
Fix rounding warning
2022-07-11 17:02:59 -06:00
James Betker
3edca1a906
Rescale causal scale along with timestep spacing
2022-07-09 22:09:25 -06:00
James Betker
b432d7c7de
mdf: re-allow p_sample_loop
2022-07-09 15:35:09 -06:00
James Betker
f28cefdfe2
another fix for causal diffusion in inference
2022-07-09 15:29:47 -06:00
James Betker
8657d4d060
fix causal diffusion masking for low timesteps
2022-07-09 09:43:54 -06:00
James Betker
79a5b54e57
:(
2022-07-09 08:15:02 -06:00
James Betker
99adc846c7
Restore causal decoding
2022-07-09 08:11:08 -06:00
James Betker
5138d61767
Restore old MDF functionality for cheater gen
2022-07-09 08:01:32 -06:00
James Betker
694400a45b
implement causal sampling for standard p_sampling
2022-07-09 08:01:03 -06:00
James Betker
55b9f31825
fix mel outputs
2022-07-08 19:51:12 -06:00
James Betker
b99af89c8f
Support causal diffusion in inference
2022-07-08 14:27:19 -06:00
James Betker
ba1699cee2
Improve mdf
2022-07-08 12:30:22 -06:00
James Betker
7b4dcbf136
Support causal diffusion!
2022-07-08 12:30:05 -06:00
James Betker
78bba690de
auto grad "lr" scaling
2022-07-08 00:38:25 -06:00
James Betker
e5d97dfd56
misc
2022-07-08 00:37:53 -06:00
James Betker
611316faab
Merge pull request #9 from neonbjb:causal
...
Add causal timestep adjustments
2022-07-07 15:18:19 -06:00
James Betker
5f575b5d3c
Add causal timestep adjustments
2022-07-07 15:17:47 -06:00
James Betker
28d5b6a80a
optionally disable checkpointing in x_transformers (and make it so with the cond_encoder in tfdpc_v5)
2022-07-06 16:55:57 -06:00
James Betker
48270272e7
Use corner alignment for linear interpolation in TFDPC and TFD12
...
I noticed from experimentation that when this is not enabled, the interpolation edges are "sticky",
which is to say there is more variance in the center of the interpolation than at the edges.
2022-07-06 16:45:03 -06:00
James Betker
5816a4595e
ugh
2022-07-05 11:14:09 -06:00
James Betker
7440e43531
Fix some bugs
2022-07-05 10:37:47 -06:00
James Betker
2b128730e7
Improve conditioning separation logic
2022-07-05 10:30:28 -06:00
James Betker
802998674e
Fix another edge case
2022-07-04 16:47:57 -06:00
James Betker
808a1a4a31
eval cheater_ar
2022-07-04 08:50:09 -06:00
James Betker
bac9a8b728
Make MDF compatible with ar_prior models
2022-07-04 08:38:47 -06:00
James Betker
455943779b
Fix bug in conditioning segment fetching
2022-07-04 08:16:14 -06:00
James Betker
e5859acff7
Rework tfdpc_v5 further..
2022-07-03 18:19:01 -06:00
James Betker
6cc0405c7c
generate longer mels?
2022-07-03 17:54:32 -06:00
James Betker
58f26b1900
mods to support cheater ar prior in tfd12
2022-07-03 17:54:22 -06:00
James Betker
286918c581
conditioning masking is random
2022-07-01 21:43:30 -06:00
James Betker
e06ee1b6f3
music_joiner script
2022-07-01 00:44:48 -06:00
James Betker
1953887122
Add conditoning_masking to tfdpcv5
2022-07-01 00:44:40 -06:00
James Betker
4c3413d008
Support aac datatypes
2022-07-01 00:44:20 -06:00
James Betker
f5c246b879
AR cheater gen & centroid injector
2022-06-28 23:52:54 -06:00
James Betker
43ea259228
Fix MDF for cosine schedule
2022-06-28 17:29:21 -06:00
James Betker
861aa0e139
clustering script and injector
2022-06-28 17:07:56 -06:00
James Betker
ee3b426dae
Ffix tfdpc_v5 conditioning
2022-06-27 14:06:09 -06:00
James Betker
0278576f37
Update mdf to be compatible with cheater_gen
2022-06-27 10:11:23 -06:00
James Betker
69b614e08a
tfdpc5
2022-06-26 19:46:57 -06:00
James Betker
d0f2560396
fix
2022-06-25 21:22:08 -06:00
James Betker
f12f0200d6
tfdpc_v4
...
parametric efficiency improvements and lets try feeding the timestep into the conditioning encoder
2022-06-25 21:17:00 -06:00
James Betker
42de09d983
tfdpc_v3 inference
2022-06-25 21:16:13 -06:00
James Betker
7a9c4310e8
support reading cheaters directly
2022-06-23 11:39:10 -06:00
James Betker
b210e5025c
Le encoder shalt always be frozen.
2022-06-23 11:34:46 -06:00
James Betker
aeff1a4cc7
divided by zero
2022-06-21 20:26:19 -06:00
James Betker
f0117150d0
produce correct clip_lengths..
2022-06-21 20:21:12 -06:00
James Betker
4a1f3aba31
come on guys... :((
2022-06-21 20:12:54 -06:00
James Betker
fcfb3a1525
fix
2022-06-21 20:09:59 -06:00
James Betker
24e60bd510
report quantile losses for diffusion
2022-06-21 20:04:16 -06:00
James Betker
1394213f1e
allow variable size crops
2022-06-21 19:48:07 -06:00
James Betker
3330fa2c10
tfdpc_v3
2022-06-20 15:37:48 -06:00
James Betker
2209b4f301
tfdpc2
2022-06-20 09:36:21 -06:00
James Betker
0e5a3f4712
We don't need that encoder either..
2022-06-19 23:24:42 -06:00
James Betker
56c4a00e71
whoops
2022-06-19 23:22:30 -06:00
James Betker
a659cd865c
All the stuff needed for cheater latent generation
2022-06-19 23:12:52 -06:00
James Betker
c5ea2bee52
More mods
2022-06-19 22:30:46 -06:00
James Betker
691ed196da
fix codes
2022-06-19 21:29:40 -06:00
James Betker
b9f53a3ff9
don't populate gn5
2022-06-19 21:07:13 -06:00
