Commit Graph

26 Commits

Author SHA1 Message Date
enhuiz
71c85e8a2b Add AdaNorm to AdaLN 2023-01-13 02:16:28 +08:00
enhuiz
6651403910 Remove old comments 2023-01-13 00:45:46 +08:00
enhuiz
f962a9d744 Fix raise 2023-01-13 00:34:40 +08:00
enhuiz
36e8894f5c AdaLN and sample-wise quant level sampling 2023-01-13 00:33:16 +08:00
enhuiz
3b6c88d897 Fix iters 2023-01-12 20:42:28 +08:00
enhuiz
c0fff54518 Rename 2023-01-12 20:30:59 +08:00
enhuiz
85c6a11f26 Faster validation 2023-01-12 20:27:31 +08:00
enhuiz
52998447b7 Make more VRAM friendly 2023-01-12 20:07:44 +08:00
enhuiz
886c11de46 Typo 2023-01-12 19:55:04 +08:00
enhuiz
74b9dc5068 Update config 2023-01-12 19:52:21 +08:00
enhuiz
4c1695e2cf Remove duplicates, smaller bs by default 2023-01-12 19:50:25 +08:00
enhuiz
777f9d6a13 Fix feeder 2023-01-12 19:48:48 +08:00
enhuiz
958c2df660 Better prompt sampling 2023-01-12 19:46:20 +08:00
enhuiz
3a4d5be18b Add model presets 2023-01-12 19:46:20 +08:00
enhuiz
ae029c1d75 Hardcode prom levels 2023-01-12 19:46:20 +08:00
enhuiz
8edaa36f2f Skip exists 2023-01-12 18:11:22 +08:00
enhuiz
c3bacebfab Add trainer 2023-01-12 14:41:44 +08:00
enhuiz
d19449f1f1 Checkpoint on attention and only sample one layer for NAR 2023-01-12 14:41:30 +08:00
enhuiz
5e4ef084b8 Simplify interface 2023-01-12 14:24:35 +08:00
enhuiz
ea5e438fdb prom_list -> proms_list 2023-01-12 14:11:32 +08:00
enhuiz
de59c04c50 Remove old 2023-01-12 12:58:48 +08:00
enhuiz
af4dbf0b3e Refactor, add NAR 2023-01-12 12:56:44 +08:00
enhuiz
6c5f250faa Absorb stop token into the model 2023-01-12 00:09:11 +08:00
enhuiz
43483bb394 Add audio decoding 2023-01-11 23:51:56 +08:00
enhuiz
2296e2ea3c Delay pe to cover sep 2023-01-11 23:11:53 +08:00
enhuiz
154ddf264c Init 2023-01-11 23:03:25 +08:00