mrq 3826f9bae4 saner mask creation? (it doesnt matter, kv cache wont work)		2024-11-02 21:00:21 -05:00
..
emb	saner mask creation? (it doesnt matter, kv cache wont work)	2024-11-02 21:00:21 -05:00
engines
ext
models	saner mask creation? (it doesnt matter, kv cache wont work)	2024-11-02 21:00:21 -05:00
utils
__init__.py
__main__.py
config.py
data.py	saner mask creation? (it doesnt matter, kv cache wont work)	2024-11-02 21:00:21 -05:00
demo.py
export.py
inference.py
plot.py	very, very naive layerskip speculative sampling (it just checks if the current layer's state is good enough)	2024-11-02 11:49:05 -05:00
samplers.py	very, very naive layerskip speculative sampling (it just checks if the current layer's state is good enough)	2024-11-02 11:49:05 -05:00
train.py
webui.py	very, very naive layerskip speculative sampling (it just checks if the current layer's state is good enough)	2024-11-02 11:49:05 -05:00