Mike Ranzinger 29c6eadb83 Masks are now optional, and not created. Fixes required to support FlashAttention (e.g. no mask, fp/bf16)		2023-05-09 19:21:25 +00:00
..
xmoe	Code reformatting	2022-11-26 09:01:02 -08:00
__init__.py	flake8 lint checks	2022-11-26 08:10:15 -08:00
droppath.py	Code reformatting	2022-11-26 09:01:02 -08:00
embedding.py	b3 incremental decoding	2023-03-09 12:02:36 +08:00
feedforward_network.py	Remove inplace	2023-01-18 22:44:26 -08:00
multihead_attention.py	Masks are now optional, and not created. Fixes required to support FlashAttention (e.g. no mask, fp/bf16)	2023-05-09 19:21:25 +00:00
multiway_network.py	b3 incremental decoding	2023-03-09 12:02:36 +08:00
relative_position_bias.py	v0.1.2	2023-03-04 01:11:34 -08:00
xpos_relative_position.py	Update XPos	2023-01-03 22:54:24 -08:00