# from https://github.com/syncdoth/RetNet/

# there is no proper build system and I can't be assed to fork it or make it a submodule that plays nicely with python's import system
# this is included because torchscale's implementation recently changed and I don't want to keep maintaining a fork