2 Commits

Author	SHA1	Message	Date
mrq	2f7d9ab932	disable BNB for inferencing by default because I'm pretty sure it makes zero differences (can be force enabled with env vars if you'r erelying on this for some reason)	2023-04-29 00:38:18 +00:00
mrq	7b839a4263	applied the bitsandbytes wrapper to tortoise inference (not sure if it matters)	2023-02-28 01:42:10 +00:00