Commit Graph

166 Commits

Author SHA1 Message Date
Tim Dettmers
412fd0e717 Added better default compute_dtype handling for Linear4bit layers. 2023-07-22 12:56:29 -07:00
Tim Dettmers
c82f51c0f7 Increased occupancy. 2023-07-19 16:08:37 -07:00
Tim Dettmers
1ab6758b36 Changed CUDA setup to use PyTorch default; added a weak test. 2023-07-13 23:58:41 -07:00
Tim Dettmers
90b0ac57b0 Fixed missing bias in bnb.matmul_4bit for inference; more tests. 2023-07-11 17:13:33 -07:00
Tim Dettmers
dc96e9e7c8 Test for bloom that fails with inference kernels. 2023-07-11 15:40:20 -07:00
Tim Dettmers
ba51d95d43 Added more extensive gemv tests; blocksize guard for gemv. 2023-07-11 05:55:49 -07:00
Tim Dettmers
a26a321e07 Removed debugging statement. 2023-07-10 14:34:19 -07:00
Tim Dettmers
306f6b2362 Fixed accidential deletion of limits in kernel. 2023-07-10 14:24:33 -07:00
Tim Dettmers
490153b29f Added generation tests. 2023-07-10 12:19:16 -07:00
Tim Dettmers
5fab673442 Added fp32 compute type for gemv_4bit. 2023-07-09 21:06:01 -07:00
Tim Dettmers
cef519c89e Added test for Param4bit.to() and fixed double quant behavior. 2023-07-09 17:16:50 -07:00
Tim Dettmers
0f0390acb2 Added double quantization support and tests. 2023-07-09 15:32:03 -07:00
Tim Dettmers
94168d79d7 Added FP4 fast inference support. 2023-07-09 14:46:19 -07:00
Tim Dettmers
4b88d69de7 Added abitrary data types; fixed a bug for small matrices. 2023-07-09 12:04:09 -07:00
Tim Dettmers
eefbf60270 Turning optimization (float accumulation). 185 vs 50. 2023-07-08 16:31:58 -07:00
Tim Dettmers
7e49b5b938 Added warp_shuffle indexing 185 vs 54. 2023-07-08 14:27:12 -07:00
Tim Dettmers
02fd80cb81 Added bfloat16 quantizations and tests. 2023-07-04 19:58:31 -07:00
Tim Dettmers
dfe6900b94 Vectorized loads, conflict free NF4; 52 vs 172. 2023-07-04 15:20:10 -07:00
Tim Dettmers
f89ff93e26 Initial 4-bit naive batch size 1, 81 vs 185. 2023-07-03 18:45:38 -07:00
Tim Dettmers
e54d2730fc Added debugging functions. 2023-05-30 20:42:21 -07:00
Tim Dettmers
b7f04e2a20 Added lookup table. 2023-05-30 20:07:05 -07:00
Tim Dettmers
1b8772a8f3 Added PagedLion and bf16 Lion. 2023-05-23 19:37:38 -07:00
Tim Dettmers
2bce175d15 Fixed Makefile. 2023-05-23 18:42:19 -07:00
Tim Dettmers
4bd1151829 Fixed gradient accumulation test. 2023-05-07 15:06:17 -07:00
Tim Dettmers
675baa79d2 Merge remote-tracking branch 'origin/main' into merge 2023-05-07 13:34:03 -07:00
Tim Dettmers
f64cfe65aa Fixed prefetch bug for non-paged tensors; added benchmark. 2023-05-06 21:49:16 -07:00
Tim Dettmers
44d68ff29c Added paged optimizers. 2023-05-06 14:59:29 -07:00
Tim Dettmers
ec38ba95b0 Added paging. 2023-05-06 11:14:06 -07:00
Tim Dettmers
264a948539 4-bit draft; 128 vector load 240. 2023-05-02 16:15:38 -07:00
Tim Dettmers
869b7e83b5 Warp multi-specialization 240. 2023-05-02 12:10:32 -07:00
Tim Dettmers
77f15fdce9 Shared memory efficient 240. 2023-05-02 11:38:11 -07:00
Tim Dettmers
394749db71 Correct implementation 240. 2023-05-02 08:58:59 -07:00
Tim Dettmers
9aa232cc39 Initial. 2023-05-02 07:53:29 -07:00
Tim Dettmers
9192c9de64 Tighter and scaled error analysis. 2023-05-02 07:50:32 -07:00
Tim Dettmers
f9bfea8f23 Baseline for debugging. 2023-05-02 07:24:12 -07:00
Tim Dettmers
7cc8ff4727 Warp specalization 362. 2023-05-01 08:21:12 -07:00
Tim Dettmers
c35ed09b66 Double frag 440. 2023-04-30 18:19:30 -07:00
Tim Dettmers
ad07d254fb Slow tensor core solution. 2023-04-30 17:43:02 -07:00
Tim Dettmers
21723f796a 4-bit draft. 2023-04-29 21:52:47 -07:00
Tim Dettmers
cad839941b Added bit template. 2023-04-28 22:10:42 -07:00
Tim Dettmers
f3e97ccbd2 New implementation for batch size 1. 2023-04-28 21:29:40 -07:00
Tim Dettmers
f6df4aef6a Added fp16 and thread/item template. 2023-04-28 18:26:52 -07:00
Tim Dettmers
c1bfb210c5 First baseline kernel. 2023-04-28 17:19:02 -07:00
Tim Dettmers
9cab14a3ff Adedd pipeline draft. 2023-04-27 15:12:49 -07:00
Tim Dettmers
d1c4c20568 Added non-cutlass template. 2023-04-27 15:11:26 -07:00
Tim Dettmers
0afc8e9e2f Best attempt at cutlass3. 2023-04-26 17:12:34 -07:00
Tim Dettmers
0f9d30207f Added nested quantization for blockwise quantization. 2023-04-19 11:48:47 -07:00
Tim Dettmers
7dc198feb7 Added 32-bit optimizer for bfloat16 gradients. 2023-04-17 18:01:49 -07:00
Tim Dettmers
9e7cdc9ea9 Added last SwitchBack refactors. All tests green. 2023-04-12 13:41:30 -07:00
Tim Dettmers
7140c01405 Merge branch 'main' into fp8_merge 2023-04-12 11:44:39 -07:00