21 Commits

Author	SHA1	Message	Date
Tim Dettmers	6bc2b992be	Added blocksizes 2048, 1024, and 512 to blockwise quant.	2022-11-06 16:27:48 -08:00
Tim Dettmers	2f2063bac2	Added k<256 quantile estimate.	2022-11-06 13:05:25 -08:00
Tim Dettmers	98cbc4bc4f	Added k-bit fp8 map.	2022-11-06 11:59:37 -08:00
Tim Dettmers	caf1832526	Added k-bit linear quantization.	2022-11-06 11:47:54 -08:00
Tim Dettmers	1efb87d89d	Added FP8 quantization map.	2022-11-03 19:49:50 -07:00
Tim Dettmers	df86625a93	Isolated CUDASetup logging; all tests green.	2022-10-24 11:54:25 -07:00
Tim Dettmers	c05dd42ddd	Fixed cpu blockwise quantization for small input tensors.	2022-09-13 10:37:53 -07:00
Tim Dettmers	19a7adca7a	Fixed 2^31 max size issue for cpu blockwise quant.	2022-09-11 11:55:09 -07:00
Tim Dettmers	7e0fb655e1	Some initial code. Needs to be tested.	2022-08-23 13:59:34 -07:00
Tim Dettmers	dede343033	Added fused bias in dequant_mm.	2022-08-16 11:12:09 -07:00
Tim Dettmers	1ed2fa2f21	Removed storage() from get_ptr; added boilerplate for bias dequant_mm.	2022-08-16 10:56:17 -07:00
Titus von Koeller	ea7c14f8ef	reran black with linelength 80 for greater readability	2022-08-01 09:32:47 -07:00
Titus von Koeller	bfa0e33294	ran black and isort for coherent code formatting	2022-08-01 03:31:48 -07:00
Tim Dettmers	5737f2b027	Merge branch 'patch_merge' into extract_outliers	2022-07-26 19:38:01 -07:00
Tim Dettmers	32fa459ed7	Added col_ampere outlier extraction kernel.	2022-07-26 18:15:51 -07:00
Tim Dettmers	bcab99ec87	Working outlier extraction for Turing.	2022-07-26 17:39:30 -07:00
Tim Dettmers	cbb901ac51	Boilerplate and test for extract_outliers.	2022-07-26 12:12:38 -07:00
Tim Dettmers	1e88edd8c0	Removed rowscale (segfaults on ampere).	2022-07-25 17:27:57 -07:00
Tim Dettmers	8b1fd32e3e	Fixed makefile; fixed Ampere igemmlt_8 bug.	2022-07-25 14:02:14 -07:00
Tim Dettmers	c771b3a75a	Most tests passing.	2022-07-22 14:41:05 -07:00
Tim Dettmers	7439924891	Initial commit	2021-10-05 19:16:20 -07:00