bitsandbytes-rocm/CHANGELOG.md

41 lines
1.4 KiB
Markdown
Raw Normal View History

2021-10-21 02:26:43 +00:00
### 0.0.21
2021-10-06 02:16:20 +00:00
- Ampere, RTX 30 series GPUs now compatible with the library.
2021-10-21 02:26:43 +00:00
### 0.0.22:
2021-10-06 02:16:20 +00:00
- Fixed an error where a `reset_parameters()` call on the `StableEmbedding` would lead to an error in older PyTorch versions (from 1.7.0).
2021-10-21 02:26:43 +00:00
### 0.0.23:
2021-10-06 02:16:20 +00:00
Bugs:
- Unified quantization API: each quantization function now returns `Q, S` where `Q` is the quantized tensor and `S` the quantization state which may hold absolute max values, a quantization map or more. For dequantization all functions now accept the inputs `Q, S` so that `Q` is dequantized with the quantization state `S`.
- Fixed an issue where the CUDA 11.1 binary was not compiled with the right headers
API changes:
- Block-wise quantization for optimizers now enabled by default
Features:
- Block-wise quantization routines now support CPU Tensors.
2021-10-21 02:26:43 +00:00
### 0.0.24:
2021-10-06 02:16:20 +00:00
- Fixed a bug where a float/half conversion led to a compilation error for CUDA 11.1 on Turning GPUs.
- removed Apex dependency for bnb LAMB
2021-10-21 02:26:43 +00:00
### 0.0.25:
Features:
- Added `skip_zeros` for block-wise and 32-bit optimizers. This ensures correct updates for sparse gradients and sparse models.
- Added support for Kepler GPUs. (#4)
2021-10-21 23:07:24 +00:00
- Added Analysis Adam to track 8-bit vs 32-bit quantization errors over time.
2021-10-22 00:26:18 +00:00
- Make compilation more user friendly.
2021-10-21 02:26:43 +00:00
Bug fixes:
- fixed "undefined symbol: \_\_fatbinwrap_38" error for P100 GPUs on CUDA 10.1 (#5)
2021-10-22 00:26:18 +00:00
Docs:
- Added docs with instructions to compile from source.
2021-10-21 02:26:43 +00:00