Adds support for 4bit (nf4) and 8bit bitsandbytes quantization (3/3) - #151
Open
Rypo wants to merge 15 commits into
Open
Adds support for 4bit (nf4) and 8bit bitsandbytes quantization (3/3)#151Rypo wants to merge 15 commits into
Rypo wants to merge 15 commits into
Commits
Commits on Nov 26, 2024
- committed
- committed
- committed
Commits on Dec 2, 2024
Commits on Dec 3, 2024
Commits on Dec 5, 2024
- committed
- committed
- committed
- committed