INT4 quantizations of Qwen3.8-27B calibrated at 262k context: AWQ and GPTQ weights, each in bf16-KV and calibrated fp8-e4m3 KV editions.
-
abhishekchohan/Qwen3.8-27B-AWQ-INT4-FP8KV
Image-Text-to-Text • 28B • Updated • 5.77k • 1 -
abhishekchohan/Qwen3.8-27B-AWQ-INT4
Image-Text-to-Text • 28B • Updated • 1.34k -
abhishekchohan/Qwen3.8-27B-GPTQ-INT4-FP8KV
Image-Text-to-Text • 28B • Updated • 73.4k • 2 -
abhishekchohan/Qwen3.8-27B-GPTQ-INT4
Image-Text-to-Text • 28B • Updated • 3.89k