"Not all quantized model perform good", serving framework ollama uses NVIDIA gpu, llama.cpp uses CPU with AVX & AMX
v1k
xbruce22
AI & ML interests
None yet
Recent Activity
liked a model 3 days ago
nvidia/Qwen3.8-Flash-Next-FP4-Local liked a model 4 days ago
stepfun-ai/Step-5-Preview-NVFP4 liked a model 6 days ago
openbmb/MiniCPM-V-4.7-35B-A3B-FP8