Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14

Base only

Active filters: cpu-offload

albucino/Qwen3.8-Flash-Next-W4A16-FP8PLE

Text Generation • 73B • Updated 2 days ago • 2.93k • 32

MikeKuykendall/deepseek-moe-16b-q4-k-m-cpu-offload-gguf

Text Generation • 16B • Updated Oct 9, 2025 • 161 • 4

MikeKuykendall/gpt-oss-20b-moe-cpu-offload-gguf

Text Generation • 21B • Updated Oct 6, 2025 • 237 • 3

MikeKuykendall/phi-3.5-moe-cpu-offload-gguf

Text Generation • 42B • Updated Oct 8, 2025 • 19

MikeKuykendall/deepseek-moe-16b-cpu-offload-gguf

Text Generation • 16B • Updated Oct 8, 2025 • 29

MikeKuykendall/phi-3.5-moe-q4-k-m-cpu-offload-gguf

Text Generation • 42B • Updated Oct 9, 2025 • 28

MikeKuykendall/phi-3.5-moe-q2-k-cpu-offload-gguf

Text Generation • 42B • Updated Oct 9, 2025 • 22

MikeKuykendall/phi-3.5-moe-q8-0-cpu-offload-gguf

Text Generation • 42B • Updated Oct 9, 2025 • 15

MikeKuykendall/deepseek-moe-16b-q2-k-cpu-offload-gguf

Text Generation • 16B • Updated Oct 9, 2025 • 56

MikeKuykendall/deepseek-moe-16b-q8-0-cpu-offload-gguf

Text Generation • 16B • Updated Oct 9, 2025 • 100

daksh-neo/Nemotron-3-Super-120B-NF4-4bit

Text Generation • 126B • Updated Mar 30 • 39 • 1

Hob-forge/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUF

Text Generation • 32B • Updated 28 days ago • 209

sustainaibler/sarvam-30b-resi-ai-t2t-rd1

Text Generation • 32B • Updated May 3

Fluffy/Kimi-K3-W4A16-RTN

Image-Text-to-Text • 2.7T • Updated 2 days ago • 32