Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

684

Base only

Active filters: nemotron

mgoin/Minitron-4B-Base-FP8

Text Generation • 4B • Updated Aug 16, 2024 • 15 • 3

mgoin/Minitron-8B-Base-FP8

Text Generation • 8B • Updated Jul 26, 2024 • 18 • 3

mgoin/nemotron-3-8b-chat-4k-sft-hf

Text Generation • 9B • Updated Nov 13, 2024 • 44

PaulD/Minitron-4b_Base

Text Generation • 4B • Updated Jul 24, 2024 • 18

mgoin/Nemotron-4-340B-Base-hf

Text Generation • 341B • Updated Aug 8, 2024 • 31 • 1

mgoin/Nemotron-4-340B-Base-hf-FP8

Text Generation • 341B • Updated Aug 8, 2024 • 74 • 2

mgoin/Nemotron-4-340B-Instruct-hf

Text Generation • 341B • Updated Aug 8, 2024 • 47 • 4

mgoin/Nemotron-4-340B-Instruct-hf-FP8

Text Generation • 341B • Updated Aug 8, 2024 • 20 • 3

AlexWortega/nemo_asr_mixed

Text Generation • 4B • Updated Aug 29, 2024 • 16

mlx-community/Minitron-4B-Base-4bit

4B • Updated Aug 29, 2024 • 9

mlx-community/Minitron-4B-Base-8bit

4B • Updated Aug 29, 2024 • 8

mlx-community/Minitron-4B-Base

4B • Updated Aug 29, 2024 • 8

kykim0/minitron-4b-tulu-v2-mix

Text Generation • 4B • Updated Sep 1, 2024 • 16 • 1

kykim0/minitron-8b-tulu-v2-mix

Text Generation • 8B • Updated Sep 4, 2024 • 15

nvidia/Nemotron-Mini-4B-Instruct

Text Generation • Updated Feb 14, 2025 • 88.7k • 187

SicariusSicariiStuff/nvidia_Nemotron-Mini-4B-Instruct_FP8

4B • Updated Sep 14, 2024 • 10

SicariusSicariiStuff/nvidia_Nemotron-Mini-4B-Instruct_BF16

4B • Updated Sep 14, 2024 • 10

gaianet/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Sep 15, 2024 • 354

ltavabi/Nemotron-Mini-4B-Instruct-wspeechtokens

Text Generation • 4B • Updated Oct 10, 2024 • 17

OpenBuddy/openbuddy-nemotron-70b-v23.1-131k

Text Generation • 71B • Updated Oct 24, 2024 • 42 • • 4

nvidia/Nemotron-4-Mini-Hindi-4B-Base

Updated Jan 14 • 607 • 17

nvidia/Nemotron-4-Mini-Hindi-4B-Instruct

4B • Updated Aug 20, 2025 • 503 • 21

OpenBuddy/openbuddy-nemotron-70b-v23.2-131k-gguf

Text Generation • 71B • Updated Oct 27, 2024 • 12 • 1

joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4

Text Generation • 71B • Updated Nov 5, 2024 • 127 • 3

bartowski/openbuddy-nemotron-70b-v23.2q-131k-GGUF

Text Generation • 71B • Updated Nov 16, 2024 • 1.17k • 2

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 39

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 17

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 48

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 60

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 104 • 2