Instructions to use TachyHealth/DeepSeek-R1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use TachyHealth/DeepSeek-R1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="TachyHealth/DeepSeek-R1", trust_remote_code=True)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("TachyHealth/DeepSeek-R1", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("TachyHealth/DeepSeek-R1", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use TachyHealth/DeepSeek-R1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "TachyHealth/DeepSeek-R1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/TachyHealth/DeepSeek-R1

SGLang

How to use TachyHealth/DeepSeek-R1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "TachyHealth/DeepSeek-R1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "TachyHealth/DeepSeek-R1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "TachyHealth/DeepSeek-R1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use TachyHealth/DeepSeek-R1 with Docker Model Runner:
```
docker model run hf.co/TachyHealth/DeepSeek-R1
```

DeepSeek-R1

Commit History

Jan 30, 2025

02:01
Upload model-00161-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
c89cbd1
01:56
Upload model-00160-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
d39e536
01:51
Upload model-00159-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1371b91
01:47
Upload model-00158-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
8f8d44a
01:28
Upload model-00148-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
3e9332a
01:23
Upload model-00147-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
b7bc19f
01:19
Upload model-00146-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
33caa94
01:14
Upload model-00145-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
b734ac1
00:59
Upload model-00132-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
acad8a3
00:54
Upload model-00131-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ddd039c
00:50
Upload model-00130-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6bee594
00:45
Upload model-00129-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
de8ecb4
00:34
Upload model-00118-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
279c6a3
00:28
Upload model-00117-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
7d23ad6
00:23
Upload model-00116-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
782eacc
00:19
Upload model-00115-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a59e5dc
00:14
Upload model-00114-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
376a8b9
00:09
Upload model-00113-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ea90451
00:05
Upload model-00112-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
4ca2895
00:00
Upload model-00111-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
4e2d39a

Jan 29, 2025

23:56
Upload model-00110-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
88891df
23:52
Upload model-00109-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
74e1b02
23:48
Upload model-00108-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a0a3446
23:43
Upload model-00107-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
7e7215c
23:39
Upload model-00106-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
f2a44fd
23:35
Upload model-00105-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1b16155
23:30
Upload model-00104-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1f2cead
23:26
Upload model-00103-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
0560d43
23:21
Upload model-00102-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6f6af91
23:17
Upload model-00101-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
a77dc69
23:12
Upload model-00100-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
52df7ed
23:11
Upload model-00099-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
955863d
23:06
Upload model-00098-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
c93ab76
23:02
Upload model-00097-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
2c44709
22:58
Upload model-00096-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
9e06eb4
22:53
Upload model-00095-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ac23a32
22:49
Upload model-00094-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
150459c
22:44
Upload model-00093-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
6b63bd6
22:40
Upload model-00092-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
d6a0264
22:35
Upload model-00091-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
bc05864
22:31
Upload model-00090-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
ad7fe3c
22:27
Upload model-00089-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
481124e
22:22
Upload model-00088-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
1d5f546
22:18
Upload model-00087-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
743a74a
22:14
Upload model-00086-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
9d35ebc
22:10
Upload model-00085-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
70e3cfc
22:06
Upload model-00084-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
dcd8305
22:02
Upload model-00083-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
3fa820c
21:57
Upload model-00082-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
40612bc
21:53
Upload model-00081-of-000163.safetensors with huggingface_hub

TachyHealthResearch

Verified signature
53c72fc

Commit History

Jan 30, 2025

Upload model-00161-of-000163.safetensors with huggingface_hub

Upload model-00160-of-000163.safetensors with huggingface_hub

Upload model-00159-of-000163.safetensors with huggingface_hub

Upload model-00158-of-000163.safetensors with huggingface_hub

Upload model-00148-of-000163.safetensors with huggingface_hub

Upload model-00147-of-000163.safetensors with huggingface_hub

Upload model-00146-of-000163.safetensors with huggingface_hub

Upload model-00145-of-000163.safetensors with huggingface_hub

Upload model-00132-of-000163.safetensors with huggingface_hub

Upload model-00131-of-000163.safetensors with huggingface_hub

Upload model-00130-of-000163.safetensors with huggingface_hub

Upload model-00129-of-000163.safetensors with huggingface_hub

Upload model-00118-of-000163.safetensors with huggingface_hub

Upload model-00117-of-000163.safetensors with huggingface_hub

Upload model-00116-of-000163.safetensors with huggingface_hub

Upload model-00115-of-000163.safetensors with huggingface_hub

Upload model-00114-of-000163.safetensors with huggingface_hub

Upload model-00113-of-000163.safetensors with huggingface_hub

Upload model-00112-of-000163.safetensors with huggingface_hub

Upload model-00111-of-000163.safetensors with huggingface_hub

Jan 29, 2025

Upload model-00110-of-000163.safetensors with huggingface_hub

Upload model-00109-of-000163.safetensors with huggingface_hub

Upload model-00108-of-000163.safetensors with huggingface_hub

Upload model-00107-of-000163.safetensors with huggingface_hub

Upload model-00106-of-000163.safetensors with huggingface_hub

Upload model-00105-of-000163.safetensors with huggingface_hub

Upload model-00104-of-000163.safetensors with huggingface_hub

Upload model-00103-of-000163.safetensors with huggingface_hub

Upload model-00102-of-000163.safetensors with huggingface_hub

Upload model-00101-of-000163.safetensors with huggingface_hub

Upload model-00100-of-000163.safetensors with huggingface_hub

Upload model-00099-of-000163.safetensors with huggingface_hub

Upload model-00098-of-000163.safetensors with huggingface_hub

Upload model-00097-of-000163.safetensors with huggingface_hub

Upload model-00096-of-000163.safetensors with huggingface_hub

Upload model-00095-of-000163.safetensors with huggingface_hub

Upload model-00094-of-000163.safetensors with huggingface_hub

Upload model-00093-of-000163.safetensors with huggingface_hub

Upload model-00092-of-000163.safetensors with huggingface_hub

Upload model-00091-of-000163.safetensors with huggingface_hub

Upload model-00090-of-000163.safetensors with huggingface_hub

Upload model-00089-of-000163.safetensors with huggingface_hub

Upload model-00088-of-000163.safetensors with huggingface_hub

Upload model-00087-of-000163.safetensors with huggingface_hub

Upload model-00086-of-000163.safetensors with huggingface_hub

Upload model-00085-of-000163.safetensors with huggingface_hub

Upload model-00084-of-000163.safetensors with huggingface_hub

Upload model-00083-of-000163.safetensors with huggingface_hub

Upload model-00082-of-000163.safetensors with huggingface_hub

Upload model-00081-of-000163.safetensors with huggingface_hub