🤝 Open to Collab

Uday Pratap Singh Atwal

upsatwal

2 47

https://uday.codes

upsatwal

AI & ML interests

Inference optimization, ML Ops

Recent Activity

reacted to cafkafk's post with 🔥 5 days ago

I'm working on a local model that can be run on stuff like an an RTX 3080 at 60 t/s. I'm focused on making it good at Rust and Nix. It's... not done yet, but doing great already. Had a 28/100 on livebench v6 earlier, which obviously isn't amazing. But for my first real model, very exciting. Can't wait to share more as I get closer to the finish line in the coming weeks.

updated a Space 8 days ago

beacon-gui/README

updated a collection 8 days ago

The Beacon Project

View all activity

Organizations

reacted to cafkafk's post with 🔥 5 days ago

Post

4479

I'm working on a local model that can be run on stuff like an an RTX 3080 at 60 t/s. I'm focused on making it good at Rust and Nix. It's... not done yet, but doing great already. Had a 28/100 on livebench v6 earlier, which obviously isn't amazing.

But for my first real model, very exciting. Can't wait to share more as I get closer to the finish line in the coming weeks.

6 replies

updated a Space 8 days ago

BEACON

⚡

Home of BEACON Behavioral Fingerprinting Research Project

updated a collection 8 days ago

The Beacon Project

Collection

2 items • Updated 8 days ago • 1

upvoted a collection 8 days ago

The Beacon Project

Collection

2 items • Updated 8 days ago • 1

updated a collection 8 days ago

The Beacon Project

Collection

2 items • Updated 8 days ago • 1

liked a model about 2 months ago

Qwen/Qwen3.8-27B

Image-Text-to-Text • 28B • Updated Aug 14 • 6.76M • • 17.2k

liked a model 4 months ago

yenupam/desi-max

Text-to-Image • Updated May 4 • • 11

updated a dataset 5 months ago

beacon-gui/BEACON-Dataset

Preview • Updated May 20 • 911 • 3

authored a paper 5 months ago

BEACON: A Multimodal Dataset for Learning Behavioral Fingerprints from Gameplay Data

Paper • 2605.10867 • Published May 11 • 6

upvoted a paper 5 months ago

BEACON: A Multimodal Dataset for Learning Behavioral Fingerprints from Gameplay Data

Paper • 2605.10867 • Published May 11 • 6

liked a dataset 5 months ago

beacon-gui/BEACON-Dataset

Preview • Updated May 20 • 911 • 3

published a dataset 5 months ago

beacon-gui/BEACON-Dataset

Preview • Updated May 20 • 911 • 3

reacted to danielhanchen's post with 🚀 5 months ago

Post

10911

Unsloth is now one of the top 10 most followed organizations on Hugging Face. 🤗🦥

Thanks so much for all the support!
Our HF page:

unsloth

5 replies

liked a Space 9 months ago

UGI Leaderboard

📢

2.12k

Uncensored General Intelligence Leaderboard

liked a model 10 months ago

PrimeIntellect/INTELLECT-1

Text Generation • 10B • Updated Nov 29, 2024 • 677 • 67

liked a Space 11 months ago

The Smol Training Playbook

📚

3.32k

The secrets to building world-class LLMs

liked a Space about 1 year ago

Transformers Timeline

🤗

Interactive timeline to explore the 🤗Transformers models

reacted to prithivMLmods's post with 🤗 about 1 year ago

Post

3432

Comparing: DeepCaption-VLA-7B, built on Qwen2.5-VL-7B-Instruct, is tailored for image captioning and vision-language attribution, focusing on precise, descriptive captions of visual properties, object attributes, and scene details. In contrast, Qwen2.5-VL-7B-Abliterated-Caption-it is fine-tuned for abliterated captioning, generating highly detailed descriptions across diverse visual categories.

Models🤗
✦ DeepCaption-VLA-7B : prithivMLmods/DeepCaption-VLA-7B
✦ Qwen2.5-VL-7B-Abliterated-Caption-it : prithivMLmods/Qwen2.5-VL-7B-Abliterated-Caption-it

Spaces⛵
➜ VisionScope-R2 : prithivMLmods/VisionScope-R2
➜ Qwen2.5-VL-Outpost : https://huggingface.co/spaces/prithivMLmods/Qwen2.5-VL-Outpost

Collection🗞️
DeepCaption attr. : prithivMLmods/deepcaption-attr-68b041172ebcb867e45c556a
VL Abliterated-Caption : prithivMLmods/vl-abliterated-caption-68a0443b63182e97a15c47a3
Multimodal VLMs - Until July'25 : prithivMLmods/multimodal-vlms-until-july25-688312e6b840e1e156f13027
Multimodal VLMs - Aug'25 : prithivMLmods/multimodal-vlms-until-july25-688312e6b840e1e156f13027

GitHub↗️
> DeepCaption-VLA-7B [4bit-notebook demo] : https://github.com/PRITHIVSAKTHIUR/Multimodal-Outpost-Notebooks/blob/main/DeepCaption-VLA-7B%5B4bit%20-%20notebook%20demo%5D/DeepCaption-VLA-7B.ipynb
> Qwen2.5-VL-3B-Abliterated-Caption-it(caption) : https://github.com/PRITHIVSAKTHIUR/Multimodal-Outpost-Notebooks/blob/main/Qwen2.5-VL-3B-Abliterated-Caption-it(caption)/Qwen2_5_VL_3B_Abliterated_Caption_it.ipynb

The community GPU grant was given by Hugging Face — special thanks to them. 🤗🚀

To know more about it, visit the app page or the respective model page!!

reacted to Lewdiculous's post with ❤️ about 1 year ago

Post

71791

More context for your Pascal GPU or older!

Update: Now available in the official releases of KoboldCpp!
[releases] https://github.com/LostRuins/koboldcpp/releases/latest

These are great news for all the users with GTX 10XX, P40...

Flash Attention implementation for older NVIDIA GPUs without requiring Tensor Cores has come to llama.cpp in the last few days, and should be merged in the next version of KoboldCpp, you can already try it with another fork or by building it.

[Mentioned KCPP fork] https://github.com/Nexesenex/kobold.cpp/releases/latest

[PR] https://github.com/ggerganov/llama.cpp/pull/7188

You should expect less VRAM usage for the same context, allowing you to experience higher contexts with your current GPU.

There have also been reported final tokens/second speed improvements for inference, so that's also grand!

If you have tried it, I'd like to hear your experiences with --flashattention so far, especially for this implementation and for the large number of Pascal (GTX 10XX, P40...) cards.

Discussion linked bellow, with more links to relevant information:

https://huggingface.co/LWDCLS/LLM-Discussions/discussions/11

Cheers!