🦾 进行一些人工智能研究

Ujjwal Tyagi

Ujjwal-Tyagi

35 976 420

ujjwal-shirova

AI & ML interests

Chief Scientist at Shirova AI, dedicated to advancing open-source AI; possesses extensive experience in Large Language Model (LLM) fine-tuning, model architecture, and related research, with a passion for building scalable and efficient models.

Recent Activity

liked a model 1 day ago

prism-ml/Ternary-Bonsai-2-27B-gguf

updated a dataset 10 days ago

Ujjwal-Tyagi/ai-ml-foundations-book-collection

updated a bucket 10 days ago

Ujjwal-Tyagi/the-pile-deduplicated

View all activity

Organizations

buckets 8

Posts 15

Post

582

6 Open-Source Libraries to FineTune LLMs
1. Unsloth
GitHub: https://github.com/unslothai/unsloth
→ Fastest way to fine-tune LLMs locally
→ Optimized for low VRAM (even laptops)
→ Plug-and-play with Hugging Face models

2. Axolotl
GitHub: https://github.com/OpenAccess-AI-Collective/axolotl
→ Flexible LLM fine-tuning configs
→ Supports LoRA, QLoRA, multi-GPU
→ Great for custom training pipelines

3. TRL (Transformer Reinforcement Learning)
GitHub: https://github.com/huggingface/trl
→ RLHF, DPO, PPO for LLM alignment
→ Built on Hugging Face ecosystem
→ Essential for post-training optimization

4. DeepSpeed
GitHub: https://github.com/microsoft/DeepSpeed
→ Train massive models efficiently
→ Memory + speed optimization
→ Industry standard for scaling

5. LLaMA-Factory
GitHub: https://github.com/hiyouga/LLaMA-Factory
→ All-in-one fine-tuning UI + CLI
→ Supports multiple models (LLaMA, Qwen, etc.)
→ Beginner-friendly + powerful

6. PEFT
GitHub: https://github.com/huggingface/peft
→ Fine-tune with minimal compute
→ LoRA, adapters, prefix tuning
→ Best for cost-efficient training

Post

511

This is the best set of AI and ML books and a full guide to learning machine learning from the ground up. This is my study material that I used, so I thought it would be helpful to share it with others. Like, share, and add it to your collection at Ujjwal-Tyagi/ai-ml-foundations-book-collection.