MiniLLM/MiniLLM-gpt2-340M
Text Generation β’ Updated β’ 281 β’ 5
AI & ML interests
Training efficient language models (MiniLLM, MiniPLM)
MiniLLM/SFT-gpt2-120M
Text Generation β’ 0.1B β’ Updated β’ 423
MiniLLM/SFT-gpt2-760M
Text Generation β’ 0.8B β’ Updated β’ 55
MiniLLM/MiniPLM-Qwen-500M
Text Generation β’ 0.5B β’ Updated β’ 100 β’ β’ 7
MiniLLM/MiniPLM-llama3.1-212M
Text Generation β’ 0.2B β’ Updated β’ 38 β’ 6
MiniLLM/MiniPLM-Mamba-130M
Text Generation β’ 0.1B β’ Updated β’ 72 β’ 4
MiniLLM/MiniPLM-Qwen-1.2B
Text Generation β’ 1B β’ Updated β’ 119 β’ 4
MiniLLM/Ref-Pretrain-Qwen-104M
Text Generation β’ 0.1B β’ Updated β’ 499 β’ 5
MiniLLM/Pretrain-Qwen-1.2B
Text Generation β’ 1B β’ Updated β’ 30
MiniLLM/Pretrain-Qwen-500M
Text Generation β’ 0.5B β’ Updated β’ 40
MiniLLM/Pretrain-Qwen-200M
Text Generation β’ 0.2B β’ Updated β’ 480
MiniLLM/VanillaKD-Pretrain-Qwen-200M
Text Generation β’ 0.2B β’ Updated β’ 33
MiniLLM/VanillaKD-Pretrain-Qwen-500M
Text Generation β’ 0.5B β’ Updated β’ 30 β’
MiniLLM/VanillaKD-Pretrain-Qwen-1.2B
Text Generation β’ 1B β’ Updated β’ 33
MiniLLM/init-gpt2-120M
Text Generation β’ 0.1B β’ Updated β’ 1.05k β’ 1
MiniLLM/teacher-Llama-13B
Text Generation β’ Updated β’ 28
MiniLLM/MiniLLM-Llama-7B
Text Generation β’ Updated β’ 419 β’ 3
MiniLLM/MiniPLM-Qwen-200M
Text Generation β’ 0.2B β’ Updated β’ 7.52k β’ 10
MiniLLM/init-Llama-7B
Text Generation β’ Updated β’ 10
MiniLLM/teacher-OPT-13B
Text Generation β’ Updated β’ 56
MiniLLM/SeqKD-Llama-7B
Text Generation β’ Updated β’ 22
MiniLLM/KD-Llama-7B
Text Generation β’ Updated β’ 33
MiniLLM/SFT-Llama-7B
Text Generation β’ Updated β’ 17
MiniLLM/init-OPT-6.7B
Text Generation β’ Updated β’ 16
MiniLLM/init-OPT-2.7B
Text Generation β’ Updated β’ 20
MiniLLM/init-OPT-1.3B
Text Generation β’ Updated β’ 28
MiniLLM/SeqKD-OPT-6.7B
Text Generation β’ Updated β’ 37
MiniLLM/SeqKD-OPT-2.7B
Text Generation β’ Updated β’ 34
MiniLLM/SeqKD-OPT-1.3B
Text Generation β’ Updated β’ 42
MiniLLM/KD-OPT-6.7B
Text Generation β’ Updated β’ 43