Shangzhen Zhu
ArgonnSZ
·
AI & ML interests
None yet
Recent Activity
submitted a paper about 1 month ago
Pretraining Transformers with Quantized Softmax in Attention upvoted a paper about 1 month ago
Softmax Reparameterization for Output-Head Quantization upvoted a paper about 1 month ago
Approximating Softmax in Pretrained LLMs: Model Sensitivity and Kernel Acceleration