Songhao Wu
shwu
AI & ML interests
Mixture-of-Experts Model, Language Model Pretraining
Recent Activity
liked a model about 18 hours ago
IQuestLab/IQuest-Q1 upvoted a paper 3 months ago
LatentMoE: Toward Optimal Accuracy per FLOP and Parameter in Mixture of Experts authored a paper 4 months ago
Redesign Mixture-of-Experts Routers with Manifold Power IterationOrganizations
None yet