MoE models are the new big thing for low-end hardware. Try Chat Completion with the official Gemma 4 samplers: top_k: 64; top_p: 0.95; temp: 1.0
Paul Mercer
unknown2304
AI & ML interests
None yet
Recent Activity
liked a model 2 days ago
kyx0r/Neona-12B updated a collection 2 days ago
26B-A4B RP/eRP and other MoEs updated a collection 10 days ago
26B-A4B RP/eRP and other MoEsOrganizations
None yet
models 0
None public yet
datasets 0
None public yet