gianlucamazza/SmolLM2-360M-Instruct-ort-genai-int4-cpu
Text Generation • Updated
Gianluca Mazza PRO
gianlucamazza
AI & ML interests
LLM systems in production, agent state and recovery, evaluation, inference cost
Recent Activity
posted an update 1 day ago
GGUF models from xllama's catalogue, my independent research project for local LLM inference on an Xbox Series S. Each note gives the measured figures or test status, with model, quant and setup. For example, LFM2.5-350M (QAD Q4_0, Dev Mode, llama.cpp CPU) decodes at 101.6 tok/s. Source for every number: xllama's model matrix. Not affiliated with Microsoft.
https://huggingface.co/collections/gianlucamazza/xllama-models-measured-on-xbox-series-s-6aca0b32275cbe99dbf02d89 commentedon their article 3 days ago
RAGFS: a filesystem interface for agents, and the query JSON I keep as a retrieval receipt posted an update 3 days ago
A keyless, offline playground for mklang, my language and interpreter for LLM control flow. Parse, check and lint, format, and run the bundled examples and conformance cases. No model runs and no API key is needed; judge picks come from fixture files.
https://huggingface.co/spaces/gianlucamazza/mklang-playgroundOrganizations
