Pre-computed Q-Filters for efficient KV cache compression.
Nathan Godey
nthngdy
AI & ML interests
None yet
Recent Activity
updated a model 2 days ago
nthngdy/fabric-1p7B-95k-copy updated a model 12 days ago
nthngdy/fabric-1p7B-sft-tulu3-lr1e4 published a model 12 days ago
nthngdy/fabric-1p7B-sft-tulu3-lr1e4Organizations
models 77
nthngdy/fabric-1p7B-sft-tulu3-lr1e4
Updated • 1.63k
nthngdy/fabric-1p7B-sft-tulu3
Text Generation • Updated • 310
nthngdy/fabric-1p7B-95k-copy
Updated • 729
nthngdy/fabric-1p7B-95k
Updated • 1.09k
nthngdy/smollm2-135M-cpt_sw256_copy_sink
0.1B • Updated • 8
nthngdy/smollm2-135M-cpt_sw256
0.1B • Updated • 8
nthngdy/smollm2-135M-cpt_dense_copy_sink
0.1B • Updated • 7
nthngdy/smollm2-135M-cpt_dense
0.1B • Updated • 4
nthngdy/matryoshka-3B
Text Generation • 3B • Updated • 303 • 4
nthngdy/grad_bottleneck_2B
Text Generation • Updated • 19
datasets 30
nthngdy/mmlu_olmo3_contamination
Viewer • Updated • 15.9k • 166
nthngdy/hellaswag_wikihow_olmo_contamination
Viewer • Updated • 1.28k • 5
nthngdy/hellaswag_activitynet
Viewer • Updated • 21.5k • 11
nthngdy/hellaswag_wikihow
Viewer • Updated • 38.4k • 12
nthngdy/mmlu_olmo_contaminated
Viewer • Updated • 3.33k • 305
nthngdy/mmlu_olmo_decontaminated
Viewer • Updated • 10.7k • 339
nthngdy/pile_small_deduped_tokenized
Viewer • Updated • 100k • 14
nthngdy/mmlu_olmo_contamination
Viewer • Updated • 15.9k • 362
nthngdy/mmlu_shuffled
Viewer • Updated • 31.7k • 535
nthngdy/mmlu
Viewer • Updated • 116k • 22