UltraBERT: Beyond the Limit of BERT Pre-training. Pre-trained 150M/380M encoders and a text embedding model, English, 32K context.
Data Mining and Information Systems Lab
dmis-lab
AI & ML interests
None yet
Recent Activity
updated a collection 11 minutes ago
UltraBERT updated a collection 11 minutes ago
UltraBERT updated a collection 11 minutes ago
UltraBERTOrganizations
This collection hosts CVRR series introduced in paper, Reason Through the Latent! Making Latent Visual Reasoning Necessary
-
Reason Through the Latent! Making Latent Visual Reasoning Necessary
Paper • 2609.06746 • Published • 38 -
dmis-lab/Qwen2.5-VL-7B-CVRR
Visual Question Answering • Updated • 141 -
dmis-lab/Qwen3-VL-8B-CVRR
Visual Question Answering • Updated • 447 -
dmis-lab/Gemma3-4B-CVRR
Visual Question Answering • Updated • 288
UltraBERT: Beyond the Limit of BERT Pre-training. Pre-trained 150M/380M encoders and a text embedding model, English, 32K context.
This collection hosts CVRR series introduced in paper, Reason Through the Latent! Making Latent Visual Reasoning Necessary
-
Reason Through the Latent! Making Latent Visual Reasoning Necessary
Paper • 2609.06746 • Published • 38 -
dmis-lab/Qwen2.5-VL-7B-CVRR
Visual Question Answering • Updated • 141 -
dmis-lab/Qwen3-VL-8B-CVRR
Visual Question Answering • Updated • 447 -
dmis-lab/Gemma3-4B-CVRR
Visual Question Answering • Updated • 288
models 73
dmis-lab/UltraBERT-Embed-150M
Updated
dmis-lab/UltraBERT-380M
Updated
dmis-lab/UltraBERT-150M
Updated
dmis-lab/InternVL3-38B-CVRR
Visual Question Answering • Updated • 298
dmis-lab/InternVL3-9B-CVRR
Visual Question Answering • Updated • 886
dmis-lab/Gemma4-31B-CVRR
Visual Question Answering • Updated • 319 • 1
dmis-lab/Gemma4-12B-CVRR
Visual Question Answering • Updated • 1.01k
dmis-lab/Gemma3-27B-CVRR
Visual Question Answering • Updated • 2
dmis-lab/Gemma3-12B-CVRR
Visual Question Answering • Updated • 86
dmis-lab/Gemma3-4B-CVRR
Visual Question Answering • Updated • 288
datasets 11
dmis-lab/ToxReason
Viewer • Updated • 35.6k • 63
dmis-lab/llama-3.1-medprm-reward-raw-test-set
Viewer • Updated • 5.47k • 24
dmis-lab/llama-3.1-medprm-reward-raw-training-set
Viewer • Updated • 11.7k • 43
dmis-lab/llama-3.1-medprm-reward-test-set
Updated • 77 • 2
dmis-lab/llama-3.1-medprm-reward-training-set
Viewer • Updated • 11.7k • 141 • 12
dmis-lab/TemporalHead
Viewer • Updated • 11 • 38 • 1
dmis-lab/meerkat-instructions
Viewer • Updated • 440k • 1.07k • 11
dmis-lab/RF-Collection
Preview • Updated • 120 • 1
dmis-lab/ChroKnowBench
Preview • Updated • 199 • 8
dmis-lab/ETHIC
Viewer • Updated • 1.99k • 97 • 7