UltraBERT-380M

dmis-lab/UltraBERT-380M

Fill Mask430M parameterstransformersLicense: apache-2.0
Tracked by OpenModelStats since October 10, 2026View on Hugging Face ↗
Downloads 30D
982
Total downloads
982
Gained 7D
—
Gained 30D
—
Likes
50
Rank · tracked models
#58,706
–this week
Parameters
430M
Last source update
Oct 14, 2026

Downloads over time

Cumulative total downloads observed by OpenModelStats

Likes over time

Rank among tracked models

Lower is better

Not enough tracked history yet for a chart.

OpenModelStats began tracking this model on 2026-10-10. Charts appear as daily observations accumulate.

Overview

UltraBERT-380M is a fill mask model published by dmis-lab. OpenModelStats has tracked the model since Oct 10, 2026, most recently observing it 24h ago.

Published
Oct 10, 2026
Last updated
Oct 14, 2026
Library
transformers
License
apache-2.0
Task
Fill Mask
Parameters
429,966,336
Spaces
—
Derivative models
—
Velocity 7D/day
—
transformerssafetensorsultrabertfill-maskencodermasked-language-modelinglong-contextcustom_codeendataset:mlfoundations/dclm-baseline-1.0dataset:HuggingFaceFW/fineweb-edudataset:HuggingFaceTB/stack-edu

Similar models

Models similar to UltraBERT-380M
ModelDL 30D
bacformer-large-masked-complete-genomesmacwiatrak20.5K
bacformer-large-masked-MAGmacwiatrak2,615
polish-roberta-large-v2sdadas1,612
gte-en-mlm-largeAlibaba-NLP1,779
IgBertExscientia20.8K
IgBert_unpairedExscientia9,352
dmis-lab/UltraBERT-380M — Downloads, Growth & Stats | OpenModelStats