UltraBERT-380M

dmis-lab/UltraBERT-380M

Fill Mask430M parameterstransformersLicense: apache-2.0
Tracked by OpenModelStats since October 10, 2026View on Hugging Face ↗
Downloads 30D
91
Total downloads
91
Gained 7D
—
Gained 30D
—
Likes
3
Rank · tracked models
—
–this week
Parameters
430M
Last source update
Oct 10, 2026

Downloads over time

Rolling recent-window downloads as reported

Likes over time

Rank among tracked models

Lower is better

Not enough tracked history yet for a chart.

OpenModelStats began tracking this model on 2026-10-10. Charts appear as daily observations accumulate.

Overview

UltraBERT-380M is a fill mask model published by dmis-lab. OpenModelStats has tracked the model since Oct 10, 2026, most recently observing it Oct 13, 2026.

Published
Oct 10, 2026
Last updated
Oct 10, 2026
Library
transformers
License
apache-2.0
Task
Fill Mask
Parameters
429,966,336
Spaces
—
Derivative models
—
Velocity 7D/day
—
transformerssafetensorsultrabertfill-maskencodermasked-language-modelinglong-contextcustom_codeendataset:mlfoundations/dclm-baseline-1.0dataset:HuggingFaceFW/fineweb-edudataset:HuggingFaceTB/stack-edu

Similar models

Models similar to UltraBERT-380M
ModelDL 30D
bacformer-large-masked-MAGmacwiatrak24.5K
bacformer-large-masked-complete-genomesmacwiatrak24.4K
polish-roberta-large-v2sdadas1,901
gte-en-mlm-largeAlibaba-NLP1,779
IgBertExscientia20.8K
IgBert_unpairedExscientia832
dmis-lab/UltraBERT-380M — Downloads, Growth & Stats | OpenModelStats