UltraBERT-380M

dmis-lab/UltraBERT-380M

Fill Mask430M parameterstransformersLicense: apache-2.0
Tracked by OpenModelStats since October 10, 2026View on Hugging Face ↗
Downloads 30D
91
Total downloads
91
Gained 7D
—
Gained 30D
—
Likes
3
Rank · tracked models
—
–this week
Parameters
430M
Last source update
Oct 10, 2026

Downloads over time

Daily gain between consecutive observations

Likes over time

Rank among tracked models

Lower is better

Not enough tracked history yet for a chart.

OpenModelStats began tracking this model on 2026-10-10. Charts appear as daily observations accumulate.

Overview

UltraBERT-380M is a fill mask model published by dmis-lab. OpenModelStats has tracked the model since Oct 10, 2026, most recently observing it Oct 13, 2026.

Published
Oct 10, 2026
Last updated
Oct 10, 2026
Library
transformers
License
apache-2.0
Task
Fill Mask
Parameters
429,966,336
Spaces
—
Derivative models
—
Velocity 7D/day
—
transformerssafetensorsultrabertfill-maskencodermasked-language-modelinglong-contextcustom_codeendataset:mlfoundations/dclm-baseline-1.0dataset:HuggingFaceFW/fineweb-edudataset:HuggingFaceTB/stack-edu

Similar models

Models similar to UltraBERT-380M
ModelDL 30D
bacformer-large-masked-MAGmacwiatrak24.5K
bacformer-large-masked-complete-genomesmacwiatrak24.4K
polish-roberta-large-v2sdadas1,901
gte-en-mlm-largeAlibaba-NLP1,779
IgBertExscientia20.8K
IgBert_unpairedExscientia832
dmis-lab/UltraBERT-380M — Downloads, Growth & Stats | OpenModelStats