distilroberta-base

distilbert/distilroberta-base

Fill Mask82.8M parameterstransformersLicense: apache-2.0
Tracked by OpenModelStats since August 24, 2026View on Hugging Face ↗
Downloads 30D
1.5M
Total downloads
137.2M
Gained 7D
+343.2K(increase)
0.3%(up) vs baseline
Gained 30D
—
Likes
182
+2 in 7D
Rank · tracked models
#262
1(down 1 places)this week
Parameters
82.8M
Last source update
Feb 19, 2024
Momentum
83.1
  • distilroberta-base gained 343.2K downloads during the last seven tracked days.
  • It moved from #15 to #16 among tracked Fill Mask models this week.

Downloads over time

Cumulative total downloads observed by OpenModelStats

Likes over time

Rank among tracked models

Lower is better

Overview

distilroberta-base is a fill mask model published by distilbert. OpenModelStats has tracked the model since Aug 24, 2026, most recently observing it Oct 4, 2026.

Published
Mar 2, 2022
Last updated
Feb 19, 2024
Library
transformers
License
apache-2.0
Task
Fill Mask
Parameters
82,760,793
Spaces
—
Derivative models
3
Velocity 7D/day
49K
transformerspytorchtfjaxrustsafetensorsrobertafill-maskexbertendataset:openwebtextarxiv:1910.01108

Model family

Based on base-model relationships reported by the source's metadata.

Similar models

Models similar to distilroberta-base
ModelDL 30D
distilroberta-base-climate-fclimatebert2,926
polish-spladesdadas2,017
EsperBERTo-smalljulien-c13.1K
SecBERTjackaduma395.7K
SecRoBERTajackaduma12.5K
VHHBERTCOGNANO3,643
distilbert/distilroberta-base — Downloads, Growth & Stats | OpenModelStats