distilroberta-base

distilbert/distilroberta-base

Fill Mask82.8M parameterstransformersLicense: apache-2.0
Tracked by OpenModelStats since September 5, 2026View on Hugging Face ↗
Downloads 30D
1.5M
Total downloads
137.3M
Gained 7D
+343.2K(increase)
0.3%(up) vs baseline
Gained 30D
—
Likes
182
+2 in 7D
Rank · tracked models
#265
3(down 3 places)this week
Parameters
82.8M
Last source update
Feb 19, 2024
Momentum
83.1
  • distilroberta-base gained 343.2K downloads during the last seven tracked days.

Downloads over time

Daily gain between consecutive observations

Likes over time

Rank among tracked models

Lower is better

Overview

distilroberta-base is a fill mask model published by distilbert. OpenModelStats has tracked the model since Sep 5, 2026, most recently observing it Oct 5, 2026.

Published
Mar 2, 2022
Last updated
Feb 19, 2024
Library
transformers
License
apache-2.0
Task
Fill Mask
Parameters
82,760,793
Spaces
100
Derivative models
3
Velocity 7D/day
49K
transformerspytorchtfjaxrustsafetensorsrobertafill-maskexbertendataset:openwebtextarxiv:1910.01108

Model family

Based on base-model relationships reported by the source's metadata.

Similar models

Models similar to distilroberta-base
ModelDL 30D
distilroberta-base-climate-fclimatebert2,877
polish-spladesdadas1,939
EsperBERTo-smalljulien-c12.9K
SecBERTjackaduma410.4K
SecRoBERTajackaduma12.6K
VHHBERTCOGNANO3,643
distilbert/distilroberta-base — Downloads, Growth & Stats | OpenModelStats