distilroberta-base

distilbert/distilroberta-base

Fill Mask82.8M parameterstransformersLicense: apache-2.0
Tracked by OpenModelStats since August 24, 2026View on Hugging Face ↗
Downloads 30D
1.5M
Total downloads
135.2M
Gained 7D
Gained 30D
Likes
179
Rank · tracked models
#298
this week
Parameters
82.8M
Last source update
Feb 19, 2024

Downloads over time

Cumulative total downloads observed by OpenModelStats

Not enough tracked history yet for a chart.

OpenModelStats began tracking this model on 2026-08-24. Charts appear as daily observations accumulate.

Likes over time

Not enough tracked history yet for a chart.

OpenModelStats began tracking this model on 2026-08-24. Charts appear as daily observations accumulate.

Rank among tracked models

Lower is better

Not enough tracked history yet for a chart.

OpenModelStats began tracking this model on 2026-08-24. Charts appear as daily observations accumulate.

Overview

distilroberta-base is a fill mask model published by distilbert. OpenModelStats has tracked the model since Aug 24, 2026, most recently observing it 56 min ago.

Published
Mar 2, 2022
Last updated
Feb 19, 2024
Library
transformers
License
apache-2.0
Task
Fill Mask
Parameters
82,760,793
Spaces
Derivative models
Velocity 7D/day
transformerspytorchtfjaxrustsafetensorsrobertafill-maskexbertendataset:openwebtextarxiv:1910.01108

Model family

Based on base-model relationships reported by the source's metadata.

Derivative models

Similar models

Models similar to distilroberta-base
ModelDL 30D
distilroberta-base-climate-fclimatebert3,520
polish-spladesdadas2,933
EsperBERTo-smalljulien-c16.8K
SecBERTjackaduma63.1K
SecRoBERTajackaduma13.9K
ChemBERTa-100M-MLMDeepChem15.7K