Attn-Only-2L512W-Shortformer-6B-big-lr
NeelNanda/Attn-Only-2L512W-Shortformer-6B-big-lr
transformers
Tracked by OpenModelStats since August 28, 2026View on Hugging Face ↗
- Downloads 30DRolling recent-window download count as reported by the source platform.
- 1,121
- Total downloadsCumulative all-time download counter reported by the source platform.
- 28.3K
- Gained 7DIncrease in cumulative total downloads between OpenModelStats' own observations seven days apart.
- +258(increase)
- 0.9%(up) vs baseline
- Gained 30DIncrease in cumulative total downloads between OpenModelStats' own observations roughly thirty days apart.
- —
- LikesCommunity likes reported by the source platform.
- 0
- +0 in 7D
- Rank · tracked modelsPosition among all eligible models tracked by OpenModelStats, ordered by recent downloads.
- #30,332
- 155(up 155 places)this week
- Parameters
- —
- Last source update
- Oct 29, 2022
- MomentumOpenModelStats' composite rising-model signal (0–100): a percentile blend of absolute 7-day download gains, capped percentage growth, and likes gained. See Methodology.
- 41.2
- Attn-Only-2L512W-Shortformer-6B-big-lr gained 258 downloads during the last seven tracked days.
Downloads over time
Daily gain between consecutive observationsLikes over time
Rank among tracked models
Lower is betterOverview
Attn-Only-2L512W-Shortformer-6B-big-lr is an AI model published by NeelNanda. OpenModelStats has tracked the model since Aug 28, 2026, most recently observing it Sep 26, 2026.
- Published
- Oct 19, 2022
- Last updated
- Oct 29, 2022
- Library
- transformers
- License
- —
- Task
- —
- Parameters
- —
- Spaces
- 0
- Derivative models
- —
- Velocity 7D/day
- 37
transformersendpoints_compatibleregion:us
Publisher
NeelNandaView publisher statistics →Similar models
| Model | DL 30D |
|---|---|
| all-MiniLM-L6-v2sentence-transformers | 244M |
| ms-marco-MiniLM-L6-v2cross-encoder | 86.7M |
| bge-small-en-v1.5BAAI | 63.2M |
| electra-base-discriminatorgoogle | 46.3M |
| paraphrase-multilingual-MiniLM-L12-v2sentence-transformers | 45.2M |
| bert-base-uncasedgoogle-bert | 42.7M |