Attn_Only_1L512W_C4_Code

NeelNanda/Attn_Only_1L512W_C4_Code

transformers
Tracked by OpenModelStats since August 28, 2026View on Hugging Face ↗
Downloads 30D
3,462
Total downloads
66.2K
Gained 7D
+543(increase)
0.8%(up) vs baseline
Gained 30D
—
Likes
4
+0 in 7D
Rank · tracked models
#14,567
77(up 77 places)this week
Parameters
—
Last source update
Oct 26, 2022
Momentum
47.8
  • Attn_Only_1L512W_C4_Code gained 543 downloads during the last seven tracked days.

Downloads over time

Daily gain between consecutive observations

Likes over time

Rank among tracked models

Lower is better

Overview

Attn_Only_1L512W_C4_Code is an AI model published by NeelNanda. OpenModelStats has tracked the model since Aug 28, 2026, most recently observing it Sep 27, 2026.

Published
Oct 26, 2022
Last updated
Oct 26, 2022
Library
transformers
License
—
Task
—
Parameters
—
Spaces
—
Derivative models
—
Velocity 7D/day
78
transformersendpoints_compatibleregion:us

Similar models

Models similar to Attn_Only_1L512W_C4_Code
ModelDL 30D
all-MiniLM-L6-v2sentence-transformers244M
ms-marco-MiniLM-L6-v2cross-encoder86.7M
bge-small-en-v1.5BAAI63.2M
electra-base-discriminatorgoogle46.3M
paraphrase-multilingual-MiniLM-L12-v2sentence-transformers45.2M
bert-base-uncasedgoogle-bert42.7M
NeelNanda/Attn_Only_1L512W_C4_Code — Downloads, Growth & Stats | OpenModelStats