transformer-pretraining-from-scratch
hari-8/transformer-pretraining-from-scratch
Tracked by OpenModelStats since September 29, 2026View on Hugging Face ↗
- Downloads 30DRolling recent-window download count as reported by the source platform.
- 647
- Total downloadsCumulative all-time download counter reported by the source platform.
- 647
- Gained 7DIncrease in cumulative total downloads between OpenModelStats' own observations seven days apart.
- 0
- Gained 30DIncrease in cumulative total downloads between OpenModelStats' own observations roughly thirty days apart.
- —
- LikesCommunity likes reported by the source platform.
- 1
- +0 in 7D
- Rank · tracked modelsPosition among all eligible models tracked by OpenModelStats, ordered by recent downloads. #10623 among tracked Text Generation models.
- #38,457
- 203(down 203 places)this week
- Parameters
- 69.3M
- Last source update
- Sep 3, 2026
- MomentumOpenModelStats' composite rising-model signal (0–100): a percentile blend of absolute 7-day download gains, capped percentage growth, and likes gained. See Methodology.
- 4.4
- It moved from #10564 to #10623 among tracked Text Generation models this week.
Downloads over time
Cumulative total downloads observed by OpenModelStatsLikes over time
Rank among tracked models
Lower is betterOverview
transformer-pretraining-from-scratch is a text generation model published by hari-8. OpenModelStats has tracked the model since Sep 29, 2026, most recently observing it Sep 5, 2026.
- Published
- Sep 3, 2026
- Last updated
- Sep 3, 2026
- Library
- transformers
- License
- mit
- Task
- Text Generation
- Parameters
- 69,284,608
- Spaces
- —
- Derivative models
- —
- Velocity 7D/day
- 0
transformerssafetensorsdecoder_transformer_scratchtext-generationdecoder-onlyfrom-scratchpytorchcausal-lmcustom_codeenlicense:mitregion:us
Publisher
hari-8View publisher statistics →Similar models
| Model | DL 30D |
|---|---|
| SmolLM2-70Mcodelion | 510 |
| DiscoverLM-70Mreaperdoesntknow | 2,895 |
| chesspythia-70mmlabonne | 1,632 |
| xslmAlienstro | 424 |
| chess_llama_68mbharathrajcl | 3,114 |
| vicuna-68mdouble7 | 4,494 |