Llama-SARM-4B

Schrieffer/Llama-SARM-4B

Reinforcement Learning4.6B parameterstransformersLicense: llama3.1
Tracked by OpenModelStats since August 24, 2026View on Hugging Face ↗
Downloads 30D
19
Total downloads
679
Gained 7D
+7(increase)
Gained 30D
—
Likes
2
+0 in 7D
Rank · tracked models
—
–this week
Parameters
4.6B
Last source update
Dec 11, 2025
  • Llama-SARM-4B gained 7 downloads during the last seven tracked days.

Downloads over time

Rolling recent-window downloads as reported

Likes over time

Rank among tracked models

Lower is better

Not enough tracked history yet for a chart.

OpenModelStats began tracking this model on 2026-08-24. Charts appear as daily observations accumulate.

Overview

Llama-SARM-4B is a reinforcement learning model published by Schrieffer. OpenModelStats has tracked the model since Aug 24, 2026, most recently observing it Sep 11, 2026.

Published
Aug 26, 2025
Last updated
Dec 11, 2025
Library
transformers
License
llama3.1
Task
Reinforcement Learning
Parameters
4,552,142,848
Spaces
1
Derivative models
—
Velocity 7D/day
1
transformerssafetensorsllamatext-classificationreward-modelrlhfsparse-autoencoderinterpretabilityreinforcement-learningcustom_codearxiv:2508.08746base_model:meta-llama/Llama-3.1-8B-Instruct

Model family

Based on base-model relationships reported by the source's metadata.

Similar models

Models similar to Llama-SARM-4B
ModelDL 30D
beaver-7b-v1.0-costPKU-Alignment4,668
beaver-7b-v1.0-rewardPKU-Alignment3,754
inf-retriever-v1-proinfly2,928
Open-Reasoner-Zero-7BOpen-Reasoner-Zero1,917
a3-rl-laion_nemotron-gym-agent-calendar-80-8Blaion5,195
MetaAgent-XMercury73532,957