LumiOpenPoro 2 Long

Poro 2 8B Long Math Reasoning RL Preview

This preview adds reinforcement learning to the Poro 2 Long mathematical SFT checkpoint. It trains mathematical reasoning in Finnish and English through separate language-specific environments.

Preview

Model design and training

The release follows mathematical SFT and reports 900 reinforcement-learning steps. It uses separate Finnish and English problem environments to retain bilingual reasoning. The card still limits its intended scope to mathematics and labels it a preview. Its lineage runs through Poro 2 Long to Llama 3.1 8B.Llama-Poro-2-8B-Long-Math-Reasoning-RL-Preview: official model card

Practical assessment

Practical guidance. Assess mathematical correctness separately from the language and length of the explanation. Compare the RL checkpoint with SFT on the same unseen Finnish problems. A persuasive chain of reasoning can still contain an incorrect intermediate result.

Specifications & access

Poro 2 8B Long Math Reasoning RL Preview specifications
DetailValue and conditions
StatusPreview
AccessDownloadable
Model identifiersLlama-Poro-2-8B-Long-Math-Reasoning-RL-Preview
Context window131,072 tokens

Sequence length reported by this release's model card; this is not a guaranteed useful retrieval length.

Llama-Poro-2-8B-Long-Math-Reasoning-RL-Preview: official model card
Model size8.03 billion parameters.Llama-Poro-2-8B-Long-Math-Reasoning-RL-Preview: official model card
LicenseLlama 3.1 Community License.Llama-Poro-2-8B-Long-Math-Reasoning-RL-Preview: official model card

Related models