0.5B base model trained on 60B tokens rivals Qwen3.5-2B trained on 30T+ tokens

1 comments

• cobychapple 39 minutes ago
  it's 2.59B total with 553M active, so "0.5B vs 2B" more like 2.5B vs 2B? the card's own table has OLMo-2 1B (61.1) beating both.