s1.1-1.5B-20k-bf16 / README.md
lbourdois's picture
Improve language tag
0edd215 verified
|
raw
history blame
1.16 kB
metadata
pipeline_tag: text-generation
inference: true
license: apache-2.0
datasets:
  - simplescaling/s1K-1.1
base_model:
  - Qwen/Qwen2.5-1.5B-Instruct
library_name: transformers
language:
  - zho
  - eng
  - fra
  - spa
  - por
  - deu
  - ita
  - rus
  - jpn
  - kor
  - vie
  - tha
  - ara

Model Summary

s1.1 is our sucessor of s1 with better reasoning performance by leveraging reasoning traces from r1 instead of Gemini.

This model is a successor of s1-32B with slightly better performance. Thanks to Bespoke Labs (Ryan Marten) for helping generate r1 traces for s1K with Curator.

Use

The model usage is documented here.


Model is trained with block_size 20000