hanzla/Qwen2-0.5B-GRPO-summary_test_v4
Updated
hanzlajavaid
hanzla
AI & ML interests
Direct Preference Optimization, Supervised Finetuning, Stable Diffusion
Recent Activity
updated
a model
about 12 hours ago
hanzla/Qwen2-0.5B-GRPO-summary_test_v4
updated
a model
about 14 hours ago
hanzla/Qwen2-0.5B-GRPO-summary_test_v3
published
a model
about 16 hours ago
hanzla/Qwen2-0.5B-GRPO-summary_test_v4
Organizations
hanzla's activity
updated
a
model
about 12 hours ago
updated
a
model
about 14 hours ago
published
2
models
about 16 hours ago
updated
2
models
2 days ago
published
a
model
3 days ago
updated
a
model
4 days ago
published
2
models
4 days ago
liked
a
model
5 days ago
published
a
Space
16 days ago
updated
a
Space
16 days ago
Ollama support
1
#1 opened 23 days ago
by
ayan4m1
liked
a
model
25 days ago
posted
an
update
27 days ago
Post
1994
Hi community,
Few days back, I posted about my ongoing research on making reasoning mamba models and I found great insights from the community.
Today, I am announcing an update to the model weights. With newer checkpoints, the Falcon3 Mamba R1 model now outperforms very large transformer based LLMs (including Gemini) for Formal Logic questions of MMLU. It scores 60% on formal logic which is considered a tough subset of questions in MMLU.
I would highly appreciate your insights and suggestions on this new checkpoint.
Model Repo: hanzla/Falcon3-Mamba-R1-v0
Chat space: hanzla/Falcon3MambaReasoner
Few days back, I posted about my ongoing research on making reasoning mamba models and I found great insights from the community.
Today, I am announcing an update to the model weights. With newer checkpoints, the Falcon3 Mamba R1 model now outperforms very large transformer based LLMs (including Gemini) for Formal Logic questions of MMLU. It scores 60% on formal logic which is considered a tough subset of questions in MMLU.
I would highly appreciate your insights and suggestions on this new checkpoint.
Model Repo: hanzla/Falcon3-Mamba-R1-v0
Chat space: hanzla/Falcon3MambaReasoner
liked
a
model
28 days ago
updated
2
Spaces
28 days ago
updated
a
model
28 days ago