Post
563
Mariusz Kurman PRO
mkurman
AI & ML interests
AI Tech Lead | MD
Recent Activity
liked
a dataset
5 days ago
FreedomIntelligence/medical-o1-reasoning-SFT
liked
a dataset
5 days ago
ThinkAgents/Function-Calling-with-Chain-of-Thoughts
liked
a dataset
25 days ago
MaziyarPanahi/Llama-Nemotron-Post-Training-Dataset-v1-ShareGPT
Organizations
Posts
17
Post
858
Just released NVAMP Loss!
āļø modification of the cross-entropy loss function designed specifically for training LLMs.
āļø twist on the standard cross-entropy loss by emphasizing the importance of outlier prediction errors and dynamically normalizing token-level variance.
āļø more stable and efficient training, leading to models that generalize better.
Check it out, give it a spin, and let me know what you think!
Licensed under the Apache 2.0 license and ready to use. Happy training! š„š¤
https://github.com/mkurman/nvamp-loss
āļø modification of the cross-entropy loss function designed specifically for training LLMs.
āļø twist on the standard cross-entropy loss by emphasizing the importance of outlier prediction errors and dynamically normalizing token-level variance.
āļø more stable and efficient training, leading to models that generalize better.
Check it out, give it a spin, and let me know what you think!
Licensed under the Apache 2.0 license and ready to use. Happy training! š„š¤
https://github.com/mkurman/nvamp-loss
spaces
1
models
6
mkurman/llama-3.2-MEDIT-3B-o1-GRPO-LLM-Eval
Text Generation
ā¢
Updated
ā¢
3
mkurman/Llama-3.2-MedIT-3B-R1
Updated
ā¢
81
ā¢
1
mkurman/Llama-3.2-MedIT-SUN-2.5B-BT-GRPO
Updated
ā¢
47
ā¢
3
mkurman/Qwen2.5-14B-DeepSeek-R1-1M
Text Generation
ā¢
Updated
ā¢
410
ā¢
51
mkurman/phi4-MedIT-10B-o1
Text Generation
ā¢
Updated
ā¢
44
ā¢
4
mkurman/llama-3.2-MEDIT-3B-o1
Text Generation
ā¢
Updated
ā¢
60
ā¢
12