Datasets processed from MOSS for Fine-Tuning
Matthew Khoriaty
AMindToThink
AI & ML interests
None yet
Organizations
None yet
RMU: bio forget corpora. cyber: cyber forget. both wikitext retain
https://arxiv.org/abs/2410.19278.
The code https://github.com/AMindToThink/wmdp.
-
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Text Generation • 3B • Updated • 9 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer3
Text Generation • 3B • Updated • 3 -
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Text Generation • 3B • Updated • 9 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Text Generation • 3B • Updated • 13 •
Datasets processed from MOSS for Fine-Tuning
RMU: bio forget corpora. cyber: cyber forget. both wikitext retain
https://arxiv.org/abs/2410.19278.
The code https://github.com/AMindToThink/wmdp.
-
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Text Generation • 3B • Updated • 9 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer3
Text Generation • 3B • Updated • 3 -
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Text Generation • 3B • Updated • 9 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Text Generation • 3B • Updated • 13 •
models
124
AMindToThink/folder_structure_test
Updated
AMindToThink/ppo_with_value15
Updated
AMindToThink/ppo_with_value14
Updated
AMindToThink/ppo_push_main_13
Text Generation
•
0.2B
•
Updated
•
16
AMindToThink/ppo_push_main_12
0.2B
•
Updated
•
1
AMindToThink/ppo_on_value_no_value11
0.2B
•
Updated
•
1
AMindToThink/pushed_value_model
Text Classification
•
0.1B
•
Updated
•
3
AMindToThink/value_model_0
Text Classification
•
0.1B
•
Updated
•
4
AMindToThink/ppo
Text Generation
•
0.2B
•
Updated
•
15
AMindToThink/ppo9
0.2B
•
Updated
•
1
datasets
7
AMindToThink/moss-002-sft-data-instruction-output-ascii-only
Viewer
•
Updated
•
1.75M
•
11
AMindToThink/openthoughts-as-assistant-for-sft
Viewer
•
Updated
•
114k
•
8
AMindToThink/common_bugs
Viewer
•
Updated
•
45
•
15
AMindToThink/moss-002-sft-data-instruction-output
Viewer
•
Updated
•
3.53M
•
53
•
1
AMindToThink/mmlu_wmdp_combined
Viewer
•
Updated
•
4.74k
•
9
AMindToThink/mmlu_wmdp_bio_combined
Viewer
•
Updated
•
1.43k
•
13
AMindToThink/wmdp-cyber-corpus_unpaired-preference
Viewer
•
Updated
•
5.47k
•
18