Hugging Face's logo

IntelLabs
/
Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM

PyTorch
Safetensors
English
Model card Files Community
1
jinjieyuan commited on
Commit
f8b7eab
·
verified ·
1 Parent(s): c0b0bd6

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: apache-2.0
4
+ ---
5
+
6
+ # Mamba-Shedder Model: mamba-shedder-mamba2-2.7b-ssm22
7
+
8
+ | Source Model | Components Removed | Recovery Tuning | WikiText PPL | Avg. Score | Relative Acc. |
9
+ |--------------------------------------------------------------------|-----------------------------------------|-----------------|---------------|------|------|
10
+ | [mamba2-2.7b](https://huggingface.co/state-spaces/mamba2-2.7b) | - | - | 4.10 | 60.2 | 100% |
11
+ | [mamba-shedder-mamba2-2.7b-ssm22](https://huggingface.co/IntelLabs/mamba-shedder-mamba2-2.7b-ssm22) | 22 SSDs | ✘ | 6.50 | 57.8 | 96% |