Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
---
|
| 4 |
+
# The Need for Speed: Pruning Transformers with One Recipe
|
| 5 |
+
|
| 6 |
+
- [Paper](https://arxiv.org/abs/2403.17921v1)
|
| 7 |
+
- [GitHub](https://github.com/Skhaki18/optin-transformer-pruning)
|
| 8 |
+
- [Project Page](http://www.samirkhaki.com/optin-transformer-pruning/)
|
| 9 |
+
|
| 10 |
+
This repository contains the pre-computed parameter rankings for several language and vision models.
|
| 11 |
+
## Saved Parameter Rankings
|
| 12 |
+
The saved parameter rankings include the computed salience scores for various language and vision models using the OPTIN framework. To run the evaluation with our saved pruning framework, please download the respective model/task folder and create the expected file tree detailed on our GitHub.
|