Fused Ion 's picture

Fused Ion

fusedion
Ā·

AI & ML interests

None yet

Recent Activity

Organizations

None yet

fusedion's activity

reacted to schuler's post with šŸ‘šŸ”„ 2 months ago
view post
Post
7237
šŸ“¢ New Research Alert: Making Language Models Smaller & Smarter!

Thrilled to share the latest technical report demonstrating how to reduce language model parameters by 77% while maintaining performance.

The secret? Grouped pointwise convolutions. Yes. We brought a method from computer vision to the transformers arena.

šŸ”‘ Key Findings:
• 77% parameter reduction.
• Maintained model capabilities.
• Improved generalization.

Paper: https://www.researchgate.net/publication/388835829_SAVING_77_OF_THE_PARAMETERS_IN_LARGE_LANGUAGE_MODELS_TECHNICAL_REPORT
Code: https://github.com/joaopauloschuler/less-parameters-llm
  • 2 replies
Ā·
replied to takeraparterer's post 3 months ago