Foundation Text-Generation Models Below 360M Parameters - a Felladrin Collection

Felladrin 's Collections

Frequently Used Spaces

Trained Models 🏋️

Foundation Text-Generation Models Below 360M Parameters

Foundation Text-Generation Models Below 360M Parameters

updated 19 days ago

Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.

HuggingFaceTB/SmolLM2-360M

Text Generation • Updated Feb 6 • 107k • 45

Note License: apache-2.0 Context Length: 8k
PleIAs/Pleias-350m-Preview

Updated Feb 14 • 364 • 20

Note License: apache-2.0 Context Length: 2k
OuteAI/Lite-Oute-1-300M

Text Generation • Updated Aug 24, 2024 • 110 • 7

Note License: apache-2.0 Context Length: 4k
keeeeenw/MicroLlama

Text Generation • Updated Oct 10, 2024 • 3.15k • 46

Note License: apache-2.0 Context Length: 2k
cerebras/Cerebras-GPT-256M

Text Generation • Updated Nov 22, 2023 • 360 • 25

Note License: apache-2.0 Context Length: 2k
UUFO-Aigis/Pico-OpenLAiNN-250M

Updated Feb 24 • 10 • 3

Note License: apache-2.0 Context Length: 2k
upstage/TinySolar-248m-4k

Text Generation • Updated Feb 7, 2024 • 322 • 7

Note License: apache-2.0 Context Length: 4k
M4-ai/TinyMistral-248M-v3

Text Generation • Updated Oct 20, 2024 • 181 • 8

Note License: apache-2.0 Context Length: 2k
MiniLLM/MiniPLM-llama3.1-212M

Text Generation • Updated Mar 25 • 179 • • 4

Note License: apache-2.0 Context Length: 1k
MiniLLM/MiniPLM-Qwen-200M

Text Generation • Updated Oct 27, 2024 • 292 • 4

Note License: apache-2.0 Context Length: 1k
princeton-nlp/Sheared-Pythia-160m

Text Generation • Updated Dec 4, 2023 • 15 • 4

Note License: apache-2.0 Context Length: 2k
JackFram/llama-160m

Text Generation • Updated Jan 4, 2024 • 286k • 34

Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-160M

Text Generation • Updated Mar 25 • 3.44k • 5

Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-160m

Text Generation • Updated Jul 9, 2023 • 168k • 31

Note License: apache-2.0 Context Length: 2k
openai-community/gpt2

Text Generation • Updated Feb 19, 2024 • 12.7M • • 2.69k

Note License: mit Context Length: 1k
HuggingFaceTB/SmolLM2-135M

Text Generation • Updated Feb 6 • 570k • 84

Note License: apache-2.0 Context Length: 8k
amd/AMD-Llama-135m

Text Generation • Updated Oct 9, 2024 • 13.5k • 112

Note License: apache-2.0 Context Length: 2k
MiniLLM/MiniPLM-Mamba-130M

Text Generation • Updated Mar 25 • 8 • 3

Note License: apache-2.0 Context Length: 1k
EleutherAI/gpt-neo-125m

Text Generation • Updated Jan 31, 2024 • 148k • 204

Note License: mit Context Length: 2k
cerebras/Cerebras-GPT-111M

Text Generation • Updated Nov 22, 2023 • 4.76k • 76

Note License: apache-2.0 Context Length: 2k
BEE-spoke-data/smol_llama-101M-GQA

Text Generation • Updated Dec 25, 2023 • 1.18k • 28

Note License: apache-2.0 Context Length: 1k
UUFO-Aigis/Pico-OpenLAiNN-100M

Updated Feb 24 • 33 • 1

Note License: apache-2.0 Context Length: 2k
Felladrin/Qwen2-96M

Text Generation • Updated Mar 15 • 1.25k • 2

Note License: apache-2.0 Context Length: 8k
Felladrin/Minueza-2-96M

Text Generation • Updated 21 days ago • 588 • 6

Note License: apache-2.0 Context Length: 4k
distilbert/distilgpt2

Text Generation • Updated Feb 19, 2024 • 2.69M • 524

Note License: apache-2.0 Context Length: 1k
weiser/82M-0.4

Text Generation • Updated Nov 12, 2024 • 3 • 1

Note License: apache-2.0 Context Length: 1k
BEE-spoke-data/smol_llama-81M-tied

Text Generation • Updated Nov 20, 2023 • 240 • 6

Note License: apache-2.0 Context Length: 1k
EleutherAI/pythia-70m

Updated Nov 21, 2023 • 141k • 66

Note License: apache-2.0 Context Length: 2k
JackFram/llama-68m

Text Generation • Updated May 23, 2024 • 588k • 27

Note License: apache-2.0 Context Length: 2k
OuteAI/Lite-Oute-1-65M

Text Generation • Updated Aug 25, 2024 • 145 • 9

Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-60M

Text Generation • Updated Mar 25 • 2.68k • 4

Note License: apache-2.0 Context Length: 2k
Felladrin/Minueza-32M-Base

Text Generation • Updated 20 days ago • 72 • 18

Note License: apache-2.0 Context Length: 2k
GerbilLab/Gerbil-A-32m

Text Generation • Updated Mar 30, 2023 • 36 • 2

Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-31m

Text Generation • Updated Jul 26, 2023 • 80.5k • 5

Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-20M

Text Generation • Updated 11 days ago • 2.37k • 8

Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-14m

Text Generation • Updated Jul 26, 2023 • 236k • 23

Note License: apache-2.0 Context Length: 2k