Models

medmekk/Llama-3.1-70B-torchao-int8_weight_only

Updated Oct 8, 2024 • 3

mav23/OpenMath2-Llama3.1-70B-GGUF

71B • Updated Oct 27, 2024 • 212

mav23/Hermes-3-Llama-3.1-70B-GGUF

71B • Updated Nov 4, 2024 • 194

osllmai-community/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • 37B • Updated Jan 24 • 336

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • 11B • Updated Dec 6, 2024 • 30.9k • 35

MikeRoz/meta-llama_Llama-3.3-70B-Instruct-4.25bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 22 • 1

matatonic/Llama-3.3-70B-Instruct-6.5bpw-h8-exl2.2.3

Text Generation • Updated Dec 6, 2024 • 6

LoneStriker/Llama-3.3-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 13 • 1

LoneStriker/Llama-3.3-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 9 • 2

LoneStriker/Llama-3.3-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 8 • 1

LoneStriker/Llama-3.3-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 13 • 3

LoneStriker/Llama-3.3-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 6 • 3

LoneStriker/Llama-3.3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2024 • 9 • 2

MikeRoz/meta-llama_Llama-3.3-70B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Dec 7, 2024 • 22 • 1

LoneStriker/Llama-3.3-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Dec 7, 2024 • 10 • 1

osllmai-community/Llama-3.3-70B-Instruct-GGUF

71B • Updated Jan 24 • 13

ThomasBaruzier/Llama-3.3-70B-Instruct-GGUF

71B • Updated Feb 22 • 316 • 2

Infermatic/Llama-3.3-70B-Instruct-FP8-Dynamic

Text Generation • 71B • Updated Dec 9, 2024 • 4.19k • 2

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_S-GGUF

Text Generation • 71B • Updated Jan 15 • 6

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 15 • 16

roleplaiapp/Llama-3.3-70B-Instruct-Q2_K-GGUF

Text Generation • 71B • Updated Jan 15 • 9

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 15 • 9

roleplaiapp/Llama-3.3-70B-Instruct-Q4_0-GGUF

Text Generation • 71B • Updated Jan 15 • 52 • 2

roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 15 • 3

roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_M-GGUF

Text Generation • 71B • Updated Jan 15 • 86 • 2

roleplaiapp/Llama-3.3-70B-Instruct-Q5_0-GGUF

Text Generation • 71B • Updated Jan 16 • 5

roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_S-GGUF

Text Generation • 71B • Updated Jan 16 • 9

roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_M-GGUF

Text Generation • 71B • Updated Jan 16 • 47

roleplaiapp/Llama-3.3-70B-Instruct-Q6_K-GGUF

Text Generation • 71B • Updated Jan 16 • 24

roleplaiapp/Llama-3.3-70B-Instruct-Q8_0-GGUF

Text Generation • 71B • Updated Jan 16 • 15