Models

pytorch/SmolLM3-3B-8da4w

Text Generation • Updated 4 days ago • 125 • 25

mobiuslabsgmbh/Llama-3.1-8B-Instruct_gemlite-ao_a16w4_gs_128_pack_32bit

Text Generation • Updated Jun 3 • 34 • 2

jerryzh168/llama3-int4wo-128

Updated Sep 13, 2024 • 3

medmekk/Meta-Llama-3-8B-quantized-int8_weight_only

Updated Oct 8, 2024 • 6

medmekk/Meta-Llama-3-8B-quantized-int8_dynamic_activation_int8_weight

Updated Oct 8, 2024 • 4

medmekk/Meta-Llama-3-8B-quantized-int4_weight_only

Updated Oct 8, 2024 • 5

medmekk/Meta-Llama-3-8B-quantized-int8_weight_only-2

Updated Oct 8, 2024 • 5

medmekk/Meta-Llama-3-8B-quantized-int4_weight_only-2

Updated Oct 8, 2024 • 5

medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs-64

Updated Oct 8, 2024 • 4

medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs-32

Updated Oct 8, 2024 • 4

medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs_256

Updated Oct 8, 2024 • 4

medmekk/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Oct 9, 2024 • 5

medmekk/Meta-Llama-3-8B-torchao-int8_dynamic_activation_int8_weight

Updated Oct 8, 2024 • 4

medmekk/gpt2-torchao-int8_weight_only

Updated Oct 8, 2024 • 4

medmekk/Llama-3.1-70B-torchao-int8_weight_only

Updated Oct 8, 2024 • 4

medmekk/new_model

Updated Oct 17, 2024 • 5

medmekk/qsdf

Updated Oct 18, 2024 • 4

medmekk/new_gpt2

Updated Oct 18, 2024 • 4

medmekk/an_other_torchao

Updated Oct 18, 2024 • 5

medmekk/an_other_torchao_dynamic

Updated Oct 18, 2024 • 4

marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Oct 18, 2024 • 7

medmekk/new_tesing_model

Updated Oct 22, 2024 • 2

medmekk/testing_int4

Updated Oct 22, 2024 • 3

medmekk/quantized_int8_2

Updated Oct 22, 2024 • 3

medmekk/quantized_int4

Updated Oct 22, 2024 • 3

medmekk/quantized_70B

Updated Oct 22, 2024 • 3

medmekk/Meta-Llama-3-8B-torchao-int4_weight_only-gs_128

Updated Oct 22, 2024 • 4

medmekk/custom_name

Updated Oct 22, 2024 • 2

medmekk/custom_name_1

Updated Oct 22, 2024 • 2

medmekk/deepseek-coder-1.3b-base-torchao-int8_weight_only

Updated Oct 22, 2024 • 3