nm-testing
/

llama3-8b-w8_channel-a8_tensor-compressed

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions

llama3-8b-w8_channel-a8_tensor-compressed

Commit History

Updated compression_config to quantization_config

a6678d2
verified

mgoin commited on Oct 9, 2024

Upload folder using huggingface_hub

dc6365d
verified

sadkins65 commited on Jun 7, 2024

Upload folder using huggingface_hub

54347c9
verified

sadkins65 commited on May 30, 2024

initial commit

18b8375
verified

sadkins65 commited on May 30, 2024