RedHatAI
/

Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

Llama-3.2-3B-Instruct-quantized.w8a8

Commit History

Update config.json with the correct state (#1)

505dad2
verified

dsikka commited on 19 days ago

Update README.md

fb5da44
verified

alexmarques commited on Oct 16, 2024

Updated compression_config to quantization_config

59e165b
verified

mgoin commited on Oct 9, 2024

Update README.md

0f32e45
verified

alexmarques commited on Sep 26, 2024

Create README.md

518b068
verified

alexmarques commited on Sep 26, 2024

Upload folder using huggingface_hub

1c42cac
verified

alexmarques commited on Sep 25, 2024

initial commit

664ba2b
verified

alexmarques commited on Sep 25, 2024