Note:

This repo hosts only a Q5_K_S of lynn-A2.7B-rp-v1. GGUF quant is from mradermacher/lynn-A2.7B-rp-v1-GGUF. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpp_hf.

Downloads last month: 16

GGUF

Model size

14.3B params

Architecture

qwen2moe

Hardware compatibility

5-bit

Model tree for Clevyby/lynn-A2.7B-rp-v1-14.3b-32k-Q5_K_S-GGUF

Base model

elyn-dev/lynn-A2.7B-rp-v1

Quantized

(2)

this model