Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
The benchmark was run on a NVIDIA A1000 for the TheBloke/Mistral-7B-v0.1-AWQ and TheBloke/Mistral-7B-v0.1-GPTQ models.