DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated May 28 • 124

Note Document detailing all parameters, settings, samplers and advanced samplers to use not only my models to their maximum potential - but all models (and quants) online (regardless of the repo) to their maximum potential. Included quick start and detailed notes, include AI / LLM apps and other critical information and references too. A must read if you are using any AI/LLM right now.

DavidAU/AI_Autocorrect__Auto-Creative-Enhancement__Auto-Low-Quant-Optimization__gguf-exl2-hqq-SOFTWARE

Text Generation • Updated May 28 • 55

Note SOFTWARE patch (by me) for Silly Tavern (front end to connect to multiple AI apps / connect to AIs- like Koboldcpp, Lmstudio, Text Gen Web UI and other APIs) to control and improve output generation of ANY AI model. Also designed to control/wrangle some of my more "creative" models and make them perform perfectly with little to no parameter/samplers adjustments too.

DavidAU/Llama-3.3-70B-Instruct-How-To-Run-on-Low-BPW-IQ1_S-IQ1_M-at-maximum-speed-quality

Updated Dec 7, 2024 • 5

Note Document detailing how to operate 70B models at low BPW / Low quant levels. Can also be applied to smaller models.

DavidAU/How-To-Set-and-Manage-MOE-Mix-of-Experts-Model-Activation-of-Experts

Text Generation • Updated May 19 • 5

Note This document covers how to adjust/set the number of experts in various AI/LLM apps, and includes links to MOE/Mixture of expert models - both GGUF and source.

DavidAU/How-To-Use-Reasoning-Thinking-Models-and-Create-Them

Text Generation • Updated Apr 4 • 8

Note Details how to use reasoning/thinking models and get maximum performance from them, and includes links to all reasoning/thinking models - GGUF and source, as well as adapters to turn any "regular" model into a "reasoning/thinking" model.

DavidAU/Gemma-3-4b-it-XQuants-HORROR-Uncensored-DBL-X-Imatrix-GGUF

Text Generation • 4B • Updated Mar 19 • 120 • 5

Note Example X-Quants (11), Generations, how to build these and test them, how to build an Imatrix dataset. This process can be used to generate X-Quants for any model, model type or model size... Qwen, Llamas, Mistrals, Gemmas, EXones, ... any model.