Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
This section explores some of the specific features of 4-bit models, such as changing the compute data type, using the Normal Float 4 (NF4) data type, and using nested quantization.