Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
4-bit
Try 4-bit quantization in this notebook and learn more about it's details in this blog post.