Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
You can read more about the optimizations in the original pull request
Combining Starcoder and Flash Attention 2
First, make sure to install the latest version of Flash Attention 2 to include the sliding window attention feature.