Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
pip install -U flash-attn --no-build-isolation
Make also sure that you have a hardware that is compatible with Flash-Attention 2.