Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
pip install -U flash-attn --no-build-isolation
Also make sure that your hardware is compatible with Flash-Attention 2.