Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
raw
history blame contribute delete
139 Bytes
To enable sliding window attention, just make sure to have a flash-attn version that is compatible with sliding window attention (>=2.3.0).