Fault in Demo space
#16
by
Jared-The-Developer
- opened
Demo space is failing with error:
Failed to generate text: FlashAttention2 has been toggled on, but it cannot be used due to the following error: Flash Attention 2 is not available on CPU. Please make sure torch can access a CUDA device.
The demo is alive now.
teowu
changed discussion status to
closed