Spaces:
Running
on
Zero
Running
on
Zero
Sync from GitHub repo
Browse filesThis Space is synced from the GitHub repo: https://github.com/SWivid/F5-TTS. Please submit contributions to the Space there
- README_REPO.md +13 -13
README_REPO.md
CHANGED
@@ -107,6 +107,19 @@ docker container run --rm -it --gpus=all --mount 'type=volume,source=f5-tts,targ
|
|
107 |
docker container run --rm -it --gpus=all --mount 'type=volume,source=f5-tts,target=/root/.cache/huggingface/hub/' -p 7860:7860 ghcr.io/swivid/f5-tts:main f5-tts_infer-gradio --host 0.0.0.0
|
108 |
```
|
109 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
110 |
|
111 |
## Inference
|
112 |
|
@@ -179,19 +192,6 @@ f5-tts_infer-cli -c custom.toml
|
|
179 |
f5-tts_infer-cli -c src/f5_tts/infer/examples/multi/story.toml
|
180 |
```
|
181 |
|
182 |
-
### 3. Runtime
|
183 |
-
|
184 |
-
Deployment solution with Triton and TensorRT-LLM.
|
185 |
-
|
186 |
-
#### Benchmark Results
|
187 |
-
Decoding on a single L20 GPU, using 26 different prompt_audio & target_text pairs.
|
188 |
-
|
189 |
-
| Model | Concurrency | Avg Latency | RTF |
|
190 |
-
|-------|-------------|----------------|-------|
|
191 |
-
| F5-TTS Base (Vocos) | 1 | 253 ms | 0.0394|
|
192 |
-
|
193 |
-
See [detailed instructions](src/f5_tts/runtime/triton_trtllm/README.md) for more information.
|
194 |
-
|
195 |
|
196 |
## Training
|
197 |
|
|
|
107 |
docker container run --rm -it --gpus=all --mount 'type=volume,source=f5-tts,target=/root/.cache/huggingface/hub/' -p 7860:7860 ghcr.io/swivid/f5-tts:main f5-tts_infer-gradio --host 0.0.0.0
|
108 |
```
|
109 |
|
110 |
+
### Runtime
|
111 |
+
|
112 |
+
Deployment solution with Triton and TensorRT-LLM.
|
113 |
+
|
114 |
+
#### Benchmark Results
|
115 |
+
Decoding on a single L20 GPU, using 26 different prompt_audio & target_text pairs.
|
116 |
+
|
117 |
+
| Model | Concurrency | Avg Latency | RTF |
|
118 |
+
|-------|-------------|----------------|-------|
|
119 |
+
| F5-TTS Base (Vocos) | 1 | 253 ms | 0.0394|
|
120 |
+
|
121 |
+
See [detailed instructions](src/f5_tts/runtime/triton_trtllm/README.md) for more information.
|
122 |
+
|
123 |
|
124 |
## Inference
|
125 |
|
|
|
192 |
f5-tts_infer-cli -c src/f5_tts/infer/examples/multi/story.toml
|
193 |
```
|
194 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
195 |
|
196 |
## Training
|
197 |
|