mrfakename commited on
Commit
0b61e94
·
verified ·
1 Parent(s): ddb72ca

Sync from GitHub repo

Browse files

This Space is synced from the GitHub repo: https://github.com/SWivid/F5-TTS. Please submit contributions to the Space there

Files changed (1) hide show
  1. README_REPO.md +13 -13
README_REPO.md CHANGED
@@ -107,6 +107,19 @@ docker container run --rm -it --gpus=all --mount 'type=volume,source=f5-tts,targ
107
  docker container run --rm -it --gpus=all --mount 'type=volume,source=f5-tts,target=/root/.cache/huggingface/hub/' -p 7860:7860 ghcr.io/swivid/f5-tts:main f5-tts_infer-gradio --host 0.0.0.0
108
  ```
109
 
 
 
 
 
 
 
 
 
 
 
 
 
 
110
 
111
  ## Inference
112
 
@@ -179,19 +192,6 @@ f5-tts_infer-cli -c custom.toml
179
  f5-tts_infer-cli -c src/f5_tts/infer/examples/multi/story.toml
180
  ```
181
 
182
- ### 3. Runtime
183
-
184
- Deployment solution with Triton and TensorRT-LLM.
185
-
186
- #### Benchmark Results
187
- Decoding on a single L20 GPU, using 26 different prompt_audio & target_text pairs.
188
-
189
- | Model | Concurrency | Avg Latency | RTF |
190
- |-------|-------------|----------------|-------|
191
- | F5-TTS Base (Vocos) | 1 | 253 ms | 0.0394|
192
-
193
- See [detailed instructions](src/f5_tts/runtime/triton_trtllm/README.md) for more information.
194
-
195
 
196
  ## Training
197
 
 
107
  docker container run --rm -it --gpus=all --mount 'type=volume,source=f5-tts,target=/root/.cache/huggingface/hub/' -p 7860:7860 ghcr.io/swivid/f5-tts:main f5-tts_infer-gradio --host 0.0.0.0
108
  ```
109
 
110
+ ### Runtime
111
+
112
+ Deployment solution with Triton and TensorRT-LLM.
113
+
114
+ #### Benchmark Results
115
+ Decoding on a single L20 GPU, using 26 different prompt_audio & target_text pairs.
116
+
117
+ | Model | Concurrency | Avg Latency | RTF |
118
+ |-------|-------------|----------------|-------|
119
+ | F5-TTS Base (Vocos) | 1 | 253 ms | 0.0394|
120
+
121
+ See [detailed instructions](src/f5_tts/runtime/triton_trtllm/README.md) for more information.
122
+
123
 
124
  ## Inference
125
 
 
192
  f5-tts_infer-cli -c src/f5_tts/infer/examples/multi/story.toml
193
  ```
194
 
 
 
 
 
 
 
 
 
 
 
 
 
 
195
 
196
  ## Training
197