File size: 2,163 Bytes
e5a0238
 
d40ac77
 
e5a0238
 
d40ac77
 
 
 
e5a0238
d40ac77
e5a0238
1c174a2
 
58fed0b
e594abd
d40ac77
58fed0b
 
e2bef41
97bfe3d
 
 
 
b38ee2e
 
600d238
97bfe3d
 
 
 
 
e594abd
 
f1b31a5
 
 
 
600d238
6e5f502
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
---
base_model:
- Wan-AI/Wan2.1-VACE-14B
- vrgamedevgirl84/Wan14BT2VFusioniX
base_model_relation: merge
tags:
- text-to-video
- image-to-video
- video-to-video
- merge
language:
- en
license: apache-2.0
---

This is a merge of [Wan-AI/Wan2.1-VACE-14B](https://huggingface.co/Wan-AI/Wan2.1-VACE-14B) scopes and [vrgamedevgirl84/Wan14BT2VFusionX](https://huggingface.co/vrgamedevgirl84/Wan14BT2VFusioniX). 

The process involved extracting VACE scopes and injecting into the target models. 

- FP8 model weight was then converted to specific FP8 formats (E4M3FN and E5M2) using ComfyUI custom node [ComfyUI-ModelQuantizer](https://github.com/lum3on/ComfyUI-ModelQuantizer) by [lum3on](https://github.com/lum3on). 

## Usage

The model files can be used in [ComfyUI](https://github.com/comfyanonymous/ComfyUI/) with the WanVaceToVideo node. Place the required model(s) in the following folders:

| Type         | Name                          | Location                          | Download                |
| ------------ | ----------------------------- | --------------------------------- | ----------------------- |
| Main Model   | Wan2.1_T2V_14B_FusionX_VACE   | `ComfyUI/models/diffusion_models` | Safetensors (this repo) |
| Text Encoder | umt5-xxl-encoder              | `ComfyUI/models/text_encoders`    | [Safetensors](https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/text_encoders) / [GGUF](https://huggingface.co/city96/umt5-xxl-encoder-gguf/tree/main) |
| VAE          | Wan2_1_VAE_bf16               | `ComfyUI/models/vae`              | [Safetensors](https://huggingface.co/Kijai/WanVideo_comfy/blob/main/Wan2_1_VAE_bf16.safetensors) |

[**ComfyUI example workflow**](https://docs.comfy.org/tutorials/video/wan/vace)

### Notes

*All original licenses and restrictions from the base models still apply.*

 ## Reference

- For more information about the GGUF-quantized versions, refer to [QuantStack/Wan2.1_T2V_14B_FusionX_VACE-GGUF](https://huggingface.co/QuantStack/Wan2.1_T2V_14B_FusionX_VACE-GGUF).
- For an overview of Safetensors format, please see the [Safetensors](https://huggingface.co/docs/safetensors/index).