shauray commited on
Commit
9eb5e56
·
verified ·
1 Parent(s): 895a9b2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +69 -3
README.md CHANGED
@@ -1,3 +1,69 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Wan-AI/Wan2.1-T2V-14B
7
+ tags:
8
+ - text-to-video
9
+ - lora
10
+ - diffusers
11
+ - template:diffusion-lora
12
+ widget:
13
+ - text: >-
14
+ [conor] a man fighting another man in the MMA ring, landing a right hook towards the starting.
15
+ output:
16
+ url: videos/conor_1.webp
17
+ - text: >-
18
+ [conor] a man sitting drinking whiskey, the bottle of whiskey says "proper twelve", with girls sitting around.
19
+ output:
20
+ url: videos/conor_2.webp
21
+
22
+ ---
23
+ # Conor McGregor Lora for WanVideo2.1
24
+ <Gallery />
25
+
26
+ ## Trigger words
27
+
28
+ You should use `conor` to trigger the video generation.
29
+
30
+ ## Using with Diffusers
31
+ ```py
32
+ pip install git+https://github.com/huggingface/diffusers.git
33
+ ```
34
+
35
+ ```py
36
+ import torch
37
+ from diffusers.utils import export_to_video
38
+ from diffusers import AutoencoderKLWan, WanPipeline
39
+ from diffusers.schedulers.scheduling_unipc_multistep import UniPCMultistepScheduler
40
+
41
+ # Available models: Wan-AI/Wan2.1-T2V-14B-Diffusers, Wan-AI/Wan2.1-T2V-1.3B-Diffusers
42
+ model_id = "Wan-AI/Wan2.1-T2V-14B-Diffusers"
43
+ vae = AutoencoderKLWan.from_pretrained(model_id, subfolder="vae", torch_dtype=torch.float32)
44
+ pipe = WanPipeline.from_pretrained(model_id, vae=vae, torch_dtype=torch.bfloat16)
45
+ flow_shift = 5.0 # 5.0 for 720P, 3.0 for 480P
46
+ pipe.scheduler = UniPCMultistepScheduler.from_config(pipe.scheduler.config, flow_shift=flow_shift)
47
+ pipe.to("cuda")
48
+
49
+ pipe.load_lora_weights("shauray/Mcgregor_WanLora")
50
+
51
+ pipe.enable_model_cpu_offload() #for low-vram environments
52
+
53
+ prompt = "conor a man walking through a bar"
54
+
55
+ output = pipe(
56
+ prompt=prompt,
57
+ height=480,
58
+ width=720,
59
+ num_frames=81,
60
+ guidance_scale=5.0,
61
+ ).frames[0]
62
+ export_to_video(output, "output.mp4", fps=16)
63
+ ```
64
+
65
+ ## Download model
66
+
67
+ Weights for this model are available in Safetensors format.
68
+
69
+ [Download](/shauray/Mcgregor_WanLora/tree/main) them in the Files & versions tab.