File size: 6,991 Bytes
ecacfad
 
75a1c77
68605e0
 
 
 
 
 
 
ecacfad
 
68605e0
ecacfad
68605e0
ecacfad
 
 
 
 
68605e0
 
 
 
 
 
 
ecacfad
 
 
 
 
68605e0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
ecacfad
68605e0
ecacfad
68605e0
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
# Nieta Lumina2.0 ComfyUI 使用手册 (Lumina2.0 ComfyUI User Manual) - guide_zh.md

 
## 一、环境准备 (Environment Preparation)

### 1. 必备组件下载 (Required Components Download)

| 组件类型 (Component Type) | 下载地址 (Download Address)                               | 备注 (Remarks)                                  |
| :------------------------ | :-------------------------------------------------------- | :---------------------------------------------- |
| Lumina DIT 模型          | [NebulaeWis/NietaAniLumina_Alpha · Hugging Face](https://huggingface.co/NebulaeWis/NietaAniLumina_Alpha) | 后缀为 `.pth` 的模型文件 (Model file with .pth extension) |
| Text Encoder              | [gemma_2_2b_fp16.safetensors](https://huggingface.co/Comfy-Org/Lumina_Image_2.0_Repackaged/blob/main/split_files/text_encoders/gemma_2_2b_fp16.safetensors) | `gemma_2_2b_fp16.safetensors` 文件                   |
| VAE                       | [ae.safetensors](https://huggingface.co/Comfy-Org/Lumina_Image_2.0_Repackaged/blob/main/split_files/vae/ae.safetensors) | `ae.safetensors` 文件                             |

### 2. 软件与工作流 (Software and Workflow)

* **ComfyUI**: 必须更新至最新版本。(Must be updated to the latest version).
* **工作流文件 (Workflow File)**:
    * 推荐使用官方优化参数的JSON工作流文件。 (It is recommended to use the official JSON workflow file with optimized parameters.)
    * 示例工作流文件(The example workflow file ) [lumina_workflow.json](./lumina_workflow.json) 
    * 通过 ComfyUI 的 "Load" 功能导入工作流文件即可快速配置。(Quickly configure by importing the workflow file through ComfyUI's "Load" function.)

## 二、模型加载配置 (Model Loading Configuration)

### 节点说明(关键节点参数)(Node Description - Key Node Parameters)

| 节点名称 (Node Name)       | 参数设置 (Parameter Settings)             | 示例值 / 备注 (Example Value / Remarks)                                  |
| :------------------------- | :---------------------------------------- | :----------------------------------------------------------------------- |
| UNETLoader                 | 模型路径选择 (Model path selection)       | `lu2/results_cosine_2e-4_bs64_infallssssuum/checkpoint-e4_s68300/consolidated.00-of-01.pth` (请根据实际下载路径修改 Please modify according to your actual download path) |
| ModelSamplingAuraFlow      | 移位值 (Shift) (Shift value)             | `6.00`(官方推荐值 Official recommended value)                         |
| VAELoader                  | VAE 文件选择 (VAE file selection)         | `ae.safetensors` (请确保已下载并放置到ComfyUI的VAE目录下 Please ensure it's downloaded and placed in ComfyUI's VAEs directory) |
| CLIPLoader                 | Text Encoder 选择 (Text Encoder selection) | `gemma_2_2b_fp16.safetensors`,预设选 `lumina2` (preset select lumina2; 请确保已下载并放置到ComfyUI的CLIP目录下 Please ensure it's downloaded and placed in ComfyUI's CLIPs directory) |
| EmptySD3LatentImage        | 分辨率设置 (Resolution settings)          | 默认 `1024x1552`(支持 `1024 - 1280` 分辨率 Default 1024x1552, supports 1024 - 1280 resolution) |

## 三、提示词规范 (Prompt Specification)

### 1. 系统提示词 (System Prompt)

* 需要前缀以下文本(可修改,对出图有影响):(The following text needs to be prefixed (can be modified, affects image generation)):
    `You are an assistant designed to generate anime images based on textual prompts. <Prompt Start>`
* 示例 (Example):
    `You are an assistant... <Prompt Start> 1girl, @wlop,..................................`

### 2. 多语言支持 (Multilingual Support)

支持自然语言中英文混合输入(Gemma2等llm作为te的特性):(Supports mixed Chinese and English natural language input (a feature of LLMs like Gemma2 as Text Encoder)):
`一只坐在樱花树下的猫,sunlight effect, fantasy background`

### 3. Danbooru Tag 规范 (Danbooru Tag Specification)

* 下划线转空格 (Underscore to space):`ningen_mamei``ningen mamei`
* 括号转义 (Parentheses escaping):`dressed shadow \(meme\)`
* 画师强化 (Artist emphasis):使用 `@` 符号(如 `@wlop`)(Use the @ symbol (e.g., @wlop))

### 4. 负面提示词 (Negative Prompts)

需包含相同系统前缀:(Must include the same system prefix):
`You are an assistant... <Prompt Start> blurry, worst quality, low quality`

## 四、采样参数 (Sampling Parameters)

| 参数项 (Parameter Item) | 推荐值 (Recommended Value) | 说明 (Description)                     |
| :---------------------- | :------------------------- | :------------------------------------- |
| 采样器 (Sampler)        | `res_multistep`            | 默认,可自行调整 (Default, can be adjusted) |
| 调度器 (Scheduler)      | `linear_quadratic`         |                                        |
| CFG Scale               | `5.5`                      | 可自行调整 (Can be adjusted)             |
| 步数 (Steps)            | `30`                       | 可自行调整 (Can be adjusted)             |
| 降噪 (Denoise)          | `1.0`                      |                                        |
| 分辨率 (Resolution)     | `1024x1024``1280x1280` | 其余分辨率效果未验证 (Effects of other resolutions have not been verified) |

## 五、工作流说明 (Workflow Description)

### 1. 流程概览 (Process Overview)

UNET → AuraFlow采样 (AuraFlow Sampling) → KSampler → VAE解码 (VAE Decode) → 输出图像 (Output Image)

### 2. 关键连接 (Key Connections)

* Text Encoder 输出分别连接正 / 负提示词节点。(Text Encoder output connects to positive/negative prompt nodes respectively).
* AuraFlow 节点需插入 UNET 和 KSampler 之间。(The AuraFlow node needs to be inserted between UNET and KSampler).

## 六、注意事项 (Precautions)

1.  括号权重需转义:`\(word\)`。(Parentheses for weights need to be escaped: `\(word\)`).
2.  官方 JSON 工作流 (如 `lumina_workflow.json`) 已优化参数,建议直接导入使用。(The official JSON workflow (like `lumina_workflow.json`) has optimized parameters; it is recommended to import and use it directly).
3.  多语言提示词效果需自行测试。(The effect of multilingual prompts needs to be tested by yourself).
4.  目前Lumina推荐的提示词格式是 "tag + 自然语言",但也支持纯tag和纯自然语言,大家可以多试试。(Currently, Lumina's recommended prompt format is "tag + natural language", but it also supports pure tags and pure natural language. Everyone is encouraged to try them out).

**注:本手册基于内测版本编写,部分参数可能随版本更新调整。** (Note: This manual is based on the internal test version, and some parameters may be adjusted with version updates.)