File size: 6,991 Bytes
ecacfad 75a1c77 68605e0 ecacfad 68605e0 ecacfad 68605e0 ecacfad 68605e0 ecacfad 68605e0 ecacfad 68605e0 ecacfad 68605e0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 |
# Nieta Lumina2.0 ComfyUI 使用手册 (Lumina2.0 ComfyUI User Manual) - guide_zh.md
## 一、环境准备 (Environment Preparation)
### 1. 必备组件下载 (Required Components Download)
| 组件类型 (Component Type) | 下载地址 (Download Address) | 备注 (Remarks) |
| :------------------------ | :-------------------------------------------------------- | :---------------------------------------------- |
| Lumina DIT 模型 | [NebulaeWis/NietaAniLumina_Alpha · Hugging Face](https://huggingface.co/NebulaeWis/NietaAniLumina_Alpha) | 后缀为 `.pth` 的模型文件 (Model file with .pth extension) |
| Text Encoder | [gemma_2_2b_fp16.safetensors](https://huggingface.co/Comfy-Org/Lumina_Image_2.0_Repackaged/blob/main/split_files/text_encoders/gemma_2_2b_fp16.safetensors) | `gemma_2_2b_fp16.safetensors` 文件 |
| VAE | [ae.safetensors](https://huggingface.co/Comfy-Org/Lumina_Image_2.0_Repackaged/blob/main/split_files/vae/ae.safetensors) | `ae.safetensors` 文件 |
### 2. 软件与工作流 (Software and Workflow)
* **ComfyUI**: 必须更新至最新版本。(Must be updated to the latest version).
* **工作流文件 (Workflow File)**:
* 推荐使用官方优化参数的JSON工作流文件。 (It is recommended to use the official JSON workflow file with optimized parameters.)
* 示例工作流文件(The example workflow file ) [lumina_workflow.json](./lumina_workflow.json)
* 通过 ComfyUI 的 "Load" 功能导入工作流文件即可快速配置。(Quickly configure by importing the workflow file through ComfyUI's "Load" function.)
## 二、模型加载配置 (Model Loading Configuration)
### 节点说明(关键节点参数)(Node Description - Key Node Parameters)
| 节点名称 (Node Name) | 参数设置 (Parameter Settings) | 示例值 / 备注 (Example Value / Remarks) |
| :------------------------- | :---------------------------------------- | :----------------------------------------------------------------------- |
| UNETLoader | 模型路径选择 (Model path selection) | `lu2/results_cosine_2e-4_bs64_infallssssuum/checkpoint-e4_s68300/consolidated.00-of-01.pth` (请根据实际下载路径修改 Please modify according to your actual download path) |
| ModelSamplingAuraFlow | 移位值 (Shift) (Shift value) | `6.00`(官方推荐值 Official recommended value) |
| VAELoader | VAE 文件选择 (VAE file selection) | `ae.safetensors` (请确保已下载并放置到ComfyUI的VAE目录下 Please ensure it's downloaded and placed in ComfyUI's VAEs directory) |
| CLIPLoader | Text Encoder 选择 (Text Encoder selection) | `gemma_2_2b_fp16.safetensors`,预设选 `lumina2` (preset select lumina2; 请确保已下载并放置到ComfyUI的CLIP目录下 Please ensure it's downloaded and placed in ComfyUI's CLIPs directory) |
| EmptySD3LatentImage | 分辨率设置 (Resolution settings) | 默认 `1024x1552`(支持 `1024 - 1280` 分辨率 Default 1024x1552, supports 1024 - 1280 resolution) |
## 三、提示词规范 (Prompt Specification)
### 1. 系统提示词 (System Prompt)
* 需要前缀以下文本(可修改,对出图有影响):(The following text needs to be prefixed (can be modified, affects image generation)):
`You are an assistant designed to generate anime images based on textual prompts. <Prompt Start>`
* 示例 (Example):
`You are an assistant... <Prompt Start> 1girl, @wlop,..................................`
### 2. 多语言支持 (Multilingual Support)
支持自然语言中英文混合输入(Gemma2等llm作为te的特性):(Supports mixed Chinese and English natural language input (a feature of LLMs like Gemma2 as Text Encoder)):
`一只坐在樱花树下的猫,sunlight effect, fantasy background`
### 3. Danbooru Tag 规范 (Danbooru Tag Specification)
* 下划线转空格 (Underscore to space):`ningen_mamei` → `ningen mamei`
* 括号转义 (Parentheses escaping):`dressed shadow \(meme\)`
* 画师强化 (Artist emphasis):使用 `@` 符号(如 `@wlop`)(Use the @ symbol (e.g., @wlop))
### 4. 负面提示词 (Negative Prompts)
需包含相同系统前缀:(Must include the same system prefix):
`You are an assistant... <Prompt Start> blurry, worst quality, low quality`
## 四、采样参数 (Sampling Parameters)
| 参数项 (Parameter Item) | 推荐值 (Recommended Value) | 说明 (Description) |
| :---------------------- | :------------------------- | :------------------------------------- |
| 采样器 (Sampler) | `res_multistep` | 默认,可自行调整 (Default, can be adjusted) |
| 调度器 (Scheduler) | `linear_quadratic` | |
| CFG Scale | `5.5` | 可自行调整 (Can be adjusted) |
| 步数 (Steps) | `30` | 可自行调整 (Can be adjusted) |
| 降噪 (Denoise) | `1.0` | |
| 分辨率 (Resolution) | `1024x1024` 至 `1280x1280` | 其余分辨率效果未验证 (Effects of other resolutions have not been verified) |
## 五、工作流说明 (Workflow Description)
### 1. 流程概览 (Process Overview)
UNET → AuraFlow采样 (AuraFlow Sampling) → KSampler → VAE解码 (VAE Decode) → 输出图像 (Output Image)
### 2. 关键连接 (Key Connections)
* Text Encoder 输出分别连接正 / 负提示词节点。(Text Encoder output connects to positive/negative prompt nodes respectively).
* AuraFlow 节点需插入 UNET 和 KSampler 之间。(The AuraFlow node needs to be inserted between UNET and KSampler).
## 六、注意事项 (Precautions)
1. 括号权重需转义:`\(word\)`。(Parentheses for weights need to be escaped: `\(word\)`).
2. 官方 JSON 工作流 (如 `lumina_workflow.json`) 已优化参数,建议直接导入使用。(The official JSON workflow (like `lumina_workflow.json`) has optimized parameters; it is recommended to import and use it directly).
3. 多语言提示词效果需自行测试。(The effect of multilingual prompts needs to be tested by yourself).
4. 目前Lumina推荐的提示词格式是 "tag + 自然语言",但也支持纯tag和纯自然语言,大家可以多试试。(Currently, Lumina's recommended prompt format is "tag + natural language", but it also supports pure tags and pure natural language. Everyone is encouraged to try them out).
**注:本手册基于内测版本编写,部分参数可能随版本更新调整。** (Note: This manual is based on the internal test version, and some parameters may be adjusted with version updates.) |