Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,25 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
+
tags:
|
4 |
+
- diffusion
|
5 |
+
- image-to-image
|
6 |
+
- depth-estimation
|
7 |
+
- optical-flow
|
8 |
+
- amodal-segmentation
|
9 |
+
---
|
10 |
+
|
11 |
+
# Scaling Properties of Diffusion Models for Perceptual Tasks
|
12 |
+
|
13 |
+
### CVPR 2025
|
14 |
+
|
15 |
+
**Rahul Ravishankar\*, Zeeshan Patel\*, Jathushan Rajasegaran, Jitendra Malik**
|
16 |
+
|
17 |
+
[[Paper](https://arxiv.org/abs/2411.08034)] 路 [[Project Page](https://scaling-diffusion-perception.github.io/)]
|
18 |
+
|
19 |
+
|
20 |
+
In this paper, we argue that iterative computation with diffusion models offers a powerful paradigm for not only generation but also visual perception tasks. We unify tasks such as depth estimation, optical flow, and amodal segmentation under the framework of image-to-image translation, and show how diffusion models benefit from scaling training and test-time compute for these perceptual tasks. Through a careful analysis of these scaling properties, we formulate compute-optimal training and inference recipes to scale diffusion models for visual perception tasks. Our models achieve competitive performance to state-of-the-art methods using significantly less data and compute.
|
21 |
+
|
22 |
+
|
23 |
+
## Getting started
|
24 |
+
|
25 |
+
You can download our DiT-MoE Generalist model [here](https://huggingface.co/zeeshanp/scaling_diffusion_perception/blob/main/dit_moe_generalist.pt). Please see instructions on how to use our model in the [GitHub README](https://github.com/scaling-diffusion-perception/scaling-diffusion-perception)路
|