|
|
--- |
|
|
title: UI Screen Description Generator With Pix2Struct |
|
|
emoji: 🐨 |
|
|
colorFrom: purple |
|
|
colorTo: blue |
|
|
sdk: gradio |
|
|
sdk_version: 5.28.0 |
|
|
app_file: app.py |
|
|
pinned: false |
|
|
license: mit |
|
|
short_description: Built a vision-language application |
|
|
--- |
|
|
|
|
|
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference |
|
|
|
|
|
|
|
|
# UI Screen Describer with Pix2Struct |
|
|
|
|
|
This demo uses Google's `pix2struct-screen2words-large` model to turn UI screenshots into natural language descriptions. |
|
|
|
|
|
### Use Cases |
|
|
- Accessibility |
|
|
- UI testing |
|
|
- Auto documentation |
|
|
|
|
|
### How it works |
|
|
Upload any screenshot (e.g., app, webpage, dashboard) and the model will describe it in text. |
|
|
|
|
|
Built using Hugging Face Transformers + Gradio. |
|
|
|
|
|
|
