|
|
--- |
|
|
license: other |
|
|
license_name: server-side-public-license |
|
|
license_link: https://www.mongodb.com/legal/licensing/server-side-public-license |
|
|
tags: |
|
|
- diffusion |
|
|
- virtual try-on |
|
|
- virtual try-off |
|
|
- image generation |
|
|
- fashion |
|
|
- e-commerce |
|
|
base_model: |
|
|
- CompVis/stable-diffusion-v1-4 |
|
|
pipeline_tag: image-to-image |
|
|
library_name: diffusers |
|
|
--- |
|
|
|
|
|
## TryOffDiff <small>[[Project Page]][project_page]</small> |
|
|
|
|
|
These models are based on the research papers: |
|
|
1. _"TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models"_ [[paper]][paper_arxiv] |
|
|
2. _"MGT: Extending Virtual Try-Off to Multi-Garment Scenarios"_ [[paper]][paper2_arxiv] |
|
|
|
|
|
Available models: |
|
|
- `tryoffdiff.pth`: Generates upper-body garments. Fine-tuned on `VITON-HD-train`. |
|
|
- `tryoffdiffv2_upper.pth`: Generates upper-body garments. Fine-tuned on a subset of `Dress Code-train`. |
|
|
- `tryoffdiffv2_lower.pth`: Generates lower-body garments. Fine-tuned on a subset of `Dress Code-train`. |
|
|
- `tryoffdiffv2_dress.pth`: Generates dresses. Fine-tuned on a subset of `Dress Code-train`. |
|
|
- `tryoffdiffv2_multi.pth` (*MGT*): Generates all three garment types (upper-body, lower-body, dresses). Fine-tuned on the entire `Dress Code-train`. |
|
|
|
|
|
## Usage |
|
|
|
|
|
> For a complete running example, see the demo code on [HuggingFace Spaces][hf_spaces]. |
|
|
|
|
|
> For more information on training, inference, and evaluation, refer to the [GitHub repository][github]. |
|
|
|
|
|
## License |
|
|
TL;DR: Not available for commercial use, unless the FULL source code is shared! \ |
|
|
This project is intended solely for academic research. No commercial benefits are derived from it. |
|
|
Models are licensed under [Server Side Public License (SSPL)][license] |
|
|
|
|
|
## Citation |
|
|
If you use this work, please give a star ⭐ and a citation: |
|
|
``` |
|
|
@inproceedings{velioglu2025tryoffdiff, |
|
|
title = {TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models}, |
|
|
author = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara}, |
|
|
booktitle = {BMVC}, |
|
|
year = {2025}, |
|
|
note = {\url{https://doi.org/nt3n}} |
|
|
} |
|
|
@inproceedings{velioglu2025mgt, |
|
|
title = {MGT: Extending Virtual Try-Off to Multi-Garment Scenarios}, |
|
|
author = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara}, |
|
|
booktitle = {ICCVW}, |
|
|
year = {2025}, |
|
|
note = {\url{https://doi.org/pn67}} |
|
|
} |
|
|
``` |
|
|
|
|
|
[hf_spaces]: https://huggingface.co/spaces/rizavelioglu/tryoffdiff/blob/main/app.py |
|
|
[project_page]: https://rizavelioglu.github.io/tryoffdiff/ |
|
|
[paper_arxiv]: https://arxiv.org/abs/2411.18350 |
|
|
[paper2_arxiv]: https://arxiv.org/abs/2504.13078 |
|
|
[github]: https://github.com/rizavelioglu/tryoffdiff |
|
|
[license]: https://www.mongodb.com/legal/licensing/server-side-public-license |
|
|
|
|
|
|
