README.md

metadata

license: other
license_name: server-side-public-license
license_link: https://www.mongodb.com/legal/licensing/server-side-public-license
tags:
  - diffusion
  - virtual try-on
  - virtual try-off
  - image generation
  - fashion
  - e-commerce
base_model:
  - CompVis/stable-diffusion-v1-4
pipeline_tag: image-to-image
library_name: diffusers

TryOffDiff [Project Page]

These models are based on the research papers:

1. "TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models" [paper]
2. "MGT: Extending Virtual Try-Off to Multi-Garment Scenarios" [paper]

Available models:

• tryoffdiff.pth: Generates upper-body garments. Fine-tuned on VITON-HD-train.
• tryoffdiffv2_upper.pth: Generates upper-body garments. Fine-tuned on a subset of Dress Code-train.
• tryoffdiffv2_lower.pth: Generates lower-body garments. Fine-tuned on a subset of Dress Code-train.
• tryoffdiffv2_dress.pth: Generates dresses. Fine-tuned on a subset of Dress Code-train.
• tryoffdiffv2_multi.pth (MGT): Generates all three garment types (upper-body, lower-body, dresses). Fine-tuned on the entire Dress Code-train.

Usage

For a complete running example, see the demo code on HuggingFace Spaces.

For more information on training, inference, and evaluation, refer to the GitHub repository.

License

TL;DR: Not available for commercial use, unless the FULL source code is shared!
This project is intended solely for academic research. No commercial benefits are derived from it. Models are licensed under Server Side Public License (SSPL)

Citation

If you use this work, please give a star ⭐ and a citation:

@article{velioglu2024tryoffdiff,
  title     = {TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models},
  author    = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara},
  journal   = {arXiv},
  year      = {2024},
  note      = {\url{https://doi.org/nt3n}}
}
@inproceedings{velioglu2025mgt,
  title     = {MGT: Extending Virtual Try-Off to Multi-Garment Scenarios},
  author    = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara},
  booktitle = {ICCVW},
  year      = {2025},
  note      = {\url{https://doi.org/pn67}}
}