Virtual Tryouts: Concept Demo for Fashion Ecommerce Websites

Model used- IDM-VTON, uses two different modules to encode the semantics of garment image; given the base UNet of the diffusion model, 1) the high-level semantics extracted from a visual encoder are fused to the cross-attention layer, and then 2) the low-level features extracted from parallel UNet are fused to the self-attention layer. In addition, the model provide detailed textual prompts for both garment and person images to enhance the authenticity of the generated visuals. Finally, the model present a customization method using a pair of person-garment images, which significantly improves fidelity and authenticity.

[@aaditshukla3159]

Source code