This tool is an adaptation of the StableDesign pipeline for interior design, specifically tailored to operate seamlessly within ComfyUI. It introduces custom nodes and enhancements to improve the generative design process while maintaining compatibility with standard workflows.
- Fully integrated with ComfyUI, featuring three custom nodes for specific tasks.
- Offers faster inference times compared to the original pipeline, enhancing user experience.
- Supports advanced functionalities like ControlNet and IP Adapter integration for improved design control.
Context
This project transforms the original StableDesign pipeline, which achieved second place in the Generative Interior Design 2024 competition, to function natively within ComfyUI. Its main purpose is to enable users to generate interior designs efficiently while utilizing ComfyUI's modular architecture.
Key Features & Benefits
The tool includes a complete restructuring for compatibility with ComfyUI, introducing three specialized custom nodes: "Interior Design Segmentator," "Image Normalize," and "Control Items." It also incorporates additional advanced custom nodes, such as Depth Anything V2 and ComfyUI_IPAdapter_plus, ensuring users can leverage a broad range of functionalities tailored for interior design tasks.
Advanced Functionalities
The tool utilizes custom ControlNet models, including controlnet_depth and own_controlnet for segmentation, which are integrated into the diffusion model's UNet. This allows for detailed and precise control over the generated design elements. Additionally, it employs a semantic segmenter based on the open-source model from OpenMMLab, ensuring high-quality segmentation for improved design accuracy.
Practical Benefits
By streamlining the workflow and offering faster inference times, this tool significantly enhances the user experience in ComfyUI. It allows for greater control over design elements through the integration of ControlNet and IP Adapter functionalities, ultimately leading to higher quality outputs and a more efficient design process.
Credits/Acknowledgments
The original pipeline was developed by MykolaL, available on Hugging Face. This adaptation retains essential logic from the original while converting it into a fully compatible format for ComfyUI, ensuring that the core functionalities are preserved and improved.