pix2gestalt
P
Pix2gestalt
Overview :
pix2gestalt is a framework for zero-shot segmentation that learns to estimate the overall shape and appearance of partially visible objects. It leverages large-scale diffusion models and transfers their representations to this task, learning a conditional diffusion model for reconstructing the whole object in challenging zero-shot scenarios, including examples that break natural and physical priors like art. We utilize a synthetically curated dataset for training, containing occluded objects and their complete counterparts. Experiments demonstrate that our method outperforms supervised baselines on established benchmark tests. Furthermore, our model can be used to significantly enhance the performance of existing object recognition and 3D reconstruction methods in scenarios with occlusions.
Target Users :
Suitable for image processing tasks involving partially occluded objects. It can be used to improve the performance of object recognition and 3D reconstruction methods.
Total Visits: 29.7M
Top Region: US(17.94%)
Website Views : 44.4K
Use Cases
Zero-shot segmentation for artwork images
Improving the recognition of occluded objects in medical images
Application to environmental perception in autonomous driving vehicles
Features
Zero-Shot Segmentation
Shape and Appearance Estimation
Conditional Diffusion Modeling
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase