

Occfusion
Overview :
OccFusion is an innovative human rendering technique that utilizes 3D Gaussian scattering and a pre-trained 2D diffusion model to efficiently and realistically render complete human figures even when partially occluded. This technology operates in a three-stage process: initialization, optimization, and refinement, significantly improving the accuracy and quality of human rendering in complex environments.
Target Users :
OccFusion targets researchers and developers in the fields of computer vision and graphics who need to render high-quality human figures in complex environments. This technology has significant implications for virtual reality, augmented reality, game development, and film production.
Use Cases
In virtual reality applications, use OccFusion technology to render a user's full-body movements in complex environments.
In film production, utilize OccFusion technology to generate human figures in occluded scenes, enhancing visual effects.
In game development, use OccFusion technology to create more realistic and dynamic movements for character design.
Features
Generate a complete human mask from a partially visible mask
Optimize 3D human Gaussian using Score-Distillation Sampling (SDS) to create a complete human geometric structure
Further improve the rendering quality of rarely observed body parts through contextual interpolation
Evaluated on ZJU-MoCap and OcMotion sequences, OccFusion achieves state-of-the-art performance in rendering occluded humans
How to Use
1. Prepare partially visible human video input.
2. Use OccFusion's initialization stage to generate a complete human mask.
3. Apply the optimization stage, optimizing the 3D human Gaussian using SDS technology.
4. In the refinement stage, use contextual interpolation to improve rendering quality.
5. Adjust parameters as needed to suit different rendering requirements.
6. Render high-quality occluded human figures.
Featured AI Tools
Chinese Picks

Capcut Dreamina
CapCut Dreamina is an AIGC tool under Douyin. Users can generate creative images based on text content, supporting image resizing, aspect ratio adjustment, and template type selection. It will be used for content creation in Douyin's text or short videos in the future to enrich Douyin's AI creation content library.
AI image generation
9.0M

Outfit Anyone
Outfit Anyone is an ultra-high quality virtual try-on product that allows users to try different fashion styles without physically trying on clothes. Using a two-stream conditional diffusion model, Outfit Anyone can flexibly handle clothing deformation, generating more realistic results. It boasts extensibility, allowing adjustments for poses and body shapes, making it suitable for images ranging from anime characters to real people. Outfit Anyone's performance across various scenarios highlights its practicality and readiness for real-world applications.
AI image generation
5.3M