%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
CHOIS
Overview :
Controllable Human-Object Interaction Synthesis (CHOIS) is an advanced technology that simultaneously generates object and human movements based on linguistic descriptions, initial object and human states, and sparse object trajectory points. This technology is crucial for simulating realistic human behavior, particularly in scenarios that require precise hand-object contact and appropriate ground-supported interactions. CHOIS improves the matching between generated object movements and input object trajectory points by introducing object geometric loss as supplementary supervisory information and designing guiding terms during the training and sampling process of the diffusion model to enforce contact constraints, thereby ensuring the authenticity of the interactions.
Target Users :
The target audience includes computer vision researchers, animators, game developers, and simulation engineers. The CHOIS technology can assist them in creating more realistic and natural human-object interaction scenes, enhancing the realism of simulations and animations, while also providing richer interactive experiences for games and virtual reality applications.
Use Cases
1. Researchers use CHOIS technology to simulate human interaction with furniture in a home environment.
2. Animators utilize CHOIS to generate natural interaction scenes between characters and props in films.
3. Game developers employ CHOIS technology to design realistic interaction motions for NPCs in games.
Features
- Generate synchronized object and human movements based on linguistic descriptions.
- Synthesize object and human movements using conditional diffusion models.
- Achieve interaction synthesis in contextual environments through sparse object trajectory points as input conditions.
- Introduce object geometric loss to enhance the matching between generated object movements and input trajectory points.
- Design guiding terms to enforce contact constraints during the sampling process.
- Support extraction of trajectory points from 3D scenes as input conditions.
- Capable of handling complex interaction scenarios that require precise hand-object contact and ground support.
How to Use
1. Prepare the initial data for objects and human states.
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%230080ff;%20}%20%3c/style%3e%3c/defs%3e%3cpath%20class='st0'%20d='M16.2,11.1c.4.5.4,1.2,0,1.8l-4.7,7.1h-3.8l5.3-8L7.6,4h3.8l4.7,7.1Z'/%3e%3c/svg%3e)
2. Provide a linguistic description that outlines the desired human-object interaction scene.
3. Define sparse object trajectory points to serve as input conditions for interaction synthesis.
4. Use the CHOIS model, inputting the aforementioned data and description.
5. The model will generate synchronized object and human movements based on the input.
6. Observe whether the generated interaction meets expectations and, if necessary, adjust the input conditions and regenerate.
7. Apply the generated interaction to the corresponding 3D scene or animation.
Featured AI Tools
English Picks
Pika
Pika is a video production platform where users can upload their creative ideas, and Pika will automatically generate corresponding videos. Its main features include: support for various creative idea inputs (text, sketches, audio), professional video effects, and a simple and user-friendly interface. The platform operates on a free trial model, targeting creatives and video enthusiasts.
Video Production
17.6M
Haiper
Haiper AI is driven by the mission to build the best perceptual foundation models for the next generation of content creation. It offers the following key features: Text-to-Video, Image Animation, Video Rewriting, Director's View.
Haiper AI can seamlessly transform text content and static images into dynamic videos. Simply drag and drop images to bring them to life. Using Haiper AI's rewriting tool, you can easily modify video colors, textures, and elements to elevate the quality of your visual content. With advanced control tools, you can adjust camera angles, lighting effects, character poses, and object movements like a director.
Haiper AI is suitable for a variety of scenarios, such as content creation, design, marketing, and more. For pricing information, please refer to the official website.
Video Production
9.8M