SpatialLM is a large language model designed for processing 3D point cloud data. It generates structured 3D scene understanding outputs, including semantic categories of building elements and objects. It can process point cloud data from various sources, including monocular video sequences, RGBD images, and LiDAR sensors, without requiring specialized equipment. SpatialLM has significant application value in autonomous navigation and complex 3D scene analysis tasks, significantly improving spatial reasoning capabilities.

MIDI is an innovative image-to-3D scene generation technology that utilizes a multi-instance diffusion model to directly generate multiple 3D instances with accurate spatial relationships from a single image. The core of this technology lies in its multi-instance attention mechanism, which effectively captures inter-object interactions and spatial consistency without complex multi-step processing. MIDI excels in image-to-scene generation, suitable for synthetic data, real-world scene data, and stylized scene images generated by text-to-image diffusion models. Its main advantages include efficiency, high fidelity, and strong generalization ability.

MeshPad is an innovative generative design tool that focuses on creating and editing 3D mesh models from sketch input. It achieves complex mesh generation and editing through simple sketch operations, providing users with an intuitive and efficient 3D modeling experience. The tool is based on triangular sequence mesh representation and utilizes a large Transformer model to implement mesh addition and deletion operations. Simultaneously, a vertex alignment prediction strategy significantly reduces computational cost, making each edit take only a few seconds. MeshPad surpasses existing sketch-conditioned mesh generation methods in mesh quality and has received high user recognition in perceptual evaluation. It is primarily aimed at designers, artists, and users who need to quickly perform 3D modeling, helping them create artistic designs in a more intuitive way.

StructLDM is a structured latent diffusion model designed to learn 3D human generation from 2D images. It can generate diverse, viewpoint-consistent human figures and supports various levels of controllable generation and editing, such as combined generation and local clothing editing. The model enables garment-independent generation and editing without requiring clothing types or mask conditions. This project was proposed by Tao Hu, Fangzhou Hong, and Ziwei Liu from the S-Lab of Nanyang Technological University, with related research published at ECCV 2024.

LucidFusion is a flexible end-to-end feedforward framework designed for generating high-resolution 3D Gaussians from unposed, sparse, and any number of multi-view images. This technology uses Relative Coordinate Maps (RCM) to align geometric features between different views, providing a high degree of adaptability for 3D generation. LucidFusion integrates seamlessly with traditional single-image-to-3D processes, producing detailed 3D Gaussians at 512x512 resolution suitable for a wide range of applications.

Long-LRM is a model designed for 3D Gaussian reconstruction, capable of recreating large scenes from a series of input images. The model can process 32 images at a resolution of 960x540 in just 1.3 seconds, operating on a single A100 80G GPU. It integrates the latest Mamba2 modules with traditional transformer modules to enhance efficiency without compromising quality through effective token merging and Gaussian trimming. Unlike traditional feedforward models that can only reconstruct small portions of a scene, Long-LRM can regenerate the entire scene in one go. On large-scale scene datasets like DL3DV-140 and Tanks and Temples, Long-LRM's performance is comparable to optimization-based methods while achieving two orders of magnitude greater efficiency.

MeshifAI is an advanced text-to-3D model generation platform designed to help developers quickly integrate high-quality 3D generation capabilities into applications, games, and websites. With its powerful AI technology, users can generate realistic 3D models with just a text description, greatly simplifying the 3D design process. The platform is easy to use and suitable for various development needs.

Style3D is a new 3D apparel simulation and modeling software that uses the latest AI technology to improve the efficiency and accuracy of garment design. The software significantly reduces the cost of producing physical sample garments and allows for real-time evaluation and modification of designs during the design phase, enabling designers to iterate design solutions more quickly. Due to its powerful simulation capabilities and intuitive user interface, Style3D is widely used in fashion, animation, and gaming industries. The software is subscription-based, and users can choose different subscription plans according to their needs.

SpatialLM is a large language model designed for processing 3D point cloud data. It generates structured 3D scene understanding outputs, including semantic categories of building elements and objects. It can process point cloud data from various sources, including monocular video sequences, RGBD images, and LiDAR sensors, without requiring specialized equipment. SpatialLM has significant application value in autonomous navigation and complex 3D scene analysis tasks, significantly improving spatial reasoning capabilities.

《Whispers from the Star》is an interactive story set in space. Players communicate with Stella, a girl who has crashed on an alien planet, through real-time AI-enhanced messaging, guiding her survival. Every response can affect her life or death. This interactive format makes players not just observers, but participants in the story. This product aims to provide an immersive experience through interactive storytelling and is suitable for users who enjoy stories and games.

MIDI is an innovative image-to-3D scene generation technology that utilizes a multi-instance diffusion model to directly generate multiple 3D instances with accurate spatial relationships from a single image. The core of this technology lies in its multi-instance attention mechanism, which effectively captures inter-object interactions and spatial consistency without complex multi-step processing. MIDI excels in image-to-scene generation, suitable for synthetic data, real-world scene data, and stylized scene images generated by text-to-image diffusion models. Its main advantages include efficiency, high fidelity, and strong generalization ability.

MeshPad is an innovative generative design tool that focuses on creating and editing 3D mesh models from sketch input. It achieves complex mesh generation and editing through simple sketch operations, providing users with an intuitive and efficient 3D modeling experience. The tool is based on triangular sequence mesh representation and utilizes a large Transformer model to implement mesh addition and deletion operations. Simultaneously, a vertex alignment prediction strategy significantly reduces computational cost, making each edit take only a few seconds. MeshPad surpasses existing sketch-conditioned mesh generation methods in mesh quality and has received high user recognition in perceptual evaluation. It is primarily aimed at designers, artists, and users who need to quickly perform 3D modeling, helping them create artistic designs in a more intuitive way.

StructLDM is a structured latent diffusion model designed to learn 3D human generation from 2D images. It can generate diverse, viewpoint-consistent human figures and supports various levels of controllable generation and editing, such as combined generation and local clothing editing. The model enables garment-independent generation and editing without requiring clothing types or mask conditions. This project was proposed by Tao Hu, Fangzhou Hong, and Ziwei Liu from the S-Lab of Nanyang Technological University, with related research published at ECCV 2024.

TRELLIS 3D AI is a professional tool that utilizes artificial intelligence technology to convert images into 3D assets. By combining advanced neural networks with Structured Latents (SLAT) technology, it preserves the structural integrity and visual details of input images to generate high-quality 3D assets. Background information indicates that TRELLIS 3D AI is trusted by professionals worldwide for reliable image-to-3D asset conversion. Unlike traditional 3D modeling tools, TRELLIS 3D AI offers a straightforward image-to-3D asset conversion process without the need for complex operations. The product is free of charge, ideal for users who need quick and efficient generation of 3D assets.

LucidFusion is a flexible end-to-end feedforward framework designed for generating high-resolution 3D Gaussians from unposed, sparse, and any number of multi-view images. This technology uses Relative Coordinate Maps (RCM) to align geometric features between different views, providing a high degree of adaptability for 3D generation. LucidFusion integrates seamlessly with traditional single-image-to-3D processes, producing detailed 3D Gaussians at 512x512 resolution suitable for a wide range of applications.