Multimodal Learning for Embodied Intelligence: Perception, Alignment, Fusion, Reasoning, and Generation

Éditeurs invités

  • Zhiliang Wu, Nanyang Technological University
  • Kun Li, United Arab Emirates University
  • Yunqiu Xu, National University of Singapore

Synthèse

Embodied intelligence systems must integrate diverse sensory inputs—vision, language, audio, touch, 3D signals, and action trajectories—to perceive and act in the physical world. This special issue focuses on multimodal learning approaches that enable embodied agents to build effective world models from these heterogeneous inputs. The work addresses unique challenges in embodied settings, including spatiotemporal understanding, cross-modal fusion, causal reasoning, and handling real-world conditions like noise, missing data, and partial observability.

The special issue invites research on multimodal representation learning, information fusion, and reasoning methods for embodied systems. Studies should explore how embodied agents leverage foundation models and integrate multiple modalities for tasks ranging from perception and interaction to planning, decision-making, and world model generation.

Thèmes proposés

  • Multimodal Representation Learning for Embodied World Models
  • Multimodal Fusion for Embodied Perception and Interaction
  • Multimodal Reasoning for Planning and Decision-Making
  • Multimodal Generating for Embodied World
  • Vision-Language-Action Modeling
  • Spatial-Temporal and 3D/4D Scene Understanding
  • Predictive and Memory-Augmented World Models
  • Foundation Models for Embodied Systems
  • Trustworthy Embodied Multimodal Learning and Applications