DreamTacVLA: Contact-Rich Manipulation with Future Tactile Prediction

This paper addresses a critical limitation of Vision-Language-Action (VLA) models: their inability to effectively handle contact-rich manipulation tasks. By introducing DreamTacVLA, the authors propose a novel framework that grounds VLA models in contact physics through the prediction of future tactile signals. This approach is significant because it allows robots to reason about force, texture, and slip, leading to improved performance in complex manipulation scenarios. The use of a hierarchical perception scheme, a Hierarchical Spatial Alignment (HSA) loss, and a tactile world model are key innovations. The hybrid dataset construction, combining simulated and real-world data, is also a practical contribution to address data scarcity and sensor limitations. The results, showing significant performance gains over existing baselines, validate the effectiveness of the proposed approach.