Efficient Tactile Simulation with Differentiability for Robotic Manipulation


Jie Xu1     Sangwoon Kim1     Tao Chen1     Alberto Rodriguez1     Pulkit Agrawal1     Wojciech Matusik1     Shinjiro Sueda2
1 Massachusetts Institute of Technology      2 Texas A&M University


Abstract


Efficient simulation of tactile sensors can unlock new opportunities for learning tactile-based manipulation policies in simulation and then transferring the learned policy to real systems, but fast and reliable simulators for dense tactile normal and shear force fields are still under-explored. We present a novel approach for efficiently simulating both the normal and shear tactile force field covering the entire contact surface with an arbitrary tactile sensor spatial layout. Our simulator also provides analytical gradients of the tactile forces to accelerate policy learning. We conduct extensive simulation experiments to showcase our approach and demonstrate successful zero-shot sim-to-real transfer for a high-precision peg-insertion task with high-resolution vision-based GelSlim tactile sensors.


Paper


Efficient Tactile Simulation with Differentiability for Robotic Manipulation
Jie Xu, Sangwoon Kim, Tao Chen, Alberto Rodriguez, Pulkit Agrawal, Wojciech Matusik, Shinjiro Sueda
Conference on Robot Learning (CoRL) 2022
[Paper]  [OpenReview] [Video]  [Poster]  [Simulation Code]  [Paper Example Code]  [BibTeX]


Video Demo





Related Papers


An End-to-End Differentiable Framework for Contact-Aware Robot Design
Jie Xu, Sangwoon Kim, Tao Chen, Alberto Rodriguez, Pulkit Agrawal, Wojciech Matusik, Shinjiro Sueda
Robotics: Science and Systems (RSS 2021)
[Project Page]


© Massachusetts Institute of Technology 2022