A team led by Prof. DONG Erbao from the University of Science and Technology of China (USTC) of the Chinese Academy of Sciences (CAS), collaborating with Prof. YU Xinge from the City University of Hong Kong, developed a novel tactile perception method based on the structural color of flexible grating structural color. The work was published in National Science Review.
Vision-based tactile sensors (VTSs) play a crucial role in facilitating robots to perform complex and precise operations. However, existing VTS primarily rely on geometric optics or marker tracking technology, which severely limit their resolution and accuracy in force-position recognition.
To address these challenges, the team proposed a novel design inspired by the structural color of Morpho butterfly wings. They utilized the structural color patterns formed by the flexible grating films under LED white light illumination to represent tactile information. To better estimate the single-point contacts from structural color images, they employed deep learning algorithms to enhance information decoding and optimize dataset configurations.
This new VTS design, called IrisTact, achieved high spatial resolution and force accuracy at contact points, significantly improving the overall performance of tactile recognition. IrisTact fully exploits the rich tactile information contained in the structural color patterns, surpassing current VTS in terms of spatial resolution for contact point localization and accuracy of force recognition.
Schematics of tactile perception method based on flexible grating structural color. (Image by Prof. Dong’s team)
Furthermore, this new method demonstrates broad applicability. Leveraging the modular design of core components, the team further developed sensor prototypes for three typical application scenarios: low-frequency vibration detection, whisker sensing, and 3D contact perception. With an additional end-effector transmitting vibration to the film, the vibration sensor can measure subtle low-frequency vibration signals based on the elasticity of the film. The bionic whisker sensor, featuring a rigid-flexible coupling whisker, can detect pulse frequency and airflow disturbances. The flexible grating film can be independently used in endoscopic systems to enable circular 3D contact perception.
Examples of application prototypes. (Image by Prof. Dong’s team)
IrisTact provides a new pathway for intelligent sensing, exhibiting great application potential in fields such as robotic perception, environment monitoring and medical devices.
Paper link: https://doi.org/10.1093/nsr/nwae413
(Written by LIU Danxu, edited by ZHANG Yihang, USTC News Center)
