Learning dynamic tactile sensing with robust vision based training

article Learning dynamic tactile sensing with robust vision based training published yes Oliver Kroemer author Christoph Lampert author 40C20FD2-F248-11E8-B48F-1D18A9856A870000-0001-8622-7887 Jan Peters author ChLa department Dynamic tactile sensing is a fundamental ability to recognize materials and objects. However, while humans are born with partially developed dynamic tactile sensing and quickly master this skill, today's robots remain in their infancy. The development of such a sense requires not only better sensors but the right algorithms to deal with these sensors' data as well. For example, when classifying a material based on touch, the data are noisy, high-dimensional, and contain irrelevant signals as well as essential ones. Few classification methods from machine learning can deal with such problems. In this paper, we propose an efficient approach to infer suitable lower dimensional representations of the tactile data. In order to classify materials based on only the sense of touch, these representations are autonomously discovered using visual information of the surfaces during training. However, accurately pairing vision and tactile samples in real-robot applications is a difficult problem. The proposed approach, therefore, works with weak pairings between the modalities. Experiments show that the resulting approach is very robust and yields significantly higher classification performance based on only dynamic tactile sensing. IEEE2011 eng IEEE Transactions on Robotics 00029140460001510.1109/TRO.2011.2121130 273545 - 557 Kroemer, Oliver, Christoph Lampert, and Jan Peters. “Learning Dynamic Tactile Sensing with Robust Vision Based Training.” IEEE Transactions on Robotics. IEEE, 2011. <a href="https://doi.org/10.1109/TRO.2011.2121130">https://doi.org/10.1109/TRO.2011.2121130</a>. Kroemer, O., Lampert, C., & Peters, J. (2011). Learning dynamic tactile sensing with robust vision based training. IEEE Transactions on Robotics. IEEE. <a href="https://doi.org/10.1109/TRO.2011.2121130">https://doi.org/10.1109/TRO.2011.2121130</a> O. Kroemer, C. Lampert, and J. Peters, “Learning dynamic tactile sensing with robust vision based training,” IEEE Transactions on Robotics, vol. 27, no. 3. IEEE, pp. 545–557, 2011. Kroemer, Oliver, et al. “Learning Dynamic Tactile Sensing with Robust Vision Based Training.” IEEE Transactions on Robotics, vol. 27, no. 3, IEEE, 2011, pp. 545–57, doi:<a href="https://doi.org/10.1109/TRO.2011.2121130">10.1109/TRO.2011.2121130</a>. Kroemer O, Lampert C, Peters J. 2011. Learning dynamic tactile sensing with robust vision based training. IEEE Transactions on Robotics. 27(3), 545–557. O. Kroemer, C. Lampert, J. Peters, IEEE Transactions on Robotics 27 (2011) 545–557. Kroemer O, Lampert C, Peters J. Learning dynamic tactile sensing with robust vision based training. IEEE Transactions on Robotics. 2011;27(3):545-557. doi:<a href="https://doi.org/10.1109/TRO.2011.2121130">10.1109/TRO.2011.2121130</a> 33822018-12-11T12:03:01Z2025-09-30T08:48:31Z