Our four-legged friends don’t walk on tarmac the same way as they do on ice or sand as they can see and feel the floor with their eyes and nerve endings and adapt accordingly. The TRACEPaw open-source project, which stands for “Terrain Recognition And Contact force Estimation through Sensorized Legged Robot Paw“, aims to bring the same capabilities to legged robots. Autonomous Robots Lab achieves this through the Arduino Nicla Vision board leveraging its camera and microphone to run machine learning models on the STM32H7 Cortex-M7 microcontroller in order to determine the type of terrain and estimate the force exercized on the leg. But the camera is apparently not used to look at the terrain, but instead, at the deformation of the silicone hemisphere – made of “Dragon Skin” – at the end of the leg to estimate 3D force vectors, while the microphone is used to recognize terrain types […]
TRACEPaw sensorized paw helps legged robots “feel the floor” with Arduino Nicla Vision
