Skynet is finally here! OK, not quite, but at least we do have ESP-Skainet now courtesy of Espressif Systems. ESP-Skainet is an intelligent voice assistant that features the company’s WakeNet wake word engine and MultiNet speech commands recognition.
WakeNet
WakeNet has been specifically designed for low-power MCUs such as ESP8266 or ESP32 with a low memory footprint (20KB RAM) and a high calculation speed that makes it capable of achieving a high success rate for wake word detection even in noisy environments.
Tested in the company’s upcoming LyraT-Mini audio board that combines an ESP32-WROVER-B module and a codec, WakeNet achieves a 97% wake word success rate at a one-meter distance, and 95% three meters away in a quiet environment.
ESP-Skainet wake-up engine ships with the wake-up word “” (Hi Lexin), which translates in “Hello Espressif”, and supports up to five wake words. You can use customize wake words as well, but you’d have to go through Espressif Systems to enable this customization.
MultiNet
Once your smart audio device (aka smart speaker) has been woken-up by the wake word it will listen to what you have to say using and convert the audio to text using MultiNet speech commands recognition which currently works in Chinese (Mandarin) only, but English support is coming soon, more exactly in the next release.
The company further explains how it works internally:
MultiNet’s design draws on Convolutional Recurrent Neural Networks (CRNN) and Connectionist Temporal Classification (CTC). MultiNet uses an audio clip’s Mel-Frequency Cepstral Coefficients (MFCC) as input, and the phonemes of that audio clip, which could be either in Chinese or in English, as output. By comparing the output’s phonemes, MultiNet can identify the relevant Chinese or English command.
At this stage up to 100 spoken commands in Chinese, including customized ones, are supported. Customizing voice commands do not require you to train the model again, and access to the network is not needed. Note that while WakeNet requires only 20KB RAM, ESP-Skainet (MultiNet) works on ESP8266 or ESP32 modules with at least 4MB SPI RAM.
More details may be found in the press release and Github repository.
Jean-Luc started CNX Software in 2010 as a part-time endeavor, before quitting his job as a software engineering manager, and starting to write daily news, and reviews full time later in 2011.
Support CNX Software! Donate via cryptocurrencies, become a Patron on Patreon, or purchase goods on Amazon or Aliexpress
Who has the hardware to give this a whirl? Doesn ‘t look like the Olimex ESP32-ADF board is available in the US yet. Any other hardware options that I don’t have to wait three weeks on the shipping?