New Voice-Controlled Multimodal AI Solution Enables Low-Power Contactless Operation in Vision AI-Based IoT and Edge Applications

Published  July 28, 2021   0
Voice-Controlled Multimodal AI Solution

Renesas Electronics Corporation and Syntiant Corporation have jointly developed voice-controlled multimodal AI solution that enables low-power contactless operation for image processing in vision AI-based IoT and edge systems. The new solution combines Renesas RZ/V Series vision AI microprocessor unit (MPU) and the low-power multimodal, multi-feature Syntiant NDP120 Neural Decision Processor and delivers advanced voice and image processing capabilities.

Enabling low-power voice-controlled operation of embedded vision AI systems in IoT and edge applications, this jointly developed solution is suitable to be used in self-checkout machines, security cameras, and video conference systems, and smart appliances such as robotic cleaning devices.

The notable features of the new solution are always-on functionality with quick voice-triggered activation from standby mode to perform object recognition, facial recognition, and other vision-based tasks that are critical functions in security cameras and other systems. The multimodal architecture of the solution makes it easier to create contactless user experiences for vision AI-based systems. The dedicated, power-efficient chip used for voice recognition helps in reducing standby power consumption while speeding up system development.

The new solution is part of Renesas’ Winning Combinations, which feature compelling analog, power, and embedded processing product combinations that help customers accelerate their designs and get to market faster. This voice-controlled multimodal AI solution uses multiple mutually compatible devices from Renesas portfolio to provide customers an elevated prototyping platform for faster time to market and reduced risk. The reference design for the new multimodal AI solution including circuit diagrams and BOM lists is available now from the company website.