ZČU
Interface for multimodal communication for robotic platforms in ROS
The software is an interface implemented in the Robot Operating System (ROS) environment designed to process data and trigger actions for multimodal human-machine communication. Thanks to the use of ROS, the system is implemented in a modular way and then easily extended with new modules.
The current version includes modules with automatic speech recognition (ASR) and speech synthesis (TTS) services using our Speechcloud library. This makes it possible not only to understand user commands but also to generate responses based on the intentions detected in the speech.
The system is developed with multiplatform capability in mind, with the ability to run on both x86 (conventional PC) and ARM platforms. It manages on a range of smaller sized devices with the possibility of integration into a physical device. The system was developed primarily for compatibility with NVIDIA Jetson, but also runs on the Raspberry Pi platform.
Translated with DeepL.com (free version)
This work was created with the support of the project "R&D of Technologies for Advanced Digitization in the Pilsen Metropolitan Area (DigiTech)" No.: CZ.02.01.01/00/23_021/0008436 co-financed by the European Union.
Contact form
This research/development result is protected by license. To download or get more information, please fill in the form below: