Enabling Voice Bots

voice is increasingly seen as the future of user interactions an increasing number of devices and software applications are becoming voice ready and it is imperative that voice is kept in mind while designing the chatbot interactions with end users engati includes several flavours of voice recognition to enable voice driven interactions these include using voice over web, mobile widgets as well as on channels like whatsapp voice support can also be extended beyond these traditional channels & interfaces to use cases like ivrs availability availability there are two key flavours of voice support in engati voice to text on web widget available as part of engati’s business plan voice conversations – available on request as part of engati’s enterprise plan this also includes support for handling voice notes on whatsapp setup – voice to text (web widget) setup – voice to text (web widget) this option is available as part of engati’s business plan and is supported on web chatbot widget on chrome to enable it, navigate to configure > web display > settings and enable the checkboxes enabling this would allow the end users to see an option to enable audio input mode on the website widget in this mode, the chatbot listens to the user's commands and responds back normally in text setup – voice interactions setup – voice interactions engati enables end 2 end voice interactions and whatsapp voice notes handling by enabling integration with google voice to integrate, you would first need to generate your google service account credentials as a json file as a prerequisite, you need to have a google app configured in your google console account step 1 visit https //console cloud google com/ and click on “ select a project ”, and add details to it step 2 navigation menu > apis & services > enable apis & services step 3 search for “cloud speech to text api” as well as ”cloud text to speech api” and enter your payment details to get it enabled step 4 navigate to menu > iam & admin tab in the left panel open the iam & admin page in the gcp console select your project and click continue step 5 in the left nav, click service accounts select the option to "create a service account" step 6 you can provide a name of your choice for the service account and continue select “ organization administrator ” in the role field of " grant this service account access to project" and continue in the next step, you will have the option to grant users access this part can be skipped step 7 click on the three dots and select "manage keys" step 8 click on add key and then create new key create a json key type step 9 upload the credentials json file in engati under configure > advanced > voice integration voice conversation for multilingual bots engati chatbots can also respond in multiple languages, to use this functionality you must have ” localization service ” enabled in your chatbot please follow this document to know more about multilingual capability https //docs engati com/documentation/building your bot/enabling multiple languages/ once this option has been enabled, when the user selects the arabic language option and asks a question in arabic the bot would respond to the user in arabic similarly if the user had selected the german language and would ask the user in german the bot would respond in the same note the languages supported in the engati chatbot platform for voice conversation are dependent on the fact that these languages must be supported by google too configuration – voice conversation on web configuration – voice conversation on web once voice integration is completed, configuration for enabling voice on web widget can be completed from the deploy section supported configurations include enable voice input allow users to give input by speaking instead of typing the message this is supported only for the web widget usage on chrome enable voice conversation this option is available after google voice integration, explained earlier is completed on enabling this option, engati would use your configured google account for voice to text and text to voice conversions enable continuous voice mode this allows users to have complete voice conversation including speaking to the bot and listening to the bot respond back in voice voice response gender the bot will respond to the selected gender’s voice phrase hints this would allow you to enter 10 custom keywords or phrases that need to be recognized by the voice engine this would typically help you to enter your domain specific keywords or your brand/product names end user experience on the web widget for the chatbot on the first launch of the bot for a user, the browser may pop up a permission dialog box to allow the use of a microphone allowing microphone access is mandatory when voice input is enabled, the bot user will see a mic icon at the bottom right corner of the chat window to start voice conversations, this mic icon needs to be clicked once voice mode starts, the bot gives the user the option to speak before processing the collected voice input and responding back in the configured voice note voice integration on whatsapp is supported only on certain providers if you face any issues or queries please reach out to us at support\@engati com