Add a feature: Translate voice calls

Similarly to Skype, you can add a speech translator, a.k.a translating spoken text during conversation and speaking the detected phrases in another language.

This can be done by using:

Translate API: https://cloud.google.com/translate/
Web Speech API: https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_API

More specifically, within Web Speech API, use:

Speech Recognition: https://developer.mozilla.org/en-US/docs/Web/API/SpeechRecognition
Speech Synthesis (already being used in text chat with /tts): https://developer.mozilla.org/en-US/docs/Web/API/SpeechSynthesis

By combining the three - if both users use headsets, the input from mic 1 can be converted to text, then the Translate API translates the text from language 1 to 2, and finally - the Speech Synthesis can speak the translated text to user 2.

Of course, you should also use another API to first detect if both languages are not the same, otherwise it'll just be annoying to hear the same sentence twice.

Comments