Voice Project

The goal of this project is to experiment with voice assistance.

Problem

In a time where laws on phone use while driving are becomming more strict, Automakers have been making their infortainment systems more phone like. Changes such as:

• More Screens
• Larger screens
• Increased connectivity
• Feature packed menus

and more have made our vehicles less intuitive to use. They have also increased

Solution

I propose that we need to move away from screens and find an alternative way for drivers to interact with their cars.

I this project I want to investigate voice assistants as a potential solution.

Voice assistance could replace screens because of the following:

• Allows for a diverse set of commands
• Driver does not have use their hands or eyes for the interaction
  • both of which are be occupied with driving
• Intuitive, just like communicating to the passenger

Potential Implementations

• LiveKit
• OpenVoice OS
• Rhaspy

Learnings

1. 5 major parts of a voice assistant

   ASR : Automatic Speech Recongnition

   NLU : Natural Language Understanding

   DM : Dialogue Managment

   TTS : Text-to-Speech

   WWD : Wake Word Detection

Important references

• The BEST in car voice command assistant product from Xpeng P7
  • This video shows a good example of what a voice assitant could be. Standout features include
    • Multiple commands per wake
    • Anything that is on the screen can be done using voice
    • A simple confirmations
      • "Ok"
      • "A/C On"
    • User can interupt at any time
    • Buffering commands
    • Context Aware