Cars, mobile phones, and smart home devices already provide automatic speech recognition (ASR) by default. However, human machine interfaces (HMI) in industrial settings, as opposed to consumer settings, operate under different conditions and thus, present different design challenges. Voice control, arguably the most natural form of communication, has the potential to shorten complex command sequences and menu structures in order to directly execute a final command. Therefore, this contribution explored how differing HMI scenarios could possibly be optimized, by either replacing or complementing existing touch control interactions with voice control. Typical machine commands from CNC milling machines and industrial robots were categorized by their complexity, quantified by menu level and the necessary number of interactions. The collected interaction data showed that voice control can already provide a time efficiency advantage at either one additional menu level or three touchscreen interactions. For complex machine commands, such as those needing five menu levels and seven interactions on the touchscreen, the time efficiency advantage of voice control can reach up to 67 %. Furthermore, the study shows the possibility of reducing machine operator training times when using voice control by significantly lower interaction times for the first repetition of the participants.
Evaluating the Efficiency of Voice Control as Human Machine Interface in Production - ReadMe
The data set provides all used data for the documented research study.
The data is sorted by 15 participants, 33 voice (speech)/touch commands,
and 3 repetitions for every voice/touch command for every participant.
The input durations are measured in seconds.
Questions and results of the questionnaire. Details are described in the paper.
- Measured input durations of the study voice-controlled_production_time_efficiency_measured_times.xlsx (33.34 kB)
- Results of the questionnaire of the study voice-controlled_production_time_efficiency_subjective_perception.xlsx (14.93 kB)