Voice-controlled_production_efficiency_study_data

Citation Author(s):
Marvin
Norda
Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg Branch for Hearing, Speech and Audio Technology HSA
Christoph
Engel
Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg Branch for Hearing, Speech and Audio Technology HSA
Jan
Rennies
Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg Branch for Hearing, Speech and Audio Technology HSA
Jens Ekkehart
Appell
Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg Branch for Hearing, Speech and Audio Technology HSA
Sven Carsten
Lange
University of Applied Sciences Emden/Leer - Emden Campus, Mechanical Engineering
Axel
Hahn
Deutsches Zentrum für Luft- und Raumfahrt eV, Institute of Systems Engineering for future Mobility
Submitted by:
Marvin Norda
Last updated:
Tue, 06/13/2023 - 05:03
DOI:
10.21227/zqt3-yw55
Data Format:
Links:
License:
0
0 ratings - Please login to submit your rating.

Abstract 

Cars, mobile phones, and smart home devices already provide automatic speech recognition (ASR) by default. However, human machine interfaces (HMI) in industrial settings, as opposed to consumer settings, operate under different conditions and thus, present different design challenges. Voice control, arguably the most natural form of communication, has the potential to shorten complex command sequences and menu structures in order to directly execute a final command. Therefore, this contribution explored how differing HMI scenarios could possibly be optimized, by either replacing or complementing existing touch control interactions with voice control. Typical machine commands from CNC milling machines and industrial robots were categorized by their complexity, quantified by menu level and the necessary number of interactions. The collected interaction data showed that voice control can already provide a time efficiency advantage at either one additional menu level or three touchscreen interactions. For complex machine commands, such as those needing five menu levels and seven interactions on the touchscreen, the time efficiency advantage of voice control can reach up to 67 %. Furthermore, the study shows the possibility of reducing machine operator training times when using voice control by significantly lower interaction times for the first repetition of the participants.

Instructions: 

Evaluating the Efficiency of Voice Control as Human Machine Interface in Production - ReadMe

controlled_production_time_efficiency_measured_times.xlsx

    The data set provides all used data for the documented research study.
    The data is sorted by 15 participants, 33 voice (speech)/touch commands,
    and 3 repetitions for every voice/touch command for every participant.                    
    The input durations are measured in seconds.    

voice-controlled_production_time_efficiency_subjective_perception.xlsx

    Questions and results of the questionnaire. Details are described in the paper.

Funding Agency: 
Niedersächsisches Ministerium für Wissenschaft und Kultur
Grant Number: 
Vorab 11 – 76251-99-2/19 (ZN3812)

Documentation