Authors:
Daniel Pawlowicz
1
;
Jule Weber
2
and
Claudia Dukino
3
Affiliations:
1
University of Stuttgart IAT, Institute of Human Factors and Technology Management, Stuttgart, Germany
;
2
Eberhard Karls University Tübingen, Tübingen, Germany
;
3
Fraunhofer IAO, Fraunhofer Institute for Industrial Engineering IAO, Stuttgart, Germany
Keyword(s):
Whisper, Fine-Tuning, Domain, Speech-to-Text Transcription.
Abstract:
The integration of Speech-to-Text (STT) technology has the potential to enhance the efficiency of industrial workflows. However, standard speech models demonstrate suboptimal performance in domain-specific use cases. In order to gain user trust, it is essential to ensure accurate transcription, which can be achieved through the fine-tuning of the model to the specific domain. OpenAI’s Whisper was selected as the initial model and subsequently fine-tuned with domain-specific real-world recordings. The fine-tuned model outperforms the initial model in terms of transcription of technical jargon, as evidenced by the results of the study. The fine-tuned model achieved a validation loss of 1.75 and a Word Error Rate (WER) of 1. In addition to improving accuracy, this approach addresses the challenges of noisy environments and speaker variability that are common in real-world industrial environments. The present study demonstrates the efficacy of fine-tuning the Whisper model to new vocabul
ary with technical jargon, thereby underscoring the value of model adaptation for domain-specific use cases.
(More)