loading
  • Login
  • Sign-Up

Research.Publish.Connect.

Paper

Authors: Samuel Silva and António Teixeira

Affiliation: University of Aveiro, Portugal

ISBN: 978-989-758-212-7

Keyword(s): Audiovisual Speech, Articulatory Synthesis, European Portuguese.

Related Ontology Subjects/Areas/Topics: Biomedical Engineering ; Biomedical Signal Processing ; Cybernetics and User Interface Technologies ; Devices ; Human-Computer Interaction ; Information and Systems Security ; Physiological Computing Systems ; Physiological Processes and Bio-Signal Modeling, Non-Linear Dynamics

Abstract: In speech communication, both the auditory and visual streams play an important role, ensuring both a certain level of redundancy (e.g., lip movement) and transmission of complementary information (e.g., to emphasize a word). The common current approach to audiovisual speech synthesis, generally based on data-driven methods, yields good results, but relies on models controlled by parameters that do not relate with how humans do it, being hard to interpret and adding little to our understanding of the human speech production apparatus. Modelling the actual system, adopting an anthropomorphic perspective would provide a myriad of novel research paths. This article proposes a conceptual framework to support research and development of an articulatory-based audiovisual speech synthesis system. The core idea is that the speech production system is modelled to produce articulatory parameters with anthropomorphic meaning (e.g., lip opening) driving the synthesis of both the auditory and visu al streams. A first instantiation of the framework for European Portuguese illustrates its viability and constitutes an important tool for research in speech production and the deployment of audiovisual speech synthesis in multimodal interaction scenarios, of the utmost relevance for the current and future complex services and applications. (More)

PDF ImageFull Text

Download
Sign In Guest: Register as new SCITEPRESS user or Join INSTICC now for free.

Sign In SCITEPRESS user: please login.

Sign In INSTICC Members: please login. If not a member yet, Join INSTICC now for free.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 54.163.117.182. INSTICC members have higher download limits (free membership now)

In the current month:
Recent papers: 1 available of 1 total
2+ years older papers: 2 available of 2 total

Paper citation in several formats:
Silva S. and Teixeira A. (2017). An Anthropomorphic Perspective for Audiovisual Speech Synthesis.In Proceedings of the 10th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4: BIOSIGNALS, (BIOSTEC 2017) ISBN 978-989-758-212-7, pages 163-172

@conference{biosignals17,
author={Samuel Silva and António Teixeira},
title={An Anthropomorphic Perspective for Audiovisual Speech Synthesis},
booktitle={Proceedings of the 10th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4: BIOSIGNALS, (BIOSTEC 2017)},
year={2017},
pages={163-172},
doi={},
isbn={978-989-758-212-7},
}

TY - CONF

JO - Proceedings of the 10th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4: BIOSIGNALS, (BIOSTEC 2017)
TI - An Anthropomorphic Perspective for Audiovisual Speech Synthesis
SN - 978-989-758-212-7
AU - Silva S.
AU - Teixeira A.
PY - 2017
SP - 163
EP - 172
DO -

Sorted by: Show papers

Note: The preferred Subjects/Areas/Topics, listed below for each paper, are those that match the selected paper topics and their ontology superclasses.
More...

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.

Show authors

Note: The preferred Subjects/Areas/Topics, listed below for each author, are those that more frequently used in the author's papers.
More...