A Comparative Study on the Performance of ChatGPT-4 and Claude 3 in Translating Engineering Specialized Course Textbooks

Yiqin Jiang

2025

Abstract

This study examines the advantages and disadvantages of Claude 3 and ChatGPT-4 for translating engineering texts. Both AI technologies analyze scientific texts from four engineering textbooks for accuracy, fluency, audience appropriateness and logicality using the CO-STAR framework. The translation outcomes of AI tools were contrasted and examined with those of rule-based machine translation and human translation of the four paragraphs. Overall, Claude 3 performs better than ChatGPT-4, according to the results, and ChatGPT-4 has to be enhanced in terms of audience adaption and fluency. Nevertheless, the overall quality of the translations is inferior to that of human translators, and both AI systems have representational flaws. This study emphasizes the need for improvement in the distribution of educational resources across languages, as well as the potential of AI technologies for translating engineering textbooks.

Paper Citation

in Harvard Style

Jiang Y. (2025). A Comparative Study on the Performance of ChatGPT-4 and Claude 3 in Translating Engineering Specialized Course Textbooks. In Proceedings of the 1st International Conference on Innovative Education and Social Development - Volume 1: IESD; ISBN 978-989-758-779-5, SciTePress, pages 454-460. DOI: 10.5220/0013999300004912

in Bibtex Style

@conference{iesd25,
author={Yiqin Jiang},
title={A Comparative Study on the Performance of ChatGPT-4 and Claude 3 in Translating Engineering Specialized Course Textbooks},
booktitle={Proceedings of the 1st International Conference on Innovative Education and Social Development - Volume 1: IESD},
year={2025},
pages={454-460},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013999300004912},
isbn={978-989-758-779-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 1st International Conference on Innovative Education and Social Development - Volume 1: IESD
TI - A Comparative Study on the Performance of ChatGPT-4 and Claude 3 in Translating Engineering Specialized Course Textbooks
SN - 978-989-758-779-5
AU - Jiang Y.
PY - 2025
SP - 454
EP - 460
DO - 10.5220/0013999300004912
PB - SciTePress