Speaking to Machine: Validity of Pronunciation Assessment by Technology-Driven Systems
DOI:
https://doi.org/10.55544/ijrah.5.3.31Keywords:
Pronunciation assessment, technology-driven, intelligibility, high- and low-stakes assessmentsAbstract
This mini review discusses the validity of technology-driven pronunciation assessment systems, focusing on their alignment with intelligibility as the central criterion of communicative competence. The review highlights the need for theoretical recalibration to ensure valid and inclusive assessment practices in high- and low-stakes contexts by interrogating scoring mechanisms, native-norm dependencies, and human-machine correlations.
Downloads
References
Derwing, T. M., & Munro, M. J. (2005). Second Language Accent and Pronunciation Teaching: A Research-Based Approach. TESOL Quarterly, 39(3), 379–397. https://doi.org/10.2307/3588486
Derwing, T. M., & Munro, M. J. (2015). Pronunciation fundamentals: Evidence-based perspectives for L2 teaching and research, 42. John Benjamins Publishing Company. https://doi.org/10.1093/applin/amw041
Baese-Berk, M. M., Levi, S. V., & Van Engen, K. J. (2023). Intelligibility as a measure of speech perception: Current approaches, challenges, and recommendations. The Journal of the Acoustical Society of America, 153(1), 68–76. https://doi.org/10.1121/10.0016806
Field, J. (2005). Intelligibility and the Listener: The Role of Lexical Stress. TESOL Quarterly, 39(3), 399-. https://doi.org/10.1002/(ISSN)1545-7249
Celce-Murcia, M., Brinton, D. M., & Goodwin, J. M. (1996). Teaching pronunciation: A reference for teachers of English to speakers of other languages. Cambridge University Press.
Celce-Murcia, M., Brinton, D. M., & Goodwin, J. M. (2010). Teaching pronunciation hardback with audio CDs (2): A course book and reference guide. Cambridge University Press.
Hahn, L. D. (2004). Primary Stress and Intelligibility: Research to Motivate the Teaching of Suprasegmentals. TESOL Quarterly, 38(2), 201-. https://doi.org/10.1002/(ISSN)1545-7249
Litman, D., Strik, H., & Lim, G. S. (2018). Speech technologies and the assessment of second language speaking: approaches, challenges, and opportunities. Language Assessment Quarterly, 15(3), 294-309. https://doi.org/10.1080/15434303.2018.1472265
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed.). New York: American Council on Education.
Isaacs, T., Thomson, R. I., Kang, O., & Murphy, J. M. (2018). Fully automated speaking assessment: Changes to proficiency testing and the role of pronunciation. In The Routledge Handbook of Contemporary English Pronunciation (1st ed., Vol. 1, pp. 570–584). Routledge. https://doi.org/10.4324/9781315145006-36
Van Moere, A., Suzuki, M., Kang, O., & Ginther, A. (2018). Using Speech Processing Technology In Assessing Pronunciation. In Assessment in Second Language Pronunciation (1st ed., pp. 137–152). Routledge. https://doi.org/10.4324/9781315170756-8
Messick, S. (1996). Validity of performance assessments. In G. Phillips (Ed), Technical issues in large-scale performance assessment, 1-18.
Tajeddin, Z., Khatib, M., & Mahdavi, M. (2022). Critical language assessment literacy of EFL teachers: scale construction and validation. Language Testing, 39(4), 649-678. https://doi.org/10.1177/02655322211057040
Chen, T., & Sun, S. (2025). Evaluating automated evaluation systems for spoken English proficiency: An exploratory comparative study with human raters. PloS One, 20(3), e0320811-. https://doi.org/10.1371/journal.pone.0320811
Riazi, M. (2013). Concurrent and predictive validity of the Pearson Academic Test of English (PTE Academic). Studies in Language Assessment, 1–27. https://doi.org/10.58379/VFSQ6999
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Ali Babaeian
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
10.55544/ijrah
editor@ijrah.com | 
+91-8874396939
This work is licensed under a 