High school teachers’ perceptions of using ChatGpt for designing English reading comprehension tests for tenthgrade students

Main Article Content

High school teachers’ perceptions of using ChatGpt for designing English reading comprehension tests for tenthgrade students

Tác giả

Hoàng Hồng Phượng
Lê Thị Hạ Quỳnh

Tóm tắt

Reading tests are effective assessments to evaluate EFL learners’ reading ability; however, designing them has been reported by teachers to be time-consuming and demanding. With the development of AI tools like ChatGPT, many English teachers have employed them to assist in making such tests. While ChatGPT can support the generation of many reading test components, some concern that its created content is not reliable without human supervision. To investigate high school teachers’ perceptions of using ChatGPT for this purpose, we carried out this study using embedded mixed-methods research. We distributed questionnaires to 20 high school teachers who were generally familiar with the tool; then, to gain an in-depth understanding of their opinions, we conducted semi-structured interviews with 10 randomly selected participants. After analyzing the data, we found that between 60% and 95% of the teachers agreed ChatGPT is useful in generating reading tests across various aspects, particularly in generating comprehension questions (95%) and saving time and effort (85%). However, 75% of respondents also recognized that certain issues persist in ChatGPT’s output, such as repetitive or mechanical phrasing in questions, inconsistencies in passage length and structure, and potential inaccuracies or biases. This highlights the crucial role of teachers in reviewing and refining AI-generated content to ensure its suitability before using it in assessments.

Article Details

Chuyên mục
Khoa học Xã hội & Nhân văn
Tiểu sử của Tác giả

Hoàng Hồng Phượng

Khoa Ngoại ngữ, Trường Đại học Tây Nguyên;
Tác giả liên hệ: Hoàng Hồng Phượng; ĐT: 0359213222; Email: hhphuong@ttn.edu.vn.

Lê Thị Hạ Quỳnh

Khoa Ngoại ngữ, Trường Đại học Văn Lang

Tài liệu tham khảo

  • Abas, M. A., Arumugam, S. E., Yunus, M. M., & Raliq, K R. M. (2023). ChatGPT and Personalized Learning: Opportunities and Challenges in Higher Education. International Journal of Academic Research in Business & Social Sciences, 13(12). http://dx.doi.org/10.6007/IJARBSS/v13-i12/20240
  • Ahn, Y. Y. (2023). Performance of ChatGPT 3.5 on CSAT: Its potential as a language learning and assessment tool. Journal of the Korea English Education Society, 22(2), 119–145. http://dx.doi. org/10.18649/jkees.2023.22.2.119
  • AIPRM (n.d.). 100+ ChatGPT Statistics 2024. Retrieved from https://www.aiprm.com/chatgptstatistics/ on 02 Jan, 2025.
  • Anggeraja, M. F. A., Samtidar, & Aeni, N. (2024). The Use of ChatGPT in Enhancing Students Writing Ability. Journal of Excellence in English Language Education, 3(3), 396-413.
  • Bezirhan, U., & Davier, M. V. (2023). Automatics reading passage generation with OpenAI’ large language model. Computer and Education: Artificial Intelligence 5 (2023) 100161. https://doi. org/10.1016/j.caeai.2023.100161
  • Bonner, E., Lege, R., & Frazier, E. (2023). Large Language Model-based AI in the Language Classroom: Practical Ideas for Teaching. Teaching English with Technology, 23(1), 23-41. https:// doi.org/10.56297/BKAM1691/WIEO1749
  • Negro, D. L. (2024). The influence of AI on EFL teaching materials development: Evaluating reading comprehension exercises generated by ChatGPT. Università Ca’ Foscari Venezia Publisher.
  • Gregersen, E. (2024). Chat Geberative Pre-training Transformer. Britannica. Retrieved from https:// https://www.britannica.com/technology/ChatGPT on 26 Dec, 2024.
  • Hong, W. S. H. (2023). The impact of ChatGPT on foreign language teaching and learning: Opportunities in education and research. Journal of Education and Technology and Innovation, 5(1), 37-45. https:// doi.org/10.61414/jeti.v5i1.103
  • Kaplan-Rakowski, R., Sweigart Grotewold, K., Hartwick, P., Papin, K. (2023). Generative AI and teachers’ perspectives on its implementation in education. Journal of Interactive Learning Research, 34(2), 313-338.
  • Karakas, A., & Yesilyurt, Y. E. (2023). The Use of ChatGPT for Lesson Planning. ChatGPT in Foreign Language Education and Translation Studies. ISBN: 978-605-170-934-5 e-ISBN: 978-605-170- 935-2.
  • Konhke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 54(2), 537–550. https://doi.org/10.1177/00336882231162868.
  • Koraishi, O. (2023). Teaching English in the Age of AI: Embracing ChatGPT to Optimize EFL Materials and Assessment. LET Linguistics Literature and English Teaching Journal, 3(1), 55-72.
  • Kwon, S-K., & Lee, Y. T. (2023). Investigating the performance of generative AI ChatGPT’s reading comprehension ability. Journal of the Korea English Education Society, 22(2), 147–172.
  • Meniado, J. C. (2023). The Impact of ChatGPT on English Language Teaching, Learning, and Assessment: A Rapid Review of Literature. Arab World English Journal, 14, 3-18. https://dx.doi. org/10.24093/awej/vol14no4.1
  • Nguyen, T. P. T. (2023). The application of ChatGPT in language test design – The what and how. Proceedings of the AsiaCALL International Conference, 4, 104-115. https://doi.org/10.54855/ paic.2348
  • Rivera-Rosas, C. N., Calleja-Lopez, J. R. T., Ruibal-Tavares, E., Villanueva-Neri, A., Flores-Felix, C. M., & Trujillo-Lopez, S. (2024). Exploring the potential of ChatGPT to create multiple-choice questions exams. Educacion Medica, 24(4), 100930. https://doi.org/10.1016/j.edumed.2024.100930
  • Shin, D., & Lee, J. H. (2023). Can ChatGPT make reading comprehension testing items on par with human experts?. Language Learning & Technology, 27(3), 27-40.
  • Sihite, M. R., Meisuri, & Sibarani, B. (2023). Examining the Validity and Reliability of ChatGPT 3.5-Generated Reading Comprehension Questions for Academic Texts. RIELS Journal, 4(4), 937- 944. https://doi.org/10.47175/rielsj.v4i4.835
  • Statista (2023). Amount of companies using ChatGPT in their business function in 2023, by industry. Retrieved from https://www.statista.com/statistics/1384323/industries-using-chatgpt-in-business/ on 02 Jan, 2025.
  • Tseng, W., & Warschauer, M. (2023). AI-writing tools in education: If you can’t beat them, join them. Journal of China Computer-Assisted Language Learning, 3(2), 258-262. https://doi.org/10.1515/ jccall-2023-0008
  • UNESCO (2023). Harnessing the Era of Artificial Intelligence in Higher Education: A Primer for Higher Education Stakeholders.
  • Xiao, C., Xu, S. X., Zhang, K. Wang, Y., & Xia, L. (2023). Evaluating Reading Comprehension Exercises Generated by LLMs: A showcase of ChatGPT in Education Applications. Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2023), 610-625. Association for Computational Linguistics.