Investigating the Effectiveness of ChatGPT in Language Assessment (82833)

Session Information: Assessment Theories & Methodologies
Session Chair: Badri Adhikari

Wednesday, 27 November 2024 17:10
Session: Session 5
Room: Room 705 (7F)
Presentation Type: Oral Presentation

All presentation times are UTC + 9 (Asia/Tokyo)

This study investigates the effectiveness of employing Artificial Intelligence (AI), notably ChatGPT, in language assessment. With the continuous advancement and integration of AI technology in education, there is an increasing interest in its potential to enhance language learning and assessment. In this research, ChatGPT was used to with evaluate 15 essays written by English students, offering detailed feedback and assigning grades based on predetermined criteria in a rubric. Subsequently, an experienced senior teacher specializing in English writing assessed the results. Utilizing a qualitative approach, the study conducted an in-depth interview with the teacher to glean insights into the reliability and effectiveness of ChatGPT's evaluation. The findings revealed a notable correlation between the grades assigned by the teacher and ChatGPT for the set of essays. Furthermore, the teacher interviews underscored ChatGPT's utility in alleviating teachers' workload, albeit acknowledging its partial replacement of human teachers. This study advocates for AI as a complementary tool to human instruction, emphasizing the indispensability of human expertise for comprehensive feedback. It suggests a collaborative approach between AI and human teachers to enhance writing instruction and evaluation.

Authors:
Maryam Alghafri, University of Technology and Applied Sciences, Oman
Maha Aldaree, University of Technology and Applied Sciences, Oman


About the Presenter(s)
Dr Maryam is the head of Continous education and community service department at the University of Technology and Applied Sciences

See this presentation on the full scheduleWednesday Schedule


A Note to Presenters

To enhance academic profiles and showcase research, we encourage all presenters and co-presenters to include links to their public LinkedIn, ResearchGate profile, and research websites. Presenters may update their bio for their presentation by completing the form linked below by October 22, 2024.
- Presenter Information Update Form
Submitted changes will be reflected on November 01, 2024

Additionally, presenters should also update their IAFOR account details if there have been any changes to affiliations or biographies.
- https://submit.iafor.org/my-account/edit-account


Conference Comments & Feedback

Place a comment using your LinkedIn profile

Comments

Share on activity feed

Powered by WP LinkPress

Share this Presentation

Posted by Clive Staples Lewis

Last updated: 2023-02-23 23:45:00