Comparing the Performances of Grammarly and ChatGPT in Correcting ESL Writing Errors (74816)

Session Information: Foreign Languages Education & Applied Linguistics (including ESL/TESL/TEFL)
Session Chair: Ian Davison

Thursday, 23 November 2023 14:20
Session: Session 4
Room: Room 707
Presentation Type: Oral Presentation

All presentation times are UTC + 9 (Asia/Tokyo)

The research on grammar checking systems has been conducted for a considerable period of time. In recent years, Grammarly has been widely recommended and has garnered impressive acclaim. In November 2022, OpenAI ChatGPT emerged, making a significant impact across multiple research fields. To compare the performances of Grammarly and ChatGPT-based checker, this study utilized example sentences from a renowned reference book called "Common Mistakes in English" (Fitikides, 2002) by Longman. The data set includes 584 typical errors made by non-native English speakers. The results obtained in this study are interesting. In terms of un-English expressions, Grammarly corrected only 22% of the errors, while ChatGPT successfully revised 75% of them. Regarding cases of incorrect omissions, Grammarly corrected only 48.7% of the errors, whereas ChatGPT accurately revised 85% of them. In the areas of misplaced words, Grammarly rectified only 33% of the errors, while ChatGPT achieved an impressive 89% correction rate. In terms of confused verbs, Grammarly addressed only 14.8% of the errors, whereas ChatGPT accurately revised 85% of them. In the case of confused nouns, Grammarly failed to correct any errors, whereas ChatGPT correctly revised 86% of the 21 errors. Finally, for the confusion of parts of speech, Grammarly corrected only 43% of the errors, while ChatGPT achieved a 77% accuracy rate. Based on these results, it is clear that ChatGPT achieves remarkably high levels of accuracy, ranging from 75% to as high as 89%. This result clearly demonstrates ChatGPT's significant improvement in precision when correcting ESL errors.

Authors:
Haojan Chen, National Taiwan Normal University, Taiwan


About the Presenter(s)
Professor Haojan chen is a University Professor/Principal Lecturer at National Taiwan Normal University in Taiwan

See this presentation on the full scheduleThursday Schedule



Conference Comments & Feedback

Place a comment using your LinkedIn profile

Comments

Share on activity feed

Powered by WP LinkPress

Share this Presentation

Posted by Clive Staples Lewis

Last updated: 2023-02-23 23:45:00