Robo-Sensei's NLP-Based Error Detection and Feedback Generation

Authors

  • Noriko Nagata

DOI:

https://doi.org/10.1558/cj.v26i3.562-579

Keywords:

Natural Language Processing, Error Detection, Feedback Generation, Japanese, Online Textbook

Abstract

This paper presents a new version of Robo-Sensei's NLP (Natural Language Processing) system which updates the version currently available as the software package ROBO-SENSEI: Personal Japanese Tutor (Nagata, 2004). Robo-Sensei's NLP system includes a lexicon, a morphological generator, a word segmentor, a morphological parser, a syntactic parser, an error detector, and a feedback generator. The present paper focuses on the error detector and the feedback generator and describes how those components are integrated into Robo-Sensei's NLP system, what types of errors are detected, and what kinds of feedback messages are generated. The author is currently developing a new Robo-Sensei online textbook (Nagata, in press). The updated system is the NLP processing engine behind the new textbook.

References

Amaral, L., & Meurers, D. (2008, March). Little things With big effects: On the identification and interpretation of tokens for error diagnosis in ICALL. Paper presented at the CALICO Preconference Workshop on Automatic Analysis of Learner Language, San Francisco, CA.

Dansuwan, S., Nishina, K., Akahori, K., & Shimizu, Y. (2001). Development and evaluation of a Thai learning system on the web using natural language processing. CALICO Journal, 19, 67-88. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

Delmonte, R. (2003). Linguistic knowledge and reasoning for error diagnosis and feedback generation. CALICO Journal, 20, 513-532. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

De Felice, R., & Pulman, S. G. (2008, March). Automatic detection of preposition errors in learner writing. Paper presented at the CALICO Preconference Workshop on Automatic Analysis of Learner Language, San Francisco, CA.

Heift, T. (2003). Multiple learner errors and meaningful feedback: A challenge for ICALL systems. CALICO Journal, 20, 533-548. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

Heift, T., & Schulze, M. (2007). Errors and intelligence in computer-assisted language learning: Parsers and pedagogues. New York: Routledge.

Holland, V. M., Kaplan, J. D., & Sams, M. R. (1995). Intelligent language tutors. Mahwah, NJ: Lawrence Erlbaum.

Jang, S. B., Lee, S., & Seo, S. (2008, March). Annotation of Korean learner corpora for particle error detection. Paper presented at the CALICO Preconference Workshop on Automatic Analysis of Learner Language, San Francisco, CA.

L’haire, S., & Vandeventer Faltin, A. (2003). Error diagnosis in the FreeText project. CALICO Journal, 20, 481-495. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

Matsumoto, Y. (1988). 自然言語理解 [Natural Language Understanding]. In H. Tanaka & J/ Tsujii (Eds.), 三章統語解析の手法 [Chapter 3: Parsing methods]. Tokyo: オーム社.

Nagata, N. (1993). Intelligent computer feedback for second language instruction. The Modern Language Journal, 77, 330-339.

Nagata, N. (1995). An effective application of natural language processing in second language instruction. CALICO Journal, 13, 47-67. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

Nagata, N. (1996). Computer vs. workbook instruction in second language acquisition. CALICO Journal, 14, 53-75. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

Nagata, N. (1997a). The effectiveness of computer-assisted metalinguistic instruction: A case study in Japanese. Foreign Language Annals, 30, 187-200.

Nagata, N. (1997b). An experimental comparison of deductive and inductive feedback generated by a simple parser. System, 25, 515-534.

Nagata, N. (2002). BANZAI: An application of natural language processing to web-based language learning. CALICO Journal, 19, 583-999. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

Nagata, N. (2004). ROBO-SENSEI: Personal Japanese tutor. Boston, MA: Cheng and Tsui.

Nagata, N. (2007). Input enhancement by natural language processing. In C. Gascoigne (Ed.), Assessing the impact of input enhancement in second language education: Evaluation in theory, research and practice (pp. 153-167). Stillwater, OK: New Forums Press.

Nagata, N. (in press). An online Japanese textbook with natural language processing. In I. Lancashire (Ed.), Teaching literature and language online. New York: MLA.

Nagata, N., & Swisher, V. (1995). A study of consciousness-raising by computer: The effect of metalinguistic feedback on second language learning. Foreign Language Annals, 28, 337-347.

Omaggio, A. C. (1986). Teaching language in context. Boston: Heinle and Heinle.

Oyama, H., Matsumoto, Y., Asahara, M., & Sakata, K. (2008, March). Construction of an error information tagged corpus of Japanese language learners and automatic error detection. Paper presented at the CALICO Preconference Workshop on Automatic Analysis of Learner Language, San Francisco, CA.

Reuer, V. (2003). Error recognition and feedback with lexical functional grammar. CALICO Journal, 20,

-512. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

Sanders, R. (1991). Error analysis in purely syntactic parsing of free input: The example of German.

CALICO Journal, 9, 72-89. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

Swartz, M. L., & Yazdani, M. (Eds.). (1992). Intelligent tutoring systems for foreign language learning: The bridge to international communication. London: Longman.

Tschichold, C. (2003). Lexically driven error detection and correction. CALICO Journal, 20, 549-559. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

Winograd, T. (1983). Language as a cognitive process. Vol. I: Syntax. Boston: Addison-Wesley.

Yang, J. C., & Akahori, K. (1998). Error analysis in Japanese writing and its implementation in a computer assisted language learning system on the world wide web. CALICO Journal, 15, 47-66. Retrieved March 23, 2009, from https://calico.org/page.php?id=5

Downloads

Published

2013-01-14

Issue

Section

Articles

How to Cite

Nagata, N. (2013). Robo-Sensei’s NLP-Based Error Detection and Feedback Generation. CALICO Journal, 26(3), 562-579. https://doi.org/10.1558/cj.v26i3.562-579