Computing Accurate Grammatical Feedback in a Virtual Writing Conference for German-Speaking Elementary-School Children

An Approach Based on Natural Language Generation

Authors

  • Karin Harbusch
  • Gergana Itsova
  • Ulrich Koch
  • Christine Kühner

DOI:

https://doi.org/10.1558/cj.v26i3.626-643

Keywords:

Tutoring System, Pedagogical Agent, Natural Language Generation, Automatic Syntactic Feedback, German

Abstract

We built a natural language processing (NLP) system implementing a "virtual writing conference" for elementary-school children, with German as the target language. Currently, state-of-the-art computer support for writing tasks is restricted to multiple-choice questions or quizzes because automatic parsing of the often ambiguous and fragmentary texts produced by students presents insurmountable problems. Here, we follow a different course by deploying natural language generation technology to evaluate and improve the grammatical quality of learner output. Based on an abstract representation of the story under construction, all paraphrases of simple and combined clauses are generated fully and automatically. From this source, the system produces exercises enabling the learners to improve their sentences. We describe how a pedagogical agent supports the writing process of elementary-school children by providing appropriate feedback.

References

Altman, P., Caro, M., Metge-Egan, L., & Roberts, L. (2007). Sentence combining workbook (2nd ed.). Boston: Thomson.

André, E., Rist, T., & Müller, T. (1997). WebPersona: A life-like presentation agent for educational applications on the World Wide Web. In Proceedings of the Intelligent Educational Systems on the World Wide Web Workshop, 8th World Conference of the AIED Society (pp. 25-36). Kobe, Japan.

Bateman, J. A. (1997). Enabling technology for multilingual natural language generation: The KPML development environment. Journal of Natural Language Engineering, 3, 5-55.

Callaway, C. B. (2000). Narrative prose generation. Unpublished doctoral dissertation, North Carolina State University, Raleigh, NC.

Copestake, A., Flickinger, D., Sag, I., & Pollard, C. (2005). Minimal Recursion Semantics: An introduction. Journal of Research on Language and Computation, 3, 281-332.

Daiker, D. A., Kerek, A., & Morenberg, M. (Eds.). (1985). Sentence combining: A rhetorical perspective. Carbondale, IL: Southern Illinois University Press.

Davies, G., & Bruzzone, M. (2004). Fun with texts version 4.0 (new multi-media version). Maidenhead, UK: Camsoft. Available at http://www.camsoftpartners.co.uk/fwt.htm

Economides, A. A. (2005). Adaptive feedback evaluation. In Proceedings of the 5th International Conference on Distance and Web Engineering (DIWEB’05) (pp. 134-139). Corfu, Greece.

Feiler, P. H., & Walker, J. J. (2001). Adaptive feedback scheduling of incremental and design-to-time tasks. In Proceedings of the 23rd International Conference on Software Engineering (CSE 2001) (pp. 318-326). Toronto, Canada.

Felix, U. (2005). E-learning pedagogy in the third millennium: The need for combining social and cognitive constructivist approaches. RECALL, 17, 85-100.

Fortmann, C., & Forst, M. (2004). An LFG grammar checker for CALL. In R. Delmonte, P. Delcloque, & S. Tonelli (Eds.), Proceedings of the InSTIL/ICALL2004 Symposium on NLP and speech technologies in advanced language learning systems (pp. 59-62). Padua, Italy: Unipress.

Fränkel, C. (2008). Evaluation von Syntaxanalysemethoden angewendet auf Datenmaterial aus transliterierten Schulaufsätzen. Unpublished thesis, University of Koblenz-Landau, Germany.

Granger, S. (2004). Computer learner corpus research: Current status and future prospects. In U. Connor & T. Upton (Eds.), Applied corpus linguistics: A multidimensional perspective (pp. 123-145). Amsterdam: Rodopi.

Graves, D. H. (1983). Writing: Teachers & children at work. Portsmouth, NH: Heinemann.

Harbusch, K., Itsova, G., Koch, U., & Kühner, C. (2008). The Sentence Fairy: A natural-language gen- The Sentence Fairy: A natural-language generation system in support of teaching essay writing to elementary school children. Computer Assisted Language Learning, 4, 339-352.

Harbusch, K., & Kempen, G. (2002). A quantitative model of word order and movement in English, Dutch and German complement constructions. In S.-C. Tseng (Ed.), Proceedings of the 19th International Conference on Computational Linguistics (COLING 2002) (pp. 328-334). New Brunswick, NY: Association for Computational Linguistics; San Francisco, CA: Morgan Kaufmann.

Harbusch, K., Kempen, G., van Breugel, C., & Koch, U. (2006). A generation-oriented workbench for Performance Grammar: Capturing linear order variability in German and Dutch. In A. Belz & R. Dale (Eds.), Proceedings of the Fourth International Natural Language Generation Conference (INLG 2006) (pp. 9-11). New Brunswick, NY: Association for Computational Linguistics.

Harbusch, K., Kempen, G., & Vosse, T. (2008). A natural-language paraphrase generator for on-line monitoring and commenting incremental sentence construction by L2 learners of German. Paper presented at WorldCALL 2008: Briding the World through Technology Enhanced Language Learning, Fukuoka, Japan.

Harbusch, K., van Breugel, C., Koch, U., & Kempen, G. (2007). Interactive sentence combining and para- Interactive sentence combining and paraphrasing in support of integrated writing and grammar instruction: A new application area for natural language sentence generators. In S. Busemann (Ed.), Proceedings of the 11th European Workshop on Natural Language Generation (ENLG 2007) (pp. 65-68). Saarbrucken, Germany: DFKI-Report.

Heift, T. (2008). Modeling learner variability in CALL. Computer Assisted Language Learning, 4, 305-321.

Heift, T., & Schulze, M. (Eds.). (2003). Error diagnosis and error correction in CALL. CALICO Journal, 20, 433-436.

Hewer, S. (2000). Text manipulation. Menlo Park, CA: Center for Innovative Learning Technologies (CILT Publications).

Jackson, S. L., Krajcik, J. S., & Soloway, E. (1998). The design of guided learner-adaptable scaffolding in interactive learning environments. In Proceedings of ACM, CHI 98 Human Factors in Computing Systems (pp. 187-194). Los Angeles, CA: ACM.

Kempen, G., & Harbusch, K. (2002). Performance Grammar: A declarative definition. In A. Nijholt, M. Theune, & H. Hondorp (Eds.), Computational linguistics in the Netherlands 2001 (pp. 148-168). Amsterdam: Rodopi.

Kempen, G., & Harbusch, K. (2003). Dutch and German verb constructions in Performance Grammar. In P. A. M. Seuren & G. Kempen (Eds.), Verb constructions in German and Dutch (pp. 185-221). Amsterdam: John Benjamins.

Lester, J. C., Strone, B. A., & Stelling, G. D. (1999). Lifelike pedagogical agents for mixed-initiative problem solving in constructivist learning environments. User Modeling and User-Adapted Interaction, 9, 1-44.

L’haire, S., & Vandeventer Faltin, A. (2003). Error diagnosis in the FreeText project. CALICO Journal, 20, 481-495.

Mann, W. C., & Thompson, S. A. (1988). Rhetorical structure theory: Toward a functional theory of text organization. Text, 8, 243-281.

Mason, B. J., & Bruning, R. (2001). Providing feedback in computer-based instruction: What the research tells us. Retrieved January 22, 2009, from http://dwb.unl.edu/Edit/MB/MasonBruning.html

Mellon, J. C. (1969). Transformational sentence-combining: A method for enhancing the development of syntactic fluency in English composition. Urbana, IL: National Council of Teachers of English.

Moreno, R., Mayer, R. E., Spires, H. A., & Lester, J. C. (2001). The case for social agency in computerbased teaching: Do students learn more deeply when they interact with animated pedagogical agents? Cognition and Instruction, 19, 177-214.

Nerbonne, J., Dokter, D., & Smit, P. (1998). Morphological processing and computer–assisted language learning. CALL Journal, 11, 421-437.

Paechter, M., & Schweitzer, K. (2006). Learning and motivation with virtual tutors. Does it matter if the tutor is visible on the Net? In M. Pivec (Ed.), Affective and emotional aspects in human-computer interaction (pp. 155-164). Amsterdam: IOS Press.

Reiter, E., & Dale, R. (2000). Building applied natural language generation systems. New York: Cambridge University Press.

Shermis, M. D., & Burstein, J. (Eds.). (2003). Automatic essay scoring: A cross-disciplinary perspective. Mahwah, NJ: Lawrence Erlbaum.

Smith Nash, S. (2007). New e-learning teaching techniques book useful for all. Birmingham, UK: Packt.

Streiter, O., Knapp, J., & Voltmer, L. (2004). Gymnazilla: Language learning with the internet. In Proceedings of the 6th Teaching and Language Corpora Conference (TALC 2004). Granada, Spain. Retrieved April 8, 2009, from http://dev.eurac.edu:8080/autoren/publs/talc04.pdf

Theune, M., Slabbers, N., & Hielkema, F. (2007). The Narrator: NLG for digital storytelling. In S. Busemann (Ed.), Proceedings of the 11th European Workshop on Natural Language Generation (ENLG 2007) (pp. 109-112). Saarbrucken, Germany: DFKI-Report.

Thonke, F., Groß Ophoff, J., Hosenfeld, I., & Isaac, K. (in press). Kriteriengestützte Erfassung von Schreibleistungen im Projekt VERA. In Proceedings of the 15. Europäischen Lesekongress der deutschen Gesellschaft für Lesen und Schreiben (DGLS). Berlin: DGLS.

Vasilyeva, E. (2007). Towards personalized feedback in educational computer games for children. In Proceedings of the Sixth Conference on IASTED International Conference Web-Based Education (pp. 597-602). Chamonix, France: IASTED.

Vasilyeva, E., Pechenizkiy, M., & Puuronen, S. (2006). The challenge of feedback personalization to learning styles in a web-based learning system. In Proceedings of the Sixth International Conference on Advanced Learning Technologies (ICALT’06) (pp. 1143-1144). Kerkrade, The Netherlands.

Zamorano Mansilla, J. R. (2004). Text generators, error analysis and feedback. In R. Delmonte, P. Delcloque, & S. Tonelli (Eds.), Proceedings of the InSTIL/ICALL2004 Symposium on NLP and speech technologies in advanced language learning systems (pp. 87-90). Padua, Italy: Unipress.

Zock, M., & Quint, J. (2004). Converting an electronic dictionary into a drill tutor. In R. Delmonte, P. Delcloque, & S. Tonelli (Eds.), Proceedings of the InSTIL/ICALL2004 Symposium on NLP and speech technologies in advanced language learning systems (pp. 41-44). Padua, Italy: Unipress.

Downloads

Published

2013-01-14

Issue

Section

Articles

How to Cite

Harbusch, K., Itsova, G., Koch, U., & Kühner, C. (2013). Computing Accurate Grammatical Feedback in a Virtual Writing Conference for German-Speaking Elementary-School Children: An Approach Based on Natural Language Generation. CALICO Journal, 26(3), 626-643. https://doi.org/10.1558/cj.v26i3.626-643

Most read articles by the same author(s)

1 2 3 4 5 6 7 8 9 10 > >>