Computer vs. Workbook Instruction in Second Language Acquisition
DOI:
https://doi.org/10.1558/cj.v14i1.53-75Keywords:
CALI, intelligent CALI, natural language processing, parsing, error analysis, feedback, workbook, Japanese, second language acquisitionAbstract
Many studies have failed to demonstrate the effectiveness of CALI (Computer Assisted Language Instruction) as compared to non-CALI instruction, and the pedagogical significance of CALI programs has been questioned. This study employs an intelligent CALI program, called Nihongo-CALI (Japanese Computer Assisted Language Instruction), which uses natural language processing to provide more sophisticated error analysis and feedback than conventional CALI programs. The study compares the effectiveness of Nihongo-CALI with non-CALI workbook instruction, in the form of self-study lessons. The results of the study show that given the same grammar notes and exercises, ongoing intelligent computer feedback is more effective than simple workbook answer sheets for developing learners' grammatical skill in producing Japanese particles and sentences. The results emphasize the importance of providing an intelligent level of feedback to the learner, a task for which natural language processing is well suited.
References
Adams, Edward N., and Peter S. Rosenbaum (1969). DLI-IBM Joint Feasibility Study in Computer assisted Foreign Language Instruction. Final report. Monterey, CA: Defense Language Institute. [DERS: ED 032 542].
Albertson, L.M. (1986). "Personalized Feedback and Cognitive Achievement in Computer assisted Instruction." Journal of Instructional Psychology 13, 55-57.
Anderson, J.R., C..F. Boyle, and B.J. Reiser (1985). "Intelligent Tutoring Systems." Science 228, 456-562
Barrutia, Richard (1970). "Two Approaches to Self-Instructional Language Study: Computerized Foreign Language Instruction." Hispania 53, 361-371.
Birenbaum, M., and K.K. Tatsuoka (1987). "Effect of 'On-line' Feedback on the Seriousness of Subsequent Errors." Journal of Educational Measurement 24, 145-155.
Bonner, Jodi (1987). "Computer Courseware: Frame-Based or Intelligent?" Educational Technology 27, 3, 30-35.
Collins, M., D. Carnine, and R. Gersten (1987). "Elaborated Corrective Feedback and the Acquisition of Reasoning Skills: A Study of Computer Assisted Instruction." Exceptional Children 54, 254-262.
Conrad, K. Bernd (1996). "CALL-Non-English L2 Instruction." Annual Review of Applied Linguistics 16, 158-181.
Corbett, A.T., and J.R. Anderson (1990). "The Effect of Feedback Control on Learning to Program with the LISP Tutor." Proceedings: Twelfth Annual Conference of the Cognitive Science Society, 796-803. Hillsdale, NJ: Lawrence Erlbaum Associates.
DeKeyzer, R., and K. Sokalski (1997). "The Differential Role of Comprehension and Production Practice." Forthcoming in Language Learning.
Dunkel, Patricia, Ed. (1991). "The Effectiveness Research on Computer Assisted Instruction and Computer Assisted Language Learning." Computer Assisted Language Learning and Testing: Research Issues and Practice. New York: Newbury House.
Fischetti, E., and A. Gisolfi (1990). "From Computer Aided Instruction to Intelligent Tutoring Systems." Educational Technology August, 7-17.
Flynn, S. (1986). "Production vs. Comprehension: Differences in Underlying Competencies." Studies in Second Language Acquisition 8, 135-164.
Garrett, Nina (1987). "A psycholinguistic Perspective on Grammar and CALL. "Modern Media in Foreign Language Education: Theory and Implementation, edited by Wm. Flint Smith. Lincolnwood, Illinois: National Textbook Company.
Gilman, D. A. (1969). "The Effect of Feedback on Learners' Certainty of Response and Attitude Towards Instruction in a computer assisted Instruction Program for Teaching Science concepts." Journal of Research in Science Teaching 6, 171-184.
Grant, L., R. McAvoy, and J.B. Keenan (1982). "prompting and Feedback Variables in Concept Programming." Teaching of Psychology 9, 173-177.
Hagen, L. Kirk (1995). "Unification-Based Parsing Applications of Intelligent Foreign Language Tutoring Systems." CALICO Journal 12, 2 & 3, 5-31.
Hannafin, M.J. (1983). "The Effects of Systemized Feedback on Learning in Natural Classroom Setting." Educational Research Quarterly 7, 22-29.
Hausser, Roland (1989). "Principles of Computational Morphology." Unpubl. Manuscript. Carnegie Mellon University, Laboratory for Computational Linguistics.
Higgins, John and Tim Johns (1984). Computers in Language Learning. Addison-Wesley, World Language Division.
Hodes, C.L. (1985). "Relative Effectiveness of Corrective and Noncorrectrive Feedback in Computer Assisted Instruction on Learning and Achievement." Journal of Education Technology Systems 13, 249-254.
Holland, Melissa, Richard Maisano, Cathie Alderks, and Jeffery Martin (1993). "Parsers in Tutors: hat Are They good For?" CALICO Journal 11, 1, 28-46.
Jorden, E.H. (1987). Japanese: The Spoken Language, Part 1. New Haven and London: Yale Univ. Press.
Juozulynas, Vilius (1984). "Errors in the Compositions of Second-Year German Students: An Empirical Study for Parse-Based ICALI." CALICO Journal 12, 1, 5-17.
Kleinmann, Howard. (1987). "The Effect of Computer assisted Instruction of ESL Reading Achievement. "The Modern Language Journal 71, 3, 267-276.
Kulhav, Raymond W. and Walter Wager (1993). "Feedback in Programmed Instruction: Historical Context and Implications for Practice." Interactive Instruction and Feedback, edited by John Dempsey and Gregory ales, 3-20. Englewood Cliffs, New Jersey: Educational Technology Publications.
Kulhavy, J.A., M.T. White, B. W. Topp, A. Chan and J. Adams (1985). "Feedback Complexity and Corrective Efficiency." Contemporary Educational Psychology 10, 285-291.
Kulik, James A. and Chen-Lin C. Kulik (1987). "Review of Recent Research Literature on Computer-Based Instruction." Contemporary Educational Psychology 12, 222-230.
Liou, Hsien-Chin (1991). "Development of an English Grammar Checker: A Progress Report." CALICO Journal 9, 1, 57-70.
Liou, Hsien-Chin, Samuel Want, and Yuli Hung-Yeh (1992). "Can Grammatical CALL Help EFL Writing Instruction?" CALICO Journal 10, 1, 23-44.
Labrie, Gilles and L.P.S. Singh (1991). "Parsing, Error Diagnostics, and Instruction in a French Tutor." CALICO Journal 9, 1, 9-25.
Levin, Lori, David A. Evans, and Donna Gates (1991). "The ALICE System: A Workbench for Learning and Using Language." CALICO Journal, 9, 1, 27-56.
Loritz, Donald (1992). "Generalized Transition Network Parsing for Language Study: The GPARS System for English, Russian, Japanese, and Chinese." CALICO Journal 10, 1, 5-22.
Mellgren, Millie (1983). "Applying Microcomputers in the Foreign Language Classroom: Challenges and Opportunities." The Foreign Language Classroom: New Techniques, edited by Alan Garfinkel. Proceedings of the Central States Conference on the Teaching of Foreign Languages. National Textbook Company, Lincolnwood, Illinois.
Merrill, J. (1987). "Levels of Questioning and Forms of Feedback: Instructional Factors in Courseware Design." Journal of Computer-Based Instruction 14, 18-22.
Morrison, H.W. and E.N. Adams (1968). "Pilot Study of a CAI Laboratory in German." The Modern Language Journal 52, 279-287.
Nagata, Noriko (1997). "The Effectiveness of Computer Assisted Metalinguistic Instruction: A Case Study in Japanese." Forthcoming in Foreign Language Annals.
______. (1996). "Production vs. Comprehension Practice in Second Language Acquisition." Technical Report 71596, Department of Modern Languages, University of San Francisco.
______. (1995). "an Effective Application of Natural Language Processing in Second Language Instruction." CALICO Journal 13, 1, 47-67.
______. (1993). "Intelligent Computer Feedback for Second Language Instruction." The Modern Language Journal 77, 3, 330-339.
______. (1992). A Study of the Effectiveness of Intelligent CALI as an Application of Natural Language Processing. Dissertation, University of Pittsburgh.
______. and M. Virginia Swisher (1995). "A Study of Consciousness-Raising by Computer: The Effect of Metalinguistic Feedback on Second Language Learning." Foreign Language Annals 28, 3, 337-347.
Orey, Michael A. and Wayne a. Nelson (1993). "Development Principles for Intelligent Tutoring Systems: Integrating Cognitive Theory into the Development of Computer-Based Instruction. Educational Technology, Research and Development 41, 1, 59-72.
Pederson, Kathleen Marshall (1987). "Research on CALL." Modern Media in Foreign Language Education: Theory and Implementation, edited by Wm. Flint Smith. Lincolnwood, Illinois: National Textbook Company.
Pica, T., L. Holliday, N. Lewis, and L. Morgenthaler (1989). "Comprehensible Output as an Outcome of Linguistic Demands on the Learner." Studies in Second Language Acquisition 11, 63-90.
Pusack, James P. (1983). "Answer-Processing and Error Correction in Foreign Language CAI." System 11, 1, 53-64.
Roblyer, M.D., W.H. Castine, and F.J. King, Eds. (1988). Assessing the Impact of ComputerBased Instruction: A Review of Recent Research. New York: Hawthorn Press.
Roper, W.J. (1977). "Feedback in Computer Assisted Instruction." Programmed Learning and Educational Technology 14, 43-49.
Sanders, Ruth (1991). "Error Analysis in purely Syntactic Parsing of Free Input: The Example of German." CALICO Journal 9, 1, 72-89.
Sherwood, Bruce Arne and Judith N. Sherwood (1988). The cT Language. Champaign, IL: Stipes.
Si-Quing, Chen , and Xu Luomai (1990). "Grammar Debugger: A Parser for Chinese EFL Learners." CALICO Journal 8, 2, 63-75.
Swain, Merrill (1985). "Communicative Competence: Some Roles of Comprehensible Input and Comprehensible Output in Its Development." Input in Second Language Acquisition, edited by Susan Gass and C. Madden, 235-253. Rowley, MA: Newbury House.
Teichert, Herman U. (1985). "Computer Assisted Instruction in Beginning College German: An Experiment." CALICO Journal 3, 2, 18-24.
Tomita, Masaru, T. Mitamura, H. Musha, and M. Kee. (1988). "The Generalized LR Parser/Compiler Version 8.1: User's Guide." CMU-CMT-88-MEMO. Carnegie Mellon University, Center for Machine Translation.
Underwood, John H. (1989). "On the Edge: Intelligent CALL in the 1990s." Computers and the Humanities 23, 71-84.
______. (1987). "Artificial Intelligence and CALL." Modern Media in Foreign Language Education: Theory and Implementation, edited by Wm. Flint Smith. Lincolnwood, Illinois: National Textbook Company.
Williams, Roger (1980). "Design, Development, and Testing of Five Computer Assisted Instruction Lessons in French Grammar." Ph.D. Dissertation. University of Georgia, Athens.
Yazdani, Masouda (1991). "The LINGER Project: An Artificial Intelligence approach to Second-Language Tutoring." Computer Assisted Language Learning 4, 2, 107-116.
Albertson, L.M. (1986). "Personalized Feedback and Cognitive Achievement in Computer assisted Instruction." Journal of Instructional Psychology 13, 55-57.
Anderson, J.R., C..F. Boyle, and B.J. Reiser (1985). "Intelligent Tutoring Systems." Science 228, 456-562
Barrutia, Richard (1970). "Two Approaches to Self-Instructional Language Study: Computerized Foreign Language Instruction." Hispania 53, 361-371.
Birenbaum, M., and K.K. Tatsuoka (1987). "Effect of 'On-line' Feedback on the Seriousness of Subsequent Errors." Journal of Educational Measurement 24, 145-155.
Bonner, Jodi (1987). "Computer Courseware: Frame-Based or Intelligent?" Educational Technology 27, 3, 30-35.
Collins, M., D. Carnine, and R. Gersten (1987). "Elaborated Corrective Feedback and the Acquisition of Reasoning Skills: A Study of Computer Assisted Instruction." Exceptional Children 54, 254-262.
Conrad, K. Bernd (1996). "CALL-Non-English L2 Instruction." Annual Review of Applied Linguistics 16, 158-181.
Corbett, A.T., and J.R. Anderson (1990). "The Effect of Feedback Control on Learning to Program with the LISP Tutor." Proceedings: Twelfth Annual Conference of the Cognitive Science Society, 796-803. Hillsdale, NJ: Lawrence Erlbaum Associates.
DeKeyzer, R., and K. Sokalski (1997). "The Differential Role of Comprehension and Production Practice." Forthcoming in Language Learning.
Dunkel, Patricia, Ed. (1991). "The Effectiveness Research on Computer Assisted Instruction and Computer Assisted Language Learning." Computer Assisted Language Learning and Testing: Research Issues and Practice. New York: Newbury House.
Fischetti, E., and A. Gisolfi (1990). "From Computer Aided Instruction to Intelligent Tutoring Systems." Educational Technology August, 7-17.
Flynn, S. (1986). "Production vs. Comprehension: Differences in Underlying Competencies." Studies in Second Language Acquisition 8, 135-164.
Garrett, Nina (1987). "A psycholinguistic Perspective on Grammar and CALL. "Modern Media in Foreign Language Education: Theory and Implementation, edited by Wm. Flint Smith. Lincolnwood, Illinois: National Textbook Company.
Gilman, D. A. (1969). "The Effect of Feedback on Learners' Certainty of Response and Attitude Towards Instruction in a computer assisted Instruction Program for Teaching Science concepts." Journal of Research in Science Teaching 6, 171-184.
Grant, L., R. McAvoy, and J.B. Keenan (1982). "prompting and Feedback Variables in Concept Programming." Teaching of Psychology 9, 173-177.
Hagen, L. Kirk (1995). "Unification-Based Parsing Applications of Intelligent Foreign Language Tutoring Systems." CALICO Journal 12, 2 & 3, 5-31.
Hannafin, M.J. (1983). "The Effects of Systemized Feedback on Learning in Natural Classroom Setting." Educational Research Quarterly 7, 22-29.
Hausser, Roland (1989). "Principles of Computational Morphology." Unpubl. Manuscript. Carnegie Mellon University, Laboratory for Computational Linguistics.
Higgins, John and Tim Johns (1984). Computers in Language Learning. Addison-Wesley, World Language Division.
Hodes, C.L. (1985). "Relative Effectiveness of Corrective and Noncorrectrive Feedback in Computer Assisted Instruction on Learning and Achievement." Journal of Education Technology Systems 13, 249-254.
Holland, Melissa, Richard Maisano, Cathie Alderks, and Jeffery Martin (1993). "Parsers in Tutors: hat Are They good For?" CALICO Journal 11, 1, 28-46.
Jorden, E.H. (1987). Japanese: The Spoken Language, Part 1. New Haven and London: Yale Univ. Press.
Juozulynas, Vilius (1984). "Errors in the Compositions of Second-Year German Students: An Empirical Study for Parse-Based ICALI." CALICO Journal 12, 1, 5-17.
Kleinmann, Howard. (1987). "The Effect of Computer assisted Instruction of ESL Reading Achievement. "The Modern Language Journal 71, 3, 267-276.
Kulhav, Raymond W. and Walter Wager (1993). "Feedback in Programmed Instruction: Historical Context and Implications for Practice." Interactive Instruction and Feedback, edited by John Dempsey and Gregory ales, 3-20. Englewood Cliffs, New Jersey: Educational Technology Publications.
Kulhavy, J.A., M.T. White, B. W. Topp, A. Chan and J. Adams (1985). "Feedback Complexity and Corrective Efficiency." Contemporary Educational Psychology 10, 285-291.
Kulik, James A. and Chen-Lin C. Kulik (1987). "Review of Recent Research Literature on Computer-Based Instruction." Contemporary Educational Psychology 12, 222-230.
Liou, Hsien-Chin (1991). "Development of an English Grammar Checker: A Progress Report." CALICO Journal 9, 1, 57-70.
Liou, Hsien-Chin, Samuel Want, and Yuli Hung-Yeh (1992). "Can Grammatical CALL Help EFL Writing Instruction?" CALICO Journal 10, 1, 23-44.
Labrie, Gilles and L.P.S. Singh (1991). "Parsing, Error Diagnostics, and Instruction in a French Tutor." CALICO Journal 9, 1, 9-25.
Levin, Lori, David A. Evans, and Donna Gates (1991). "The ALICE System: A Workbench for Learning and Using Language." CALICO Journal, 9, 1, 27-56.
Loritz, Donald (1992). "Generalized Transition Network Parsing for Language Study: The GPARS System for English, Russian, Japanese, and Chinese." CALICO Journal 10, 1, 5-22.
Mellgren, Millie (1983). "Applying Microcomputers in the Foreign Language Classroom: Challenges and Opportunities." The Foreign Language Classroom: New Techniques, edited by Alan Garfinkel. Proceedings of the Central States Conference on the Teaching of Foreign Languages. National Textbook Company, Lincolnwood, Illinois.
Merrill, J. (1987). "Levels of Questioning and Forms of Feedback: Instructional Factors in Courseware Design." Journal of Computer-Based Instruction 14, 18-22.
Morrison, H.W. and E.N. Adams (1968). "Pilot Study of a CAI Laboratory in German." The Modern Language Journal 52, 279-287.
Nagata, Noriko (1997). "The Effectiveness of Computer Assisted Metalinguistic Instruction: A Case Study in Japanese." Forthcoming in Foreign Language Annals.
______. (1996). "Production vs. Comprehension Practice in Second Language Acquisition." Technical Report 71596, Department of Modern Languages, University of San Francisco.
______. (1995). "an Effective Application of Natural Language Processing in Second Language Instruction." CALICO Journal 13, 1, 47-67.
______. (1993). "Intelligent Computer Feedback for Second Language Instruction." The Modern Language Journal 77, 3, 330-339.
______. (1992). A Study of the Effectiveness of Intelligent CALI as an Application of Natural Language Processing. Dissertation, University of Pittsburgh.
______. and M. Virginia Swisher (1995). "A Study of Consciousness-Raising by Computer: The Effect of Metalinguistic Feedback on Second Language Learning." Foreign Language Annals 28, 3, 337-347.
Orey, Michael A. and Wayne a. Nelson (1993). "Development Principles for Intelligent Tutoring Systems: Integrating Cognitive Theory into the Development of Computer-Based Instruction. Educational Technology, Research and Development 41, 1, 59-72.
Pederson, Kathleen Marshall (1987). "Research on CALL." Modern Media in Foreign Language Education: Theory and Implementation, edited by Wm. Flint Smith. Lincolnwood, Illinois: National Textbook Company.
Pica, T., L. Holliday, N. Lewis, and L. Morgenthaler (1989). "Comprehensible Output as an Outcome of Linguistic Demands on the Learner." Studies in Second Language Acquisition 11, 63-90.
Pusack, James P. (1983). "Answer-Processing and Error Correction in Foreign Language CAI." System 11, 1, 53-64.
Roblyer, M.D., W.H. Castine, and F.J. King, Eds. (1988). Assessing the Impact of ComputerBased Instruction: A Review of Recent Research. New York: Hawthorn Press.
Roper, W.J. (1977). "Feedback in Computer Assisted Instruction." Programmed Learning and Educational Technology 14, 43-49.
Sanders, Ruth (1991). "Error Analysis in purely Syntactic Parsing of Free Input: The Example of German." CALICO Journal 9, 1, 72-89.
Sherwood, Bruce Arne and Judith N. Sherwood (1988). The cT Language. Champaign, IL: Stipes.
Si-Quing, Chen , and Xu Luomai (1990). "Grammar Debugger: A Parser for Chinese EFL Learners." CALICO Journal 8, 2, 63-75.
Swain, Merrill (1985). "Communicative Competence: Some Roles of Comprehensible Input and Comprehensible Output in Its Development." Input in Second Language Acquisition, edited by Susan Gass and C. Madden, 235-253. Rowley, MA: Newbury House.
Teichert, Herman U. (1985). "Computer Assisted Instruction in Beginning College German: An Experiment." CALICO Journal 3, 2, 18-24.
Tomita, Masaru, T. Mitamura, H. Musha, and M. Kee. (1988). "The Generalized LR Parser/Compiler Version 8.1: User's Guide." CMU-CMT-88-MEMO. Carnegie Mellon University, Center for Machine Translation.
Underwood, John H. (1989). "On the Edge: Intelligent CALL in the 1990s." Computers and the Humanities 23, 71-84.
______. (1987). "Artificial Intelligence and CALL." Modern Media in Foreign Language Education: Theory and Implementation, edited by Wm. Flint Smith. Lincolnwood, Illinois: National Textbook Company.
Williams, Roger (1980). "Design, Development, and Testing of Five Computer Assisted Instruction Lessons in French Grammar." Ph.D. Dissertation. University of Georgia, Athens.
Yazdani, Masouda (1991). "The LINGER Project: An Artificial Intelligence approach to Second-Language Tutoring." Computer Assisted Language Learning 4, 2, 107-116.
Downloads
Published
2013-01-14
Issue
Section
Articles
How to Cite
Nagata, N. (2013). Computer vs. Workbook Instruction in Second Language Acquisition. CALICO Journal, 14(1), 53-75. https://doi.org/10.1558/cj.v14i1.53-75
