Evaluating CUES: Some Problems and Issues in Experimental CALL Research

Authors

  • Mary-Louise Craven

DOI:

https://doi.org/10.1558/cj.v5i3.51-64

Keywords:

CALL research, experimental design, protocol analysis, L2 writing software

Abstract

The effectiveness of a computer program, CUES, designed to improve adult ESL students' essays was tested both formally and informally. The formal measures carried out in both the experin7eiital and the control groups included: 1) holistic ratings of both groups' pre- and post- intervention essays, and 2) a comparison of pre- and post-intervention thinking-aloud protocol analyses. The informal measures included a questionnaire administered to the students and critical comments about the program garnered from the students' responses in a 500-ivord essay entitled, "Assess the program CUES." This research provides an opportunity for the author to examine critically the research methods used, and to conclude that both formal and informal evaluation measures provide a balanced assessment of CALL software.

References

Bereiter, C. and M. Scardamalia. 1987. The Psychology of Written communication. Hillsdale, N.J.: Lawrence Erlbaum Associates.

Craven, Mary-Louise. 1987. A Pilot Study Exploring the Effectiveness of the Computer Program, CUES, to Improve University-Level ESL Students' Writing. M.A. Thesis, University of Toronto.

Ericsson, K. and H. Simon. 1984. Protocol Analysis: Verbal Reports as Data. Cambridge, Mass.: MIT Press.

Emig, Janet. 1983. The Web of Meaning. New Jersey: Boynton/Cook Publishers, Inc.

Flower, Linda and John R. Hayes. 1981. A Cognitive Process Theory of Writing. College Composition and Communication. 32.4: 365-387.

Jones, C. Stanley. 1982. Attention to Rhetorical Information While Composing in a Second Language. In the Proceedings of the 4th Los Angeles Second Language Research Forum.

Jones, C. Stanley and J. Tetroe. 1987. Composing in a Second Language, in A. Matsuhashi (Ed.) Writing in Real Time: Modelling the Writing Process. New York: Ablex Publishing.

Lay, Nancy Duke S. 1982. Composing Processes of Adult ESL learners: A Case Study. TESOL Quarterly. 16.3: 406.

Mohan, Bernard and Winnie Lo. 1985. Academic Writing and Chinese Students: Transfer and Developmental Factors. TESOL Quarterly. 19.3: 515-534.

Perl, Sondra. 1979. The Composing Processes of Unskilled College Writers. Research in the Teaching of English. 13.4: 317-336.

Perl, Sondra. 1980. A Look at Basic Writers in the Process of Writing, in L. Kasend and D.R. Hoeber (Eds.), Basic Writing. Urbana, IL: National Council of Teachers of English.

Pianko, Sharon. 1979. A Description of the Composing Process of College Freshman Writers. Research in the Teaching of English. 13.1: 5-22.

Raimes, Ann. 1985. What Unskilled ESL Students Do as They Write: A Classroom Study of Composing. TESOL Quarterly. 19.2: 229-258.

Scardamalia, Bereiter and Steinbach. 1984. Teachability of Reflective Processes in Written Composition. Cognitive Science. 8: 173-190.

Sommers, Nancy. 1980. Revision Strategies of Student Writers and Experienced Adult Writers. College Composition and Communication. 31.4: 378-388.

Windeatt, Scott. 1986. Observing CALL in Action, in G. Leech and C. Candlin (Eds.), Computers in English Language Teaching and Research. Essex: Longman Group Limited.

Zamel, Vivian. 1982. Writing: The Process of Discovering Meaning. TESOL Quarterly. 16.2: 195-210.

Zamel, Vivian. 1983. The Composing Process of Advanced ESL Students: Six Case Studies. TESOL Quarterly. 17.2: 165-187.

Downloads

Published

2013-01-14

Issue

Section

Articles

How to Cite

Craven, M.-L. (2013). Evaluating CUES: Some Problems and Issues in Experimental CALL Research. CALICO Journal, 5(3), 51-64. https://doi.org/10.1558/cj.v5i3.51-64

Most read articles by the same author(s)