Computer Adaptive Language Tests (CALT) Offer a Great Potential for Functional Testing. Yet, Why Don't They?
DOI:
https://doi.org/10.1558/cj.v11i4.23-39Keywords:
Computer adaptive language testing (CALT), validity, adaptability, functional testingAbstract
Computer adaptive language testing (CALT) is a relatively new computer based testing approach which offers substantial advantages such as 1) the ability for examinees to pace themselves, the ability 2) to individualize tests, 3) to make tests shorter, 4) to promote a more positive attitude toward tests, 5) to report test results immediately, 6) to measure tests with precision, and 7) to improve test security. CALT tailors tests to the student's level of language ability. The item sequencing of CALT is based on a continuum of difficulty; items are calibrated according to their difficulty index. CALT tests are administered according to pre-established indexes of increment and decrement. However, CALT cannot test the multidimensional nature of language, and as such it fails to fit and to assess its communicative and functional nature. This article proposes to replace multiple choice and cloze formats and to apply the potential of CALT to live-action simulations. With adaptive live-action simulations, students could be assessed on their ability to function in situations that would adapt to the examinee's level of proficiency. With this in mind, computer adaptive task based language assessment could very well be the next generation of CALT.
References
Bernhard, E., and C. Deville (1991). "Testing in Foreign Language Programs and Testing Programs in Foreign Language Departments: Reflections and Recommendations." Assessing Foreign Language Proficiency of Undergraduates, edited by R. Teschner. Boston, MA: Heinle and Heinle.
Canale, M. (1986). "The Promise and Threat of Computerized Adaptive Assessment of Reading Comprehension." Technology and Language Testing, edited by C. W. Stansfield. Washington, DC: TESOL.
Dandonoli, P. (1989). "The ACTFL Computerized Adaptive Test of Foreign Language Reading Proficiency." Modern Technology in Foreign Language Education: Application and Projects, edited by F. Smith. Lincolnwood, IL: National Textbook.
Gale, L. (1989). “Macario, Montevidisco, and Interactive Digame: Developing Interactive Video for Language Instruction." Modern Technology in Foreign Language Education: Application and Projects, edited by F. Smith. Lincolnwood, IL: National Textbook.
Henning, G. (1991). "Validating an Item Bank in a Computer Assisted or Computer Adaptive Test: Using Item Response Theory for the Process of Validating CATS." Computer Assisted Language Learning and Testing: Research Issues and Practice, edited by P. Dunkel. New York, NY: Newbury House.
Kaya-Carton, E., A. Carton, and P. Dandonoli (1991). "Developing a Computer Adaptive Test of French Reading Proficiency." Computer Assisted Language Learning and Testing: Research Issues and Practice, edited by P. Dunkel. New York, NY: Newbury House.
Lange, D. L. (1990). 'Priority Issues in the Assessment of Communicative Language Abilities." Foreign Language Annals 23 403-407.
Larson, J. W., and H. S. Madsen (1985). "Computerized Adaptive Language Testing: Moving Beyond Computer Assisted Testing." CALICO Journal 2, 32-35.
______. (1989). “S-CAPE: A Spanish Computerized Adaptive Placement Exam." Modern Technology in Foreign Language Education: Application and Projects, edited by F. Smith. Lincolnwood, IL: National Textbook.
Madsen, H. S. (1986). "Evaluating a Computer Adaptive ESL Placement Test." CALICO Journal 4, 41-50.
______. (1991). “Computer Adaptive Testing of Listening and Reading Comprehension: The Brigham Young University Approach.” Computer Assisted Language Learning and Testing: Research Issues and Practice, edited by P. Dunkel. New York, NY: Newbury House.
Murray, J., D. Morgenstern, and G. Furstenberg (1989). “The Athena Language Learning Project: Design and Issues for the Next Generation of Computer Based Language Learning Tool." Modern Technology in Foreign Language Education: Application and Projects, edited by F. Smith. Lincolnwood, IL: National Textbook.
Pusack, J., and S. Otto (1990). “Applying Instructional Technologies." Foreign Language Annals 23, 409-417.
Rash, G. (1960). Probalistic Models for Some Intelligence Attainment Tests. Chicago: University of Chicago Press.
Stansfield, C. (1990). "Some Foreign Language Test Development Priorities for the Last Decade of the Twentieth Century." Foreign Language Annals 23, 395-401.
Stevenson, J., and S. Gross (1991). "Use of Computerized Adaptive Testing Model for ESOL/Bilingual Entry/Exit Decision Making." Computer Assisted Language Learning and Testing: Research Issues and Practice, edited by P. Dunkel. New York, NY: Newbury House.
Tung, P. (1986). "Computerized Adaptive Testing: Implications for Language Test Developers." Technology and Language Testing, edited by C. W. Stansfield. Washington, DC: TESOL.
