Computerized Dictation for Assessing Listening Proficiency
DOI:
https://doi.org/10.1558/cj.v13i2-3.73-85Keywords:
Language testing, listening, dictation, ESLAbstract
This paper describes the construction and small-scale implementation of a computer program which can be used on a self-access basis to assess secondary school students' ESL listening proficiency. The test involves an extended dictation which is in the form of a dialogue. Subjects both hear and see on the screen (to provide context) the first speaker's utterances, but only hear the second speaker's utterances. After each exchange, subjects have to type in the second speaker's utterance, and the match between their input and the utterance is scored. Results indicate a good correlation with traditional pen-and-paper tests, suggesting that the concept has the potential to assess listening other than by administering a test to a group of subjects via a taped recording at a single sitting.
References
Alderson, J. (1991). “Language Testing in the 1990s: How Far Have We Come? How Much Further Have We to Go?” Current Developments in Language Testing, edited by S. Anivan. SEAMEO, Regional Language Centre.
______. (1988). “Innovations in Language Testing: Can the Micro-computer Help?” Special Report No. 1: Language Testing Update. Lancaster: Lancaster University.
Ariew, R., and P. Dunkel (1989). “A Prototype for a Computer-based Listening Comprehension Proficiency Test. Final Report.” Pennsylvania: Dept. of Speech Communication, Pennsylvania State University.
Bachman, L., and A. Palmer (1982). “The Construct Validation of some Components of Communicative Competence.” TESOL Quarterly 16, 449-465.
Carlson, R. (1994). “Computer Adaptive Testing: A Shift in the Evaluation Paradigm.” Journal of Educational Technology Systems 22, 3, 213-24.
Coniam, D. (1995). “Towards a Common Ability Scale for Hong Kong English Secondary School Forms.” Language Testing 12, 2, 184-195.
Dunkel, P. (1991). “Computerized Testing of Nonparticipatory L2 Listening Comprehension Proficiency: An ESL Prototype Development Effort.” Modern Language Journal 75, 1, 64-73.
Falvey, P., J. Holbrook and D. Coniam (1994). Assessing Students. Hong Kong: Longman.
Fouly, K. (1985). A Multivariate Study of the Nature of Language Proficiency and its Relationship to Learner Traits: A Confirmatory Approach. Unpublished Ph.D. thesis. University of Illinois at Urbana-Champaign.
______., and G. Cziko (1985). “Determining the Reliability, Validity and Scalability of the Graduated Dictation Test.” Language Learning 35, 5, 555-566.
Gronlund, N. (1985). Measurement and Evaluation in Teaching. New York: Macmillan.
Hambleton, R. (1989). “Applications of Item Response Theory.” International Journal of Educational Research 13, 2, 121-220.
Harlech-Jones, B. (1983). “ESL Proficiency and a Word Frequency Count.” ELT Journal 37, 1, 62-70.
Meara, P., and G. Jones (1988). “Vocabulary Size as a Placement Indicator.” Applied Linguistics in Society: Papers from the 20th Annual Meeting of the British Association for Applied Linguistics, edited by Pamela Grunwell. Nottingham, September 1987.
Meunier, L. (1994). “Computer Adaptive Language Tests (CALT) Offer a Great Potential for Functional Testing. Yet, Why Don’t They?” CALICO Journal 11, 4, 23-39.
Mydlarski, D., and D. Paramskas (1985). “Template System for Second Language Aural Comprehension.” CALICO Journal 3, 8-12.
Oller, J. (1979). Language Testing at School: A Pragmatic Approach. Longman: London.
Perkins, K., S. Brutton and P. Angelis (1986). “Derivational Complexity and Item Difficulty in a Sentence Repetition Task.” Language Learning 36, 2, 125-141.
Richards, J. (1991). Focus 5. Hong Kong: Oxford University Press.
Sinclair, J. (1991). Corpus Concordance Collocation. Oxford: Oxford University Press.
Smittle, P. (1991). “Computerized Adaptive Testing in Reading.” Journal of Developmental Education 15, 2, 2-5.
Wise, S., and B. Plake (1989). “Research on the Effects of Administering Tests via Computers.” Educational Measurement: Issues and Practice 8, 3, 5-10.
______. (1988). “Innovations in Language Testing: Can the Micro-computer Help?” Special Report No. 1: Language Testing Update. Lancaster: Lancaster University.
Ariew, R., and P. Dunkel (1989). “A Prototype for a Computer-based Listening Comprehension Proficiency Test. Final Report.” Pennsylvania: Dept. of Speech Communication, Pennsylvania State University.
Bachman, L., and A. Palmer (1982). “The Construct Validation of some Components of Communicative Competence.” TESOL Quarterly 16, 449-465.
Carlson, R. (1994). “Computer Adaptive Testing: A Shift in the Evaluation Paradigm.” Journal of Educational Technology Systems 22, 3, 213-24.
Coniam, D. (1995). “Towards a Common Ability Scale for Hong Kong English Secondary School Forms.” Language Testing 12, 2, 184-195.
Dunkel, P. (1991). “Computerized Testing of Nonparticipatory L2 Listening Comprehension Proficiency: An ESL Prototype Development Effort.” Modern Language Journal 75, 1, 64-73.
Falvey, P., J. Holbrook and D. Coniam (1994). Assessing Students. Hong Kong: Longman.
Fouly, K. (1985). A Multivariate Study of the Nature of Language Proficiency and its Relationship to Learner Traits: A Confirmatory Approach. Unpublished Ph.D. thesis. University of Illinois at Urbana-Champaign.
______., and G. Cziko (1985). “Determining the Reliability, Validity and Scalability of the Graduated Dictation Test.” Language Learning 35, 5, 555-566.
Gronlund, N. (1985). Measurement and Evaluation in Teaching. New York: Macmillan.
Hambleton, R. (1989). “Applications of Item Response Theory.” International Journal of Educational Research 13, 2, 121-220.
Harlech-Jones, B. (1983). “ESL Proficiency and a Word Frequency Count.” ELT Journal 37, 1, 62-70.
Meara, P., and G. Jones (1988). “Vocabulary Size as a Placement Indicator.” Applied Linguistics in Society: Papers from the 20th Annual Meeting of the British Association for Applied Linguistics, edited by Pamela Grunwell. Nottingham, September 1987.
Meunier, L. (1994). “Computer Adaptive Language Tests (CALT) Offer a Great Potential for Functional Testing. Yet, Why Don’t They?” CALICO Journal 11, 4, 23-39.
Mydlarski, D., and D. Paramskas (1985). “Template System for Second Language Aural Comprehension.” CALICO Journal 3, 8-12.
Oller, J. (1979). Language Testing at School: A Pragmatic Approach. Longman: London.
Perkins, K., S. Brutton and P. Angelis (1986). “Derivational Complexity and Item Difficulty in a Sentence Repetition Task.” Language Learning 36, 2, 125-141.
Richards, J. (1991). Focus 5. Hong Kong: Oxford University Press.
Sinclair, J. (1991). Corpus Concordance Collocation. Oxford: Oxford University Press.
Smittle, P. (1991). “Computerized Adaptive Testing in Reading.” Journal of Developmental Education 15, 2, 2-5.
Wise, S., and B. Plake (1989). “Research on the Effects of Administering Tests via Computers.” Educational Measurement: Issues and Practice 8, 3, 5-10.
Downloads
Published
2013-01-14
Issue
Section
Articles
How to Cite
Coniam, D. (2013). Computerized Dictation for Assessing Listening Proficiency. CALICO Journal, 13(2-3), 73-85. https://doi.org/10.1558/cj.v13i2-3.73-85
