A Hybrid of a CBT- and a CAT-based New English Placement Test Online (NEPTON)
DOI:
https://doi.org/10.1558/cj.v25i2.276-304Keywords:
New English Placement Test Online (NEPTON), Hybrid of a Computer-based Test (CBT) and a Computer Adaptive Test (CAT), English Placement Test (EPT), Foreign Language Placement Testing, Second Language (L2), Foreign Language (FL)Abstract
In recent years, many tertiary institutions have been changing their pen-and-paper English placement test practices into computer based ones. In the process of constructing the University of Nicosia (Intercollege) New English Placement Test Online (NEPTON), we discovered how to redesign our test to include the use of technology. The present article reports this experience in three parts. In the first section, we demonstrate how NEPTON, a hybrid of a computer-based test (CBT) and a computer adaptive test (CAT) model was influenced and shaped by theoretical issues such as CBT and CAT characteristics--their advantages and disadvantages--and by practical issues such as the particular context of the institution. This is followed by a detailed description of the test, highlighting its essential and innovative features. Lastly, we discuss and analyze different aspects of the test's first administration to establish how reliable and valid this test is as a placement instrument for first-year University of Nicosia (Intercollege) students.
References
The TOEFL Test Details: Learners and Test Takers Internet-based Testing (iBT). (n. d.). Available from http://www.ets.org
A common European framework of reference for languages. Learning, teaching, assessment. (n. d.). Retrieved October 8, 2007, from http://www.coe.int/t/dg4/linguistic/Source/Framework_EN.pdf
Alderson, J. C. (1987). Innovation in language testing: Can the micro-computer help? [Special Report No. 1]. Language Testing Update. University of Lancaster: Lancaster, UK.
Alderson, J. C., Clapham, C., & Wall, D. (1995). Language test construction and evaluation. New York: Cambridge University Press.
Almond, R. G., Steinberg, L. S., & Mislevy, R. H. (2002). Enhancing the design and delivery of assessment systems: A four-process architecture. Journal of Technology, Learning and Assessment, 1 (5), 3-63. Retrieved October 8, 2007, from http://escholarship.bc.edu/jtla/vol1/5
Anastasi, A. (1982). Psychological testing (5th ed.). New York: Macmillan.
Bachman, L. F. (2003). Fundamental considerations in language testing. Oxford: Oxford University Press.
Blackboard. (2004). Blackboard learning system. Washington, DC: Blackboard, Inc. Available from http://www.blackboard.com
Brown, J. D. (1997). Computers in language testing: Present research and some future directions. Language Learning & Technology, 1 (1), 44-59. Retrieved October 8, 2007, from http://llt.msu.edu/vol1num1/brown/default.html
Brown J. D. (June, 2003). Norm-reference item analysis (item facility and item discrimination). Shiken: JALT Testing & Evaluation SIG Newsletter, 17 (2), 16-19. Retrieved October 17, 2007, from http://jalt.org/test/bro_17.htm
Cohen, A. (1984). Fourth ACROLT meeting on language testing. TESOL Newsletter, 18, 23.
Chapelle, C. A. (2001). Computer applications in second language acquisition: Foundations for teaching, testing and research. Cambridge: Cambridge University Press.
Chapelle, C. A., & Douglas, D. (2006). Assessing language through technology. Cambridge: Cambridge University Press.
DIALANG. (2001). Available from http://dialang.org./intro.htm
Dunkel, P. (1999). Considerations in developing or using second/foreign language proficiency computeradaptive tests. Language Learning & Technology, 2 (2), 77-93. Retrieved October 8, 2007, from http://llt.msu.edu/vol2num2/article4
Fulcher, G. (2000). Computers in language testing. In P. Brett & G. Motteram (Eds.), A special interest in computers (pp. 93-107). Manchester: IATEFL Publications. Retrieved October 8, 2007, from http://www.le.ac.uk/education/testing/ltrfile/Computers.html
Fulcher, G. (2003). Interface design in computer-based language testing. Language Testing, 20 (4), 384-408.
Godwin-Jones, R. (2001). Language testing tools and technologies. Language Learning & Technology, 5 (2), 8-12. Retrieved October 8, 2007, from http://llt.msu.edu/vol5num2/emerging/default.html
Grist, S. (1989). Computerized adaptive tests (ERIC Digest No. 107). ERIC Clearinghouse on Tests Measurement and Evaluation. Washington DC: American Institutes for Research. Retrieved October 8, 2007, from http://www.ericdigests.org/pre-9213/tests.htm
Half-Baked Software. (n. d.). Hot potatoes (Version 6.0.3). Victoria, British Columbia, Canada: Halfbaked Software, Inc. Available from http://www.halfbakedsoftware.com
Heaton, J. B. (1988). Writing English language tests. New York: Longman.
Hughes, A. (1989). Testing for language teachers. Cambridge, UK: Cambridge University Press.
Item Analysis. (n. d.). East Lansing, MI: Scoring Office, Michigan State University. Retrieved October 8, 2007, from http://www.msu.edu/dept/soweb/itanhand.html
Kitao, S., & Kitao, K. (1996). Testing communicative competence. The Internet TESL Journal, 2 (5). Retrieved October 8, 2007, from http://iteslj.org/Articles/Kitao-Testing.html
Larson, J. W., & Madsen, H. (1985). Computerized adaptive language testing: Moving beyond computerassisted testing. CALICO Journal, 2 (3), 32-37. Retrieved October 8, 2007, from https://calico.org
Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum.
Mack, D., & Seven, D. (2002). Programming data driven web applications with ASP.NET. Indianapolis, IN: SAMS Publishing.
Noijons, J. (1994). Testing computer assisted language tests: Towards a checklist for CALT. CALICO Journal, 12 (1), 37-58. Retrieved October 8, 2007, from https://calico.org
Papadima-Sophocleous, S. (2005). Development, implementation, and evaluation of an online English placement test at college level: A case study. Doctorate of Professional Studies project, Middlesex University.
Quia Corporation. (1998-2006). Quia. Available from http://www.quia.com
Quick Placement Test [computer software]. (2001). Cambridge, Oxford, UK: University of Cambridge, Oxford University Press.
Question Mark Perception [computer software]. (n. d.). London, UK: Question Mark Computing Ltd.
Roever, C. (2001). Web-based language testing. Language Learning & Technology, 5 (2), 84-94. Retrieved October 8, 2007, from http://llt.msu.edu/vol5num2/roever/default.html
Sceppa, D. (2002). Microsoft ADO.NET. Redmond, WA: Microsoft Press.
Stevenson, J., & Gross, S. (1991). Use of a computerized adaptive testing model for ESOL/bilingual entry/exit decision making. In P. Dunkel (Ed.), Computer-assisted language learning and testing (pp. 223-235). New York: Newbury House.
Statistics Guide, Interpreting the Reports (n. d.). Retrieved October 8, 2007, from http://helpdesk.kent.edu/howto/testscoring/stat
TOEFL Sampler [computer software]. (1998). Princeton, NJ: Educational Testing Service.
TOEFL Testing Program [Online]. Available from http://www.ets.org
Vispoel, W. P., Hendrickson, A. B., & Bleiler, T. (2000). Limiting answer review and change on computer adaptive vocabulary tests: Psychometric and attitudinal results. Journal of Educational Measurement, 37 (1), 21-38.
Wainer, H., & Eignor, D. (2000). Caveats, pitfalls, and unexpected consequences of implementing largescale computerized testing. In H. Wainer, N. J. Dorans, D. Eignor, R. Flaugher, B. F. Green, R. J. Mislevy, L. Steinberg, & D. Thissen (Eds.), Computer adaptive testing: A primer (2nd ed.) (pp. 271-299). Hillsdale, NJ: Laurence Erlbaum Associates.
Walther, S. (2003). ASP.NET unleashed (2nd ed.). Indianapolis, IN: SAMS Publishing.
WebCT (Version 3.0) [online]. (2004). Washington, DC: Blackboard, Inc. Available from http://www.blackboard.com
Weir, C. J. (1990). Communicative language testing. Wiltshire, UK: Prentice Hall International.
