Using Multimedia Vocabulary Annotations in L2 Reading and Listening Activities
DOI:
https://doi.org/10.11139/cj.27.2.311-327Keywords:
CALL, Multimedia Vocabulary Annotation, Incidental Vocabulary Learning, Computer-mediated Reading and ListeningAbstract
This paper reviews the role of multimedia vocabulary annotation (MVA) in facilitating second language (L2) reading and listening activities. It examines the multimedia learning and multimedia language learning theories that underlie the MVA research, synthesizes the findings on MVA in the last decade, and identifies three underresearched areas on the subject.
References
Al-Seghayer, K. (2001). The effect of multimedia annotation modes on L2 vocabulary acquisition: A comparative study. Language Learning & Technology, 5(1), 202-232. Retrieved October 19, 2009, from http://llt.msu.edu/vol5num1/alseghayer
Ariew, R., & Ercetin, G. (2004). Exploring the potential of hypermedia annotations for second language reading. Computer Assisted Language Learning, 17, 237-259.
Borrás, I., & Lafayette, R. C. (1994). Effects of multimedia courseware subtitling on the speaking performance of college students of French. The Modern Language Journal, 78, 61-75.
Chall, J. (1983). Stages of reading development. New York: McGraw-Hill.
Chen, H. (2002). Investigating the effects of L1 and L2 glosses on foreign language reading comprehension and vocabulary retention. Paper presented at the annual meeting of the Computer-Assisted Language Instruction Consortium, Davis, CA.
Chun, D. M., & Payne, J. S. (2004). What makes students click: Working memory and look-up behavior. System, 32, 481-503
Chun, D. M., & Plass, J. L. (1996a). Effects of multimedia annotations on vocabulary acquisition. The Modern Language Journal, 80, 183-198.
Chun, D. M., & Plass, J. L. (1996b). Facilitating reading comprehension with multimedia. System, 24, 503-519.
Chun, D. M., & Plass, J. L. (1997a). Cyberbuch [Computer program]. New York: St. Martin’s Press.
Chun, D. M., & Plass, J. L. (1997b). Research on text comprehension in multimedia environments. Language Learning & Technology, 1(1), 60-81. Retrieved October 19, 2009, from http://llt.msu.edu/vol1num1/chun_plass
Chun, D. M., & Plass, J. L. (1999). Review of Cyberbuch. Language Learning & Technology, 3(1), 42-45. Retrieved February 2, 2008, from http://llt.msu.edu/vol3num1/review/review5.html
DeKeyser, R. (2007). Skill acquisition theory. In B. VanPatten & J. Williams (Eds.), Theories in second language acquisition: An introduction (pp. 97-114). Mahwah, NJ: Lawrence Erlbaum Associates.
DynEd International Incorporation. (2007). New Dynamic English. Retrieved February 2, 2008, from http://www.dyned.com/products/nde
Fliessbach, K., Weis, S., Klaver, P., Elger, C. E., & Weber, B. (2006). The effect of word concreteness on recognition memory. NeuroImage, 32, 1413-1421.
Gass, S. M. (1997). Input, interaction, and the second language learner. Mahwah, NJ: Lawrence Erlbaum Associates.
Gettys, S., Imhof, L. A., & Kautz, J. O. (2001). Computer-assisted reading: The effect of glossing format on comprehension and vocabulary retention. Foreign Language Annals, 34, 91-106.
Grace, C. (1998). Retention of word meanings inferred from context and sentence-level translations: Implications for the design of beginning-level CALL software. The Modern Language Journal, 82, 533-544.
Grace, C. (2000). Gender differences: Vocabulary retention and access to translations for beginning language learners in CALL. The Modern Language Journal, 84, 214-224.
Hart, G. (2007). Combining words and pictures: Degrees of abstraction. Intercom, 42, 38-39.
Hong, W. (1997). Multimedia computer-assisted reading in business Chinese. Foreign Language Annals, 30, 335-344.
Hulstijn, J. H., Hollander, M., & Greidanus, T. (1996). Incidental vocabulary learning by advanced foreign language students: The influence of marginal gloss, dictionary use, and reoccurrence of unknown words. The Modern Language Journal, 80, 327-339.
Ikeda, N. (1999). Effects of different types of images on the understanding of stories: Basic research to develop Japanese teaching materials for use on the internet. System, 27, 105-118.
Jacobs, G., Dufon, P., & Hong, F. (1994). L1 and L2 vocabulary glosses in L2 reading passages: Their effects for increasing comprehension and vocabulary knowledge. Journal of Research in Reading, 17, 19-28.
Jones, L. C. (2003). Supporting listening comprehension and vocabulary acquisition with multimedia annotations: The students’ voice. CALICO Journal, 21, 41-65. Retrieved October 19, 2009, from https://calico.org/page.php?id=5
Jones, L. C. (2004). Testing L2 vocabulary recognition and recall using pictorial and written test items. Language Learning & Technology, 8(3), 122-143. Retrieved October 19, 2009, from http://llt.msu.edu/vol8num3/jones/default.html
Jones, L. C. (2006a). Listening comprehension in multimedia environment. In L. Ducate & N. Arnold, (Eds.), Calling on CALL: From theory and research to new directions in foreign language teaching (pp. 99-126). San Marcos, TX: CALICO.
Jones, L. C. (2006b). Effects of collaboration and multimedia annotations on vocabulary learning and listening comprehension. CALICO Journal, 24, 33-58. Retrieved October 19, 2009, from https://calico.org/page.php?id=5
Jones, L. C., & Plass, J. L. (2002). Supporting listening comprehension and vocabulary acquisition in French with multimedia annotations. The Modern Language Journal, 86, 546-561.
Juel, C. (1991). Beginning reading. In R. Barr, M. Kamil, P. Mosenthal, & P. Pearson, (Eds.), Handbook of reading research (pp. 759-788). New York: Longman.
Kintsch, W., & Van Dijk, T. (1978). Toward a model of text comprehension and production. Psychological Review, 85, 363–394.
Kost, C. R., Foss, P., & Lenzini, J. J. (1999). Textual and pictorial glosses: Effectiveness of incidental vocabulary growth when reading in a foreign language. Foreign Language Annals, 32, 89-113.
Krashen, S. (1982). Principles and practice in second language acquisition. New York: Pergamon.
Krashen, S. (1985). The input hypothesis: Issues and complications. London: Longman.
Kroll, J. F., & Stewart, E. (1994). Category interference in translation and picture naming: Evidence for asymmetric connections between bilingual memory representations. Journal of Memory and Language, 33, 149-174.
Laufer, B. (1989). What percentage of text-lexis is essential for comprehension? In C. Lauren & M. Nordman (Eds.), Special language: From humans thinking to thinking machines. Philadelphia: Multilingual Matters.
Lin, H., & Chen, T. (2007). Reading authentic EFL text using visualization and advance organizers in a multimedia learning environment. Language Learning & Technology, 11(3), 83-106. Retrieved October 19, 2009, from http://llt.msu.edu/vol11num3/linchen Liu, N., & Nation, I. S. P. (1985). Factors affecting guessing vocabulary in context. RELC Journal, 16, 33-42.
Lomicka, L. L. (1998). “To gloss or not to gloss”: An investigation of reading comprehension online. Language Learning & Technology, 1(2), 41-50. Retrieved October 19, 2009, from http://llt.msu.edu/vol1num2/article2/default.html
Long, M. H. (1985). Input and second language acquisition theory. In S. M. Gass & C. G. Madden (Eds.), Input in second language acquisition (pp. 377-393). Rowley, MA: Newbury House.
Mayer, R. E. (1997). Multimedia learning: Are we asking the right questions? Educational Psychologist, 32, 1-19.
Mayer, R. E. (2001). Multimedia learning. New York: Cambridge University Press.
Mayer, R. E. (2002). Cognitive theory and the design of multimedia instruction: An example of the twoway street between cognition and instruction. New Directions for Teaching and Learning, 89, 55-71.
Mayer, R. E., & Anderson, R. W. (1992). The instructive animation: Helping students build connections between words and pictures in multimedia learning. Journal of Educational Psychology, 84, 444-452.
Mayer, R. E., & Gallini, J. K. (1990). When is an illustration worth ten thousand words? Journal of Educational Psychology, 82, 715-726.
Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. In R. Bruning, C. A. Horn, & L. M. Pytlik Zillig (Eds.), Web-based learning: What do we know? Where do we go? (pp. 23-44). Greenwich, CT: Information Age Publishing.
Miyasako, N. (2002). Does text-glossing have any effects on incidental vocabulary learning through reading for Japanese senior high school students? Language Education & Technology, 39, 1-20.
Moreno, R. (2004). Decreasing cognitive load for novice students: Effects of explanatory versus corrective feedback on discovery-based multimedia. Instructional Science, 32, 99-113.
Moreno, R., & Durán, R. (2004). Do multiple representations need explanations? The role of verbal guidance and individual differences in multimedia mathematics learning. Journal of Educational Psychology, 96, 492-503.
Nation, I. S. P. (2001). Learning vocabulary in another language. Cambridge, UK: Cambridge University Press.
Paivio, A. (1969). Mental imagery in associative learning and memory. Psychological Review, 3, 241-263.
Paivio, A. (1971). Imagery and verbal processes. New York: Holt, Rinehart, and Winston.
Paivio, A. (1986). Mental representations: A dual coding approach. Oxford, England: Oxford University Press.
Plass, J. L., Chun, D. M., Mayer, R. E., & Leutner, D. (1998). Supporting visual and verbal learning preferences in a second-language multimedia learning environment. Journal of Educational Psychology, 90, 25-36.
Plass, J. L., & Jones, L. C. (2005). Second language acquisition with multimedia. In R. Mayer (Ed.), The Cambridge handbook of multimedia learning. (pp. 476-488). New York: Cambridge University Press.
Read, J. (2004). Research in teaching vocabulary. Annual Review of Applied Linguistics, 24, 146-161.
Rumelhart, D. E. (1977). Toward an interactive model of reading. In S. Dornic (Ed.), Attention and performance VI (pp. 573–603). Hillsdale, NJ: Lawrence Erlbaum.
Stanovich, K. E. (1986). Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading research quarterly, 21, 360-407.
Swaffar, J., Arens, K., & Byrnes, H. (1991). Reading for meaning: An integrated approach to language learning. Englewood Cliffs, NJ: Prentice Hall.
Swain, M. (1985). Communicative competence: Some roles of comprehensible input and comprehensible output in its development. In S. M. Gass & C. G. Madden (Eds.), Input in second language acquisition (pp. 235-253). Rowley, MA: Newbury House.
Swain, M., & Lapkin, S. (1995). Problems in output and the cognitive processes they generate: A step towards second language learning. Applied Linguistics, 16, 371-391.
VanPatten, B. (2007). Input processing in adult second language acquisition. In B. VanPatten & J. Williams (Eds.), Theories in second language acquisition: An introduction. (pp. 115-136). Mahwah, NJ: Lawrence Erlbaum Associates.
Vygotsky, L. (1978). Mind and society: The development of higher psychological processes. Cambridge, MA: Harvard University Press.
Watanabe, Y. (1997). Input, intake, and retention: Effects of increased processing on incidental learning of foreign language vocabulary. Studies in Second Language Acquisition, 19, 287-307.
Yeh, Y., & Wang, C. (2003). Effects of multimedia vocabulary annotations and learning styles on vocabulary learning. CALICO Journal, 21, 131-144. Retrieved October 19, 2009, from https://calico.org/page.php?id=5
Yoshii, M. (2006). L1 and L2 glosses: Their effects on incidental vocabulary learning. Language Learning & Technology, 10(3), 85-101. Retrieved October 19, 2009, from http://llt.msu.edu/vol10num3/yoshii/default.html
Yoshii, M., & Flaitz, J. (2002). Second language incidental vocabulary retention: The effect of picture and annotation types. CALICO Journal, 20, 33-58. Retrieved October 19, 2009, from https://calico.org/page.php?id=5
