Supporting Student Differences in Listening Comprehension and Vocabulary Learning with Multimedia Annotations
DOI:
https://doi.org/10.1558/cj.v26i2.267-289Keywords:
Listening Comprehension, Vocabulary Acquisition, Multimedia Annotations, Spatial Ability, Verbal AbilityAbstract
This article describes how effectively multimedia learning environments can assist second language (L2) students of different spatial and verbal abilities with listening comprehension and vocabulary learning. In particular, it explores how written and pictorial annotations interacted with high/low spatial and verbal ability learners and thus affected students' acquisition of new vocabulary and their aural comprehension when they listened to a L2 passage. Students (N = 171) were randomly assigned to one of four groups while listening to a passage in French: a control group that received no annotations and three treatment groups that received written annotations, pictorial annotations, or both written and pictorial annotations. In terms of learning abilities, little difference was found between high- and low-spatial-ability learners when interacting with pictorial or written annotations. However, high-verbal-ability learners consistently outperformed low-verbal-ability learners on recall protocol and vocabulary tests when pictorial annotations alone were present. Within the low- and high-ability groups, learning was consistently greatest when pictorial and written annotations were accessed.
References
Adobe. (1994). Premiere 4.2 [Computer software, Macintosh]. Mountain View, CA: Adobe Systems.
Amon, E., Muyskens, J. A., & Omaggio Hadley, A. C. (2000). Vis à Vis (2nd ed.). [Computer software, CD-ROM]. Boston: McGraw-Hill.
Ayersman, D. J., & Von Minden, A. (1995). Individual differences, computers, and instruction. Computers in Human Behavior, 11, 371-390.
Bacon, S. (1992). Authentic listening in Spanish: How learners adjust their strategies to the difficulty of the input. Hispania, 75, 398-411.
Baggett, P. (1984). Role of temporal overlap of visual and auditory materials in forming dual media associations. Journal of Educational Psychology, 76, 408-417.
Baggett, P. (1989). Understanding visual and verbal messages. In H. Mandl & J. Levin (Eds.), Knowledge acquisition from text and pictures (pp. 101-124). Amsterdam: Elsevier.
Baltova, I. (1999). The effect of subtitled and staged video input on the learning and retention of content and vocabulary in a second language. Unpublished doctoral dissertation, University of Toronto, Canada.
Brett, P. (1995). Multimedia for listening comprehension: The design of a multimedia-based resource for developing listening skills. System, 23, 77-85.
Brett, P. (1997). A comparative study of the effects of the use of multimedia on listening comprehension. System, 25, 39-53.
Brünken, R., Plass, J., & Leutner, D. (2004). Assessment of cognitive load in multimedia learning with dual-task methodology: Auditory load and modality effects. Instructional Science, 32, 115-132.
Buzhardt, G. A., & Hawthorne, M. (1993). Rencontres sur le Mississippi, 1682-1763. Jackson, MS: University Press of Mississippi.
Carlson, H. L. (1990). Learning style and program design in interactive multimedia. Educational Technology Research and Development, 39(3), 41-48.
Cennamo, K. S. (1993). Learning from video: Factors influencing learners’ preconceptions and invested mental effort. Educational Technology Research and Development, 41(3), 33-45.
Chamot, A. (1995). Learning strategies and listening comprehension. In D. J. Mendelsohn & J. Rubin (Eds.), A guide for the teaching of second language listening (pp. 13-30). San Diego, CA: Dominie Press.
Chamot, A., & Küpper, L. (1989). Learning strategies in foreign language instruction. Foreign Language Annals, 22, 13-24.
Chun, D. M., & Plass, J. L. (1996a). Effects of multimedia annotations on vocabulary acquisition. The Modern Language Journal, 80, 183-198.
Chun, D. M., & Plass, J. L. (1996b). Facilitating reading comprehension with multimedia. System, 24, 503-519.
Chun, D. M., & Plass, J. L. (1997a). Research on text comprehension in multimedia environments. Language Learning & Technology, 1(1), 1-35. Retrieved, October 27, 2008, from http://llt.msu.edu/vol1num1/chun_plass/default.html
Chun, D. M., & Plass, J. L. (1997b). CyberBuch [Computer software, CD-ROM]. New York: St. Martin’s Press.
Chung, U. K. (1994). The effect of audio, a single picture, multiple pictures, or video on second-language listening comprehension. Unpublished doctoral dissertation, University of Illinois at UrbanaChampaign.
Ekstrom, R. B., French, J. W., & Harman, H. H. (1976). Manual for kit of factor-referenced cognitive tests. Princeton, NJ: Educational Testing Service.
Fischer, R., & Farris, M. (1995). Instructional basis of Libra. IALL Journal of Language Learning Technologies, 28(1), 29-90.
Guillory, H. G. (1998). The effects of keyword captions to authentic French video on learner comprehension. CALICO Journal, 15, 89-108.
Heining-Boynton, A. L., Cowell, G. S., & Torres-Quiñones, S. S. (1999). ¡Atrévete! [Computer software, CD-ROM]. Harcourt.
Hoven, D. (1999). A model for listening and viewing comprehension in multimedia environments. Language Learning & Technology, 3(1), 88-103. Retrieved October 27, 2008, from http://llt.msu.edu/vol3num1/hoven/index.html
Joiner, E. (1997). Teaching listening: How technology can help. In M. Bush & R. Terry (Eds.), Technology-enhanced language learning (pp. 77-120). Lincolnwood, IL: National Textbook Company.
Jonassen, D. H., & Grabowski, B. L. (1993). Handbook of individual differences; Learning and instruction. Hillsdale, NJ: Lawrence Erlbaum.
Jones, L. (2003). Supporting listening comprehension and vocabulary acquisition with multimedia annotations: The students’ voice. CALICO Journal, 21, 41-65.
Jones, L. (2004). Testing L2 vocabulary recognition and recall using pictorial and written test items. Language Learning & Technology, 8(3), 122-143. Retrieved October 27, 2008, from http://llt.msu.edu/vol8num3/default.html
Jones, L. (2006). Effects of collaboration and multimedia annotations on vocabulary learning and listening comprehension. Manuscript submitted for publication.
Jones, L., & Plass, J. (2002). Supporting listening comprehension and vocabulary acquisition in French with multimedia annotations. The Modern Language Journal, 86, 546-561.
Kirby, J. R. (1993). Collaborative and competitive effects of verbal and spatial processes. Learning and Instruction, 3, 201-214.
Knight, S. (1994). Dictionary use while reading: The effects on comprehension and vocabulary acquisition for students of different verbal abilities. The Modern Language Journal, 78, 285-299.
Kost, C. R., Foss, P., & Lenzini, J. J. (1999). Textual and pictorial glosses: Effectiveness on incidental vocabulary growth when reading in a foreign language. Foreign Language Annals, 32, 89-113.
Kozma, R. B. (1991). Learning with media. Review of Educational Research, 61, 179-211.
Lee, J. F. (1986). On the use of the recall task to measure L2 reading comprehension. Studies in Second Language Acquisition, 8, 201-212.
Long, D. (1987). Listening comprehension: Need and neglect. Hispania, 70, 921-928.
Long, D. (1989). Second language listening comprehension: A schema theoretic perspective. The Modern Language Journal, 73, 22-30.
Lynch, T. (1995). The development of interactive listening strategies in second language academic settings. In D. J. Mendelsohn & J. Rubin (Eds.), A guide for the teaching of second language listening (pp. 166-185). San Diego, CA: Dominie Press.
Lynch, T. (1998). Theoretical perspectives on listening. Annual Review of Applied Linguistics, 18, 3-19.
Macromedia. (1997). Authorware 4.0 [Computer software, Macintosh] San Francisco, CA: Macromedia, Inc.
Mayer, R. E. (1992). Cognition and instruction: Their historic meeting within educational psychology. Journal of Educational Psychology, 84, 405-412.
Mayer, R. E. (1997). Multimedia learning: Are we asking the right questions? Educational Psychologist, 32, 1-19.
Mayer, R. E. (2001). Multimedia learning. Cambridge, MA: Cambridge.
Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38, 43-52.
Mayer, R. E., & Sims, V. K. (1994). For whom is a picture worth a thousand words? Extensions of a dualcoding theory of multimedia learning. Journal of Educational Psychology, 86, 389-401.
Mendelsohn, D. J. (1998). Teaching listening. Annual Review of Applied Linguistics, 18, 81-101.
Meskill, C. (1996). Listening skills development through multimedia. Journal of Educational Multimedia and Hypermedia, 6, 179-201.
O’Malley, J. M., Chamot, A., & Walker, C. (1987). Some applications of cognitive theory to second language acquisition. Studies in Second Language Acquisition, 9, 287-306.
Plass, J. L., Chun, D. M., Mayer, R. E., & Leutner, D. (1998). Supporting visual and verbal learning preferences in a second language multimedia learning environment. Journal of Educational Psychology, 90, 25-36.
Plass, J. L., Chun, D. M., Mayer, R. E., & Leutner, D. (2003). Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities. Computers in Human Behavior, 19, 221-243.
Pouwels, J. B. (1992). The effectiveness of vocabulary visual aids for auditory and visual foreign language students. Foreign Language Annals, 25, 391-401.
Purdy, M. (1996). The limits to human contact: How communication technology mediates relationships. Paper presented at the meeting of the International Listening Association.
Pusack, J., & Otto, S. (1997). Taking control of multimedia. In M. Bush & R. Terry (Eds.), Technologyenhanced language learning (pp. 1-46). Lincolnwood, IL: National Textbook Company.
Raphan, D. (1996). A multimedia approach to academic listening. Teachers of English to Speakers of Other Languages, 6, 24-28.
Riding, R., & Cheema, I. (1991). Cognitive styles—An overview and integration. Educational Psychology, 11, 193-215.
Sabo, G., Restrepo, L. F., & Jones, L. (2000). First encounters: Native Americans and Europeans in the Mississippi Valley [Computer software: CD-Rom]. Fayetteville, AR: Arkansas Archeological Survey.
Salaberry, M. R. (2001). The use of technology for second language learning and teaching: A retrospective. The Modern Language Journal, 85, 39-56.
Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4, 295-312.
Sweller, J. (1999). Instructional design in technical areas. Camberwell, Australia: ACER Press.
University of Texas (2004). Français Interactif [website]. Available at http://www.laits.utexas.edu/fi
