AI in CALL--Artificially Inflated or Almost Imminent?

Authors

  • Mathias Schulze

DOI:

https://doi.org/10.1558/cj.v25i3.510-527

Keywords:

Artificial Intelligence (AI), Natural Language Processing (NLP), Intelligent Computer-assisted Language Learning (ICALL), Intelligent Tutoring System (ITS)

Abstract

The application of techniques from artificial intelligence (AI) to CALL has commonly been referred to as intelligent CALL (ICALL). ICALL is only slightly older than the CALICO Journal, and this paper looks back at a quarter century of published research mainly in North America and by North American scholars. This 'inventory taking' will provide a basis for establishing the place, context, and direction of ICALL in the CALICO Journal, CALICO organization, and CALL research and development in general. As a point of reference, I will use a list of desiderata for ICALL (Oxford, 1993) from the outside perspective of second language acquisition (SLA).

References

Amaral, L., Metcalf, V., & Meurers, D. (2006). Language awareness through re-use of NLP technology. Paper presented at the Preconference Workshop—Computational and Linguistic Challenges, Annual Conference of the Computer Assisted Language Instruction Consortium, University of Hawaii, Oahu, Hawaii.

Anderson, D. D. (1995). Machine translation as a tool in second language learning. CALICO Journal, 13(1), 68-97.

Bailin, A. (1990). Skills in context and student modeling. CALICO Journal, 8(1), 7-22.

Bailin, A. (1995). Intelligent computer-assisted language learning: A bibliography. Computers and the Humanities, 29(5), 375-387.

Bailin, A. (Ed.). (1991). ICALI research [Special Issue]. CALICO Journal, 9(1).

Bailin, A., & Thomson, P. (1988). The use of natural language processing in computer-assisted language instruction. Computers and the Humanities, 22(1), 99-110.

Bailin, A., & Levin, L. S. (Eds.). (1989). Intelligent computer-assisted language instruction [Special Issue]. Computers and the Humanities, 23.

Bowerman, C. (1993). Intelligent computer-aided language learning. LICE: A system to support undergraduates writing in German. Unpublished doctoral dissertation, University of Manchester Institute of Science and Technology, Manchester, UK.

Brocklebank, C. P. (1998). An experiment in developing a prototype intelligent teaching system from a parser written in Prolog. Unpublished master’s thesis, University of Manchester Institute of Science and Technology, Manchester, UK.

Bull, S. (1993). Towards user/system collaboration in developing a student model for intelligent computer-assisted language learning. Computer Assisted Language Learning, 8(1), 3-8.

Bull, S. (1994a). Learning languages: Implications for student modelling in ICALL. ReCall, 6(1), 34-39.

Bull, S. (1994b). Student modeling for second language acquisition. Computers and Education, 23(1-2), 13-20.

Bull, S. (1997a). Promoting effective learning strategy use in CALL. CALL, 10(1), 3-39.

Bull, S. (1997b). See yourself write: A simple student model to make students think. In A. Jameson, C. Paris, & C. Tasso (Eds.), User Modeling: Proceedings of the Sixth International Conference, UM97 (pp. 315-326). Berlin: Springer Verlag.

Bull, S. (2000a). ‘Do it yourself’ student models for collaborative student modelling and peer interaction. In B. P. Goettl, H. M. Halff, C. Redfield Luckhardt & V. J. Shute (Eds.), Intelligent Tutoring Systems. 4th International Conference, ITS ‘98, San Antonio, TX, August 16-19, 1998 Proceedings (pp. 176-185). Berlin: Springer Verlag.

Bull, S. (2000b). Individualized recommendations for learning strategy use. In G. Gauthier, C. Frasson, & K. VanLehn (Eds.), Intelligent Tutoring Systems. 5th International Conference, ITS 2000, Montréal, Canada, June 2000, Proceedings (pp. 594-603). Berlin: Springer Verlag.

Bull, S., Brna, P., & Pain, H. (1995). Extending the scope of the student model. User Modeling and UserAdapted Interaction, 5(1), 45-65.

Bull, S., Pain, H., & Brna, P. (1993). Collaboration and reflection in the construction of a student model for intelligent computer assisted language learning. In Proceedings of the Seventh International PEG Conference (PEG93). AI Tools and the Classroom: Theory into Practice. Vol. I (pp. 48-56). Edinburgh: Moray House.

Cerri, S. A. (1989). ALICE: Acquisition of linguistic items in the context of examples. Instructional Science, 18(1), 63-92.

Chanier, T. (1994). Language learning. Journal of Artificial Intelligence in Education [Special Issue], 5.

Chanier, T., Pengelly, M., Twidale, M., & Self, J. A. (1992). Conceptual modeling in error analysis in computer-assisted language learning systems. In M. L. Swartz & M. Yazdani (Eds.), Intelligent tutoring systems for foreign language learning: The bridge to international communication (pp. 125-150). New York: Springer Verlag.

Chen, S.-Q., & Xu, L. (1990). Grammar-debugger: A parser for Chinese EFL learners. CALICO Journal, 8(2), 63-75.

Cunningham, P. A., Iberall, T., & Woolf, B. W. (1987). CALEB: An intelligent silent second language tutor. In Proceedings of IEEE International Conference on Systems, Man, and Cybernetics (pp. 1210-1215). Los Alamitos, CA: Computer Society IEEE.

de Bot, K., Lowie, W., & Verspoor, M. (2005). Dynamic systems theory and applied linguistics: The ultimate “so what”? International Journal of Applied Linguistics, 15(1), 116-118.

de Bot, K., Lowie, W., & Verspoor, M. (2007). A dynamic systems theory approach to second language acquisition. Bilingualism: Language and Cognition, 10(1), 7-21.

DeSmedt, W. H. (1995). Herr Kommissar: An ICALL conversation simulator for intermediate German. In V. M. Holland, J. D. Kaplan, & M. R. Sams (Eds.), Intelligent language tutors: Theory shaping technology (pp. 153-174). Mahwah, NJ: Lawrence Erlbaum Associates.

Dokter, D., & Nerbonne, J. (1998). A session with Glosser-RuG. In S. Jager, J. A. Nerbonne, & A. van Essen (Eds.), Language teaching and language technology (pp. 89-95). Lisse: Swets & Zeitlinger.

Dokter, D., Nerbonne, J., Schürcks-Grozeva, L., & Smit, P. (1998). Glosser-RuG: A user study. In S.

Jager, J. A. Nerbonne, & A. van Essen (Eds.), Language teaching and language technology (pp. 169-178). Lisse: Swets & Zeitlinger.

Ellis, N. C., & Larsen-Freeman, D. (2006). Language emergence: Implications for applied linguistics— Introduction to the Special Issue. Applied Linguistics, 27(4), 558-589.

Emirkanian, L., & Bouchard, L. H. (1988a). Knowledge integration in a robust and efficient morphosyntactic analyzer for French. In D. Vargha (Ed.), Coling Budapest. Proceedings of the 12th International Conference on Computational Linguistics (Vol. 1, pp. 166-171). Budapest: John von Neumann Society for Computer Sciences.

Emirkanian, L., & Bouchard, L. H. (1988b). Towards a knowledge-based tool for correcting French text. In F. Lovis & E. D. Tagg (Eds.), Computers in education (pp. 583-588). Amsterdam: Elsevier Science.

Fujiwara, M., & Yamura-Takei, M. (2002). Zero-Checker: A CALL program for reading and writing Japanese. In Proceedings of the Third International Conference on Computer Assisted Systems for Teaching and Learning Japanese (pp. 205-208). San Diego: University of California. Also available at http://www.nier.go.jp/saka/cas2002/0222.html

Gamper, J., & Knapp, J. (2002). A Review of Intelligent CALL Systems. Computer Assisted Language Learning, 15(4), 329-342.

Hackenberg, R. G. (1984). Generate a natural language sentence generator. CALICO Journal, 2(2), 5-8.

Hamburger, H., & Hashim, R. (1992). Foreign language tutoring and learning environment. In M. L. Swartz & M. Yazdani (Eds.), Intelligent tutoring systems for foreign language learning. The bridge to international communication (pp. 201-218). Berlin: Springer Verlag.

Heidorn, G. E., Jensen, K., Miller, L. A., Byrd, R. J., & Chodorow, M. (1982). The EPISTLE text-critiquing system. IBM Systems Journal, 21(3), 305-326.

Heift, T. (1998). Designed intelligence: A language teacher model. Unpublished doctoral dissertation, Simon Fraser University, Burnaby, British Columbia, Canada.

Heift, T. (2001). Error-specific and individualized feedback in a web-based language tutoring system: Do they read it? ReCall, 13(2), 129-142.

Heift, T. (2002). Learner control and error correction in ICALL: Browsers, peekers and adamants. CALICO Journal, 19(3), 295-313.

Heift, T. (2003). Multiple learner errors and feedback: A challenge for ICALL systems. CALICO Journal, 20(3), 549-560.

Heift, T. (2004). Corrective feedback and learner uptake in CALL. ReCALL, 16(2), 416-431.

Heift, T. (2006). Context-sensitive help in CALL. Computer Assisted Language Learning, 19(2), 193-242.

Heift, T. (2007). Learner personas in CALL. CALICO Journal, 25(1), 1-10.

Heift, T., & Nicholson, D. (2000a). Enhanced server logs for intelligent, adaptive web-based systems. In Technical Report of the Institute for Semantic Information Processing (pp. 29-37). Osnabrück: Universität Osnabrück.

Heift, T., & Nicholson, D. (2000b). Theoretical and practical considerations for web-based intelligent language tutoring systems. In G. Gauthier, C. Frasson & K. Van Lehn (Eds.), Intelligent Tutoring Systems. 5th International Conference, IITS 2000, Montréal, Canada, June 19-23, 2000. Proceedings (pp. 354-362). Montréal: Springer Verlag.

Heift, T., & Schulze, M. (2003a). Student modeling and ab initio language learning. System, 31(4), 519-535.

Heift, T., & Schulze, M. (Eds.). (2003b). Error diagnosis and error correction in CALL [Special Issue]. CALICO Journal, 20(3).

Heift, T., & Schulze, M. (2007). Errors and intelligence in CALL. Parsers and pedagogues. New York: Routledge.

Holland, V. M., & Kaplan, J. D. (1995). Natural language processing techniques in computer assisted language learning: Status and instructional issues. Instructional Science, 23(3), 351-380.

Holland, V. M., Kaplan, J. D., & Sams, M. R. (Eds.). (1995). Intelligent language tutors: Theory shaping technology. Mahwah, NJ: Lawrence Erlbaum Associates.

Hubbard, P., & Bradin-Siskin, C. (2004). Another look at tutorial CALL. ReCALL, 16(2), 448–461.

Jehle, F. (1987). A free-form dialog program in Spanish. CALICO Journal, 5(2), 11-22.

Jensen, K., Heidorn, G. E., Miller, L. A., & Ravin, Y. (1984). Parse fitting and prose fixing: Getting a hold on ill-formedness. American Journal of Computational Linguistics, 9(3-4), 147-160.

Jung, U. O. H. (2002). An international bibliography of computer assisted language learning: Fifth installment. System, 30(3), 349–398.

Kang, Y.-S., & Maciejewski, A. A. (2000). A student model of technical Japanese reading proficiency for an intelligent tutoring system. CALICO Journal, 18(1), 9-40.

Kaplan, J. D., & Holland, V. M. (1995). Application of learning principles to the design of a second language tutor. In V. M. Holland, J. D. Kaplan, & M. R. Sams (Eds.), Intelligent language tutors: Theory shaping technology (pp. 273-287). Mahwah, NJ: Lawrence Erlbaum Associates.

Kaplan, J. D., Sabol, M. A., Wisher, R. A., & Seidel, R. J. (1998). The military language tutor (MILT) program: An advanced authoring system. Computer Assisted Language Learning, 11(3), 265-287.

Kempen, G. (1992). Language technology and language instruction: Computational diagnosis of word level errors. In M. L. Swartz & M. Yazdani (Eds.), Intelligent tutoring systems for foreign language learning. The bridge to international communication (pp. 191-198). Berlin: Springer Verlag.

Krashen, S. D. (1982). Principles and practice in second language acquisition. Oxford: Pergamon.

Lado, R. (1957). Linguistics across cultures: Applied linguistics for language teachers. Ann Arbor, MI: The University of Michigan Press.

Larsen-Freeman, D. (1997). Chaos/complexity science and second language acquisition. Applied Linguistics, 18(2), 141-165.

Larsen-Freeman, D. (2000). Second language acquisition and applied linguistics. Annual Review of Applied Linguistics, 20, 165-181.

Larsen-Freeman, D. (2003). Teaching language: From grammar to grammaring. Southbank, Victoria: Thomson/Heinle.

Larsen-Freeman, D. (2006). The emergence of complexity, fluency, and accuracy in the oral and written production of five Chinese learners of English. Applied Linguistics, 27(4), 590-619.

Lawler, R. W. (1990). Dual purpose learning environments. Computer Assisted Language Learning, 4(1), 46-52.

Lawler, R. W. (1993). Dual purpose learning environments. In M. Yazdani (Ed.), Multilingual multimedia. Bridging the language barrier with intelligent systems (pp. 73-84). Oxford: Intellect.

Levin, L. S., & Evans, D. A. (1995). ALICE-chan: A case study in ICALL theory and practice. In V. M. Holland, J. D. Kaplan, & M. R. Sams (Eds.), Intelligent language tutors: Theory shaping technology (pp. 77-99). Mahwah, NJ: Lawrence Erlbaum Associates.

Levin, L. S., Evans, D. A., & Gates, D. M. (1991). The ALICE system: A workbench for learning and using language. CALICO Journal, 9(1), 27-54.

Levy, M. (1997). Computer-assisted language learning. Context and conceptualisation. Oxford: Clarendon.

Lusuardi, C. (2005). The use of natural language processing in CALL for the purpose of error diagnosis. Paper presented at the annual meeting of Eurocall, Krakow, Poland.

Lyster, R. (2007). Learning and teaching languages through content: A counterbalanced approach. Amsterdam; Philadelphia: John Benjamins.

Mabbott, A., & Bull, S. (2004). Alternative views on knowledge: Presentation of open learner models. In J. C. Lester, R. M. Vicari, & F. Paraguacu (Eds.), Intelligent Tutoring Systems: 7th International Conference (pp. 689-698). Berlin: Springer-Verlag.

Maritxalar, M., Ezeiza, N., & Schulze, M. (Eds.). (2007). Proceedings of the Workshop NLP for Educational Resources at the International Conference on Recent Advances in Natural Language Programming 2007. Borovets, Bulgaria: Bulgarian Academy of Sciences.

Matthews, C. (1992). Intelligent CALL (ICALL) bibliography. Hull, UK: CTI Centre for Modern Languages.

Matthews, C. (1993). Grammar frameworks in intelligent CALL. CALICO Journal, 11(1), 5-27.

McCalla, G. I., Vassileva, J., Greer, J. E., & Bull, S. (2000). Active learner modelling. In G. Gauthier, C. Frasson, & K. VanLehn (Eds.), Intelligent Tutoring Systems. 5th International Conference, ITS 2000, Montréal, Canada, June 2000, Proceedings (pp. 53-62). Berlin: Springer Verlag.

Molla, S. R., Sanders, A. F., & Sanders, R. H. (1988). Artificial intelligence in a German adventure game: Spion in Prolog. CALICO Journal, 6(1), 9-23.

Murray, J. H. (1991). Anatomy of a new medium: Literary and pedagogic uses of advanced linguistic computer science. Computers and the Humanities, 25(1), 1-14.

Nagata, N. (1992). A study of the effectiveness of intelligent CALI as an application of natural language processing. Unpublished doctoral dissertation, University of Pittsburgh, Pittsburgh, PA.

Nagata, N. (1993). Intelligent computer feedback for second language instruction. Modern Language Journal, 77(3), 330-338.

Nagata, N. (1995). An effective application for natural language processing in second language instruction. CALICO Journal, 13(1), 47-67.

Nagata, N. (1996). Computer vs. workbook instruction in second language acquisition. CALICO Journal, 14(1), 53-75.

Nagata, N. (1997). An experimental comparison of deductive and inductive feedback generated by a simple parser. System, 25(4), 515-534.

Nagata, N. (1998a). Input vs. output practice in educational software for second language acquisition. Language Learning & Technology, 1(2), 23-40. Retrieved March 2, 2008, from http://llt.msu.edu/vol1num2/article1

Nagata, N. (1998b). The relative effectiveness of production comprehension practice in second language Acquisition. Computer Assisted Language Learning, 11(2), 153-177.

Nagata, N. (2002). BANZAI: An application of natural language processing to web-based language learning. CALICO Journal, 19(3), 583-599.

Nagata, N., & Swisher, M. V. (1995). A study of consciousness-raising by computer: The effect of metalinguistic feedback on second language learning. Foreign Language Annals, 28(3), 337-347.

Nerbonne, J. A. (2003). Computer-assisted language learning and natural language processing. In R. Mitkov (Ed.), The Oxford handbook of computational linguistics (pp. 670-698). Oxford: Oxford University Press.

Nerbonne, J. A., & Dokter, D. (1999). An intelligent word-based language learning assistant. Traitement Automatique des Languages, 40(1), 125-142.

O’Malley, J. M., & Chamot, A. U. (1990). Learning strategies in second language acquisition. Cambridge: Cambridge University Press.

Oxford, R. L. (1993). Intelligent computers for learning languages: The view for language acquisition and instructional methodology. Computer Assisted Language Learning, 6(2), 173-188.

Pijls, F., Daelemans, W., & Kempen, G. (1987). Artificial intelligence tools for grammar and spelling instruction. Instructional Science, 16(3), 319-336.

Pulman, S. G. (1984). Limited domain systems for language teaching. In Proceedings of Coling84: Tenth International Conference on Computational Linguistics and 22nd Annual Meeting of the Association for Computational Linguistics (pp. 84-87). Stanford, CA: Stanford University.

Richardson, S. D., & Braden-Harder, L. C. (1988). The experience of developing a large-scale natural language text processing system: Critique. In EDITOR (Ed.), Proceedings of the Second Conference on Applied Natural Language Processing. Association for Computational Linguistics (pp. 195-202). Austin, TX: Association for Computational Linguistics.

Roosmaa, T., & Prószéky, G. (1998). GLOSSER—Using language technology tools for reading texts in a foreign language. In S. Jager, J. A. Nerbonne, & A. van Essen (Eds.), Language teaching and language technology (pp. 101-107). Lisse: Swets & Zeitlinger.

Rypa, M., & Feuerman, K. (1995). CALLE: An exploratory environment for foreign language learning. In V. M. Holland, J. D. Kaplan, & M. R. Sams (Eds.), Intelligent language tutors: Theory shaping technology (pp. 55-76). Mahwah, NJ: Lawrence Erlbaum Associates.

Sams, M. R. (1995). Advanced technologies for language learning: The BRIDGE project within the ARI language tutor program. In V. M. Holland, J. D. Kaplan, & M. R. Sams (Eds.), Intelligent language tutors: Theory shaping technology (pp. 7-21). Mahwah, NJ: Lawrence Erlbaum Associates.

Sanders, A. F., & Sanders, R. H. (1982). Spion: ‘Intelligent’ computer games for German language teaching. In Proceedings of the Foreign Language Instructional Technology Conference (pp. 141-146). Monterey, CA: Goethe Institute and Defense Language Institute.

Sanders, R. H. (1984). Pilot-Spion: A computer game for German students. Unterrichtspraxis, 17(1), 123-129.

Sanders, R. H. (1995). Thirty years of computer assisted language instruction: Introduction. CALICO Journal, 12(4), 5-14.

Schoelles, M., & Hamburger, H. (1996). Teacher-usable exercise design tools. In C. Frasson, G. Gauthier, & A. Lesgold (Eds.), Intelligent Tutoring Systems. Second International Conference, ITS’96, Montréal, Canada, June 1996, Proceedings (pp. 102-110). Berlin: Springer Verlag.

Schulze, M. (1998). Teaching grammar—learning grammar: Aspects of second language acquisition. Computer Assisted Language Learning, 11(2), 215-228.

Schulze, M. (1999). From the developer to the learner: Computing grammar—learning grammar. ReCALL, 11(1), 117-124.

Schulze, M. (2001). Textana—Grammar and grammar checking in parser-based CALL. Unpublished doctoral dissertation, University of Manchester Institute of Science and Technology, Manchester, UK.

Schulze, M. (2003). Grammatical errors and feedback: Some theoretical insights. CALICO Journal, 20 (3), 437-450.

Schulze, M. (in press). Modeling SLA processes using NLP. In C. Chapelle (Ed.), Edited Proceedings of the Fifth Conference on Technology for Second Language Learning: Towards Adaptive CALL: Natural Language Processing for Diagnostic Language Assessment. Ames, IA: Iowa State University.

Schulze, M., & Hamel, M.-J. (1998). Use and re-use of syntactic parsers in CALL. Towards diagnosing learner errors. In J. Gassin, M. Smith, & D. Cunningham (Eds.), Proceedings of WorldCALL (pp. 203-204). Melbourne: Melbourne University.

Schulze, M., Hamel, M.-J., & Thompson, J. (Eds.). (1999). Language processing in CALL. ReCALL special publication (Proceedings of a one-day conference “Natural Language Processing in ComputerAssisted Language Learning” held at University of Manchester Institute of Science and Technology, 9 May 1998, Organised by the Centre of Computational Linguistics, University of Manchester Institute of Science and Technology, in association with Eurocall). Hull, UK: University of Hull, CTI Centre for Modern Languages.

Schuster, E. (1986). The role of native grammars in correcting errors in second language learning. Computational Intelligence, 2(1), 93-98.

Selinker, L. (1974). Interlanguage. In J. C. Richards (Ed.), Error analysis: Perspectives on second language acquisition (pp. 31-54). London: Longman.

Selinker, L. (1992). Rediscovering interlanguage. London: Longman.

Swartz, M. L., & Yazdani, M. (1992). Intelligent tutoring systems for foreign language learning: The bridge to international communication. New York: Springer Verlag.

ten Hacken, P. (2003). Computer-assisted language learning and the revolution in computational linguistics. Linguistik online, 17(5), 23-39.

Thompson, J., & Zähner, C. (Eds.). (1992). Proceedings of the ICALL Workshop, University of Manchester Institute of Science and Technology, September 1991. Hull, UK: University of Hull, CTI Centre for Modern Languages.

Tokuda, N., Heift, T., & Chen, L. (2002). ICALL. Computer-Assisted Language Learning [Special Issue], 15(4).

Underwood, J. H. (1982). Simulated conversation as CAI strategy. Foreign Language Annals, 15(2), 209-212.

Underwood, J. H. (1984). Linguistics, computers, and the language teacher. Rowley, MA: Newbury House Publishers.

Weischedel, R. M., Voge, W. M., & James, M. (1978). An artificial intelligence approach to language instruction. Artificial Intelligence, 10(2), 225-240.

Wikipedia. The Free Encyclopedia. (n.d.) Available at http://en.wikipedia.org/wiki/Main_Page

Yamura-Takei, M., Fujiwara, M., Yoshie, M., & Aizawa, T. (2002). Automatic linguistic analysis for language teachers: The case of zeros. In Proceedings of Coling 2002: The Seventeenth International Conference on Computational Linguistics (n.p.). Taipei: Association for Computational Linguistics.

Yazdani, M. (1991). The Linger project: An artificial intelligence approach to second-language tutoring.

Computer Assisted Language Learning, 4(2), 107-116.

Yazdani, M., & Uren, J. (1988). Generalising language-tutoring systems: A French/Spanish case study using LINGER. Instructional Science, 17(2), 179-188.

Zock, M. (1988). Language learning as problem solving. Modeling logical aspects of inductive learning to generate sentences in French by man and machine. In D. Vargha (Ed.), Coling Budapest. Proceedings of the Twelfth International Conference on Computational Linguistics (Vol. 2, pp. 806-811). Budapest: John von Neumann Society for Computing Sciences.

Zock, M. (1992). SWIM or sink: The problem of communicating thought. In M. L. Swartz & M. Yazdani (Eds.), Intelligent tutoring systems for foreign language learning. The bridge to international communication (pp. 235-247). Berlin: Springer Verlag.

Zock, M. (1996). Computational linguistics and its use in the real world: The case of computer assisted language learning. In Proceedings of Coling ’96: The Sixteenth International Conference on Computational Linguistics (Vol. 1, pp. 1002-1004). Copenhagen: Center for Sprogteknologi.

Zock, M., Sabah, G., & Alviset, C. (1986). From structure to process. Computer-assisted teaching of various strategies for generating pronoun constructions in French. In Proceedings of COLING (pp. 566-569). Bonn: Institut for angewandte Kommunikations- und Sprachforschung e.V. (IKS).

Downloads

Published

2013-01-14

Issue

Section

Articles

How to Cite

Schulze, M. (2013). AI in CALL--Artificially Inflated or Almost Imminent?. CALICO Journal, 25(3), 510-527. https://doi.org/10.1558/cj.v25i3.510-527