Giving Help and Praise in a Reading Tutor with Imperfect Listening--Because Automated Speech Recognition Means Never Being Able to Say You're Certain

Authors

  • Jack Mostow
  • Gregory Aist

DOI:

https://doi.org/10.1558/cj.v16i3.407-424

Keywords:

Speech Recognition, Oral Reading, Computer-Assisted Language Learning, Intelligent Tutoring Systems, Multimedia

Abstract

Human tutors make use of a wide range of input and output modalities, such as speech, vision, gaze, and gesture. Computer tutors are typically limited to keyboard and mouse input. Project LISTEN's Reading Tutor uses speech recognition technology to listen to children read aloud and help them. Why should a computer tutor listen? A computer tutor that listens can give help and praise naturally and unobtrusively. We address the following questions: When and how should a computer tutor that listens help students? When and how should it praise students? We examine how the advantages and disadvantages of speech recognition technology helped shape the design and implementation of the Reading Tutor. Despite its limitations, this technology enables the Reading Tutor to provide patient, unobtrusive, and natural assistance for reading aloud.

References

Aist, G. S. (1998). Expanding a time-sensitive conversational architecture for turntaking to handle content-driven interruption. In Proceedings of the Fifth International Conference on Speech and Language Processing (ICSLP98), Sydney, Australia.

Aist, G. S. (1997). Challenges for a mixed initiative spoken dialog system for oral reading tutoring. Paper presented at the Symposium on Computational Models for Mixed Initiative Interaction, American Association for Artificial Intelligence Annual Meeting, Palo Alto, CA.

Aist, G., Chan, P., Huang, X. D., Jiang, L., Kennedy, R., Latimer, D., Mostow, J., & Yeung, C. (1998). How effective is unsupervised data collection for children’s speech recognition? In Proceedings of the Fifth International Conference on Speech and Language Processing (ICSLP98), Sydney, Australia.

Aist, G. S., & Mostow, J. (1997). When speech input is not an afterthought: A reading tutor that listens. In Proceedings of the Workshop on Perceptual User Interfaces, Banff, Canada.

Bernstein, J., & Rtischev, D. (1991). A voice interactive language instruction system. In Proceedings of the Second European Conference on Speech Communication and Technology (EUROSPEECH91), Genova, Italy.

Curtis, M. E. (1980). Development of components of reading skill. Journal of Educational Psychology, 72 (5), 656-669.

Fox, B. A. (1993). The human tutorial dialogue project: Issues in the design of instructional systems. Hillsdale, NJ: Lawrence Erlbaum.

Hebb, D. O. (1949). The organization of behavior. New York: John Wiley and Sons.

Huang, X. D., Alleva, F., Hon, H. W., Hwang, M. Y., Lee, K. F., & Rosenfeld, R. (1993). The Sphinx-II speech recognition system: An overview. Computer Speech and Language, 7 (2), 137-148.

IBM. (1998). Watch Me Read. http://www.ibm.com/IBM/IBMGives/k12ed/watch.htm.

Kantrov, I. (1991). Talking to the computer: A prototype speech recognition system for early reading instruction. Technical Report 91-3. Newton, MA: Center for Learning, Teaching, and Technology, Education Development.

Mostow, J., Hauptmann, A. G., Chase, L. L., & Roth, S. F. (1993). Towards a reading coach that listens: Automated detection of oral reading errors. In Proceedings of the Annual Meeting of the American Association for Artificial Intelligence (AAAI 93), Washington, DC.

Mostow, J., Roth, S. F., Hauptmann, A. G., & Kane, M. (1994). A prototype reading coach that listens. In Proceedings of the Annual Meeting of the American Association for Artificial Intelligence (AAAI 94), Seattle, WA.

Mostow, J., Hauptmann, A., & Roth, S. F. (1995). Demonstration of a reading coach that listens. In Proceedings of the Eighth Annual Symposium on User Interface Software and Technology, Pittsburgh, PA. (Sponsored by ACM SIGGRAPH and SIGCHI in cooperation with SIGSOFT).

Mostow, J., and Aist, G. S. (1997). The sounds of silence: Towards automatic evaluation of student learning in a reading tutor that listens. In Proceedings of the Annual Meeting of the American Association for Artificial Intelligence (AAAI 97), Palo Alto, CA.

Mostow, J., and Aist, G. S. (in preparation). Evaluating tutors that listen: An overview of Project LISTEN. To appear in K. Forbus and P. Feltovich (Eds.), as-yet untitled collection on artificial intelligence and education. Palo Alto, CA: AAAI Press.

Phillips, M., McCandless, M., & Zue, V. (1992). Literacy tutor: An interactive reading aid. Technical Report. Cambridge, MA: Spoken Language Systems Group, Laboratory for Computer Science, Massachusetts Institute of Technology.

Russell, M., Brown, C., Skilling, A., Series, R., Wallace, J., Bonham, B., & Barker, P. (1996). Applications of automatic speech recognition to speech and language development in young children. In Proceedings of the Fourth International Conference on Spoken Language Processing, Philadelphia, PA.

Wenger, E. (1987). Artificial Intelligence and Tutoring Systems. Los Altos, CA: Morgan Kaufman.

Downloads

Published

2013-01-14

Issue

Section

Articles

How to Cite

Mostow, J., & Aist, G. (2013). Giving Help and Praise in a Reading Tutor with Imperfect Listening--Because Automated Speech Recognition Means Never Being Able to Say You’re Certain. CALICO Journal, 16(3), 407-424. https://doi.org/10.1558/cj.v16i3.407-424

Most read articles by the same author(s)

1 2 3 4 5 6 7 8 9 10 > >>