Abstract
Este artigo é uma resenha bibliográfica derivada de um projeto de pesquisa focando na multimodalidade e seu possível impacto na aprendizagem de línguas estrangeiras, com especial atenção aos desenhos de textos (KRESS & VAN LEEUWEN, 2001) de acordo com o informado pelos modelos de aprendizado multimodal (SCHNOTZ, 2005; MAYER, 2001). Em primeiro lugar, o artigo resgata estes modelos e os relaciona ao campo da aquisição de um segundo idioma. Em continuação, descreve-se alguns pontos de possível encontro e diálogos entre estes dois campos de pesquisa. Finalmente, apresenta alguns estudos que se realizaram em torno ao aprendizado multimodal de línguas como exemplos deste diálogo
ABSTRACT:
This article is a partial review of the literature that supports an investigation on the possible impact of multimodality on foreign language learning, with particular emphasis on text design (KRESS & VAN LEEUWEN, 2001) and models of multimedia learning (SCHNOTZ, 2005; MAYER, 2001). To start, the article describes these models and establishes their relation to the field of second language acquisition. To continue, we discuss some meeting points that may justify our interest in making multimodal leaning and foreign language education engage in dialog. The article concludes with a brief account of some studies dealing with multimodal foreign language learning that illustrate such dialogue.
Keywords: Multimodal learning, sociosemiotic models, multimodal second/foreign language teaching-learning
References
ATKINSON, R. C., & RAUGH, M. R. (1975). An application of the mnemonic keyword method to the acquisition of a Russian vocabulary. Journal of Experimental Psychology: Human Learning and Memory, 104, p. 126-133.
BADDELEY, A. D. & HITCH, G. J. (1974). Working memory. In: G. H. Bower (ed.), The psychology of learning and motivation: Advances in research and theory. New York: Academic Press, v. 8, p. 47-89.
BADDELEY, A. D. (1986). Working memory. New York: Oxford University Press.
CANAGARAJAH, A.S. (1999). Resisting linguistic imperialism in English teaching. Oxford: OUP.
CASSELL, J. (2007). A framework for gesture generation and interpretation. In: Cipolla, R. and Pentland, A. (eds). Computer vision in human-machine interaction. Cambridge: CUP.
CHANDÍA, F. et al (2007). Multimodality and vocabulary learning: evaluating the impact of the modality and redundancy multimedia principles on the lexical retention of EFL secondary students classified as imagers and verbalizers. Undergraduate thesis, Licenciado en Educación en Inglés, USACH. Santiago.
DE BEAUGRANDE, R. (1997). Text, discourse and process. Toward a multidisciplinary science of texts.
Washington: National Academy Press. Available at:<http://www.beaugrande.com/TDPOpening.htm>.
Accessed on: 14 February 2008.
DUBOIS, M. & VIAL, I. (2000). Multimedia design: the effects of relating multimodal information. Journal of Computer Assisted Learning. v. 16, p. 157-165.
DOUGHTY J. C. & M. H. LONG (eds.) (2006). The handbook of second language acquisition. Malden, Ma.: Blackwell Publishing Ltd.
ELSWORTH, S. & ROSE, J. (1999). Go for Chile. Primer Año de Enseñanza Media. Santiago de Chile: Addison Wesley Longman.
FARÍAS, M. (2004). Textos multimodales en tiempos de competencias múltiples. In: Actas del XIV Congreso Nacional de SONAPLES. Univ. de Los Lagos. Osorno.
_____. (2006). Critical language awareness in foreign language learning. Literatura y Lingüística, n. 16, p. 209- 220. Available at: < http://www.scielo.cl/scielo.php>. Accessed on: 22 June 2009.
FARIAS, M. & ACEVEDO, I. (2008). El rol de los gestos en el discurso multimodal de aprendices de inglés como lengua extranjera. In: Farías and Obilinovic (eds.) Aprendizaje Multimodal/Multimodal learning, Santiago de Chile: Publifahu USACH, p. 97-110.
FARÍAS, M.; OBILINOVIC, K. & ORREGO, R. (2007). Implications of multimodal learning models for foreign language teaching and learning. Colombian Applied Linguistics Journal. n. 19, p. 174-200.
_____. (2009). Estudio exploratorio de aplicación del principio de redundancia en el aprendizaje de expresiones idiomáticas en lengua extranjera. In: Actas del II Congreso Nacional de la Cátedra UNESCO Lectura y Escritura. Universidad de Los Lagos. Osorno.
GASS, S. (2006). Input and interaction, In: The handbook of second language acquisition. Doughty, C. J. & Long, M. H., (eds.). Malden, Ma.: Blackwell publishing Ltd, p. 224-255.
HARPER, B., HEDBERG, J., CORDEROY, B., & WRIGHT R. (2000). Employing cognitive tools within interactive multimedia applications. In: S. Lajoie. (ed). Computers as cognitive tools. Mahwah, NJ: Lawrence Erlbaum, p. 227-245.
HULSTIJN, J. H. (2006). Incidental and intentional learning. In: The handbook of second language acquisition.
Doughty, C. J. & Long, M. H. (eds.). Malden, Ma.: Blackwell Publishing Ltd, p. 349-381.
KRESS, G. & VAN LEEUWEN, T. (1996). Reading images. The grammar of visual design. London: Routledge.
_____. (2001). Multimodal discourse: The modes and media of contemporary communications. London: Edward Arnold.
LARSEN-FREEMAN, D. (2003). Teaching Language: From grammar to grammaring, Canada: ThomsonHeinle.
LEWIS, M. (ed.) (2000). Teaching collocation, further developments in the lexical approach. Hove: Language Teaching Publications.
MACIS, M. (2007). The effect of enhanced input through multimedia presentations on performance in the retention of collocations. Master´s thesis for the Program in Linguistics, Universidad de Santiago de Chile, Santiago.
MAYER, R. & ANDERSON, R. (1991). Animations need narrations: an experiment test of a dual-coding hypothesis. Journal of Educational Psychology. v. 83, n. 4, p. 484-490.
MAYER, R & MORENO, R. (1998). A split attention effect in multimedia learning: evidence for dual processing systems in working memory. Journal of Educational Psychology. v. 90, n. 2, p. 312-320.
MAYER, R. (2001). Multimedia learning. New York: Cambridge University Press.
_____. (2002). Cognitive theory and the design of multimedia instruction: an example of the two-way street between cognition and instruction. In: Halpern, D. & Hakel, M. (eds.). Applying the science of learning to university teaching and beyond. San Francisco, CA: Jossey-Bass, p. 55-71.
_____. (ed.) (2005). The Cambridge handbook of multimedia learning. New York: Cambridge University Press.
MCNEILL, D. (2005). Gesture and thought. Chicago: University of Chicago Press.
MIYAKE, A. & SHAH, P. (2004). (eds.) Models of working memory. Mechanics of active maintenance and executive control. New York, NY: CUP.
MITCHELL, R. & MYLES, F. (2004). Second language learning theories. New York: Hodder Arnold.
PAIVIO, A. (1971). Imagery and verbal processes. New York: Holt, Rinehart, and Winston. (Reprinted 1979, Hillsdale, NY: Lawrence Erlbaum Associates).
PENNYCOOK, A. (1994). The cultural politics of English as an international language. London: Longman.
PHILLIPSON, R. (1992). Linguistic imperialism. Oxford: OUP.
PLASS, J. (1998). Design and evaluation of the user interface of foreign language multimedia software: a cognitive approach. Language Learning & Technology. v. 2, n. 1, p. 40-53.
PLASS, J.; CHUN, D.; MAYER, R., & LEUTNER, D. (1998). Supporting visual and verbal learning preferences in a second language multimedia learning environment. Journal of Educational Psychology. v. 90, n .1, p. 25-36.
PLASS, J. & JONES, L. (2005). Multimedia learning in second language acquisition. In: Mayer, R. (ed.) The Cambridge handbook of multimedia learning. New York: CUP. p. 467-488.
PORQUIER, R. & VIVES, R. (1974). Sur quatre methods audiovisuelles. Langue Francaise. v. 24, p. 105-122.
ROBERTSON, T. (1899). El inglés al alcance de los niños y de los jóvenes en las escuelas y en la enseñanza particular. New York: D. Appleton &Co.
ROYCE, T. (2007). Multimodal communicative competence. In: Royce, T. and Bowcher, W. (eds.) New directions in the analysis of multimodal discourse. Mahwah: NJ: Lawrence Erlbaum Associates, p. 361- 390.
SADOSKI, M. & PAIVIO, A. (2001). Imagery and text. Mahwah, New Yersey: Lawrence Erlbaum Associates.
SADOSKI, M. & PAIVIO, A. (2004). A dual coding theoretical model of reading. In: Rudell, R. B. & Unrau, N. J. (eds.) Theoretical models and processes of reading. Newark, NJ: International Reading Association, p. 1329-1362.
SCHNOTZ, W. (2002). Towards and integrated view of learning from text and visual displays. Educational Psychology Review. v. 14, n. 1, p. 101-120.
_____. (2005). An integrated model of text and picture comprehension. In: R. Mayer, (ed.) The Cambridge handbook of multimedia learning. New York: CUP, p. 49-69.
SCHNOTZ, W., BANNERT, M., & SEUFERT, T. (2002). Toward and integrative view of text and picture comprehension: Visualization effects on the construction of mental models. In: Otero, J. A., León & Graesser, A. (eds.) The Psychology of science text comprehension . Mahwah, NJ: Lawrence Erlbaum, p. 385-416.
SCHNOTZ, W. & BAADTE, C. (2008). Domain learning versus language learning with multimedia. In: Farías and Obilinovic (eds.), Aprendizaje multimodal/Multimodal learning. Santiago de Chile: Publifahu USACH, p. 21-49.
SEGALOWITZ, N. (2006). Automaticity and Second Languages. In: Doughty, C. & Long, M., (eds.). The handbook of second language acquisition, Malden, Ma: Blackwell Publishing Ltd., p. 382-408.
TURKLE, S. H. (1995). Life on the screen: Identity in the age of the internet. New York: Simon & Schuster.
VILLEGAS, A. (1951). Little book for children. Santiago de Chile.
WALLACE, K. (2002). Local literacies and global literacy. In: Block, D. & Cameron, D. (eds.) Globalization and language teaching. London: Routledge, p. 101-114.
WARSCHAUER, M. (1996). Computer-assisted language learning: An introduction. In: Fotos, S. (ed.) Multimedia language teaching. Tokyo: Logos International, p. 3-20.
WOLF, M. (2008). Proust and the squid. The story and science of the reading brain. Cambridge, UK: Icon Books.
O periódico Trabalhos em Linguística Aplicada utiliza a licença do Creative Commons (CC), preservando assim, a integridade dos artigos em ambiente de acesso aberto, em que:
- A publicação se reserva o direito de efetuar, nos originais, alterações de ordem normativa, ortográfica e gramatical, com vistas a manter o padrão culto da língua, respeitando, porém, o estilo dos autores;
- Os originais não serão devolvidos aos autores;
- Os autores mantêm os direitos totais sobre seus trabalhos publicados na Trabalhos de Linguística Aplicada, ficando sua reimpressão total ou parcial, depósito ou republicação sujeita à indicação de primeira publicação na revista, por meio da licença CC-BY;
- Deve ser consignada a fonte de publicação original;
- As opiniões emitidas pelos autores dos artigos são de sua exclusiva responsabilidade.