Keywords
Multimodality
Multimodal analysis
Instantiation
Realization
Canvas
How to Cite
Abstract
Drawing on Systemic Functional Theory and the decompositional model proposed by Bateman, Wildfeuer and Hiippala (2017), this paper outlines notions and procedures we consider fundamental for the analysis of multimodal texts, particularly digital ones, by providing a theoretical and methodological model that enables a greater commitment to a clear and replicable organization of the analytical procedure. We introduce the fundamental systemic functional concepts of realization and instantiation and their implications for the study of multimodality; next, we present the notion of ‘canvas’ and the multidimensional classification of semiotic materialities; then, we make explicit the basic steps for the substantiation of the analysis of multimodal texts; and, finally, we exemplify the model with a cursory analysis of the canvas composition of Facebook posts.
References
BATEMAN, J. A. (2008). Multimodality and Genre: A Foundation for the Systematic Analysis of Multimodal Documents. New York: Palgrave.
BATEMAN, J. A.; WILDFEUER, J.; HIIPPALA, T. (2017). Multimodality – Foundations, Research and Analysis: A Problem-Oriented Introduction. Berlim: de Gruyter.
BENVENISTE, E. (1974). Problemas de linguística geral II. 2a ed. Campinas: Pontes, 2006.
COPE, B.; KALANTZIS, M. (2009). “Multiliteracies”: New literacies, new learning. Pedagogies: An international journal, v. 4, n. 3, p. 164-195.
EKMAN, P.; FRIESEN, W. V.; ELLSWORTH, P. (1982). What emotion categories or dimensions can observers judge from facial behavior? In: EKMAN, P. (ed.) Emotion in the human face. Nova York: Cambridge University Press, p. 39-55.
FARHAT, T. C.; GONÇALVES-SEGUNDO, P. R. “Manas, preciso de ajuda”: análise de pedidos de ajuda multimodais de um grupo de Facebook. Texto Livre: Linguagem e Tecnologia, v. 14, n. 1, p. 1-19, 2021a.
FARHAT, T. C.; GONÇALVES-SEGUNDO, P. R. Identidades em comunhão: estratégias multimodais de individuação em um grupo de Facebook. Texto Digital, v. 17, n. 2, p. 35-71, 2021b.
FENG, D.; O’HALLORAN, K. L. (2012). Representing emotive meaning in visual images: A social semiotic approach. Journal of Pragmatics, v. 44, n. 14, p. 2067-2084.
FORCEVILLE, C. (2020). Visual and Multimodal Communication: Applying the Relevance Principle. New York: Oxford University Press.
GUALBERTO, C. L.; SANTOS, Z. B. (2019). Multimodalidade no contexto brasileiro: um estado de arte. DELTA: Documentação de Estudos em Linguística Teórica e Aplicada, v. 35, p. 1-30.
HALLIDAY, M. A. K.; MATTHIESSEN, C. M. I. M. (2014). Introduction to Functional Grammar. 4a ed. New York/London: Routledge.
JEWITT, C.; BEZEMER, J.; O’HALLORAN, K. (2016). Introducing multimodality. London: Routledge.
KRESS, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Oxon: Routledge.
KRESS, G.; VAN LEEUWEN, T. (1996). Reading Images: The Grammar of Visual Design. 2a ed. London/New York: Routledge, 2006.
MARTIN, J. R. (1992). English Text: system and structure. Amsterdam: John Benjamins.
MATTHIESSEN, C. M. I. M. (2009). Multisemiosis and context-based register typology. In: VENTOLA, E.; GUIJARRO, A. J. M. (org.). The World Told and the World Shown: Multisemiotic Issues. London: Palgrave Macmillan, p. 11-38.
NORRIS, S.; MAIER, C. D. (org.). (2014). Interactions, Images and Texts: A Reader in Multimodality. Berlim: de Gruyter.
O’TOOLE, M. (1994). The Language of Displayed Art. London: Leicester University Press.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2022 Trabalhos em Linguística Aplicada
Downloads
