NEWS & EVENTS

Introduction to Multimodality

Time: 09:30---11:00, 27 June 2018
Venue: #218, School of Foreign Languages
Speaker: Professor Kay O'Halloran

Abstract: Multimodality is concerned with the study of language in interaction with other resources such as images, sound, movement, gesture, three-dimensional objects and space in texts, interactions and events. Interest in multimodal research is rapidly increasing because it addresses key issues in the digital age where communication involves linguistic, visual and other resources (e.g. websites, social media and so forth).  In this talk, I give an overview of the field of multimodality, including key theoretical and analytical approaches, and research questions which are currently being addressed. I also discuss current problems in multimodal analysis and future directions for research.

References:

Bateman, J. (2014). Text and Image: A Critical Introduction to the Visual/Verbal Divide. London & New York: Rouledge.

Halliday, M. A. K. (1978). Language as Social Semiotic: The Social Interpretation of Language and Meaning. London: Edward Arnold.

Jewitt, C., Bezemer, J., & O'Halloran, K. L. (2016). Introducing Multimodality. London & New York: Routledge.

Kress, G., & van Leeuwen, T. (2006). Reading Images: The Grammar of Visual Design (2nd ed.). London: Routledge.

O'Halloran, K. L. (2011). Multimodal Discourse Analysis. In K. Hyland & B. Paltridge (Eds.), Companion to Discourse Analysis (pp. 120-137). London: Continuum.

O'Toole, M. (2011). The Language of Displayed Art (2nd ed.). London & New York: Routledge.

van Leeuwen, T. (2005). Introducing Social Semiotics. London: Routledge.

Bio: Professor Kay O’Halloran

Kay O'Halloran is Professor in the School of Education at Curtin University in Western Australia. Previously she was a member of the Department of English Language & Literature (1998-2013) and founding Director of the Multimodal Analysis Lab (2007-2013) at the National University of Singapore. Her main area of research is multimodal analysis, with a focus on digital and mixed methods approaches to multimodal texts, mathematics discourse, and multimodal literacy. She has established and led large interdisciplinary research projects aimed at developing interactive digital technologies and visualisation techniques for analysing small and large multimodal datasets. She is currently research leader of the Multimodal Analysis Group at Curtin University and Visiting Distinguished Professor in the School of Foreign Languages at Shanghai Jiao Tong University.

Kay O’Halloran: 

http://oasisapps.curtin.edu.au/staff/profile/view/Kay.Ohalloran

Multimodal Analysis Group, Curtin University: http://computation.curtin.edu.au/multimodal-analysis-group/

Email: kay.ohalloran@curtin.edu.au