Multimodal Messages
Study Course Implementer
Dzirciema street 16, Rīga, szf@rsu.lv
About Study Course
Objective
Preliminary Knowledge
Learning Outcomes
Knowledge
1.Students know main directions and their development contexts in theoretical understanding of multimodality, most prominent authors, works and insights expressed in them.
Skills
1.Students independently select and use semiotic resources to create communication messages, develop analysis models and practically analyse multimodal messages in different media environments.
Competences
1.To consider specifics of communication in multimodal environments of new media, students evaluate, analyse, characterise, consult and lead composing of messages in modern communication processes.
Assessment
Individual work
|
Title
|
% from total grade
|
Grade
|
|---|---|---|
|
1.
Individual work |
-
|
-
|
|
Reading of texts, preparation of a presentation, analysis of a multimodal message, composing and communication of a multimodal message.
|
||
Examination
|
Title
|
% from total grade
|
Grade
|
|---|---|---|
|
1.
Examination |
-
|
-
|
|
2.
Examination |
-
|
-
|
|
1) depth of answers and comments at seminar discussions – 10%;
2) quality of presentation (depth of theoretical understanding, analysis of facts, argumentation, style of expression (terminological clarity) – 45%;
3) examination (oral answers to two questions on all course substance) – 45%.
|
||
Study Course Theme Plan
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Concept of modality and its understanding in cognitive sciences, linguistics and semiotics.
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Theoretical bases of modal analysis of a message
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Verbal and visual communication – perception, understanding and memory.
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Interaction between communication modes in a message.
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Concept and diversity of multimodality in modern communication.
|
-
Class/Seminar
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Models of theoretical understanding and analysis of multimodality.
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Multimodal opportunities of expression (multimodality and modern education challenges).
|
-
Lecture
|
Modality
|
Location
|
Contact hours
|
|---|---|---|
|
On site
|
Auditorium
|
2
|
Topics
|
Multimodal rhetoric (multimodal metaphor).
|
Bibliography
Required Reading
Bezemer, J., & Kress, G. (2008). Writing in multimodal texts a social semiotic account of designs for learning. Written communication, 25(2), 166-195.
Duncum, P. (2004). Visual culture isn't just visual: Multiliteracy, multimodality and meaning. Studies in art education, 252-264.
Forceville, C. (2014). Relevance Theory as model for analysing visual andmultimodal communication. Visual Communication. Berlin: Mouton de Gruyter, 51-70.
Forceville, C., & Urios-Aparisi, E. (Eds.). (2009). Multimodal metaphor (Vol. 11).
Jewitt, C. (2013) Multimodal Methods for Researching Digital Technologies./ The SAGE Handbook of Digital Technology Research. (ed.by Price, S., Jewitt, C, Brown B.) – London: SAGE, pp.255-256
Kress, G. (2009). Multimodality: A social semiotic approach to contemporary communication. Routledge.
Kress, G.( 2009) What is mode? / The Routledge Handbook of Multimodal Analysis. (ed. by Jewitt, C.) – London, New Yok: Routledge, pp. 54
Kress, G., & Van Leeuwen, T. (2001). Multimodal discourse (Vol. 208). London: Arnold.
O‘Halloran, K. L., Tan, S., & MKL, E. (2014). A multimodal approach to discourse, context and culture. Discourse in Context, 247-272.
Bednarek, M. (2015). Corpus-assisted multimodal discourse analysis of television and film narratives. In Corpora and Discourse Studies (pp. 63-87). Palgrave Macmillan, London.
Additional Reading
Gibbs Jr, R. W. (2014). Embodied Metaphor. The Bloomsbury Companion to Cognitive Linguistics, 167.
O‘Halloran, K. L., Podlasov, A., Chua, A., & Marissa, K. L. E. (2012). Interactive software for multimodal analysis. Visual Communication, 11(3), 363-381.
Ravelli, L. J., McMurtrie, R. J. (2015) Multimodality in the Built Environment. Spatial Discourse Analysis. – Routledge
Schmitz, U. (2014). Semiotic economy, growth of mass media discourse, and change of written language through multimodal techniques. Mediatization and Sociolinguistic Change, 36, 279.