Veidlapa Nr. M-3 (8)
Study Course Description

Multimodal Messages

Main Study Course Information

Course Code
KF_018
Branch of Science
Library Science; Media and communications
ECTS
3.00
Target Audience
Communication Science
LQF
Level 8
Study Type And Form
Full-Time

Study Course Implementer

Course Supervisor
Structure Unit Manager
Structural Unit
Faculty of Social Sciences
Contacts

Dzirciema street 16, Rīga, szf@rsu.lv

About Study Course

Objective

To create profound theoretical understanding of modality and multimodality in perception and composing of communication messages, to provide knowledge on diversity and specifics of types of multimodal communication, in particular in the context of media culture, as well as to conceptually develop skills to compose, evaluate and analyse multimodal messages.

Preliminary Knowledge

Theoretical aspects of communication, analysis of messages.

Learning Outcomes

Knowledge

1.Students know main directions and their development contexts in theoretical understanding of multimodality, most prominent authors, works and insights expressed in them.

Skills

1.Students independently select and use semiotic resources to create communication messages, develop analysis models and practically analyse multimodal messages in different media environments.

Competences

1.To consider specifics of communication in multimodal environments of new media, students evaluate, analyse, characterise, consult and lead composing of messages in modern communication processes.

Assessment

Individual work

Title
% from total grade
Grade
1.

Individual work

-
-
Reading of texts, preparation of a presentation, analysis of a multimodal message, composing and communication of a multimodal message.

Examination

Title
% from total grade
Grade
1.

Examination

-
-
2.

Examination

-
-
1) depth of answers and comments at seminar discussions – 10%; 2) quality of presentation (depth of theoretical understanding, analysis of facts, argumentation, style of expression (terminological clarity) – 45%; 3) examination (oral answers to two questions on all course substance) – 45%.

Study Course Theme Plan

FULL-TIME
Part 1
  1. Lecture

Modality
Location
Contact hours
On site
Auditorium
2

Topics

Concept of modality and its understanding in cognitive sciences, linguistics and semiotics.
  1. Lecture

Modality
Location
Contact hours
On site
Auditorium
2

Topics

Theoretical bases of modal analysis of a message
  1. Class/Seminar

Modality
Location
Contact hours
On site
Auditorium
2

Topics

Verbal and visual communication – perception, understanding and memory.
  1. Lecture

Modality
Location
Contact hours
On site
Auditorium
2

Topics

Interaction between communication modes in a message.
  1. Lecture

Modality
Location
Contact hours
On site
Auditorium
2

Topics

Concept and diversity of multimodality in modern communication.
  1. Class/Seminar

Modality
Location
Contact hours
On site
Auditorium
2

Topics

Models of theoretical understanding and analysis of multimodality.
  1. Lecture

Modality
Location
Contact hours
On site
Auditorium
2

Topics

Multimodal opportunities of expression (multimodality and modern education challenges).
  1. Lecture

Modality
Location
Contact hours
On site
Auditorium
2

Topics

Multimodal rhetoric (multimodal metaphor).
Total ECTS (Creditpoints):
3.00
Contact hours:
16 Academic Hours
Final Examination:
Exam (Oral)

Bibliography

Required Reading

1.

Bezemer, J., & Kress, G. (2008). Writing in multimodal texts a social semiotic account of designs for learning. Written communication, 25(2), 166-195.

2.

Duncum, P. (2004). Visual culture isn't just visual: Multiliteracy, multimodality and meaning. Studies in art education, 252-264.

3.

Forceville, C. (2014). Relevance Theory as model for analysing visual andmultimodal communication. Visual Communication. Berlin: Mouton de Gruyter, 51-70.

4.

Forceville, C., & Urios-Aparisi, E. (Eds.). (2009). Multimodal metaphor (Vol. 11).

5.

Jewitt, C. (2013) Multimodal Methods for Researching Digital Technologies./ The SAGE Handbook of Digital Technology Research. (ed.by Price, S., Jewitt, C, Brown B.) – London: SAGE, pp.255-256

6.

Kress, G. (2009). Multimodality: A social semiotic approach to contemporary communication. Routledge.

7.

Kress, G.( 2009) What is mode? / The Routledge Handbook of Multimodal Analysis. (ed. by Jewitt, C.) – London, New Yok: Routledge, pp. 54

8.

Kress, G., & Van Leeuwen, T. (2001). Multimodal discourse (Vol. 208). London: Arnold.

9.

O‘Halloran, K. L., Tan, S., & MKL, E. (2014). A multimodal approach to discourse, context and culture. Discourse in Context, 247-272.

10.

Bednarek, M. (2015). Corpus-assisted multimodal discourse analysis of television and film narratives. In Corpora and Discourse Studies (pp. 63-87). Palgrave Macmillan, London.

Additional Reading

1.

Gibbs Jr, R. W. (2014). Embodied Metaphor. The Bloomsbury Companion to Cognitive Linguistics, 167.

2.

O‘Halloran, K. L., Podlasov, A., Chua, A., & Marissa, K. L. E. (2012). Interactive software for multimodal analysis. Visual Communication, 11(3), 363-381.

3.

Ravelli, L. J., McMurtrie, R. J. (2015) Multimodality in the Built Environment. Spatial Discourse Analysis. – Routledge

4.

Schmitz, U. (2014). Semiotic economy, growth of mass media discourse, and change of written language through multimodal techniques. Mediatization and Sociolinguistic Change, 36, 279.