Empirical Approaches to Multimodality (LOG) F-K.157
Laboratorium (LB) Semestr letni 2024/2025

1. Bateman, J., Wildfeuer, J. & Hippala, T, (2017). Multimodality. Berlin/Boston: Walter de Gruyter.

2. Gazzaniga, M., Ivry, R., & Mangun, G. (2018). Cognitive Neuroscience. W.W. Norton & Co.

3. Gibson, J.J. (1979). The Ecological Approach to Visual Perception. Boston: Houghton Mifflin.

4. Hull, J. (1997). On sight and insight: a journey into the world of blindness. Oxford: Oneworld Publications.

5. Kappas, A., Olk, B. (2008). The concept of visual competence as seen from the perspective of the psychological and brain sciences. Visual studies 23(2): 162-173.

6. Mitchell, W. (2005), There are no visual media, Journal of Visual Culture, 4(2), 257–266.

7. Merleau-Ponty, M. (1962). Phenomenology of Perception. London: Routledge&Kegan Paul.

8. Mondada, L. (2016). Challenges of multimodality: Language and body in social interaction. Journal of Sociolinguistics, 20(3), 336-366.

9. Noe, A. (2004). Action in Perception. Cambridge, MA: The MIT Press.

10. Paivio, A (1986). Mental representations: a dual coding approach. Oxford. England: Oxford University Press.

11. Wright, D. (1990). Deafness: a personal account, new edition. London: Faber and Faber.

12. Zlatev, J., Wacewicz, S., Żywiczyński, P., & Van de Weijer, J. (2017). Multimodal-first or pantomime-first? Communicating events through pantomime with and without vocalization. Interaction Studies 18:3, 465–488.

ocena ciągła (aktywność i zadania)

ocena projektu ze względu na przedstawione wcześniej kryteria

1. What is multimodality?

2. Multimodality studies & Cognitive Science

3. Overview of methods

4. How to design an empirical study?

5. Multimodal navigator: canvas

6. Quantitative methods: statistics

7. Quantitative methods: questionnaires

8. Qualitative methods: an IPA interview

9. Tools: ELAN (annotation system)

10. Tools: how to collect data?

11. Project presentation

dyskusja

analiza przypadków

praca w laboratorium