Subject

Multimodal interaction

1.Course titleMultimodal interaction
2.Codem23_s_023
3.Study programme—
4.Organizer of the study programme (unit, institute, department)Faculty of Computer Science and Engineering
5.Degree level (first, second, third cycle)Second cycle
6.Academic year / semester10 / Summer
7.Number of ECTS credits6
8.Teacher
9.Prerequisites for enrolling in the course—
10.Course objectives (competences)People use different senses and systems for mutual communication, simultaneous (face -to -face conversation) or alternatively (using speech, writing, gestures, touch). Traditionally communicating with computers was carried out through the keyboard and mouse and the computer was most often suited with visual stimuli in the form of text or images. The purpose of the course is to introduce students in new ways of interacting with computer systems that allow for better experience or efficiency of interaction with them (sound control, sound interaction, gesture recognition, touch screens, tatal interfaces, upgraded reality).
11.Course contentDesign of multimodal interaction. Design, modeling and analyzing multimodal input devices that include: Recognizing speech, recognizing and tracking traits and expressions of the human face, gesture recognition, touch -free interceptions, passage phones sensors and smart environments. Multimodal output devices that include: speech synthesis, sound object intercalists, tactile interfaces. Upgraded reality. Automatic analysis of multimodal behavior.
12.Learning methodsLectures supported by slide presentations, interactive lectures, practical classes (using equipment and software packages), teamwork, case studies, guest lecturers, independent preparation and defence of a project assignment and seminar paper, and learning in an electronic environment (forums and consultations).
13.Total available time6 ECTS x 30 hours = 180 hours
14.Distribution of the available time60 + 0 + 45 + 45 + 30 = 180 hours
15.Forms of teaching activities
15.1.Lectures – theoretical teaching60 hours
15.2.Exercises (laboratory, auditory), seminars, team work0 hours
16.Other forms of activities
16.1.Project assignments45 hours
16.2.Individual assignments45 hours
16.3.Home study30 hours
17.Grading
17.1.Tests15 points
17.2.Seminar paper / project (presentation: written and oral)45 points
17.3.Activity and participation15 points
17.4.Final exam0 points
18.Grading criteria (points / grade)
up to 50 points5 (five) (F)
from 51 to 60 points6 (six) (E)
from 61 to 70 points7 (seven) (D)
from 71 to 80 points8 (eight) (C)
from 81 to 90 points9 (nine) (B)
from 91 to 100 points10 (ten) (A)
19.Requirements for signature and taking the final examcompleted activities
20.Language of instructionMacedonian and English
21.Method of monitoring teaching qualityinternal evaluation and survey mechanism
22.Literature
22.1.Required literature
1. Irena Croning & Robert Scoble | The Infinite Retina | Packt | 2020
2. Jason Jerald | The VR Book | ACM Books | 2016
3. Helen Papagiannis | Augmented Human | O`Reilly | 2017
4. Cornel Hilman | UX for XR User Experience Design and Strategies for Immersive Technologies Hillmann, Cornel. UX for XR (Design Thinking) | apress | 2021
22.2.Additional literature
No. Author Title Publisher Year