Natural language understanding and generation

1.

Subject title

Natural language understanding and generation

Обработка на природните јазици

2.

Code

F23L3W142

3.

Study program

Примена на информациски технологии, Софтверско инженерство и информациски системи, Компјутерски науки, Компјутерско инженерство, Интернет, мрежи и безбедност, Software engineering and information systems, Примена на информациски технологии, Софтверско инженерство и информациски системи, Компјутерски науки, Компјутерско инженерство, Интернет, мрежи и безбедност, Информатичка едукација, Software engineering and information systems, Стручни студии за програмирање, Стручни студии за програмирање,

4.

Organizer of the study program (unit, institute, department, division)

Faculty of Information Sciences and Computer Engineering

5.

Study cycle (first, second, third)

Прв циклус

6.

Academic year / semester

3 / Зимски

7. Number of ECTS credits

6.0

8.

Instructor

проф. д-р Ивица Димитровски проф. д-р Соња Гиевска

9.

Prerequisites for enrollment

Алгоритми и податочни структури или Примена на алгоритми и податочни структури

10.

Subject goals and competencies:

The aim of the course is for students to acquire basic theoretical and practical knowledge about natural language processing algorithms. Students will gain knowledge of the latest machine learning techniques with a focus on deep neural networks for text understanding and generation.

11.

Subject content:

1. Introduction. Basic natural language processing. 2. Vector representation of words 3. Modeling natural languages with deep neural networks 4. Overview of deep neural architectures. Knowledge extraction from textual data 5. Machine translation 6. Text generation 7. Transfer of learning. Pre-trained models 8. Systems for answering questions and summarizing text 9. Enriched representation and enriched models of natural languages (integration of knowledge bases, knowledge graph) 10. Reviewing the models from the aspect of ethical and moral norms 11. Dialogue management systems 12. Review and analysis of models for understanding and generating text (interpretation of what has been learned)

12.

Learning methods:

Предавања поддржани со презентации преку слајдови, интерактивни предавања, вежби (користење на опрема и софтверски пакети), тимска работа, пример случаи, поканети гости предавачи, самостојна изработка и одбрана на проектна задача и семинарска работа, учење во електронско опкружување (форуми, консултации).

13.

Total available time fund

6.0 ECTS x 30 hours = 180 hours

14.

Time distribution

30 + 45 + 15 + 15 + 75 = 180 hours

15.

Forms of teaching activities

15.1.

Lectures - theoretical teaching

30 hours

15.2.

Exercises (laboratory, classroom), seminars, team work

45 hours

16.

Other forms of activities

16.1.

Project tasks

15 hours

16.2.

Independent tasks

15 hours

16.3.

Homework

75 hours

17.

Grading method

17.1.

Tests

10 points

17.2.

Seminar work / project (presentation: written and oral)

15 points

17.3.

Activities and learning

10 points

17.4.

Final exam

70 points

18.

Grading criteria (points / grade)

up to 50 points

5 (five) (F)

from 51 to 60 points

6 (six) (E)

from 61 to 70 points

7 (seven) (D)

from 71 to 80 points

8 (eight) (C)

from 81 to 90 points

9 (nine) (B)

from 91 to 100 points

10 (ten) (A)

19.

Condition for signature and taking final exam

реализирани активности 15.1 и 15.2

20.

Language of instruction

македонски и англиски

21.

Quality assurance method

механизам на интерна евалуација и анкети

22.

Literature

22.1.

Mandatory literature

22.2.

Additional literature