Foundations of Information Theory

1.

Subject title

Foundations of Information Theory

Основи на теоријата на информации

2.

Code

F23L2W067

3.

Study program

Примена на информациски технологии, Софтверско инженерство и информациски системи, Компјутерски науки, Компјутерско инженерство, Информатичка едукација, Software engineering and information systems, Интернет, мрежи и безбедност, Примена на информациски технологии, Софтверско инженерство и информациски системи, Компјутерски науки, Компјутерско инженерство, Software engineering and information systems, Интернет, мрежи и безбедност, Стручни студии за програмирање, Стручни студии за програмирање,

4.

Organizer of the study program (unit, institute, department, division)

Faculty of Information Sciences and Computer Engineering

5.

Study cycle (first, second, third)

Прв циклус

6.

Academic year / semester

2 / Зимски

7. Number of ECTS credits

6.0

8.

Instructor

проф. д-р Александра Поповска Митровиќ проф. д-р Верица Бакева

9.

Prerequisites for enrollment

Калкулус 1 или Математика 1

10.

Subject goals and competencies:

Students will be introduced to the basics of probability theory, and then the basic concepts of information theory and its application in real communication systems.

11.

Subject content:

(1) Elements of combinatorics. Probability of random events. Properties of probabilities. (1) Discrete probability space. Classic definition. Conditional probability. Bayes rule. (1) Independence of random events. Bernoulli scheme. (2) Discrete and continuous distributions. (1) Random vectors: marginal and conditional distributions. Functions of random variables. (1) Numerous characteristics of random variables: mathematical expectation, dispersion of a random variable, correlation coefficient between two random variables. Central Limit Theorem. (2) Entropy and information (3) Data compression: optimal codes with prefix property. Huffman`s algorithm. Shannon-Fano-Elias algorithm. Arithmetic codes. (1) Communication channel.

12.

Learning methods:

Предавања со користење на презентации, интерактивни предавања, вежби (користење на опрема и софтверски пакети), тимска работа, пример случаи, поканети гости предавачи, самостојна изработка и одбрана на проектна задача и семинарска работа.

13.

Total available time fund

6.0 ECTS x 30 hours = 180 hours

14.

Time distribution

30 + 45 + 15 + 15 + 75 = 180 hours

15.

Forms of teaching activities

15.1.

Lectures - theoretical teaching

30 hours

15.2.

Exercises (laboratory, classroom), seminars, team work

45 hours

16.

Other forms of activities

16.1.

Project tasks

15 hours

16.2.

Independent tasks

15 hours

16.3.

Homework

75 hours

17.

Grading method

17.1.

Tests

0 points

17.2.

Seminar work / project (presentation: written and oral)

15 points

17.3.

Activities and learning

10 points

17.4.

Final exam

90 points

18.

Grading criteria (points / grade)

up to 50 points

5 (five) (F)

from 51 to 60 points

6 (six) (E)

from 61 to 70 points

7 (seven) (D)

from 71 to 80 points

8 (eight) (C)

from 81 to 90 points

9 (nine) (B)

from 91 to 100 points

10 (ten) (A)

19.

Condition for signature and taking final exam

Реализирани активности

20.

Language of instruction

Македонски и англиски

21.

Quality assurance method

механизам на интерна евалуација и анкети

22.

Literature

22.1.

Mandatory literature

22.2.

Additional literature