Fundamentals of information theory

Course title

Code

F18L2W067

Study programme

Internet, networks and security (4 years)

Organizer of the study programme (unit, institute, department)

Faculty of Computer Science and Engineering

Degree level (first, second, third cycle)

First cycle

Academic year / semester

3 / Winter

Number of ECTS credits

Teacher

—

Prerequisites for enrolling in the course

Калкулус

10.

Course objectives (competences)

Students will become familiar with the basics of probability theory, the basic terms of the of information theory and its application in real communication systems.

11.

Course content

(1) Elements of combinatorics. Probability of random events. Probability properties. (1) Discrete probability space. Classical definition of probability. Conditional probability. Bayes` theorem. (1) Independence of random events. Bernoulli`s scheme. (2) Discrete and continuous distributions. (1) Random vectors: marginal and conditional distributions. Functions of random variables (1) Numerical characteristics of random variables: mean, variance of random variable, correlation coefficient between two random variables. Central limit theorem. (2) Entropy and information. (3) Data compression: optimal codes, Huffman codes, Shanon-Fano-Elias coding, arithmetic coding. Communication channel.

12.

Learning methods

Lectures using presentations, interactive lectures, exercises (using equipment and software packages), teamwork, case studies, guest lectures, independent preparation and defense of a project assignment and a seminar paper.

13.

Total available time

6 ECTS x 30 hours = 180 hours

14.

Distribution of the available time

30 + 45 + 15 + 15 + 75 = 180 hours

15.

Forms of teaching activities

15.1.	Lectures – theoretical teaching	30 hours
15.2.	Exercises (laboratory, auditory), seminars, team work	45 hours

16.

Other forms of activities

16.1.	Project assignments	15 hours
16.2.	Individual assignments	15 hours
16.3.	Home study	75 hours

17.

Grading

17.1.	Tests	0 points
17.2.	Seminar paper / project (presentation: written and oral)	15 points
17.3.	Activity and participation	10 points
17.4.	Final exam	90 points

18.

Grading criteria (points / grade)

up to 50 points	5 (five) (F)
from 51 to 60 points	6 (six) (E)
from 61 to 70 points	7 (seven) (D)
from 71 to 80 points	8 (eight) (C)
from 81 to 90 points	9 (nine) (B)
from 91 to 100 points	10 (ten) (A)

19.

Requirements for signature and taking the final exam

Activities carried out

20.

Language of instruction

Macedonian and English

21.

Method of monitoring teaching quality

internal evaluation and survey mechanism

22.

Literature

22.1.	Required literature No. Author Title Publisher Year
22.2.	Additional literature No. Author Title Publisher Year