Subject
Big Data Concepts and Applications
| 1. | Course Title |
Big Data Concepts and Applications Concepts and applications of big data |
||||||||||||
| 2. | Code | m23_w_039 | ||||||||||||
| 3. | Study Programme | — | ||||||||||||
| 4. | Organizer of the study programme (unit, institute, department or division) | Faculty of Computer Science and Engineering | ||||||||||||
| 5. | Degree level (first, second, third cycle) | Second cycle | ||||||||||||
| 6. | Academic year / semester | 9 / Winter | ||||||||||||
| 7. | Number of ECTS credits | 6 | ||||||||||||
| 8. | Teacher | Eftim Zdravevski, Goran Velinov | ||||||||||||
| 9. | Prerequisites for enrolling in the course | — | ||||||||||||
| 10. | Objectives of the course programme (competences) | The goal of the course is for students to become familiar with the phenomenon of big data—the reasons for its emergence and the ways it is generated—as well as the theoretical and practical concepts for modeling and analyzing data with large volume, velocity, and variety. An introduction to traditional data analysis systems and the challenges associated with big data will be provided. Typical problems, applications, and systems related to big data will be reviewed. From a theoretical and practical perspective, the ecosystem built around the Hadoop framework will be studied—its purpose, concepts, and the architecture of its elements, as well as the core components of the ecosystem. | ||||||||||||
| 11. | Course content | Generation of big data. Real-world examples of the three types of big data sources: people, organizations, and sensors. Recognition and description of big data characteristics: volume, velocity, variability, variety, value, visualization, and validity. Their impact on data collection, monitoring, storage, analysis, and report generation. Procedure for obtaining value from big data through a structured analysis process. Challenges and mistakes in collecting and analyzing big data. Description of the architectural components of systems used for scalable analysis of large data. Data-driven decision-making strategies. Horizontal and vertical partitioning of data. Challenges with dimensional modeling. Modules of the Hadoop framework: Common, YARN, HDFS, MapReduce. Core components of the Hadoop ecosystem: HBase, Spark, Hive, Pig. Tools for visualizing large data. |
||||||||||||
| 12. | Learning methods | Lectures supported by slide presentations, interactive lectures, practical exercises (using equipment and software packages), teamwork, case studies, invited guest lecturers, independent preparation and defence of a project assignment and seminar paper, and learning in an electronic environment (forums and consultations). | ||||||||||||
| 13. | Total available time | 6 ECTS x 30 hours = 180 hours | ||||||||||||
| 14. | Distribution of available time | 30 + 30 + 30 + 45 + 45 = 180 hours | ||||||||||||
| 15. | Forms of teaching activities |
|
||||||||||||
| 16. | Other forms of activities |
|
||||||||||||
| 17. | Assessment method |
|
||||||||||||
| 18. | Grading criteria (points / grade) |
|
||||||||||||
| 19. | Requirement for obtaining a signature and taking the final exam | completed activities 15.1 and 15.2 | ||||||||||||
| 20. | Language of instruction | Macedonian and English | ||||||||||||
| 21. | Method for monitoring the quality of teaching | internal evaluation and survey mechanism | ||||||||||||
| 22. | Literature |
|