Cloud Data Engineering Technologies
Data is displayed for the academic year: 2024./2025.
Lecturers
Course Description
Students will learn the basic processes of data engineering projects, such as data entry, storage, transfer, transformation, cleaning, validation and transfer. Also source code management procedures, serverless programming environments and continuous code integration and delivery procedures which are essential on today’s cloud data engineering projects will be addressed. Through assignments students will gain practical skills in working with the GO programming language, Docker containers and the Kubernetes cluster, MongoDB NoSQL database, GIT Jankins and Terraform.
Prerequisites
Knowledge of basic programming and algorithms and data structures.
Construction of a web computer application that includes a client and a server part.
Study Programmes
University undergraduate
[FER3-HR] Computing - study
Skills
(3. semester)
(5. semester)
Skills
(3. semester)
(5. semester)
University graduate
[FER3-HR] Computing - study
Skills
(1. semester)
(3. semester)
[FER3-HR] Electrical Engineering and Information Technology - study
Skills
(1. semester)
(3. semester)
[FER3-HR] Information and Communication Technology - study
Skills
(1. semester)
(3. semester)
Learning Outcomes
- Explain the application of cloud data engineering technologies
- Apply the basic principles of cloud data engineering technologies
- Design, implement and test simpler cloud services and discover errors
- Use program code continuous integration and continuous delivery procedures
- Use containerization systems in cloud environment
Forms of Teaching
Lectures
Lectures will be held in 8 cycles lasting 2 hours per week in laboratory classrooms at the faculty.
LaboratoryLaboratory exercises will be held in 8 cycles of 2 hours per week in the laboratory classrooms at the Faculty.
Grading Method
Continuous Assessment | Exam | |||||
---|---|---|---|---|---|---|
Type | Threshold | Percent of Grade | Threshold | Percent of Grade | ||
Laboratory Exercises | 50 % | 40 % | 50 % | 40 % | ||
Seminar/Project | 50 % | 40 % | 50 % | 40 % | ||
Attendance | 50 % | 20 % | 50 % | 20 % |
Week by Week Schedule
- What is a data platform, cloud platforms and building data pipelines
- Data sources, transfer of local data to the cloud, retrieval from relational databases, program interfaces and public sources, data ingestion
- Using Pub / sub agent for message forwarding and Auro message format, metadata and data origin
- Data consolidation and transformation, message schema control, schema catalog construction and how to solve the problem of message schema evolution
- Using software containers, managing the Kubernetes cluster, and using the MongoDB NoSQL database
- Development of programming interfaces in GO programming language (REST API, Swagger, oAuth authentication), serving through message forwarding agents, data democratization
- Code development applications aligned with the DevOps concept, using GIT, Jankins, Terraform, establishing development, test, presentation and production environments in the cloud
- Final project
- No classes
- No classes
- No classes
- No classes
- No classes
- No classes
- No classes
Literature
General
ID 234065
Winter semester
3 ECTS
L0 English Level
L1 e-Learning
15 Lectures
0 Seminar
0 Exercises
15 Laboratory exercises
0 Project laboratory
0 Physical education excercises
Grading System
90 Excellent
80 Very Good
65 Good
50 Sufficient