Cloud Data Engineering Technologies
Data is displayed for academic year: 2023./2024.
Lecturers
Course Description
Students will learn the basic processes of data engineering projects, such as data entry, storage, transfer, transformation, cleaning, validation and transfer. Also source code management procedures, serverless programming environments and continuous code integration and delivery procedures which are essential on today’s cloud data engineering projects will be addressed. Through assignments students will gain practical skills in working with the GO programming language, Docker containers and the Kubernetes cluster, MongoDB NoSQL database, GIT Jankins and Terraform.
Study Programmes
University undergraduate
[FER3-HR] Computing - study
Skills
(3. semester)
(5. semester)
Skills
(3. semester)
(5. semester)
University graduate
[FER3-HR] Computing - study
Skills
(1. semester)
(3. semester)
[FER3-HR] Electrical Engineering and Information Technology - study
Skills
(1. semester)
(3. semester)
[FER3-HR] Information and Communication Technology - study
Skills
(1. semester)
(3. semester)
Forms of Teaching
Lectures
Lectures will be held in 8 cycles lasting 2 hours per week in laboratory classrooms at the faculty.
LaboratoryLaboratory exercises will be held in 8 cycles of 2 hours per week in the laboratory classrooms at the Faculty.
Grading Method
Continuous Assessment | Exam | |||||
---|---|---|---|---|---|---|
Type | Threshold | Percent of Grade | Threshold | Percent of Grade | ||
Laboratory Exercises | 50 % | 40 % | 50 % | 40 % | ||
Seminar/Project | 50 % | 40 % | 50 % | 40 % | ||
Attendance | 50 % | 20 % | 50 % | 20 % |
Week by Week Schedule
- What is a data platform, cloud platforms and building data pipelines
- Data sources, transfer of local data to the cloud, retrieval from relational databases, program interfaces and public sources, data ingestion
- Using Pub / sub agent for message forwarding and Auro message format, metadata and data origin
- Data consolidation and transformation, message schema control, schema catalog construction and how to solve the problem of message schema evolution
- Using software containers, managing the Kubernetes cluster, and using the MongoDB NoSQL database
- Development of programming interfaces in GO programming language (REST API, Swagger, oAuth authentication), serving through message forwarding agents, data democratization
- Code development applications aligned with the DevOps concept, using GIT, Jankins, Terraform, establishing development, test, presentation and production environments in the cloud
- Final project
- No classes
- No classes
- No classes
- No classes
- No classes
- No classes
- No classes
Literature
For students
General
ID 234065
Winter semester
3 ECTS
L0 English Level
L1 e-Learning
15 Lectures
0 Seminar
0 Exercises
15 Laboratory exercises
0 Project laboratory
Grading System
90 Excellent
80 Very Good
65 Good
50 Sufficient