Management of Big Spatial and Spatio-Temporal Data

Course Description

Introduction. Systems and programming description management. Lambda and Kappa architectures for big data. Basic principles and features of big spatial and spatio-temporal data. Modelling of spatial and spatio-temporal data. Specification of relevant operations on spatial and spatio-temporal data. Indexing. Global and local indexes. Static and dynamic indexes. Geohashes. Spatio-temporal data streams. SQL-based analysis of spatio-temporal data streams within integrated big data platforms. Implementation of data types and operations in object-functional programming language and distributed dataflow platforms. Implementation based on API of integrated platform for distributed batch and data stream processing. Development of user-defined functions. Specification of spatial and spatio-temporal queries in SQL-like query languages. Data mining of big spatio-temporal data.

Learning Outcomes

  1. Identify fundamental features of spatial and spatio-temporal big data
  2. Identify fundamental features of spatioto-temporal data streams
  3. Design and implement spatial and spatio-temporal data types in object-functional programming language and distributed data flow platforms
  4. Develop simple algorithms for big spatio-temporal data management
  5. Develop simple algorithms for spatio-temporal data streams management
  6. Develop spatial and spatio-temporal queries using SQL-like expressions
  7. Develop simple algorithms for spatio-temporal data mining and knowledge discovery.
  8. Choose big data management technologies in spatio-temporal application domain

Forms of Teaching

Lectures

Independent assignments

Week by Week Schedule

  1. Basic concepts of big spatial data
  2. Basic concepts of big spatio-temporal data
  3. Programming frameworks for big data
  4. Programming frameworks for big data
  5. Lambda and Kappa architectures
  6. Optimisation and indexing
  7. Spatial and spatio-temporal SQL and SQL-like expressions
  8. Midterm exam
  9. Spatial and spatio-temporal SQL and SQL-like expressions
  10. Parallel and distributed spatial and spatio-temporal engines
  11. Parallel and distributed spatial and spatio-temporal engines
  12. Spatial and spatio-temporal data processing pipelines
  13. Spatial and spatio-temporal data processing pipelines
  14. Project
  15. Final exam

Study Programmes

University graduate
Audio Technologies and Electroacoustics (profile)
Free Elective Courses (2. semester)
Communication and Space Technologies (profile)
Free Elective Courses (2. semester)
Computational Modelling in Engineering (profile)
Free Elective Courses (2. semester)
Computer Engineering (profile)
Free Elective Courses (2. semester)
Computer Science (profile)
Free Elective Courses (2. semester)
Control Systems and Robotics (profile)
Free Elective Courses (2. semester)
Data Science (profile)
Free Elective Courses (2. semester)
Electrical Power Engineering (profile)
Free Elective Courses (2. semester)
Electric Machines, Drives and Automation (profile)
Free Elective Courses (2. semester)
Electronic and Computer Engineering (profile)
Free Elective Courses (2. semester)
Electronics (profile)
Free Elective Courses (2. semester)
Information and Communication Engineering (profile)
Free Elective Courses (2. semester)
Network Science (profile)
Free Elective Courses (2. semester)
Software Engineering and Information Systems (profile)
Elective Course of the profile (2. semester)

Literature

(.), Zdravko Galic (2016.), Spatio-Temporal Data Streams, Springer,
(.), Nikos Pelekis, Yannis Theodoridis (2014.), Mobility Data Management and Exploration, Springer,
(.), Nathan Marz, James Warren (2015.), Big Data: Principles and Best Practices of Scalable Realtime Data Systems, Manning Publications Company,
(.), Fabian Hueske, Vasiliki Kalavri (2018.), Stream Processing with Apache Flink: Fundamentals, Implementation, and Operation of Streaming Applications, O'Reilly Media,
(.), Sandy Ryza, Uri Laserson, Sean Owen, Josh Wills (2015.), Advanced Analytics with Spark, "O'Reilly Media,,
(.), Edward Capriolo, Dean Wampler, Jason Rutherglen (2012.), Programming Hive, "O'Reilly Media, Inc.",

Associate Lecturers

For students

General

ID 223719
  Summer semester
5 ECTS
L3 English Level
L1 e-Learning
30 Lectures
15 Laboratory exercises