Popis predmeta

Course Description

Fundamentals and definitions of machine learning. State and action probabilities, and standard patterns of machine learning behaviour. Mathematical models of neuron and neural networks, diversity and properties of learning alorithms. Claster analisys, knowledge representation, compression and representation from uncomplete data. Basics of associative memories. Recursive networks and processing of time dependent patterns. Learning algorithms: Back-propagation with extensions, Kohonen and Cascade correlation algorithm, Convolutional networks, Deep learning, WTA (Winner-Takes-All). Feature extraction by competitive learning - interactive or on-line learning, Sarsa and Q-learning algorithm, Markov models. Intelligent agents and selfadaptive control of communication services.

Learning Outcomes

  1. to define concept, methods and architectures typical for machine learnings
  2. to explain how machine learning operate and basic purpose
  3. to apply knowledge about machine learning to communication services
  4. to analyze functions of machine learned components, as well as their interactions in order to find appropriate solution
  5. to analyze organization and results produced by machine learning modela
  6. to create machine learned models including various types of recognition and self-adaptation
  7. to evaluate and assess solutions based on different methods of machine learning

Forms of Teaching

Lectures

Independent assignments

Laboratory

Week by Week Schedule

  1. Perceptron (learning paradigms,Hebbian learning, competitive learning, Boltzmann learning)
  2. Multilayer perceptron (error-backpropagation learning, credit-assignment problem, backpropagation through time)
  3. Multilayer perceptron (error-backpropagation learning, credit-assignment problem, backpropagation through time)
  4. Radial basis function networks (solving interpolation problem with radial basis function networks, generalized radial basis function networks, relation to regularization theory)
  5. Self-organizing networks (Hebbian non-supervised learning, Oja's learning rule, PCA using self-organizing network, Sanger's learning rule, Competitive non-supervised learning, winner-takes-all network, Kohonen's self-organizing maps)
  6. Recurrent neural networks (Hopfield network, Hopfield network energy function, Boltzman machine, Elman networks, Jordan networks) and learning algorithms (back propagation through time, reccurent backpropagation)
  7. Online learning
  8. Midterm exam
  9. Online learning
  10. Deep convolutional networks: layers, architectures, visualization, fine tuning, applications, implementation
  11. Deep convolutional networks: layers, architectures, visualization, fine tuning, applications, implementation
  12. Decision trees (ID3, C4;5)
  13. K-means algorithm
  14. K-medoids algorithm, Max-min clustering
  15. Final exam

Study Programmes

University graduate
Audio Technologies and Electroacoustics (profile)
Free Elective Courses (1. semester) (3. semester)
Communication and Space Technologies (profile)
Free Elective Courses (1. semester) (3. semester)
Computational Modelling in Engineering (profile)
Free Elective Courses (1. semester) (3. semester)
Computer Engineering (profile)
Free Elective Courses (1. semester) (3. semester)
Computer Science (profile)
Free Elective Courses (1. semester) (3. semester)
Control Systems and Robotics (profile)
Free Elective Courses (1. semester) (3. semester)
Data Science (profile)
Free Elective Courses (1. semester) (3. semester)
Electrical Power Engineering (profile)
Free Elective Courses (1. semester) (3. semester)
Electric Machines, Drives and Automation (profile)
Free Elective Courses (1. semester) (3. semester)
Electronic and Computer Engineering (profile)
Free Elective Courses (1. semester) (3. semester)
Electronics (profile)
Free Elective Courses (1. semester) (3. semester)
Information and Communication Engineering (profile)
Free Elective Courses (1. semester) (3. semester)
Network Science (profile)
Elective Courses of the Profile (1. semester) (3. semester)
Software Engineering and Information Systems (profile)
Free Elective Courses (1. semester) (3. semester)

Literature

(.), Neural Networks and Learning Machines, Simon Haykin, Prentice Hall, c2009, New York,
(.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition David E. Rumelhart MIT Press 1987.,
(.), Reinforcement Learning:An Introduction Richard S. Sutton, Andrew G. Barto MIT Press, Cambridge 1998.,

For students

General

ID 222473
  Winter semester
5 ECTS
L3 English Level
L1 e-Learning
30 Lectures
15 Laboratory exercises

Learning Outcomes

  1. to define concept, methods and architectures typical for machine learnings
  2. to explain how machine learning operate and basic purpose
  3. to apply knowledge about machine learning to communication services
  4. to analyze functions of machine learned components, as well as their interactions in order to find appropriate solution
  5. to analyze organization and results produced by machine learning modela
  6. to create machine learned models including various types of recognition and self-adaptation
  7. to evaluate and assess solutions based on different methods of machine learning

Forms of Teaching

Lectures

Independent assignments

Laboratory

Week by Week Schedule

  1. Perceptron (learning paradigms,Hebbian learning, competitive learning, Boltzmann learning)
  2. Multilayer perceptron (error-backpropagation learning, credit-assignment problem, backpropagation through time)
  3. Multilayer perceptron (error-backpropagation learning, credit-assignment problem, backpropagation through time)
  4. Radial basis function networks (solving interpolation problem with radial basis function networks, generalized radial basis function networks, relation to regularization theory)
  5. Self-organizing networks (Hebbian non-supervised learning, Oja's learning rule, PCA using self-organizing network, Sanger's learning rule, Competitive non-supervised learning, winner-takes-all network, Kohonen's self-organizing maps)
  6. Recurrent neural networks (Hopfield network, Hopfield network energy function, Boltzman machine, Elman networks, Jordan networks) and learning algorithms (back propagation through time, reccurent backpropagation)
  7. Online learning
  8. Midterm exam
  9. Online learning
  10. Deep convolutional networks: layers, architectures, visualization, fine tuning, applications, implementation
  11. Deep convolutional networks: layers, architectures, visualization, fine tuning, applications, implementation
  12. Decision trees (ID3, C4;5)
  13. K-means algorithm
  14. K-medoids algorithm, Max-min clustering
  15. Final exam

Study Programmes

University graduate
Audio Technologies and Electroacoustics (profile)
Free Elective Courses (1. semester) (3. semester)
Communication and Space Technologies (profile)
Free Elective Courses (1. semester) (3. semester)
Computational Modelling in Engineering (profile)
Free Elective Courses (1. semester) (3. semester)
Computer Engineering (profile)
Free Elective Courses (1. semester) (3. semester)
Computer Science (profile)
Free Elective Courses (1. semester) (3. semester)
Control Systems and Robotics (profile)
Free Elective Courses (1. semester) (3. semester)
Data Science (profile)
Free Elective Courses (1. semester) (3. semester)
Electrical Power Engineering (profile)
Free Elective Courses (1. semester) (3. semester)
Electric Machines, Drives and Automation (profile)
Free Elective Courses (1. semester) (3. semester)
Electronic and Computer Engineering (profile)
Free Elective Courses (1. semester) (3. semester)
Electronics (profile)
Free Elective Courses (1. semester) (3. semester)
Information and Communication Engineering (profile)
Free Elective Courses (1. semester) (3. semester)
Network Science (profile)
Elective Courses of the Profile (1. semester) (3. semester)
Software Engineering and Information Systems (profile)
Free Elective Courses (1. semester) (3. semester)

Literature

(.), Neural Networks and Learning Machines, Simon Haykin, Prentice Hall, c2009, New York,
(.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition David E. Rumelhart MIT Press 1987.,
(.), Reinforcement Learning:An Introduction Richard S. Sutton, Andrew G. Barto MIT Press, Cambridge 1998.,

For students

General

ID 222473
  Winter semester
5 ECTS
L3 English Level
L1 e-Learning
30 Lectures
15 Laboratory exercises