Information Processing

Learning Outcomes

  1. Identify and explain fundamental techniques of signal processing
  2. Identify and explain fundamental techniques of machine learning
  3. Identify and explain fundamental techniques of image processing analysis
  4. Identify and explain fundamental techniques of text analysis
  5. Identify and explain fundamental techniques of speech analysis
  6. Identify and explain fundamental techniques of computational finance
  7. Identify and explain fundamental techniques of bioinformatics
  8. Identify and explain fundamental techniques of complex networks

Forms of Teaching

Lectures

Lectures take place in a lecture room with a lecturer who is an expert on a specific subject. The lecture is interactive, and students are expected to participate in the discussion.

Laboratory

Laboratory exercises are held in labs equipped with computers. During the exercise, students try out theoretical concepts and apply them to specific problems

Grading Method

Continuous Assessment Exam
Type Threshold Percent of Grade Threshold Percent of Grade
Laboratory Exercises 0 % 20 % 0 % 0 %
Mid Term Exam: Written 50 % 40 % 0 %
Final Exam: Written 50 % 40 %
Exam: Written 50 % 100 %

Week by Week Schedule

  1. Problem definition
  2. Advantages and drawbacks
  3. Machine learning tasks and applications, Machine learning approaches and paradigms, Hypothesis, model, parameter space, version space
  4. Inductive learning and inductive bias, language and preference bias, Loss function and error function, Overfitting and model selection, empirical and structural risk minimization
  5. Perceptron (learning paradigms,Hebbian learning, competitive learning, Boltzmann learning), Multilayer perceptron (error-backpropagation learning, credit-assignment problem, backpropagation through time), Self-organizing networks (Hebbian non-supervised learning, Oja's learning rule, PCA using self-organizing network, Sanger's learning rule, Competitive non-supervised learning, winner-takes-all network, Kohonen's self-organizing maps), Radial basis function networks (solving interpolation problem with radial basis function networks, generalized radial basis function networks, relation to regularization theory)
  6. Recurrent neural networks (Hopfield network, Hopfield network energy function, Boltzman machine, Elman networks, Jordan networks) and learning algorithms (back propagation through time, reccurent backpropagation), Network ensembles (committee machines, mixture of experts, convolutional neural networks), Spike neuron model and spiking neural network
  7. Parametric models; Parameter estimation, Speech feature vectors, Cepstral analysis, Hommomorphic analysis
  8. Midterm exam
  9. Definition, Terms, Examples of real-world networks and their properties
  10. Classification in computational finance, Modelling in computational finance
  11. Document classification and tagging, Document clustering, Text information extraction (named entities, keyphrases, relations, etc.), Event detection and tracking, Document summarization, multidocument summarization, Latent semantic document models (LSI, LDA), Textual similarity, paraphrase, and entailment
  12. Light and EM spectrum, Human visual system, Image sampling and quantization, Discrete geometry, 2D linear systems, Image sensors, Basic image processing operations, Application areas
  13. Problem definition, Feature extraction, Image segmentation, Texture analysis, Shape analysis, Motion analysis
  14. Protein, RNA and DNA, Biological sequences and structures, Bioinformatics databases, Data formats
  15. Final exam

Study Programmes

University undergraduate
Computing (study)
Elective Courses (5. semester)
Electrical Engineering and Information Technology (study)
Elective Courses (5. semester)

Literature

S. Lončarić, D. Seršić, M. Subašić (2008.), Obrada informacija: materijali za predavanja, FER, elektronička publikacija
T. Petković, D. Seršić, S. Lončarić (2008.), Obrada informacija: Upute za laboratorijske vježbe, FER, elektronička publikacija
James H. McClellan, Ronald Schafer, Mark Yoder (2015.), Signal Processing First, Pearson College Division
Rafael C. Gonzalez, Richard Eugene Woods (2008.), Digital Image Processing, Prentice Hall

General

ID 183369
  Winter semester
5 ECTS
L3 English Level
L1 e-Learning
45 Lectures
0 Exercises
15 Laboratory exercises
0 Project laboratory

Grading System

87 Excellent
75 Very Good
65 Good
56 Acceptable