Heuristic Optimization Methods
Data is displayed for academic year: 2023./2024.
Laboratory exercises
Course Description
Introduction to optimization methods and heuristics. Algorithm and problem complexity. Categorization of heuristics and bounds. Exact methods. Constructive heuristics (greedy algorithms). Improvement heuristics (hill climbing, local search). Metaheuristics: Iterative Local Search, Variable Neighborhood Search, Large Neighborhood Search, Simulated Annealing, Tabu Search, Evolutionary strategies, Ant Colony optimization, GRASP, PSO. Survey of additional heuristic techniques. Case studies on real world problems applying constructive, hybrid and metaheuristics.
Study Programmes
University graduate
[FER3-EN] Control Systems and Robotics - profile
Elective course
(3. semester)
Elective courses
(1. semester)
[FER3-EN] Data Science - profile
Elective courses
(1. semester)
Recommended elective courses
(3. semester)
[FER3-EN] Electrical Power Engineering - profile
Elective courses
(1. semester)
(3. semester)
Learning Outcomes
- explain the basic underlying principles of heuristic search as an optimization method to solve complex problems
- calculate problem complexity and algorithm complexity
- distinguish between exact methods and heuristic methods, and when to apply which methods
- identify the need for heuristics
- explain the methodology of the most commonly used heuristics (Greedy, Simmulated Annealing, Tabu Search, Evolutionary algorithms, Ant Colony optimization, PSO)
- explain the advantages and disadvantages of various heuristic methods
- develop new (hybrid) heuristic methods by applying existing heuristic methods
- evaluate the quality of the solutions obtained with heuristic methods
Forms of Teaching
Lectures
Lectures are held in two cycles. The first cycle contains 7 weeks of lectures followed by the second cycle lasting 6 weeks, with a teaching load of 2 hours per week.
LaboratoryStudents are assigned 2 laboratory assignments in which they will independently design, implement and test heuristic algorithms for solving given combinatorial optimization problems.
OtherProject: design, implementation and testing of heuristic algorithms for solving a given combinatorial optimization problem.
Grading Method
Continuous Assessment | Exam | |||||
---|---|---|---|---|---|---|
Type | Threshold | Percent of Grade | Threshold | Percent of Grade | ||
Laboratory Exercises | 25 % | 25 % | 25 % | 25 % | ||
Seminar/Project | 50 % | 25 % | 50 % | 25 % | ||
Mid Term Exam: Written | 0 % | 25 % | 0 % | |||
Final Exam: Written | 0 % | 25 % | ||||
Exam: Written | 0 % | 50 % |
Week by Week Schedule
- Introduction to optimization; optimization models, combinatorial optimization.
- Complexity theory; categorization of optimization methods; why and when to use heuristics.
- Exact methods: integer programming, branch and bound, dynamic programming.
- Greedy algorithms. Basic concepts of metaheuristics.
- Local search. Greedy randomized adaptive search procedure (GRASP).
- Variable neighborhood search. Large neighborhood search.
- Tabu search.
- Midterm exam
- Simulated annealing.
- Ant colony optimization.
- Particle swarm optimization. Project assignment.
- Evolutionary algorithms.
- Case studies involving hybrid and meta heuristics.
- Project presentations.
- Final exam
Literature
Michel Gendreau, Jean-Yves Potvin (2018.), Handbook of Metaheuristics (International Series in Operations Research & Management Science, Band 272), Springer
El-Ghazali Talbi (2009.), Metaheuristics: From Design to Implementation, Wiley
Zbigniew Michalewicz , David B. Fogel (2004.), How to Solve it: Modern Heuristics, 2nd Edition, Springer
For students
General
ID 222973
Winter semester
5 ECTS
L3 English Level
L1 e-Learning
30 Lectures
5 Seminar
0 Exercises
12 Laboratory exercises
0 Project laboratory
0 Physical education excercises
Grading System
85 Excellent
75 Very Good
65 Good
55 Sufficient