### Popis predmeta

#### Course Description

In the introductory part the conditional probability, conditional expectation and technique conditioning by random variables will be studied. Then the analysis of the series of random variables and random walk will be given. The central part is the study of Markov chains and processes, and models based on these processes. The properties of the most important processes, Poisson and Wiener processes will be studied in details.

#### Learning Outcomes

- Understand the basic principles of stochastic processes
- Learn to distinguish between stochastic processes according to their properties.
- Understand the characteristic lack of memory in different cases
- To interpret the behavior of the process in accordance with the theoretical laws.
- Determine the probability of prominent events related to stochastic processes.
- Learn to model simple problems using stochastic techniques.
- Apply stochastic techniques in the analysis of various systems.

#### Forms of Teaching

**Lectures**4 hours per week

**Partial e-learning**Online materials.

**Independent assignments**Each student must solve some problems on his own.

#### Grading Method

Continuous Assessment | Exam | |||||
---|---|---|---|---|---|---|

Type | Threshold | Percent of Grade | Threshold | Percent of Grade | ||

Quizzes | 0 % | 20 % | 0 % | 0 % | ||

Seminar/Project | 0 % | 15 % | 0 % | 0 % | ||

Mid Term Exam: Written | 0 % | 40 % | 0 % | |||

Final Exam: Written | 0 % | 40 % | ||||

Exam: Written | 0 % | 100 % |

#### Week by Week Schedule

- Conditional distribution and expectation. Conditioning on a random variable. Conditioning on a sigma-field.
- Sums of independent random variables. Stopping times Wald identities. Generating functions.
- Random walks. Probability of ruin. Recurrent events.
- Stochastic processes. Markov process. Foundations and examples. Construction of Markov chains. Transition probabilities and the Chapman-Kolmogorov equation. Stopping times and strong Markov property. Absorbing states. Transient and recurrent states. Branching processes.
- Limit theorems and stationary distributions. State classification. Ergodic theorems. Finite-dimensional distributions of processes. Moments, correlation and covariation functions. Classes of processes: Markov, homogenous Markov, weak/strong stationary, independent increment processes. Transition and density matrix and Chapman-Kolmogorov equation for Markov processes.
- Poisson process. Homogeneous Poisson processes. Memoryless property.
- Poisson processes and uniform, exponential and binomial distributions, Nonhomogeneous Poisson processes. Mixed and Compound Poisson Processes. Poisson arrivals.
- Midterm exam
- Continuous-time Markov process. Basic concepts and examples. Transition probabilities and rates. Birth and death processes. Kolmogorov differential equations. Stationary state probabilities. Ergodic theorems.
- Renewal processes. Renewal Functions. Excess life, current life and total life. Strong laws of large numbers. Recurrence times. Terminating renewal processes. Stationary renewal processes. Alternating Renewal Processes.
- Queueing models. Basic concepts. The Erlang model, M/M/1 and M/M/c queue.
- Loss systems. M/M systems. Waiting systems. M/G and G/M models. Network of queueing systems
- Introduction. Properties of Brownian motion. Multidimensional and conditional distributions. First passage times.
- Brownian motion. Transformations of the Brownian motion. Brownian motion with drift. White noise. Diffusion processes.
- Final exam

#### Study Programmes

##### University undergraduate

Computing (study)

Elective Courses
(6. semester)
Electrical Engineering and Information Technology (study)

Elective Courses
(6. semester)
##### University graduate

Audio Technologies and Electroacoustics (profile)

Free Elective Courses
(2. semester)
Communication and Space Technologies (profile)

Free Elective Courses
(2. semester)
Computational Modelling in Engineering (profile)

Elective Courses of the Profile
(2. semester)
Computer Engineering (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Computer Science (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Control Engineering and Automation (profile)

Mathematics and Science
(2. semester)
Control Systems and Robotics (profile)

Free Elective Courses
(2. semester)
Data Science (profile)

Free Elective Courses
(2. semester)
Electrical Engineering Systems and Technologies (profile)

Mathematics and Science
(2. semester)
Electrical Power Engineering (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Electric Machines, Drives and Automation (profile)

Free Elective Courses
(2. semester)
Electronic and Computer Engineering (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Electronics (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Information and Communication Engineering (profile)

Free Elective Courses
(2. semester)
Information Processing (profile)

Mathematics and Science
(2. semester)
Network Science (profile)

Free Elective Courses
(2. semester)
Software Engineering and Information Systems (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Telecommunication and Informatics (profile)

Mathematics and Science
(2. semester)
Wireless Technologies (profile)

Mathematics and Science
(2. semester)
#### Literature

(.),

*Neven Elezović, Stohastički procesi*,
Frank Beichelt (2006.),

*Stochastic Processes in Science, Engineering and Finance*, Chapman & Hall/CRC#### Lecturers

#### For students

#### General

**ID**183365

Summer semester

**5**ECTS

**L3**English Level

**L3**e-Learning

**60**Lectures

#### Grading System

**85**Excellent

**70**Very Good

**55**Good

**45**Acceptable

#### Similar Courses

#### Learning Outcomes

- Understand the basic principles of stochastic processes
- Learn to distinguish between stochastic processes according to their properties.
- Understand the characteristic lack of memory in different cases
- To interpret the behavior of the process in accordance with the theoretical laws.
- Determine the probability of prominent events related to stochastic processes.
- Learn to model simple problems using stochastic techniques.
- Apply stochastic techniques in the analysis of various systems.

#### Forms of Teaching

**Lectures**4 hours per week

**Partial e-learning**Online materials.

**Independent assignments**Each student must solve some problems on his own.

#### Grading Method

Continuous Assessment | Exam | |||||
---|---|---|---|---|---|---|

Type | Threshold | Percent of Grade | Threshold | Percent of Grade | ||

Quizzes | 0 % | 20 % | 0 % | 0 % | ||

Seminar/Project | 0 % | 15 % | 0 % | 0 % | ||

Mid Term Exam: Written | 0 % | 40 % | 0 % | |||

Final Exam: Written | 0 % | 40 % | ||||

Exam: Written | 0 % | 100 % |

#### Week by Week Schedule

- Conditional distribution and expectation. Conditioning on a random variable. Conditioning on a sigma-field.
- Sums of independent random variables. Stopping times Wald identities. Generating functions.
- Random walks. Probability of ruin. Recurrent events.
- Stochastic processes. Markov process. Foundations and examples. Construction of Markov chains. Transition probabilities and the Chapman-Kolmogorov equation. Stopping times and strong Markov property. Absorbing states. Transient and recurrent states. Branching processes.
- Limit theorems and stationary distributions. State classification. Ergodic theorems. Finite-dimensional distributions of processes. Moments, correlation and covariation functions. Classes of processes: Markov, homogenous Markov, weak/strong stationary, independent increment processes. Transition and density matrix and Chapman-Kolmogorov equation for Markov processes.
- Poisson process. Homogeneous Poisson processes. Memoryless property.
- Poisson processes and uniform, exponential and binomial distributions, Nonhomogeneous Poisson processes. Mixed and Compound Poisson Processes. Poisson arrivals.
- Midterm exam
- Continuous-time Markov process. Basic concepts and examples. Transition probabilities and rates. Birth and death processes. Kolmogorov differential equations. Stationary state probabilities. Ergodic theorems.
- Renewal processes. Renewal Functions. Excess life, current life and total life. Strong laws of large numbers. Recurrence times. Terminating renewal processes. Stationary renewal processes. Alternating Renewal Processes.
- Queueing models. Basic concepts. The Erlang model, M/M/1 and M/M/c queue.
- Loss systems. M/M systems. Waiting systems. M/G and G/M models. Network of queueing systems
- Introduction. Properties of Brownian motion. Multidimensional and conditional distributions. First passage times.
- Brownian motion. Transformations of the Brownian motion. Brownian motion with drift. White noise. Diffusion processes.
- Final exam

#### Study Programmes

##### University undergraduate

Computing (study)

Elective Courses
(6. semester)
Electrical Engineering and Information Technology (study)

Elective Courses
(6. semester)
##### University graduate

Audio Technologies and Electroacoustics (profile)

Free Elective Courses
(2. semester)
Communication and Space Technologies (profile)

Free Elective Courses
(2. semester)
Computational Modelling in Engineering (profile)

Elective Courses of the Profile
(2. semester)
Computer Engineering (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Computer Science (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Control Engineering and Automation (profile)

Mathematics and Science
(2. semester)
Control Systems and Robotics (profile)

Free Elective Courses
(2. semester)
Data Science (profile)

Free Elective Courses
(2. semester)
Electrical Engineering Systems and Technologies (profile)

Mathematics and Science
(2. semester)
Electrical Power Engineering (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Electric Machines, Drives and Automation (profile)

Free Elective Courses
(2. semester)
Electronic and Computer Engineering (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Electronics (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Information and Communication Engineering (profile)

Free Elective Courses
(2. semester)
Information Processing (profile)

Mathematics and Science
(2. semester)
Network Science (profile)

Free Elective Courses
(2. semester)
Software Engineering and Information Systems (profile)

Free Elective Courses
(2. semester)
Mathematics and Science
(2. semester)
Telecommunication and Informatics (profile)

Mathematics and Science
(2. semester)
Wireless Technologies (profile)

Mathematics and Science
(2. semester)
#### Literature

(.),

*Neven Elezović, Stohastički procesi*,
Frank Beichelt (2006.),

*Stochastic Processes in Science, Engineering and Finance*, Chapman & Hall/CRC#### Lecturers

#### For students

#### General

**ID**183365

Summer semester

**5**ECTS

**L3**English Level

**L3**e-Learning

**60**Lectures

#### Grading System

**85**Excellent

**70**Very Good

**55**Good

**45**Acceptable