Stochastic Processes

Language of Instruction

English

Learning Outcomes

After completed course, the students are expected to be able to:

• Carry out derivations involving conditional probability distributions and conditional expectations.
• Define basic concepts from the theory of Markov chains and present proofs for the most important theorems.
• Compute probabilities of transition between states and return to the initial state after long time intervals in Markov chains.
• Identify classes of states in Markov chains and characterize the classes.
• Determine limit probabilities in Markov chains after an infinitely long period.
• Derive differential equations for time continuous Markov processes with a discrete state space.
• Solve differential equations for distributions and expectations in time continuous processes and determine corresponding limit distributions.

Contact Information

advice@mi.uib.no

Course offered (semester)

Autumn

Language of Instruction

English

Aim and Content

The course will consider Markov processes in discrete and continuous time. The theory is illustrated with examples from operation research, biology and economy.

Learning Outcomes

After completed course, the students are expected to be able to:

• Carry out derivations involving conditional probability distributions and conditional expectations.
• Define basic concepts from the theory of Markov chains and present proofs for the most important theorems.
• Compute probabilities of transition between states and return to the initial state after long time intervals in Markov chains.
• Identify classes of states in Markov chains and characterize the classes.
• Determine limit probabilities in Markov chains after an infinitely long period.
• Derive differential equations for time continuous Markov processes with a discrete state space.
• Solve differential equations for distributions and expectations in time continuous processes and determine corresponding limit distributions.

Recommended previous knowledge

40 ECTS in mathematics and statistics, including courses in calculus, linear algebra and basic statistics (MAT112 Calculus II, MAT121 Linear Algebra and STAT110 Basic Course in Statistics)

Assessment methods

Written examination: 5 hours

Available aids: None

Examination only in the autumn.

Grading Scale

The grading scale used is A to F. Grade A is the highest passing grade in the grading scale, grade F is a fail.

Contact Information

advice@mi.uib.no