Module MATH3251: STOCHASTIC PROCESSES III

Department: MATHEMATICAL SCIENCES

MATH3251: STOCHASTIC PROCESSES III

Prerequisites

• Linear Algebra II (MATH2021), Analysis in Many Variables II (MATH2031).

Corequisites

• None.

Excluded Combination of Modules

• Stoachastic Processes IV (MATH4091).

Aims

• This module continues on from the treatment of probability in MATH1012 (Core Mathematics A).
• It is designed to introduce mathematics students to the wide variety of models of systems in which sequences of events are governed by probabilistic laws.
• Students completing this course should be equipped to read for themselves much of the vast literature on applications to problems in physics, engineering, chemistry, biology, medicine, psychology and many other fields.

Content

• Infinite sample spaces, random variables, expectation, joint distributions, conditional probability and expectation, partition theorems.
• Discrete time, discrete state Markov chains.
• Poisson processes.
• Stationary Gaussian processes.
• Continuous time Markov chains.
• Topics chosen from: Stochastic dynamic programming, information theory, entropy and relative entropy, percolation theory and the contact process, Brownian motion.

Learning Outcomes

• By the end of the module students will: be able to solve novel and/or complex problems in Stochastic Processes.
• have a systematic and coherent understanding of theoretical mathematics in the field of Stochastic Processes.
• have acquired coherent body of knowledge of these subjects demonstrated through one or more of the following topic areas: Probability.
• Renewal Theory.
• Discrete time Markov processes.
• Poisson processes.
• Stationary processes.
• Continuous time Markov processes.
• Branching processes.

• In addition students will have specialised mathematical skills in the following areas which can be used with minimal guidance: Modelling, Computation.

Modes of Teaching, Learning and Assessment and how these contribute to the learning outcomes of the module

• Lectures demonstrate what is required to be learned and the application of the theory to practical examples.
• Assignments for self-study develop problem-solving skills and enable students to test and develop their knowledge and understanding.
• Formatively assessed assignments provide practice in the application of logic and high level of rigour as well as feedback for the students and the lecturer on students' progress.
• The end-of-year examination assesses the knowledge acquired and the ability to solve predictable and unpredictable problems..

Teaching Methods and Learning Hours

Summative Assessment

Formative Assessment:

Four written assignments to be assessed and returned. Other assignments are set for self-study and complete solutions are made available to students.

■ Attendance at all activities marked with this symbol will be monitored. Students who fail to attend these activities, or to complete the summative or formative assessment specified above, will be subject to the procedures defined in the University's General Regulation V, and may be required to leave the University