Durham University
Programme and Module Handbook

Postgraduate Programme and Module Handbook 2025-2026

Module COMP53815: Natural Language Processing

Department: Computer Science

COMP53815: Natural Language Processing

Type Tied Level 5 Credits 15 Availability Available in 2025/2026 Module Cap
Tied to G5T609
Tied to G5T709

Prerequisites

  • None

Corequisites

  • None

Excluded Combination of Modules

  • None

Aims

  • To introduce the students to computational linguistics.
  • To introduce the students to statistical and neural language models.
  • To help students gain experience in using advanced techniques to solve natural language tasks such as text parsing, understanding, classification, translation, and generation.

Content

  • Text pre-processing
  • Feature extraction
  • Statistical language models
  • Neural language models
  • Neural word embeddings
  • Recurrent Neural Networks (RNNs) for NLP tasks
  • Advanced variations of RNNs
  • Convolutional Neural Networks (CNNs) for NLP tasks
  • Sequence-to-sequence architectures
  • Attention and self-attention mechanisms
  • Transformers
  • Pretrained transformer models, e.g., BERT and GPT
  • Multitask learning
  • NLP ethics and fairness

Learning Outcomes

Subject-specific Knowledge:
  • By the end of this module, students should be able to demonstrate:
  • an understanding of the fundamental concepts of language models.
  • an understanding of the mathematical basis of various deep-learning-based language models.
  • an understanding of the learning algorithms behind major NLP use cases e.g. machine translation, multi-task Learning, text generation and classification.
  • An understanding of the embedded bias in popular language models.
Subject-specific Skills:
  • By the end of this module, students should be able to demonstrate:
  • an ability to conduct independent research in the field of NLP.
  • an ability to handle textual data and extract representative features.
  • an ability to use state-of-the-art NLP techniques and models to solve real-world tasks.
Key Skills:
  • By the end of this module, students should be able to demonstrate:
  • an ability to design end-to-end solutions for real-world problems with textual input using state-of-the-art NLP techniques.
  • an ability to make informed decisions regarding neural architectures for NLP tasks.
  • awareness of the Language Models and their biases.

Modes of Teaching, Learning and Assessment and how these contribute to the learning outcomes of the module

  • Lectures enable the students to learn new material relevant to NLP concepts, word embeddings, language models, as well as their applications.
  • Computer classes enable the students to put into practice learning from lectures and strengthen their understanding through application.
  • The summative assignment assesses the application of methods and techniques and assesses the understanding of core concepts. It consists of a coding exercise with accompanying report.

Teaching Methods and Learning Hours

Activity Number Frequency Duration Total/Hours
Lectures 8 1 per week 2 hours 16
Lectures 8 1 per week 1 hour 8
Computer Classes 4 1 every other week (weeks 2, 4, 6, and 8) 2 hours 8
Preparation and Reading 118
Total 150

Summative Assessment

Component: Coursework Component Weighting: 100%
Element Length / duration Element Weighting Resit Opportunity
Assignment 100%

Formative Assessment:

Via computer classes.


Attendance at all activities marked with this symbol will be monitored. Students who fail to attend these activities, or to complete the summative or formative assessment specified above, will be subject to the procedures defined in the University's General Regulation V, and may be required to leave the University