Undergraduate course

Information theory

ECTS Credits


Level of Study




Teaching semester


Objectives and Content

What is information? The course deals with measures of information content of digital symbols and sequences of symbols. Based on Shannon's information theoretical framework, an introduction to the fundamental principles behind data compression, error-correcting codes, and cryptography is given. In the course we also consider how information theory can be applied to computer networks.

Learning Outcomes

On completion of the course the student should have the following learning outcomes defined in terms of knowledge, skills and general competence:


The student should be able to:

  • Explain the concepts of entropy and mutual information.
  • Understand how information can be represented in an efficient manner.
  • Explain how information theory can be applied to multiple-access channels, broadcast channels, and to general networks.
  • Explain information-theoretic aspects of data security.


The student should be able to:

  • Determine the channel capacity of a discrete memoryless point-to-point channel with given parameters.
  • Implement source coding algorithms for simple sources and sources with memory.

General competence

The student

  • has a good understanding of the field of information theory.

Required Previous Knowledge

INF100 or equivalent.

MAT111/MAT101 or equivalent.

MNF130 or equivalent (can be taken same semester).

Recommended Previous Knowledge

Basic knowledge of statistics and combinatorics.

Credit Reduction due to Course Overlap

I144: 10 ECTS

Access to the Course

Access to the course requires admission to a programme of study at The Faculty of Mathematics and Natural Sciences.

Teaching and learning methods

Ordinary lectures: 4 hours per week, 13 weeks.

Exercises: 2 hours per week, 13 weeks.

Compulsory Assignments and Attendance


Compulsory assignments are valid two semesters, the semester of the approval and the following semester.

Forms of Assessment

3 hours written exam. It is opportunity for grades on exercises, which can be included in the final grade. If less than 20 students are taking the course, it can be oral exam.

Examination Support Material

Students who have been admitted to a program of study at the University of Bergen that includes access to this course are eligible to register. For information about admission requirements see Admission.

Grading Scale

The grading scale used is A to F. Grade A is the highest passing grade in the grading scale, grade F is a fail.

Assessment Semester

Examination both spring semester and autumn semester. In semesters without teaching the examination will be arranged at the beginning of the semester.

Reading List

The reading list will be available within June 1st for the autumn semester and December 1st for the spring semester

Course Evaluation

The course will be evaluated by the students in accordance with the quality assurance system at UiB and the department.

Programme Committee

The Programme Committee is responsible for the content, structure and quality of the study programme and courses.

Course Coordinator

Course coordinator and administrative contact person can be found on Mitt UiB, or contact mailto:studieveileder@ii.uib.no Student adviser

Course Administrator

The Faculty of Mathematics and Natural Sciences represented by the Department of Informatics is the course administrator for the course and study programme.


Contact Information

Student adviser:

mailto:studieveileder@ii.uib.no Student adviser

T: 55 58 42 00

Exam information

  • For written exams, please note that the start time may change from 09:00 to 15:00 or vice versa until 14 days prior to the exam. The exam location will be published 14 days prior to the exam.

  • Type of assessment: Written examination

    06.06.2018, 15:00
    3 hours
    Withdrawal deadline