Search programme

​Use the search function to search amongst programmes at Chalmers. The programme overview and the programme syllabus relating to your studies are generally from the academic year you began your studies.

​​​

Syllabus for

Academic year
FFR050 - Information theory
 
Owner: FCMAS
3,0 Credits (ECTS 4,5)
Grading: TH - Five, Four, Three, Not passed
Level: C
Department: 16 - PHYSICS


Teaching language: English

Course module   Credit distribution   Examination dates
Sp1 Sp2 Sp3 Sp4 No Sp
0189 Examination 3,0 c Grading: TH   3,0 c   Contact examiner,  Contact examiner

In programs

TTFYA ENGINEERING PHYSICS, Year 4 (elective)
FCMAS MSc PROGRAMME IN COMPLEX ADAPTIVE SYSTEMS, Year 1 (elective)

Examiner:

Professor  Kristian Lindgren



Eligibility:

For single subject courses within Chalmers programmes the same eligibility requirements apply, as to the programme(s) that the course is part of.

Course specific prerequisites

Computer science advanced course or equivalent

Aim

The course provides an understanding of fundamental concepts used to describe complex systems, in particular dynamical systems such as chaotic low-dimensional systems, self-organizing systems and simple discrete spatially extended systems such as cellular automata. Many of the concepts are based in information theory.

Content

Basic concepts of information theory: Shannon entropy, complexity measures.
Information theory and statistical mechanics.
Geometric information theory - randomness and complexity in spatically extended systems.
Information flow. The relation between microscopic and macroscopic levels.
Introduction to computation theory and formal languages. Algorithmic information theory (Kolmogorov komplexity).
Statistical models, in particular hidden Markov models.
Cellular automata.
Applications in nonlinear dynamics, computational biology, chemical self-organizing systems, and statistical mechanics.

Literature

K. Lindgren, Information theory for complex systems. Articles from research literature. Recommended reading: T.M. Cover and J.A. Thomas, Elements of information theory, Wiley, 1991.

Examination

Written exam.


Page manager Published: Thu 03 Nov 2022.