Lectures: Information Theory (1/3 semester) & Information Field Theory (2/3 semester)

PD Dr. Torsten En▀lin
Lecture in English

Begin: 13.04.2015, End: 16.07.2015

lecture dates:
Mo 14:00 -- 16:00, H 537, Schellingstr. 4
Di   14:00 -- 16:00, A348 (=A349), Theresienstr. 37 (A)

exercise dates:
group A (Daniel Pumpe)   We,  8:00-10:00, room A348, Theresienstr. 37 (A)
group B (Theo Steininger) Th, 10:00-12:00, room A449, Theresienstr. 37 (A)

Exam Announcements:
Information theory (3 ECTS), May 18th, 14:00-16:00, Room S001 Schellingstr. 3
The post-exam review we will be on Wednesday, 17th between 4 pm and 5 pm in Garching at the Max Planck Institut for Astrophysics (Karl- Schwarzschild- Str. 1).

Information Field Theory (6 ECTS), July 13th, 14:00-16:00, Room S001 Schellingstr. 3
The post exam review incl. the release of your grades will be in room A449, Theresienstr. 37 on Thursday, July 17th between 10:00-12:00.
Until July, 28th it is possible to review your exam in our offices in Garching at the MPA. To do so, please make an appointment with your tutor. Starting the first week of August you may pick up your certifactes at Ms. Epp office.

Imaging in astronomy, geology and medicine require intelligent methods to obtain high fidelity images from noisy, incomplete data. The theoretical and mathematical framework in which imaging and data analysis methods are derived should be information theory to which these lectures will introduce first (first 1/3 semester, suited for Bachelor and Master students, 3 ETCS). Based on this, information theory for fields will be developed, which can be used to reconstruct signals from data (remaining 2/3 semester, more targeted at Master students, 6 ETCS)
The following topics will be addressed:
Aristotelian logic, Bayesian logic, measurement process (signal, response, noise), noise statistics (Gaussian, Poissonian), information measures (entropy, cross-information, ...), information Hamiltonian, relation to thermodynamics and statistical mechanics, theory of Wiener filter, construction of optimal non-linear filters, information field theory.

Lecture notes + 23.6.2015 additions + recent additions + extra notes + more extra notes (to Sec. II.3) (handwritten, with typos, & errors, will be modified during lecturing)

Bonus system

Exercise sheets: No. 1, No. 2, No. 3, No. 4, No. 5, No. 6, No. 7,No. 8,No. 9,No. 10,No. 11,

Previous examinations:Examination 2015 (Information Theory) Examination 2013, Examination 2012 (yes 2012, despite different date information in the document) , Examination 2011