ELEC 535 - Information and Coding Theory

Rice University, Spring 2004

Information Theory, Source Coding, and Error Correction Coding.

  • Instructor:
    Hyeokho Choi
    choi at ece dot rice dot edu
    Duncan Hall 2026, 713.348.3267
    Office Hours: MWF 11am-noon, or by appointment

  • Class Time and Place
    MWF 10:00 - 10:50am, AL (Abercrombie Lab) A126

    Course Outline

    Infromation measures: entropy, relative entropy, and mutual information
    Asymptotic equipartition theory
    Entropy rates
    Source coding and data compression
    Channel capacity
    Differential entropy and Gaussian channel
    Rate-distortion theory

    Textbook

    T.M. Cover and J. Thomas, Elements of Information Theory, Wiley, 1991.
    The course will closely follow this book; it is available at Rice Campus Store.

    Grading

    20% Homeworks
    25% Midterm Exam 1
    25% Midterm Exam 2
    30% Comprehensive Final Exam

    Homework Policy

    Homeworks are due in class. Late homeworks are not accepted. You can collaborate with your frieds or ask me questions during office hours while working on the problems. Please do not look at previous years' solutions, if available.


    Handouts

    Number Dates Title Postscript file
    No. 1 January 12 Syllabus download ps
    No. 2 January 21 Homework 1 download ps
    No. 5 January 25 Homework 2 download ps
    No. 7 February 1 Homework 3 download ps

    Tests

    Test Number Scheduled Dates Format
    Midterm 1 February, 2004 2-hour take home, open book & notes
    Midterm 2 April, 2004 2-hour take home, open book & notes
    Final exam Final period, 2004 3-hour take home, open book & notes

    Students with Disabilities

    Any student with a documented disability needing academic adjustments or accommodations is requested to speak with me during the first two weeks of class. All discussions will remain confidential. Students with disabilities should also contact Disability Support Services in the Ley Student Center.
    [Rice DSP Home Page] Rice DSP homepage
    Monday January 19 2004. Hyeokho Choi.