COMP / ELEC / STAT 502
Spring 2018


Schedule

The schedule of class topics, home works, tests, due dates, and handouts will come on-line in this table in a timely manner. The actual materials (Lecture Slides, other handouts, home work assignments) will be posted in Canvas for download. Should you have trouble with this web page please notify me and copy the TAs.

The The Lecture Notes and Handouts constitute the mandatory reading, and consist of two main ingredients:

Key to notation:
Lx-"title" = set #x of my lecture slides titled "title". EM-"other" = "other" electronic material that I may post.
CFi/k = Chapter k of Colin Fyfe's Volume i. Note that since I am using chapters from two different volumes two printed chapters may have the same number. Mark the volume # on your hardcopies.

Additional, optional reading is also listed here to quench your thirst for more knowledge than contained in the Lecture Notes. The references to those are given in the Course materials.
>>

No.

Date

Topic

Lecture Notes & Handouts
mandatory reading

Homework

Upload an electronic copy to Canvas
before 2:15pm on the due date,
unless otherwise indicated.

Optional Reading

1

Jan 9

Orientation, Introduction

CF2/1
L1-Introduction-502.pdf

(not a real) HW01 due 1/11

Haykin Ch1
or Ham & Kostanic Ch 1, Ch2.1-3

2

Jan 11

Train a single PE
Associative memory
Review of basics, on your own. Exercises in HW02.
Review of HW02 solutions in class, Jan 18.

CF2/1, CF2/2
Train-a-single-PE.pdf
L2-ReviewOfBasics.pdf
CF1/2
L4-AssociativeMemory.pdf

HW02 due 1/18
most of the problems will be graded
only for turning in and attempting them.
See details in the posted HW02.

Haykin Ch10
or Cover & Thomas Ch1 and Ch9

Jan 16

CLASS CANCELED, Rice closed for winter storm

3

Jan 18

Associative memory (Josh Taylor)
Review of basics, cont'd
CF1/2
L4-AssociativeMemory.pdf
Haykin Ch2.11
or Ham & Kostanic Ch 3.2

4

Jan 23

Associative memory, wrap-up.
Discussion of HW02 solutions (Zhengjia Wang)
You will be assumed to have studied
L2-ReviewOfBasics, to have attempted
solutions, and to ask questions.
CF1/2
L4-AssociativeMemory.pdf
HW03 due 2/1
MAMerrcorr-summary.pdf
Haykin Ch2.11
or Ham & Kostanic Ch 3.2

5

Jan 25 Simple Perceptron L5-Perceptron.pdf
CF1/3

Ham & Kostanic Ch 2.5-2.6; or Haykin Ch3

6

Jan 30 Simple Perceptron
Batch vs on-line learning
L5-Perceptron.pdf
CF1/3

Ham & Kostanic Ch 2.5-2.6; or Haykin Ch3

7

Feb 1 Multilayer Perceptron (Back Propagation) L6-MultiLayerPerceptron.pdf
CF1/4

HW04 Part I due 2/8 Ham & Kostanic Ch 3.3.1; or Haykin Ch4.1-4.4

8

Feb 6 Multilayer Perceptron cont'd
Issues With Backprop
L7-IssuesWithMLPs.pdf
CF1/4

Ham & Kostanic Ch 3.3.2 - 3.3.4; or Haykin Ch4.5-4.8

9

Feb 8 Issues With Backprop: Scalings, Momentum L7-IssuesWithMLPs.pdf CF1/4

Ham & Kostanic Ch 3.3.2 - 3.3.7; or Haykin Ch4.5-4.8

10

Feb 13 Issues With Backprop: Other practical items L7-IssuesWithMLPs.pdf
L7.1-BP-practical-items.pdf
L7.2-Vector-matrix-BP.pdf CF1/4

HW4 Part I and Part II together; due Feb 20 Ham & Kostanic Ch 3.3.2 - 3.3.7; or Haykin Ch4.5-4.8

11

Feb 15 # training samples; Vapnik-Chervonenkis dimension
Network Pruning
L8-VC-Dimension.pdf
L9-NetworkPruning.pdf
Review PCA for lecture on Feb 20
Material in Canvas, L2, and in Supplements/PCA-Ham&Kostanic-pp396-399.pdf
or any other standard text
Haykin Ch4.5-4.8, Haykin pp 94 - 102, Bishop

12

Feb 20 PCA nets: Oja's Symmetric Subspace Algorithm, GHA L10-UnsupervisedLearning-PCAnets.h.pdf HW06 due Mar 6 Ham & Kostanic Ch 9.1-9.3; Haykin CH8.1-5

Return to COMP / ELEC 502 / STAT 502 home page