Machine Learning

Machine learning is the study of computer algorithms that improve automatically through experience. Applications range from data mining programs that discover general rules in large data sets, to information filtering systems that automatically learn users' interests.

This book provides a single source introduction to the field. It is written for advanced undergraduate and graduate students, and for developers and researchers in the field. No prior background in artificial intelligence or statistics is assumed

SLIDES FOR INSTRUCTORS:

THE FOLLOWING SLIDES ARE MADE AVAILABLE FOR INSTRUCTORS TEACHING FROM THE TEXTBOOK MACHINE LEARNING, TOM MITCHELL, MCGRAW-HILL.

SLIDES ARE AVAILABLE IN BOTH POSTSCRIPT, AND IN LATEX SOURCE. IF YOU TAKE THE LATEX, BE SURE TO ALSO TAKE THE ACCOMANYING STYLE FILES, POSTSCRIPT FIGURES, ETC.

• CH 1. INTRODUCTION. ( POSTSCRIPT 3.8MEG), ( GZIPPED POSTSCRIPT 317K) (PDF ) ( LATEX SOURCE )
• CH 2. CONCEPT LEARNING. ( POSTSCRIPT 347K), ( GZIPPED POSTSCRIPT 100K) (PDF ) ( LATEX SOURCE )
• CH 3. DECISION TREE LEARNING. ( POSTSCRIPT 530K), ( GZIPPED POSTSCRIPT 143K) (PDF ) ( LATEX SOURCE )
• CH 4. ARTIFICIAL NEURAL NETWORKS. ( POSTSCRIPT 1.83MEG), ( GZIPPED POSTSCRIPT 329K) (PDF ) ( LATEX SOURCE )
• CH 5. EVALUATING HYPOTHESES. ( POSTSCRIPT 212K), ( GZIPPED POSTSCRIPT 67K) (PDF ) ( LATEX SOURCE )
• CH 6. BAYESIAN LEARNING. ( POSTSCRIPT 261K), ( GZIPPED POSTSCRIPT 81K) (PDF ) ( LATEX SOURCE )
  SEE ALSO SLIDES ON LEARNING BAYESIAN NETWORKS BY FRIEDMAN AND GOLDSZMIDT.
• CH 7. COMPUTATIONAL LEARNING THEORY. ( POSTSCRIPT 160K), ( GZIPPED POSTSCRIPT 50K) (PDF ) ( LATEX SOURCE )
• CH 8. INSTANCE BASED LEARNING. ( POSTSCRIPT 138K), ( GZIPPED POSTSCRIPT 39K) (PDF ) ( LATEX SOURCE )
• CH 9. GENETIC ALGORITHMS. ( POSTSCRIPT 245K), ( GZIPPED POSTSCRIPT 72K) (PDF ) ( LATEX SOURCE )
• CH 10. LEARNING SETS OF RULES. ( POSTSCRIPT 185K), ( GZIPPED POSTSCRIPT 57K) (PDF ) ( LATEX SOURCE )
• CH 11. ANALYTICAL LEARNING. ( POSTSCRIPT 261K)  (PDF )   ( LATEX SOURCE ) 
• CH 12. COMBINING INDUCTIVE AND ANALYTICAL LEARNING. ( POSTSCRIPT 419K), ( GZIPPED POSTSCRIPT 103K) (PDF ) ( LATEX SOURCE )
• CH 13. REINFORCMENT LEARNING. ( POSTSCRIPT 172K), ( GZIPPED POSTSCRIPT 40K) (PDF ) ( LATEX SOURCE )

ADDITIONAL TUTORIAL MATERIALS:

SUPPORT VECTOR MACHINES:

• TUTORIAL INFORMATION ON SUPPORT VECTOR MACHINES
• FREEWARE IMPLEMENTATION : SVM LIGHT BY THORSTEN JOACHIMS.
• K.-R. MÜLLER, S. MIKA, G. RÄTSCH, K. TSUDA, AND B. SCHÖLKOPF. AN INTRODUCTION TO KERNEL-BASED LEARNING ALGORITHMS. IEEE NEURAL NETWORKS, 12(2):181-201, MAY 2001. (PDF)

Machine Learning Slides

Week	Project	Topic	PDF Slides
1		Introduction - Machine Learning	1
		Introduction - Weka
2		Data Preprocessing
	Proj1 - Pre-processing	Project 1 presentations
3		Decision Trees (I)	3
		Decision Trees (II)	3
4	Proj2 - Decision Trees	Project 2 presentations
		Neural Networks (I)	4
5		Neural Networks (II)	4
		Neural Networks (III)	4
6	Proj3 - Neural Networks	Project 3 presentations
		Evaluating Hypothesis (I)	5
7		Evaluating Hypothesis (II)	5
	Proj4 - Evaluating Hypotheses	Project 4 presentations
8		Bayesian Learning (I)	6
		Bayesian Learning (II)	6
9		Bayesian Learning (III) - K2 algorithm	6
	Proj5 Bayesian Learning	Project 5 presentations
10		Instance-based Learning	8
	Proj6 - Instance-based Learning	Project 6 presentations
11		Genetic Algorithms (I)	9
		Genetic Algorithms (II)	9
12	Proj7 - Genetic Algorithms	Project 7 presentations
		Rule Learning (I)	10
13		Rule Learning (II)	10
		Reinforcement Learning	13