Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
AI and Machine
Applications Learning
and
Applicati
Agents
ons
Where We Are
AI and Machine
Applications Learning
and
Applicati
Agents
ons
What is Machine Learning?
Volunteer
ML: The study and design of intelligent
agents
That make decisions based on data.
The goal of machine learning is to
build computer systems that can
adapt and learn from their
experience.
Tom Dietterich
.
AI: The study and design of intelligent
agents
A Generic System
x1 y1
x2 y2
System
xN h1 , h2 ,..., hK
yM
Machine Learning 16
Past When are ML algorithms NOT
needed?
Machine Learning 17
Past Observations
Learnin
g
Machine Learning
Supervised
Learning
Learnin
g
Machine Learning
Unsupervise Supervised
d Learning Learning
Learnin
g
Machine Learning
Unsupervise Supervised
d Learning Learning
Learnin
g
Feature
Learning
Deep Learning
Learn by Doing
c
Theory will Help
c
Carpentry
Background on supervised task
Unsupervise Supervised
d Learning Learning
Today!
Learnin
g
Feature
Learning
Supervised Learning
Carpentry of Supervised
Learning
What does Data Look
Like?
Data
M observations :
For each observation (i) we have x(i) and y(i)
Supervised Learning
Training
Set
Learning
Algorith
m
h
Supervised Learning
Training
Set
Learning
Algorith
m
x h
Supervised Learning
Training
Set
Learning
Algorith
m
x h predicted
y
An Example Application
An emergency room in a hospital measures 17
variables (e.g., blood pressure, age, etc) of
newly admitted patients.
A decision is needed: whether to put a new
patient in an intensive-care unit.
Due to the high cost of ICU, those patients
who may survive less than a month are given
higher priority.
Problem: to predict high-risk patients and
discriminate them from low-risk patients.
https://www.youtube.com/watch?v=
mq0D5kq9ePE
Steps in Supervised
Learning
Learning (training): Learn a model using the training data
Testing: Test the model using unseen test data to assess the model accuracy
Training
Set
Learning
Algorith
m
x h predicted
y
Discriminative
1.Nearest Neighbors
2.Linear Regression
3.SVMs
Background on supervised task
Theoretical guarantees
on performance
Correlation between
features doesnt throw it
of
Less prone to curse of
dimensionality
Live Example
Background on supervised task
Accuracy
F1
Precision
Recall
AUC (Area Under the Curve)
ROC (Receiver Operating
Characteristic)
Efficiency (time, memory)
AUC
Overfitting?
Overfitting?
AUC (how good)
Training Set
Testing Set
Model Complexity
Generative Vs
Discriminative?
Generative approach:
is to learn each language and determine
as to
which language the speech belongs to
Discriminative approach:
is determine the linguistic diferences
without
learning any language a much easier
task!
ML Taxonomy
Generative Methods
Model class-conditional pdfs (probability distribution function) and
prior probabilities
Generative since sampling can generate synthetic data points
Popular models
Gaussians, Nave Bayes, Mixtures of multinomials
Mixtures of Gaussians, Mixtures of experts, Hidden Markov
Models (HMM)
Sigmoidal belief networks, Bayesian networks, Markov random
fields
Discriminative Methods
Directly estimate posterior probabilities
No attempt to model underlying probability distributions
Focus computational resources on given task better performance
Popular models
Logistic regression, SVMs
Traditional neural networks, Nearest neighbor
Conditional Random Fields (CRF)
Generative Models
Examples
Nearest neighbor Neural networks
106 examples