UNIT – I MID SEM EXAM QUESTION BANK

MID SEM EXAM QUESTION BANK

UNIT – I INTRODUCTION TO MACHINE LEARNING
(17 QUESTIONS ONLY)

WHY AND WHAT IS MACHINE LEARNING ?

Q1: What is Machine learning? What is its need ?

EXAMPLES OF MACHINE LEARNING PROBLEMS

Q2: Explain four examples of machine learning in detail?

Q3: Consider the problem of sorting ‘n’ numbers. Is it wise to apply machine
learning to solve this problem? Justify.
Q4: What is supervised and unsupervised learning? Explain with the
examples.
STRUCTURE OF LEARNING
or
COMPONENTS / INGREDIENTS OF LEARNING.
Q5: Explain structure of machine learning?
Explain components or ingredients of learning.

LEARNING Vs DESIGNING

Q6: Explain learning Vs Designing?

TRAINING Vs TESTING
Q7: Explain Training verses Testing.
Q8: Explain Bias variance trade off.

PREDICTIVE Vs DESCRITIVE

Q9: Explain and differentiate predictive and descriptive learning task.

GEOMETRIC MODELS, PROBABILISTIC MODELS AND LOGICAL

MODELS

Q10: Explain geometric models in detail with example.

Q11. Explain logical models in detail with example.
Q12. Explain Probabilistic models in detail with example.
FEATURE – FEATURE TYPES, CONSTRUCTION, TRANSFORMATION,
SELECTION

Q12: What do you meant by features? What are the different properties
of features? Explain types of features?

Q13: What do you meant by feature transformation and feature

construction?.
Q14: Explain feature selection in details.

Q15: Explain hierarchy of feature constructions.

Q16: What do you meant by feature calibration? What are the
advantages of it?
Q17: Explain
(i) Thresholding
(ii) Discretization
(iii) Ordering
(iv) Unordering
(v) Binarization
UNIT – II MID SEM EXAM QUESTION BANK
MID SEM EXAM QUESTION BANK
UNIT – II CLASSIFICATION AND REGRESSION
(25 QUESTIONS ONLY)

BASIC TERMINALOGIES

Q. 1 Define and explain following terms with example.

(i) label (ii) label space

(iii) Output Space (iv) Classification problem
(vi) Regression Problem (vi) Ranking and scoring
problem

(vii) Probability Estimation (viii) VC dimension

Problem
(ix) Decision Boundary (x) Decision Region

Q. 2 Explain different types of predictive machine learning tasks.

BINARY CLASSIFICATION

Q. 3 Explain with diagram

1. Univariate Binary Classification.
2. Bivariate Binary Classification.
3. Multivariate Binary Classification.

ASSESSING CLASSIFICATION PERFORMANCE

Q. 4 Explain Confusion Matrix for Binary classifier in detail.

Q.5 Prove that

(i) FPR = 1 – TNR
(ii) TNR = 1 – FPR
(iii) FNR = 1 – TPR
(iv) TPR = 1 – FNR
(v) Accuracy = 1 – Error Rate
(vi) Error Rate = 1 – Accuracy
Q. 6 Define and explain following terms.
1. True Positive 2. True Negative
3. False Positive 4. False Negative
5. TPR 6. TNR
7. FPR 8. FNR
9. Sensitivity 10. Recall
11. Specificity 12. Fallout 13. Miss rate

Q. 7 Consider following confusion matrix and calculate.

(i) Sensitivity Classifier (ii) Recall of Classifier
(iii) Miss Rate of Classifier (iv) Fallout of Classifier

Confusion Matrix Predicted Total

+ –
+
ACTUAL 8 10 18

– 4 8 12

Total 12 18 30
Comment on quality/usability of this classifier.

Q. 8 Explain Class Probability Estimation Process for binary

classifier.
Explain how classification is done by using threshold probabilities.

Q.9 Consider following partitioning of training data construct –

feature tree, probability estimation tree and classification tree.
Hit movies Hit
Action = 10 movies = 2
Movie Flop Flop
movies = 2 movies = 10
Hit Hit
movies = 12 movies = 6
 Non- Flop Flop
Action Movie movies = 6 movies = 12
Romantic Non-
Movie Romantic Movie

MULTICLASS CLASSIFICATION

Q. 10 Explain construction of multi-class classifier.

1. One vs all approach
2. One vs one approach
3. Error correcting output codes approach.

Q. 11 Explain confusion matrix for multi-class classifier. Write

formulae for following measures used for performance evaluation of
multi-class classification.
(i) Accuracy of multi-class classifier.
(ii) Error Rate of multi-class classifier.
(iii) Precision of multi-class classifier.
(iv) Recall of multi-class classifier.

Q. 12 Consider following confusion matrix evaluate performance of

this multiclass classifier.

CONFUSIO PREDICTED
N MATRIX C1 C2 C3 Tota
l
Actual C1 2 40 20 80
0
C2 20 30 20 70
C3 20 2 60 100
0
Total 6 90 10 250
0 0
REGRESSION

Q. 13 What do you meant by Regression ? explain with example.

Q. 14 What is simple linear Regression or linear Regression?

Q. 15 What is multiple linear Regression?

OVERFITTING & CATALYSTS FOR OVERFITTING

Q. 16 What do you meant by overfitting ? prove and explain there are

different catalyst for the regression classification.

Q. 17 Explain underfit, over fit, just fit models for classification or

Regression model.

THEORY OF GENERALIZATION: EFFECTIVE NUMBER OF

HYPOTHESIS, BOUNDING THE GROWTH FUNCTION, VC-
DIMENSIONS
Q. 18 EXPLAIN significance of Generalization theory.

Q. 19 Justify effective number of Hypothesis is 2n.

Q. 20 Explain Bounding function.

Q. 21 Explain relation between.

(i) Hoeffding In equaling
(ii) Bounding function to decide number of Hypothesis.

Q. 22 Explain theory of generalization w.r.t.

1. Hoeffding inequality
2. Shattering of k paints.
3. VC-dimension
4. VC-inequality
REGULARIZATION THEORY

Q. 23 Justify Regularization theory is used to achieve

good generalization.

Q. 24 Explain
(i) Shrinkage Method
(ii) Ridge Regression
(iii) Lasso Regression

Q. 25 Explain effect of learning parameter λ on Regularization.

UNIT III MID SEM QUESTION BANK
MID SEM EXAM QUESTION BANK
UNIT – III LINEAR MODELS
(30 QUESTIONS ONLY)

LINEAR MODEL

Q. 1. Short note on linear models.

UNIVARIATE REGRESSION ( Simple Regression )

Q. 2. What do you meant by least square method ? Explain

least square method in the context of linear regression. Give derivation
of β0, β1.

Q. 3. Explain how to interpret equation of Regression Equation.

Q. 4. Consider following data. Where

Xi = Rating for movie "Bahubali - part 1" by the person.
Yi = Rating for movie "Bahubali - part 2" by the person.
where rating is to done on the scale of 1 to 5 and 1 is lowest rating and 5
is highest rating.
(a) Find values of B0 and B1 w.r.t. linear regression model which best
fits given data.
(b) Interpret and explain equation of regression line.
(c) If new person rates "Bahubali part - 1" as 3 then predict the rating
of same person for "Bahubali part - 2".
(d) Can we think that this problem is classification. Justify. If it is
regression problem then also justify.

Person Xi = Rating for Yi = Rating for

movie "Bahubali movie
- part 1" by "Bahubali -
i the person
th
part 2" by
i the person
th

1st 4 3
 2nd 2 4
3rd 3 2
4th 5 5
5th 1 3
6th 3 1
Person 3 ???
NEW

Q. 5. In the context of regression define and explain following terms (or

explain measures for performance evaluation of regression).
(1) SST
(2) SSR
(3) MSE
(4) SSR Sum of squares of errors due to regression
(5) SST= SSE + SSR

MULTIVARIATE REGRESSION

Q. 6. What is Multivariate regression?

Q.7. Explain difference between multivariate and univariate regression.

Q. 8. With respect to multivariate regression explain following terms

with examples
(i) Response vector
(ii) Prediction vector
(iii) Design matrix
(iv) Slope vector
(v) Error vector
Q. 9. Derive value of weight vector in Multivariate Regression

REGULARIZED REGRESSION

Q. 10. What do you mean by Regularized Regression ? What is need of

regularized regression ?

Q. 11. Explain ridge regression & lasso regression. What is difference

between them?
Q. 12. What do you mean by linearly separable data and non-linearly
separable data ?

PERCEPTRON

Q. 13 What is perceptron ? Explain now linearly separable data is

classified by perceptron in Binary classification ?

Q. 14. What is condition for error detection in perceptron learning ?

Q. 15. What is perceptron learning algorithm ?

Q. 16. What is difference between perceptron learning and dual

perceptron learning ?

Q. 17. Explain how perceptron learning algorithm for classification can

be modified as perceptron learning algorithm for regression.

SUPPORT VECTOR MACHINE

Q. 18. What do you meant by margin classifier ? What is need of margin

classifier.

Q. 19. What do you meant by support vectors and support vector

machine ?
Q. 20. Support vector machine is maximum margin classifier comment
and Justify correctness or incorrectness of the statement.

Q. 21. Explain Geometry of support vector machine.

Q. 22. Write and explain objective function and constraint in Dual

optimization problem in dual of SVM.

SOFT-MARGIN SVM

Q. 23. What do you meant by Hard margin and soft margin. Illustrate
difference between them.

Q. 24. Compare SVM and soft margin SVM.

Q. 25. What are advantages of dual optimization problem in SVM ?

Q. 26. What do you meant by slack variables in soft margin SVM ?

Explain its role in soft margin SVM.

Q. 27. Write and explain optimization problem for

(i) SVM
(ii) Soft margin SVM.

Q. 28. Explain properties and applications of SVM.

KERNEL METHODS FOR NON-LINEARITY

Q. 29. Explain role of kernel methods to handle linearly non-separable

data.

Q. 30. Explain procedure for obtaining class probabilities from linear

classification.