●

𝑥 ℃

2
●

𝑥 ℃

●
○ ℎ1 𝑥 = 𝑤1 𝑥 + 𝑤0
○ ℎ2 𝑥 = 𝑤5′ 𝑥 5 + 𝑤4′ 𝑥 4 + ⋯ + 𝑤1′ 𝑥 + 𝑤0

3
4
ℒ𝐸 ℎ1 = 18517

5
 Which model is better?

ℒ𝐸 ℎ1 = 18517
ℒ𝐸 ℎ2 = 988

6
 Which model is better?

ℒ𝐸 ℎ1 = 18517
• ℎ2
𝓛𝑬 𝒉𝟐 = 𝟗𝟖𝟖

7
 Which model is better?

𝓛𝑬𝟐 𝒉𝟏 = 𝟒𝟗𝟔𝟏𝟔
• ℎ2
ℒ𝐸2 ℎ2 = 657305

• But when we evaluate on

other points, ℎ1 performs
much better.

8
 Which model is better?

𝓛𝑬𝟐 𝒉𝟏 = 𝟒𝟗𝟔𝟏𝟔
• ℎ2
ℒ𝐸2 ℎ2 = 657305

• But when we evaluate on

other points, ℎ1 performs
much better.

9
10
●

11
●

●
○
○

12
●

●
○
○
●

13
14
15
16
17
ℒ𝐸2 ℎ1 = 14067
ℒ𝐸2 ℎ2 = 92274

18
ℎ1

𝓛𝑬𝟐 𝒉𝟏 = 𝟏𝟒𝟎𝟔𝟕
ℒ𝐸2 ℎ2 = 92274

19
●

○ 𝜆

20
●

○ 𝜆

21
22
23
●
○

24
●
○

●
○
○

25
●
○

●
○
○

26
27
28
29
30
31
32
33
●
○

●
●

34
35
●

36
●

37
●

21
Accuracy = = 0.75 = 75%
28

38
●

○
○

39
●

○
○

○
○

40
●
○
■

○
■
■

○
■
■

41
●

○
○

42
●

○
○

𝟑
Precision = = 0.6 = 60%
𝟓

43
●

○
○

3
Precision = = 0.6 = 60%
5
𝟑
Recall = = 0.375 = 37.5%
𝟖

44
●

○
○

3
Precision = = 0.6 = 60%
5
3
Recall = = 0.375 = 37.5%
8
○
45
 𝑇𝑃 + 𝑇𝑁
Accuracy =
𝑇𝑃 + 𝐹𝑃 + 𝐹𝑁 + 𝑇𝑁
𝑇𝑃
Precision =
𝑇𝑃 + 𝐹𝑃
𝑇𝑃
Recall =
𝑇𝑃 + 𝐹𝑁
2 2(Precision ∗ Recall)
𝐹1 = =
1 1 Precision + Recall
+
Precision Recall

46
47