Skip to content
Nguyen Thuy Vy

My personal site.

  • Home
  • About
  • Bookmark

Category

60 Entries in: Machine Learning

Learning From Data – A Short Course: Exercise 3.12

Vy NguyenMarch 18, 2016
Machine Learning
no comment
Page 103: We know that in the Euclidean plane, the perceptron model cannot implement all 16 dichotomies on 4 points. That is . Take the feature transform in (3.12). (a) Show that . We have proved (in Exercise 2.4) that the hypothesis set of perceptron model in Euclidean plane has , and by the definition of [...]
Read More

Learning From Data – A Short Course: Exercise 3.10

Vy NguyenMarch 16, 2016
Machine Learning
no comment
Page 98: (a) Define an error for a single data point to be     Argue that PLA can be viewed as SGD on with learning rate . when   means that agrees with (no error at that point): . when  and  disagrees (that point is misclassified): . Hence: When there is no error at the [...]
Read More

Learning From Data – A Short Course: Exercise 3.8

Vy NguyenMarch 15, 2016
Machine Learning
no comment
Page 94: The claim that is the direction which gives largest decrease in only holds for small . Why? is small and ignorable only when is small. P/s: I’m bored. That’s why I’m posting separate post.

Learning From Data – A Short Course: Exercise 3.4

Vy NguyenMarch 7, 2016
Machine Learning
no comment
Page 87: Consider a noisy target for generating the data, where is a noise term with zero mean and variance, independently generated for every example . The expected error of the best possible linear fit to this target is thus . For the data , denote the noise in as and let , assume that [...]
Read More

Learning From Data – A Short Course: Exercise 3.3

Vy NguyenMarch 1, 2016
Machine Learning
no comment
Page 87, Exercise 3.3: Consider the hat matrix , where   is an by matrix, and is invertible. (a) Show that is symmetric. (b) Show that for any positive integer . (c) If is the identity matrix of size , show that for any positive integer . (d) Show that , where the trace is [...]
Read More

Learning From Data – A Short Course: Exercise 1.10

Vy NguyenFebruary 9, 2016
Machine Learning
no comment
Page 23, Exercise 1.10 Here is an experiment that illustrates the difference between a single bin and multiple bins. Run a computer simulation for flipping 1,000 fair coins. Flip each coin independently 10 times. Let’s focus on 3 coins as follows: is the first coin flipped; is a coin you choose at random ; is [...]
Read More

Learning From Data – A Short Course: Exercise 1.9

Vy NguyenFebruary 9, 2016
Machine Learning
no comment
Page 19, Exercise 1.9. If , use the Hoeffding Inequality to bound the probability that a sample fo 10 marbles will have and compare the answer to the previous exercise.     means any number slightly less than (reference). Hence:     If so:     We observe that:     is true.

Learning From Data – A Short Course: Exercise 1.8

Vy NguyenFebruary 9, 2016
Machine Learning
1 comment
Page 19, Exercise 1.8. If , what is the probability that a sample of 10 marbles will have ?     Here we have N = 10 (a sample of 10 marbles):         Hence:      

Learning From Data – A Short Course: Problem 2.5

Vy NguyenFebruary 6, 2016
Machine Learning
1 comment
Page 69, Problem 2.5. Prove by induction that , hence     Base cases: Induction step for :     We will prove later, for now, we will use its result:     :     :     So  follows. Prove by induction:     Base case: Induction step for :       [...]
Read More

[Book Note] Learning From Data – A Short Course

Vy NguyenFebruary 4, 2016
Machine Learning, Short Notes
1 comment
This book should be read along with watching its corresponding online course. However, you should not watch the online course alone. The Bin Model PAGE NOTE Page 19: Reference: Malik Magdon-Ismail. Page 31: y here is a random variable. Reference: Malik Magdon-Ismail, The Elements of Statistical Learning page 28. Page 32: “we will assume the target to be a [...]
Read More

Posts navigation

1 … 5 6
Categories
  • Programming
    • Snippet
  • Study
    • Calculus
    • Linear Algebra
    • Machine Learning
    • Probability & Statistics
    • Short Notes
    • Todai Entrance Exam
  • Uncategorized
Recent Comments
  • Vy Nguyen on Cambridge IELTS 10, Test 1, Academic Writing Task 2
  • Vy Nguyen on Learning From Data – A Short Course: Exercise 5.1
  • Eugen Hotaj on Learning From Data – A Short Course: Exercise 5.1
  • Muzaffarjon on Cambridge IELTS 10, Test 1, Academic Writing Task 2
  • Hughie on [Prolog] The Three Jealous Men and Their Wives
© Nguyen Thuy Vy 2021. Windflaw designed by Loft.Ocean.