Learning From Data – A Short Course: Exercise 8.9
Let be optimal for (8.10), and let be optimal for (8.11). (a) Show that . If is the optimal of (8.10) then it must satisfy the constraint , hence . If then it doesn’t matter what is, . If then we can always choose , so . (b) Show that is feasible for (8.10). To show this, [...]