Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods...

16
Variational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes)

Transcript of Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods...

Page 1: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational

Variational Methods forLogistic Regression

(thanks to Tommi Jaakola for the original notes)

Page 2: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 3: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 4: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 5: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 6: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 7: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 8: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 9: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational

particular value of λ

Page 10: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 11: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 12: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational

where does this quadratic bound come from?

consider a Taylor expansion of a convex function f(z) around z0:

Page 13: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational

convex in x2

Page 14: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 15: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational
Page 16: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational