Convex Optimization

Schedule

Day Title / Notes Reading Homework
Tue 8/25 Introduction B&V Ch 1  
Thu 8/27 Math Review: SVD, norms, etc. B&V Appendix A  
Tue 9/1 Convex Sets B&V Ch 2  
Thu 9/3 Convex Sets    
Tue 9/8 Convex Functions B&V Ch 3  
Thu 9/10 Convex Functions    
Tue 9/15 Convex Optimization Problems B&V Ch 4  
Thu 9/17 Convex Optimization Problems    
Tue 9/22 Duality B&V Ch 5  
Thu 9/24 Duality    
Tue 9/29 Duality
Prof out of town - recorded lecture
   
Thu 10/1 Approximation and Fitting
Prof out of town - recorded lecture
B&V Ch 6  
Tue 10/6 No Class – Reading Day    
Thu 10/8 Statistical Estimation B&V Ch 7  
Tue 10/13 Statistical Estimation    
Thu 10/15 Geometric Problems B&V Ch 8  
Tue 10/20 Geometric Problems    
Thu 10/22 Numerical Linear Algebra and Complexity    
Tue 10/27 Unconstrained Minimization B&V Ch 9  
Thu 10/29 Unconstrained Minimization    
Tue 11/3 No Class – Election Day    
Thu 11/5 Equality Constrained Minimization B&V Ch 10  
Tue 11/10 Interior Point Methods B&V Ch 11  
Thu 11/12 Interior Point Methods    
Tue 11/17 Conjugate Gradient Method    
Thu 11/19 Accelerated Gradient Method    
Tue 11/24 TBA / catch-up day    
Thu 11/26 No Class – Thanksgiving Break    
Tue 12/1 Stochastic Gradient Descent    
Thu 12/3 Natural Gradient Descent    
Tue 12/8 RMSprop and Adam    
Fri 12/11 Final Exam: 2:00 - 5:00, Olsson 001