Upcoming Events

 

ISE Seminar Series Fall 2020

Title: Exploiting Second Order Sparsity in Big Data Optimization

Speaker: Kim-Chuan Toh, National University of Singapore (NUS)

Time: Tuesday, October 27, 11:00 AM to 12:00 PM

Join Zoom Meeting: https://lehigh.zoom.us/s/99527921266

 

Abstract:

In this talk, we shall demonstrate how second order sparsity (SOS) in important optimization problems such as sparse optimization models in machine learning, semidefinite programming, and many others can be exploited to design highly efficient algorithms. 

The SOS property appears naturally when one applies a semismooth Newton (SSN) method to solve the subproblems in an augmented Lagrangian method (ALM) designed for certain classes of structured convex optimization problems. With in-depth analysis of the underlying generalized Jacobians and sophisticated numerical implementation, one can solve the subproblems at surprisingly low costs. For lasso problems with sparse solutions, the cost of solving a single ALM subproblem by our second order method is comparable or even lower than that in a single iteration of many first order methods.

Consequently, with the fast convergence of the SSN based ALM, we are able to solve many challenging large scale convex optimization problems in big data applications efficiently and robustly.

This talk is based on joint work with Xudong Li (Fudan U.) and Defeng Sun (PolyU).

Bio:

Dr Toh is a Professor in the Department of Mathematics at the National University of Singapore (NUS). He obtained his BSc degree in Mathematics from NUS and PhD degree in Applied Mathematics from Cornell University.

He works extensively on convex programming, particularly large-scale matrix optimization problems such as semidefinite programming, and structured convex problems arising from machine learning and statistics.

He is currently an Area Editor for Mathematical Programming Computation, an Associate Editor for SIAM Journal on Optimization, Mathematical Programming, and ACM Transactions on Mathematical Software. He received the 2017 Farkas Prize and the 2018 triennial Beale-Orchard Hays Prize. He is also a Fellow of the Society for Industrial and Applied Mathematics.

 

 

 


Past Events

Fall 2020
 
Tuesday, October 20, 2020 11:00am
ISE Seminar Series - Albert Del Pia, University of Wisconsin-Madison
Short Simplex Paths in Lattice Polytopes
 
Tuesday, October 13, 2020 11:00am
ISE Seminar Series - Coralia Cartis, Oxford University
Dimensionality Reduction Techniques for Large-Scale Optimization Problems
 
Tuesday, October 6, 2020 11:00am
ISE Seminar Series - Miles Lubin, Google NYC
"Placement, Provisioning, Packaging"
 
Tuesday September 29, 2020 11:00am
ISE Seminar Series - Juan C. Vera, Tilburg University
"The Simplex Way to Obtain Non-Negative Certificates Over Compact Semialgebraic Sets"
 
Tuesday September 8, 2020 11:00am
ISE Seminar Series - Jeff Zhang, Carnegie Mellon University
"On Local Minima in Polynomial Optimization"
 
Spring 2020
 
Tuesday February 18, 2020 11:00am
ISE Seminar Series - Andrew Papanicolaou, New York University
"PCA for Implied Volatility Surfaces"
 
Tuesday January 30, 2020 4:30pm
ISE Seminar Series - Elaheh Fata, Massachusetts Institute of Technology
"Multi-stage and Multi-customer Assortment Optimization with Inventory Constraints"
 
Thursday January 16, 2020 10:45am
ISE Seminar Series - Aida Khajavirad, Rutgers School of Business
"Convexification and Global Optimization of Mixed Integer Nonlinear Optimization Problems"
Fall 2019
 
Wednesday December 11, 2019 4:30pm
ISE Seminar Series - Temitayo Ajayi , Rice University
"Objective Selection for Cancer Treatment: An Inverse Optimization Approach"
 
Monday December 9, 2019 10:45am
ISE Seminar Series - Karmel S. Shehadeh, Carnegie Mellon University
"A Distributionally Robust Optimization Approach for Outpatient Colonoscopy Scheduling"
 
Tuesday December 3, 2019 4:30pm
ISE Seminar Series - Lavanya Marla, University of Illinois at Urbana-Champaign
"Data-driven Greedy Policies and Information-Relaxation Bounds for Ambulance Location and Deployment"
 
Tuesday, November 12, 2019 - 4:30pm
ISE Seminar Series - Kayse Maass, Northeastern University
"A Systems Approach to Disrupting Human Trafficking"
 
Tuesday, November 5, 2019 - 4:30pm
INFORMS Chapter Distinguished Speaker Series - Robert Vanderbei, Princeton University
"The Parametric Self-Dual Simplex Method — A Modern Perspective"
 
Tuesday, October 8, 2019 - 4:30pm
ISE Seminar Series - Miju Ahn, Southern Methodist University
"Learning with Difference-of-Convex Sparsity Functions"
 
Tuesday, September 17, 2019 - 4:30pm
ISE Seminar Series - Ramteen Sioshansi, The Ohio State University
"Can We Get Market and Regulatory Designs ‘Right’ for Energy Storage?"
 
Tuesday, September 10, 2019 - 4:30pm
ISE Seminar Series - Adam Elmachtoub, Columbia University
"Smart "Predict, then Optimize""
 
Spring 2019
 
Tuesday, May 7, 2019 - 4:00pm
ISE Seminar Series - Alec Koppel, U.S. Army Research Laboratory
"Policy Search for Reinforcement Learning in Continuous Spaces: Improved Limits and Reduced Variance"
 
Tuesday, April 9, 2019 - 4:00pm
ISE Seminar Series - Aida Khajavirad (Rutgers & NYU)
"Novel Polyhedral Relaxations for Mixed-Integer Polynomial Optimization Problems"
 
Tuesday, April 2, 2018 - 4:00pm
INFORMS Chapter Distinguished Speaker Series - Stefan Wild, Argonne National Laboratory
"Exploiting Structure in Derivative-Free Nonlinear Optimization to Advance Science and Engineering"
 
Tuesday, March 26, 2019 - 4:00pm
ISE Seminar Series - Clément Royer, University of Wisconsin-Madison
"Nonconvex Optimization via Newton-CG Methods with Complexity Guarantees"
 
Tuesday, March 19, 2019 - 4:00pm
ISE Seminar Series - William K. Klimack, Chevron
"Decision Analysis at Chevron"
 
Tuesday, March 5, 2019 - 4:00pm
ISE Seminar Series - James Luedtke, University of Wisconsin-Madison
"Optimizing Truck Dispatching Decisions in Open-pit Mining using Integer Programming"
 
Tuesday, February 12, 2019 - 4:00pm
ISE Seminar Series - J. Cole Smith, Clemson University
"The Maximum Semicontinuous Flow Problem"
 
Tuesday, January 29, 2019 - 4:00pm
ISE Seminar Series - Giacomo Nannicini, IBM T.J. Watson Research Center
"Fully Polynomial-Time Approximation Schemes for Stochastic Dynamic Programs: Theory and Applications"
 
Fall 2018
 
Tuesday, December 4, 2018 - 4:00pm
ISE Seminar Series - Andreas Wächter, Northwestern University
"Nonlinear Programming Formulations of Chance-Constraints"
 
Tuesday, November 27, 2018 - 4:00pm
INFORMS Chapter Distinguished Speaker Series - Gerard Cornuejols, Carnegie Mellon University
"Packing and Covering"
 
Tuesday, November 13, 2018 - 4:00pm
ISE Seminar Series - Mert Gürbüzbalaban, Rutgers University
"Momentum Acceleration Under Random Gradient Noise: From Convex to Non-Convex Optimization"
 
Tuesday, October 30, 2018 - 4:00pm
ISE Seminar Series - Michael Katehakis, Rutgers University
"Reinforcement Learning: Connections Between MDPs and MAB Problems"
 
Tuesday, October 2, 2018 - 4:00pm
ISE Seminar Series - Michael L. Overton, Courant Institute of Mathematical Sciences, NYU
"Nonsmooth, Nonconvex Optimization: Algorithms and Examples"
 
Spring 2018
 
Tuesday, May 8, 2018 - 4:00pm
ISE Seminar Series - Krzysztof Choromanski, Google
"Structure is all that you need - Learning Compressed RL Policies Via Orthogonal Gradient Sensing"
 
Tuesday, May 1, 2018 - 4:00pm
ISE Seminar Series - Henry Lam, Columbia University
"Assessing Solution Quality in Stochastic Optimization with Limited Data"
 
Tuesday, April 24, 2018 - 4:00pm
INFORMS Chapter Distinguished Speaker Series - James Renegar, Cornell University
"A Simple Nearly-Optimal Restart Scheme for Speeding-Up First Order Methods"
 
Thursday, April 19, 2018 - 4:00pm
ISE Seminar Series - Matthias Walter, RWTH Aachen University
"Investigating Polyhedra by Oracles"
 
Tuesday, April 10, 2018 - 4:00pm
ISE Seminar Series - Stefano Coniglio, University of Southampton
"Network Routing Through the Internet as a Stackelberg Game"
 
Tuesday, March 6, 2018 - 4:00pm
ISE Seminar Series - Bo Zeng, University of Pittsburgh
"Robust and Chance Constrained Optimization in Power and Logistics Systems"
 
Fall 2017
 
Tuesday, December 5, 2017 - 4:00pm
ISE Seminar Series - Garud Iyengar, Columbia University
"Automatic Event Detection in Basketball"
 
Thursday, November 30, 2017 - 4:00pm
Spencer C. Schantz Technical Lecture - William J. Cook, University of Waterloo
"Guiding the Cutting-Plane Method"
 
Wednesday, November 29, 2017 - 4:00pm
Spencer C. Schantz Distinguished Lecture Series Presents William J. Cook
"In Pursuit of the Traveling Salesman: Mathematics at the Limits of Computation"
 
Tuesday, November 14, 2017 - 4:00pm
ISE Seminar Series - Jonathan Eckstein, Rutgers University
"Asynchronous Projective Splitting for Convex Optimization and Monotone Inclusion Problems"
 
Tuesday, November 7, 2017 - 4:00pm
ISE Seminar Series - Osman Y. Ozaltin, North Carolina State University
"A Branch-and-cut Algorithm for Discrete Bilevel Linear Programs"
 
Tuesday, October 31, 2017 - 4:00pm
ISE Seminar Series - Oleg Prokopyev, University of Pittsburgh
"Sequential Max-Min Bilevel Linear Programming with Incomplete Information and Learning"
 
Tuesday, October 10, 2017 - 4:00pm
ISE Seminar Series - Ion Necoara, University Politehnica of Bucharest
"Conditions for Linear Convergence of (Stochastic) First Order Methods"
 
Thursday, October 5, 2017 - 4:00pm
INFORMS Chapter Distinguished Speaker Series: Nick Trefethen, University of Oxford
 
Tuesday, September 26, 2017 - 4:00pm
ISE Seminar Series - Andrew Dorsett, Wolfram Research
"Mathematica 11 in Education and Research"
 
Tuesday, September 19, 2017 - 4:00pm
ISE Seminar Series - Alejandro Ribeiro, University of Pennsylvania
"High Order Methods in Empirical Risk Minimization"
 
Tuesday, August 22, 2017 - 4:00pm
ISE Seminar Series - Giorgio Fasano, Thales Alenia Space
"Solving Non-Standard Packing Problems by Global Optimization and Heuristics"