News & EventsDepartment Events
Events
-
Apr23
EVENT DETAILS
lessAbstract: Policy simulation — i.e. producing a single state trajectory of a dynamical system controlled by some state dependent policy — is often the core computational bottleneck in modern Reinforcement Learning algorithms. The multiple, inherently serial, policy evaluations that must be performed in one such simulation constitute the bulk of this bottleneck. As a concrete example, simulating a fulfillment optimization policy on a month's worth of demand at a moderately large retailer is a task that can take several hours.
We present a class of iterative algorithms we dub Picard Iteration. Our scheme carefully allocates policy evaluation tasks across independent (GPU) threads. Within each iteration a single thread only evaluates the policy on its assigned tasks while assuming a certain ‘cached’ evaluation for other tasks. This cache is updated at the end of the iteration. A single iteration is ideally suited for the type of parallelism offered by a GPU (essentially the batched application of a neural network) yielding 1000x+ speedups. Unfortunately, for general problems the number of iterations required for convergence will scale with the horizon of the simulation.
We prove and demonstrate empirically, that the structure afforded by inventory management problems allows Picard iteration to converge in a small number of iterations independent of the horizon. As one practical consequence, we demonstrate a 500x speedup in policy simulation for large-scale fulfillment optimization problems. Our scheme offers a blueprint for similar speedups in related policy simulation and sequential inference tasks.
Joint work with Joren Gijsbrechts, Aryan Khojandi, Tianyi Peng and Andy Zheng.
Bio: Vivek is interested in the development of new methodologies and applications for large scale dynamic optimization. He received his Ph.D. in Electrical Engineering from Stanford University in 2007 and is the Patrick J. McGovern (1959) Professor at MIT. Vivek is a recipient of an INFORMS MSOM Student Paper Prize (2006), an INFORMS JFIG paper prize (2009, 2011), the NSF CAREER award (2011), MIT Sloan’s Outstanding Teacher award (2013), the INFORMS Simulation Society Best Publication Award (2014), the INFORMS Pricing and Revenue Management Best Publication Award (2015), the INFORMS MSOM Best Publication award in Management Science (2016), the MSOM Young Scholar Prize and the MIT-wide Jamieson Prize for Excellence in Teaching (2020). His practice based work has won the Wagner prize (2022) and has been judged a finalist for the Pierskalla Award (2011), the Gary L. Lilien ISMS-MSI Marketing Practice Prize (2016) and the Wagner Prize (2018). Vivek’s doctoral advisees have on various occasions won the Nicholson, MSOM, APS and RMP student paper prizes. Outside of academia, Vivek was co-founder/CTO at Celect (2014-19; acquired by Nike) and was a corresponding author of the Nature Communications paper underlying the technology at Seer (IPO in 2020). He serves on several technology startup advisory boards and has worked in various capacities in quantitive finance and private equity.
TIME Tuesday, April 23, 2024 at 11:00 AM - 12:00 PM
LOCATION ITW 1.350, Ford Motor Company Engineering Design Center map it
CONTACT Kendall Minta kendall.minta@gmail.com EMAIL
CALENDAR Department of Industrial Engineering and Management Sciences (IEMS)
-
May8
EVENT DETAILSmore info
lessThe Center for Scientific Studies in the Arts is a collaboration between the Art Institute of Chicago and materials science-related departments at Northwestern University to pursue objects-based and objects-inspired scientific research. Materials research benefits ongoing work in conservation, archaeology, art history, and curatorial scholarship.
Learn how the Center uses materials research to care for art objects in sustainable, innovative ways with Maria Kokkori, Senior Scientist in the Center for Scientific Studies in the Arts. She will be in conversation with Corey Byrnes, Northwestern Associate Professor of Chinese Culture and co-founder/co-director of the Environmental Humanities Workshop in Kaplan Humanities Center.
This event is presented by the McCormick School of Engineering and Applied Science in conjunction with exhibition Actions for the Earth: Art, Care & Ecology.
TIME Wednesday, May 8, 2024 at 6:00 PM - 7:30 PM
LOCATION Block Museum of Art, Mary and Leigh map it
CONTACT Block Museum of Art block-museum@northwestern.edu EMAIL
CALENDAR Block Museum of Art
-
Jun10
EVENT DETAILSmore info
lessMcCormick School of Engineering PhD Hooding and Master’s Degree Recognition Ceremony
TIME Monday, June 10, 2024 at 9:00 AM - 11:00 AM
LOCATION Welsh-Ryan Arena
CONTACT Amy Pokrass amy.pokrass@northwestern.edu EMAIL
CALENDAR McCormick School of Engineering and Applied Science
-
Jun10
TIME Monday, June 10, 2024 at 2:00 PM - 4:00 PM
LOCATION Welsh-Ryan Arena
CONTACT Amy Pokrass amy.pokrass@northwestern.edu EMAIL
CALENDAR McCormick School of Engineering and Applied Science