News & Events
Department Events & Announcements

Events

  • Apr
    13

    CS Seminar: Reinforcement Learning and Control with Generative World Models (Arindam Banerjee)

    Department of Computer Science (CS)

    12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

    EVENT DETAILS

    Monday / CS Seminar
    April 13 / 12:00 PM
    Hybrid / Mudd 3514

    Speaker
    Arindam Banerjee, University of Illinois Urbana-Champaign

    Talk Title
    Reinforcement Learning and Control with Generative World Models

    Abstract

    "Recent years have witnessed remarkable advances in generative modeling — from diffusion models and flow matching to autoregressive transformers and action-conditioned video models — that are rapidly closing the gap between learned simulators and the complexity of real-world dynamics. These developments open a principled path toward a new generation of reinforcement learning (RL) algorithms that harness the representational power of generative world models, naturally bridging model-based planning and model-free policy optimization within a unified framework.

    In this talk, we introduce an inference-time policy optimization framework inspired by model predictive control (MPC), built around a pretrained policy and a learned world model (WM) of state transitions and rewards. While existing approaches use learned dynamics to generate imagined trajectories — either during training or at inference — they stop short of using those trajectory rollouts to optimize policy parameters on the fly. Our approach addresses this gap through a Differentiable World Model (DWM) pipeline that enables end-to-end gradient computation through WM trajectory rollouts, yielding inference-time policy optimization (ITPO) grounded in MPC. Across continuous-control benchmarks, ITPO with DWM consistently outperforms strong offline RL baselines. Beyond the core RL framework, we also discuss principled approaches to fine-tuning generative models under distribution shift, which enable the online deployment of such world-model-based policies."

    Biography
    Arindam Banerjee is a Founder Professor at the Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign. He currently serves as the President of the Society for Artificial Intelligence and Statistics which runs the annual international AISTATS conference. He is an ACM Fellow. His research interests are in machine learning and artificial intelligence. His current research focuses on computational and statistical aspects of deep learning, spatial and temporal data analysis, generative models, and sequential decision making. His work also focuses on applications of machine learning in complex real-world and scientific domains including problems in weather and climate, ecology, and agriculture. He has won several awards over the years, including the NSF CAREER award, the IBM Faculty Award, and seven best paper awards at top-tier venues.

    Research Area/Interest:
    Machine Learning, Artificial Intelligence

    ---
    Zoom: TBA
    Panopto: TBA

    more less

    TIME Monday, April 13, 2026 at 12:00 PM - 1:00 PM

    LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

    ADD TO CALENDAR

    CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

    CALENDAR Department of Computer Science (CS)

  • Mar
    25

    IDEAL:LLMs and Strategic Agents for Machine Learning

    Department of Computer Science (CS)

    1:45 PM Hive 2350, Ford Motor Company Engineering Design Center

    EVENT DETAILS

    TIME Wednesday, March 25, 2026 at 1:45 PM - 6:30 PM

    LOCATION Hive 2350, Ford Motor Company Engineering Design Center    map it

    ADD TO CALENDAR

    CONTACT Indira Munoz    indira.munoz@northwestern.edu EMAIL

    CALENDAR Department of Computer Science (CS)

  • Apr
    2

    Seminar: Unlocking the Value of Private Data: Differentially Private Synthetic Data Generation (Tianhao Wang)

    Department of Computer Science (CS)

    12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

    EVENT DETAILS

    TIME Thursday, April 2, 2026 at 12:00 PM - 1:00 PM

    LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

    ADD TO CALENDAR

    CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

    CALENDAR Department of Computer Science (CS)

  • Apr
    6

    ME/CS/HCI Seminar- Faez Ahmed

    McCormick - Mechanical Engineering (ME)

    3:00 PM 1-350, Ford Motor Company Engineering Design Center

    EVENT DETAILS

    TIME Monday, April 6, 2026 at 3:00 PM - 4:00 PM

    LOCATION 1-350, Ford Motor Company Engineering Design Center    map it

    ADD TO CALENDAR

    CONTACT Jeremy Wells    jeremywells@northwestern.edu EMAIL

    CALENDAR McCormick - Mechanical Engineering (ME)

  • Apr
    22

    CS Seminar: On the Hardness of Learning Regular Expressions (Lev Reyzin)

    Department of Computer Science (CS)

    12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

    EVENT DETAILS

    TIME Wednesday, April 22, 2026 at 12:00 PM - 1:00 PM

    LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

    ADD TO CALENDAR

    CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

    CALENDAR Department of Computer Science (CS)

  • Apr
    27

    CS Seminar: Tushar Chandra

    Department of Computer Science (CS)

    12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

    EVENT DETAILS

    TIME Monday, April 27, 2026 at 12:00 PM - 1:00 PM

    LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

    ADD TO CALENDAR

    CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

    CALENDAR Department of Computer Science (CS)

  • Apr
    29

    CS Seminar: Bill Fefferman

    Department of Computer Science (CS)

    12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

    EVENT DETAILS

    TIME Wednesday, April 29, 2026 at 12:00 PM - 1:00 PM

    LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

    ADD TO CALENDAR

    CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

    CALENDAR Department of Computer Science (CS)

  • May
    4

    CS Seminar: Moon Duchin

    Department of Computer Science (CS)

    12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

    EVENT DETAILS

    TIME Monday, May 4, 2026 at 12:00 PM - 1:00 PM

    LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

    ADD TO CALENDAR

    CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

    CALENDAR Department of Computer Science (CS)