News & Events
Department Events

Events

  • Feb
    3

    Bradly Stadie: Making Sense of the Past with Graph Based Planning and Cold Diffusion

    Center for Robotics and Biosystems (CRB)

    12:00 PM Mechanical Engineering, B211, Technological Institute

    EVENT DETAILS

    Young man smiling. Bradly Stadie, Assistant Professor of Statistics from Northwestern University.

    Join the Center for Robotics and Biosystems (CRB) for the February Speaker Series

    Speaker: Bradly Stadie, Assistant Professor of Statistics, Northwestern University

    Date and Time: Friday, February 3 at 12:00 p.m. CT

    Location: Tech B211 and Zoom
    Zoom Link: https://tinyurl.com/CRBSeminar
    • NU-authenticated attendees will be automatically admitted. Others, please email amy.nedoss@northwestern.edu to be admitted from the waiting room.

    Abstract:
    How should we train reinforcement learning agents that are capable of abstract planning? One recent technique that has shown much promise is Search on the Replay Buffer. In this technique, agents treat a buffer of past experience as nodes on a graph and execute a graph search algorithm. The result of this search is a sequence of known good states that an agent can use to navigate its environment. There are two obvious shortcomings with this approach. 1) If we assume we can transition between every pair of states, then the complexity of the path planning problem is exponential in the size of the buffer. 2) Exploration over different possible paths remains a challenge, even if we prune the number of nodes.

    Towards overcoming these shortcomings, we introduce L3P, an algorithm for learning latent landmarks for planning. This algorithm learns landmarks in a latent space, where the distance between graph nodes is optimized to equal the number of steps it takes to transition between environmental states. We introduce a novel clustering algorithm that forces states that are close in this metric to cluster together, reducing our buffer to a few representative latent landmarks. Finally, we wrap up by considering cold diffusion approaches to solving this path planning problem. We show that sequence planning over a buffer can be recast as a diffusion model, and introduce the notion of Maximum Entropy Subgoal Skipping (MESS) to help with exploration.

    Bio:
    Bradly Stadie's research explores techniques for developing general machine intelligence. Recently, foundational models such as GPT-3 have provided a promising avenue towards training intelligent machines. In particular, these foundational models show that we can leverage large quantities of unsupervised data to learn a latent underlying structure of a data space. In this latent space, planning and abstract reasoning become much more tractable.

    In spite of its promise, there does not currently exist a GPT-3 equivalent in Reinforcement Learning. The current leading method, learning a dynamics model to predict the agent's next state, and then using this model to bootstrap a planning or curiosity module, has proven ineffective. Dr. Stadie’s current research proposes an enticing alternative: that goal-reaching should be used as the foundational model for reinforcement learning. The idea is as follows: they want agents to learn in an unsupervised fashion how to generate and reach various goal states in their environments. They can then bootstrap from this goal-reaching ability, breaking complex goals into a series of simpler tasks. This will endow agents with the ability to plan and reason over long time horizons, an essential capacity for the emergence of general intelligence. There exists a deep relationship between unsupervised goal-reaching and imitation learning, which frequently comes up in his research. From time to time, he also uses various tools from graph search, causal inference, and generative networks.

    more less

    TIME Friday, February 3, 2023 at 12:00 PM - 1:00 PM

    LOCATION Mechanical Engineering, B211, Technological Institute    map it

    ADD TO CALENDAR SHARE

    CONTACT Amy Nedoss    amy.nedoss@northwestern.edu EMAIL

    CALENDAR Center for Robotics and Biosystems (CRB)

  • Mar
    27

    Spring Break Ends

    University Academic Calendar

    All Day

    EVENT DETAILS

    TIME Monday, March 27, 2023

    ADD TO CALENDAR SHARE

    CONTACT Office of the Registrar    nu-registrar@northwestern.edu EMAIL

    CALENDAR University Academic Calendar

  • Mar
    28

    Spring Classes begin 8 a.m. (Northwestern Monday: Classes scheduled to meet on Mondays meet on this day)

    University Academic Calendar

    All Day

    EVENT DETAILS

    TIME Tuesday, March 28, 2023

    ADD TO CALENDAR SHARE

    CONTACT Office of the Registrar    nu-registrar@northwestern.edu EMAIL

    CALENDAR University Academic Calendar

  • Apr
    5

    Grand Challenges in Robotics: Industrial Dexterity: Rate, Range, and Reliability moderated by Ken Goldberg, UC Berkeley on April 5 at 12:00 PM CT

    Center for Robotics and Biosystems (CRB)

    12:00 PM

    EVENT DETAILSmore info

    TIME Wednesday, April 5, 2023 at 12:00 PM - 1:00 PM

    ADD TO CALENDAR SHARE

    CONTACT Amy Nedoss    amy.nedoss@northwestern.edu EMAIL

    CALENDAR Center for Robotics and Biosystems (CRB)

  • Apr
    7

    Carmel Majidi from Carnegie Mellon University: Soft-Matter Engineering for Robotics and Wearables on April 7

    Center for Robotics and Biosystems (CRB)

    12:00 PM ME B211, Technological Institute

    EVENT DETAILSmore info

    TIME Friday, April 7, 2023 at 12:00 PM - 1:00 PM

    LOCATION ME B211, Technological Institute    map it

    ADD TO CALENDAR SHARE

    CONTACT Amy Nedoss    amy.nedoss@northwestern.edu EMAIL

    CALENDAR Center for Robotics and Biosystems (CRB)

  • Apr
    21

    How ChatGPT and Generative AI Will Change Legal Services

    McCormick School of Engineering and Applied Science

    9:00 AM Levy Mayer Hall

    EVENT DETAILSmore info

    TIME Friday, April 21, 2023 at 9:00 AM - 5:30 PM

    LOCATION Levy Mayer Hall    map it

    ADD TO CALENDAR SHARE

    CONTACT Daniel W. Linna Jr.    daniel.linna@law.northwestern.edu EMAIL

    CALENDAR McCormick School of Engineering and Applied Science

  • May
    29

    No classes - Memorial Day

    University Academic Calendar

    All Day

    EVENT DETAILS

    TIME Monday, May 29, 2023

    ADD TO CALENDAR SHARE

    CONTACT Office of the Registrar    nu-registrar@northwestern.edu EMAIL

    CALENDAR University Academic Calendar

  • Jun
    3

    Spring classes end

    University Academic Calendar

    All Day

    EVENT DETAILS

    TIME Saturday, June 3, 2023

    ADD TO CALENDAR SHARE

    CONTACT Office of the Registrar    nu-registrar@northwestern.edu EMAIL

    CALENDAR University Academic Calendar