News & Events

Department Events & Announcements

Events

• Feb

  13

  CS Seminar: Reading to Learn: Improving Generalization by Learning From Language (Victor Zhong)

  Department of Computer Science (CS)

  12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

  EVENT DETAILS

  Wednesday / CS Seminar
  February 13th / 12:00 PM
  Mudd 3514

  Title: Reading to Learn: Improving Generalization by Learning From Language
  Speaker: Victor Zhong

  Abstract:
  Traditional machine learning systems are trained on vast quantities of annotated data or experience. These systems often do not generalize to new, related problems that emerge after training, such as conversing about new topics or interacting with new environments. In this talk, I present Reading to Learn, a new class of algorithms that improve generalization by learning to read language specifications, without requiring any actual experience or labeled examples. This includes, for example, reading FAQ documents to learn to answer questions about new topics and reading manuals to learn to play new games. I will discuss new algorithms and data for Reading to Learn applied to a broad range of tasks, including policy learning in grounded environments and data synthesis for code generation, while also highlighting open challenges for this line of work. Ultimately, the goal of Reading to Learn is to democratize AI by making it accessible for low-resource problems where the practitioner cannot obtain annotated data at scale, but can instead write language specifications that models read to generalize.

  Biography:
  Victor Zhong is a PhD student at the University of Washington Natural Language Processing group. His research is at the intersection of natural language processing and machine learning, with an emphasis on how to use language understanding to learn more generally and more efficiently. His research covers a range of topics, including dialogue, code generation, question answering, and grounded reinforcement learning. Victor has been awarded the Apple AI/ML Fellowship as well as an EMNLP Outstanding Paper award. His work has been featured in Wired, MIT Technology Review, TechCrunch, VentureBeat, Fast Company, and Quanta Magazine. He was a founding member of Salesforce Research, and has previously worked at Meta AI Research and Google Brain. He obtained a Masters in Computer Science from Stanford University and a Bachelor of Applied Science in Computer Engineering from the University of Toronto.

  more less

  TIME Monday, February 13, 2023 at 12:00 PM - 1:00 PM

  LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

  ADD TO CALENDAR

  CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

  CALENDAR Department of Computer Science (CS)

• Apr

  19

  CS Seminar: Hardware-Aware Efficient Primitives for Machine Learning (Dan Fu)

  Department of Computer Science (CS)

  12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

  EVENT DETAILS

  

  Friday / CS Seminar
  April 19th / 12:00 PM
  In Person / Mudd 3514

  Speaker
  Dan Fu, Stanford University

  Talk Title
  Hardware-Aware Efficient Primitives for Machine Learning

  Abstract
  Efficiency is increasingly tied to quality to machine learning, with more efficient training algorithms leading to more powerful models. However, today's most popular machine learning models are built on asymptotically inefficient primitives. For example, attention in Transformers scales quadratically in the input size, while MLPs scale quadratically in model dimension. In this talk, I discuss my work on improving the efficiency of the core primitives in machine learning, with an emphasis on hardware-aware algorithms and long-context applications. First, I focus on replacing attention with gated state space models (SSMs) and convolutions, which scale sub-quadratically in context length. I describe the H3 (Hungry Hungry Hippos) architecture, a gated SSM architecture that matches Transformers in quality up to 3B parameters and achieves 2.4x faster inference. Second, I focus on developing hardware-aware algorithms for SSMs and convolutions. I describe FlashFFTConv, a fast algorithm for computing SSMs and convolutions on GPU by optimizing the Fast Fourier Transform (FFT). FlashFFTConv yields up to 7x speedup and 5x memory savings, even over vendor solutions from Nvidia. Third, I will briefly touch on how these same techniques can also be used to develop sub-quadratic scaling in the model dimension. I will describe Monarch Mixer, which uses a generalization of the FFT to achieve sub-quadratic scaling in both sequence length and model dimension. Throughout the talk, I will give examples of how these ideas are beginning to take hold, with gated SSMs and their variants now leading to state-of-the-art performance in long-context language models, embedding models, and DNA foundation models.

  Biography
  Dan Fu is a PhD student in the Computer Science Department at Stanford University, where he is co-advised by Christopher Ré and Kayvon Fatahalian. His research interests are at the intersection of systems and machine learning. Recently, he has focused on developing algorithms and architectures to make machine learning more efficient, especially for enabling longer-context applications. His research has appeared as oral and spotlight presentations at NeurIPS, ICML, and ICLR, and he has received the best student paper runner up at UAI. Dan has also been supported by an NDSEG fellowship.

  Research Area/Interests
  machine learning, systems

  more less

  TIME Friday, April 19, 2024 at 12:00 PM - 1:00 PM

  LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

  ADD TO CALENDAR

  CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

  CALENDAR Department of Computer Science (CS)

• Apr

  24

  CS Seminar: AI Powered Movement Analysis, Big Rehabilitation Data and a Path to Precision Rehabilitation (R. James Cotton)

  Department of Computer Science (CS)

  12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

  EVENT DETAILS

  

  Wednesday / CS Seminar
  April 24th / 12:00 PM
  In Person / Mudd 3514

  Speaker
  R. James Cotton, Northwestern University & Shirley Ryan AbilityLab

  Talk Title
  AI Powered Movement Analysis, Big Rehabilitation Data and a Path to Precision Rehabilitation

  Abstract
  This talk will discuss multiple methodological lines of work making movement and gait analysis more clinically accessible and biomechanically grounded. This includes reconstruction from synchronized multiview videos, smartphone videos, and wearable sensors. We will also discuss how implicit functions provide a powerful representation to map from time to joint angles, and GPU accelerated methods that enable end-to-end biomechanical fits from these different modalities. It will discuss some of the opportunities that large movement data enables, including the use of self-supervised learning to discover gait representations that can function as both diagnostic and response biomarkers. Finally, we will outline a vision for a Causal Framework for Precision Rehabilitation that can model this data to link from impairment to function and identify the optimal dynamic treatment policies to improve rehabilitation outcomes.

  Biography
  I am an electrical engineer, neuroscientist, and physiatrist working as a physician-scientist at Shirley Ryan AbilityLab and Assistant Professor in the Northwestern University Department of Physical Medicine and Rehabilitation. I completed my residency in PM&R at Shirley Ryan AbilityLab (formers Rehabilitation Institute of Chicago) where I remained as faculty. Prior to that I obtained a B.S. in Electrical Engineering from Rice University followed by an MD and PhD in systems neuroscience from Baylor College of Medicine. My lab works at the intersection of artificial intelligence, wearable sensors, computer vision, causal and biomechanical modeling, and novel technologies to more precisely monitor and improve rehabilitation outcomes.

  Research Area/Interests
  AI, computer vision, gait analysis, wearable sensors, rehabilitation

  more less

  TIME Wednesday, April 24, 2024 at 12:00 PM - 1:00 PM

  LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

  ADD TO CALENDAR

  CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

  CALENDAR Department of Computer Science (CS)

• Apr

  25

  TGI Bagel Thursday

  Department of Computer Science (CS)

  9:00 AM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

  EVENT DETAILS

  Spring is finally here. Enjoy the good vibes to come with some free bagels and coffee courtesy the Computer Science Department. Mix and mingle with fellow CS students and faculty every last Thursday of the month.

  more less

  TIME Thursday, April 25, 2024 at 9:00 AM - 11:00 AM

  LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

  ADD TO CALENDAR

  CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

  CALENDAR Department of Computer Science (CS)

• Apr

  29

  CS Seminar: Kaize Ding

  Department of Computer Science (CS)

  12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

  EVENT DETAILS

  TBA

  more less

  TIME Monday, April 29, 2024 at 12:00 PM - 1:00 PM

  LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

  ADD TO CALENDAR

  CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

  CALENDAR Department of Computer Science (CS)

• May

  1

  CS Seminar: Tong Zhang

  Department of Computer Science (CS)

  12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

  EVENT DETAILS

  TBA

  more less

  TIME Wednesday, May 1, 2024 at 12:00 PM - 1:00 PM

  LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

  ADD TO CALENDAR

  CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

  CALENDAR Department of Computer Science (CS)

• May

  3

  CS Seminar: Shafi Goldwasser

  Department of Computer Science (CS)

  12:00 PM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

  EVENT DETAILS

  TBA

  more less

  TIME Friday, May 3, 2024 at 12:00 PM - 1:00 PM

  LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

  ADD TO CALENDAR

  CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

  CALENDAR Department of Computer Science (CS)

• May

  30

  TGI Bagel Thursday

  Department of Computer Science (CS)

  9:00 AM 3514, Mudd Hall ( formerly Seeley G. Mudd Library)

  EVENT DETAILS

  TBA

  more less

  TIME Thursday, May 30, 2024 at 9:00 AM - 11:00 AM

  LOCATION 3514, Mudd Hall ( formerly Seeley G. Mudd Library)    map it

  ADD TO CALENDAR

  CONTACT Wynante R Charles    wynante.charles@northwestern.edu EMAIL

  CALENDAR Department of Computer Science (CS)

• Jun

  10

  Northwestern Engineering PhD Hooding and Master's Degree Recognition Ceremony

  McCormick School of Engineering and Applied Science

  9:00 AM Welsh-Ryan Arena

  EVENT DETAILSmore info

  McCormick School of Engineering PhD Hooding and Master’s Degree Recognition Ceremony

  more less

  TIME Monday, June 10, 2024 at 9:00 AM - 11:00 AM

  LOCATION Welsh-Ryan Arena   

  ADD TO CALENDAR

  CONTACT Amy Pokrass    amy.pokrass@northwestern.edu EMAIL

  CALENDAR McCormick School of Engineering and Applied Science

• Jun

  10

  Northwestern Engineering Undergraduate Convocation

  McCormick School of Engineering and Applied Science

  2:00 PM Welsh-Ryan Arena

  EVENT DETAILSmore info

  McCormick School of Engineering Undergraduate Convocation

  more less

  TIME Monday, June 10, 2024 at 2:00 PM - 4:00 PM

  LOCATION Welsh-Ryan Arena   

  ADD TO CALENDAR

  CONTACT Amy Pokrass    amy.pokrass@northwestern.edu EMAIL

  CALENDAR McCormick School of Engineering and Applied Science