Wednesday / CS/ECE Seminar

October 14 / 12:00 PM

Hybrid / Mudd 3514

Speaker

Yuhao Zhu, University of Rochester

Talk Title

Programming and Architecting Heterogeneous Physical Intelligence: A Sensing-Computing-Human Co-Optimization Approach

Abstract

Future computers will be integrated into embodied systems that operate in complex real-world environments, such as autonomous robots and smart wearable/Extended Reality (XR) glasses. These systems must continuously sense and interpret the physical world while also generating information that engages human perceptual and cognitive systems.

This talk argues that programming and architecting future computer systems must integrate sensing and human cognition into the computing stack, and presents my lab's work toward this vision. First, I will discuss the co-design of sensing and computation, where we design novel computational image sensors and compile visual programs across heterogeneous sensing and computing hardware. Second, I will discuss co-optimizing computing with humans, where we build computational models of human visual perception, which provides perceptual, not numerical, specifications and constraints for navigating the enormous design space of visual programs. Together, these projects point toward an exciting future of computing that jointly reasons about machines, the physical world, and human cognition.

Biography

Yuhao Zhu is an Associate Professor of Computer Science, Brain and Cognitive Sciences, and an Asaro Biggar Family Fellow in Data Science, all at University of Rochester, where he and his students are mostly drawn to research problems at the intersection of computer architecture, compilers, sensing, and human factors. With his collaborators and students, he has won multiple IEEE Micro Top Picks in Computer Architecture for "novelty and potential for long-term impact", along with best paper awards/nominations at MICRO, HPCA, ASPLOS, and IEEE VR.

Research Areas: Computer architecture, graphics, imaging