About Me
Yu Gan is a senior research engineer at Google AI and System Research, working on efficient LLM serving and coding agents. He received his Ph.D. degree in Electrical and Computer Engineering at Computer Systems Laboratory (CSL), Cornell University, advised by Professor Christina Delimitrou. His Ph.D. thesis was focused on building and managing large-scale microservices in datacenters, improving their performance and resource efficiency using machine learning. He is currently broadly interested in ML for systems and systems for ML. Before studying at Cornell, he obtained my B.Eng. degree in Electronic Engineering from Tsinghua University in 2016.
Yu Gan has been recived three IEEE Micro TopPicks Awards and one CIDR Best Paper Award.
- Efficient LLM serving
- LLM agents for coding
- ML for systems
- Cloud computing
Ph.D. Electrical and Computer Engineering
Cornell University
M.S. Electrical and Computer Engineering
Cornell University
B.Eng. Electronic Engineering
Tsinghua University
I am a senior research engineer at Google AI and System Research. I am generally interested in the interdisciplinary area between machine learning and computer systems. My research focuses on three main pillars:
- Systems for ML: where I design scalable and efficient infrastructure, combining the insights into ML algorithms, to support ever-growing model complexity and request load;
- ML for Systems: where I leverage machine learning to automate and optimize the design and management of computer systems.
- LLM Coding Agents: Building and exploring the capabilities of autonomous LLM-based agents for software development, debugging, and optimization.
Ultimately, my work aims to create a virtuous cycle where advancements in AI and systems mutually propel each other forward.
Please reach out to collaborate 😃
Experience
Senior Research Engineer
Google AI and System ResearchResearch projects include:
- Efficient LLM serving via online knowledge distillation
- Building text to SQL agents with self-consistency and reinforcement learning
- Cardinality prediction benchmarks and models with GNN and graph transformers
- Foundational models for table and quary representation
Senior Software Engineer
Alibaba CloudResearch projects include:
- Building trace analysis tool for large scale microservices with GNN
Education
Ph.D. Electrical and Computer Engineering
Cornell UniversityThesis on Designing and Managing Large-Scale Interactive Microservices in Datacenters. Supervised by Prof. Christina Delimitrou. Presented papers at 5 IEEE conferences with the contributions being published in 2 Springer journals.Read ThesisM.S. Electrical and Computer Engineering
Cornell UniversityCourses: Machine Learning, Statistical Distances in ML, Computer Architecture, Operating Systems, Advanced Systems, Cloud ComputingB.Eng. Electronic Engineering
Tsinghua UniversityGPA: 91.3/100