Dan Fu
Assistant Professor
Computer Science and Engineering Department
University of California, San Diego
Distinguished Research Scientist, Together AI
Previously: PhD, Department of Computer Science, Stanford University
Research Interests: machine learning and systems, with a focus on efficiency
About Me
I'm building a world-class kernels team at Together AI. Please reach out if you're interested in joining the team!
I'm an assistant professor at UCSD leading the SandyResearch Lab and affiliated with the MLSys group. I'm also a Distinguished Research Scientist at Together AI. My research focuses on making machine learning models faster and more efficient. Recently, I've been working on efficient ML architectures that scale sub-quadratically in sequence length and model dimension, and hardware-aware systems algorithms to translate these theoretical gains to practical savings. At Together AI, I'm thrilled to be building a world-class kernels team.
Selected Research Interests:
- Hardware-aware algorithms for ML - how can we build the best systems & kernels algorithms for ML primitives like attention on modern hardware? ThunderKittens, ThunderMLA, FlashAttention, FlashFFTConv
- Efficient ML architectures - how do we change ML models to scale better along, e.g. sequence length? Chipmunk, Hungry Hungry Hippos, Monarch Mixer
Some links:
- My lab website: SandyResearch
- How I Structure Introductions to Research Papers
- The Coffee Experiment
- Stanford MLSys Seminar on YouTube (we started during the pandemic)