Colin White

About

I am a research scientist at Meta in the GenAI org, on the pre-training team. My research focuses on scaling and evaluating large language models. Previously, I was Head of Research at Abacus.AI, where I co-created and maintained LiveBench, a contamination-free LLM benchmark. I graduated from Carnegie Mellon University with a Ph.D. in computer science, advised by Nina Balcan and supported by the NDSEG Fellowship. I received my undergraduate degree from Amherst College.

For more, see my CV (last updated Mar. 2025).

Throughout my career, I've worked in generative AI, automated machine learning (AutoML), model interpretability and debiasing, and machine learning for tabular data, from both a theoretical and empirical lens. Much of my work involves designing tools for better evaluation of machine learning techniques and designing more efficient optimization methods.

News

Selected
Service

  • Senior Area Chair for ICML 2024
    Senior Area Chair for NeurIPS Track on Datasets and Benchmarks 2023-2024
    Program Chair for AutoML 2023
    Local Chair and Area Chair for AutoML 2022
    Co-organizer for the 8th AutoML Workshop at ICML 2021
    Top 10% of reviewers at NeurIPS 2020, 2021, 2022
    Top 10% of reviewers at ICML 2021, 2022
    Top 10% of reviewers at ICLR 2022

Preprints

Publications