Colin White

About

I design algorithms that create advanced AI algorithms.

I am Head of Research at Abacus.AI. I graduated from Carnegie Mellon University with a Ph.D. in computer science, advised by Nina Balcan and supported by the NDSEG Fellowship. I received my undergraduate degree from Amherst College.

For more, see my CV (last updated Jan. 2024).

I specialize in both fundamental and applied research in machine learning, including research in large language models, automated machine learning, debiasing neural networks, and machine learning for science. My goal is to create more efficient and fairer AI systems. Much of my work involves designing innovative methods by drawing insights from large-scale studies and designing tools for better benchmarking of machine learning techniques.

News

    • • June 12, 2024: we released LiveBench, a new challenging, contamination-free LLM benchmark! See the preprint, leaderboard, blog post, and VentureBeat article.
    • • May 1, 2024: I was a Senior Area Chair for ICML 2024.
    • • Feb 21, 2024: Smaug-72B is the first open-source LLM to surpass 80% on the HuggingFace Open LLM Leaderboard! Read the paper here, and a VentureBeat article here.
    • • Sep 21, 2023: I was a Senior Area Chair for the NeurIPS Track on Datasets and Benchmarks 2023.
    • • Sep 12-15, 2023: I was a Program Chair for AutoML 2023. Mark your calendars for Sep 9-12, AutoML'24 in Paris!

Preprints

Publications

Professional
Service

  • Senior Area Chair for ICML 2024
    Senior Area Chair for NeurIPS Track on Datasets and Benchmarks 2023
    Program Chair for AutoML 2023
    Local Chair and Area Chair for AutoML 2022
    Co-organizer for the 8th AutoML Workshop at ICML 2021
    Top 10% of reviewers at NeurIPS 2022
    Top 10% of reviewers at ICML 2022
    Top 10% of reviewers at ICLR 2022
    Top 10% of reviewers at NeurIPS 2021
    Top 10% of reviewers at ICML 2021
    Top 10% of reviewers at NeurIPS 2020