Who am I

I am both a pure mathematician and an ML practitioner.

Pure Mathematics:

• Scientifique Collaborateur II (senior research associate, or, just an advanced postdoc) at University of Geneva
  • Principal Investigator of Ambizione PZ00P2-193324 by Swiss National Science Foundation
• (previously) Postdoctorate @ Université d’Angers, ETH Zürich

Specialize in algebraic geometry. My PhD + Postdoc has been an amazing decade of extended college life working on the theoretic foundations of mathematics.

Machine Learning:

• Founding Engineer at poolside.ai
• (previously) Research staff at Eleuther AI

Math Publications:

https://honglu2875.github.io/publications/

ML Publications:

• (ICML 2024 spotlight) Stay on topic with Classifier-Free Guidance G. Sanchez, H. Fan, A. Spangher, E. Levi, S. Biderman
• (ICML 2024) Grokking Group Multiplication with Cosets D. Stander, Q. Yu, H. Fan, S. Biderman
• (ICLR 2024) YaRN: Efficient Context Window Extension of Large Language Models B. Peng, J. Quesnelle, H. Fan, E. Shippole
• (ICML 2023 TAGS Workshop) An ML approach to resolution of singularities G. Bérczi, H. Fan, M. Zeng
• (Genetic Programming Theory & Practice workshop) The OpenELM Library: Leveraging Progress in Language Models for Novel Evolutionary Algorithms H. Bradley, H. Fan, T. Galanos, R. Zhou, D. Scott, J. Lehman

Eleuther AI is what made all of these above possible at all. In addition, a lot of thanks need to go to Hi Flyer AI which allowed me to abuse their 10,000 A100 cluster. Also need to thank Google Research Credit and Google TRC project for allowing me to use their amazing VMs and TPU pods.