Edgar Dobriban
- Associate Professor of Statistics and Data Science, with secondary appointment in Computer and Information Science
Contact Information
- Primary Email:
dobriban@wharton.upenn.edu
- office Address:
305 Academic Research Building
265 South 37th Street
Philadelphia, PA 19104
Research Interests: Statistics and machine learning
Overview
Our research interests include problems at the interface of statistics, machine learning, and AI, such as uncertainty quantification, AI safety, robustness, high-dimensional asymptotic statistics, etc.
The group is always looking to expand. We are recruiting PhD students at Penn to work on problems in statistics and machine learning. PhD applicants interested to work with me should mention this on their application. Please apply through the departments of Statistics & Data Science, Computer and Information Science, and the AMCS program, as it gives higher chances for admission.
Education:
- PhD in Statistics, Stanford University, 2017. Advisor: David Donoho.
- BA in Mathematics, Princeton University, 2012 (Summa cum Laude/with Highest Honors). Undergraduate advisors: Jianqing Fan, Amit Singer, Robert E. Schapire.
Recent news:
- May 2025: New paper “Foundations of Top-k Decoding For Language Models“
- May 2025: New paper “Finding Distributions that Differ, with False Discovery Rate Control“
- May 2025: New paper “Synthetic-Powered Predictive Inference“
- Feb 2025: New paper “Likelihood-Ratio Regularized Quantile Regression: Adapting Conformal Prediction to High-Dimensional Covariate Shifts“
- Jan 2025: Edgar joins the steering committee of the new Stats Up AI ASA Special Interest Group as the inaugual program chair. Please join the interest group to learn more about our upcoming programs! Also, please feel free to reach out with suggestions for programs of interest.
- Dec 2024: Materials for the course “Principles of AI: LLMs” posted on Github.
- Sept 2024: Moderating a COPSS-NISS Leadership Webinar on Sept 24 with distinguished speakers Arnaud Doucet and Bin Yu. Join us! RSVP here.
- Sept 2024: New paper “Batch Predictive Inference“.
- Aug 2024: New paper “A Confidence Interval for the ℓ2 Expected Calibration Error“.
- July 2024: Interview with StatsUpAI.
- June 2024: New paper “Evaluating the Performance of Large Language Models via Debates“.
- June 2024: New paper “Watermarking Language Models with Error Correcting Codes“.
- May 2024: New paper “One-Shot Safety Alignment for Large Language Models via Optimal Dualization“.
- May 2024: Edgar receives the 2024 Peter Gavin Hall IMS Early Career Prize “for deep, fundamental, and wide-ranging contributions to mathematical statistics and statistical machine learning, including high-dimensional asymptotics (ridge regression, PCA), multiple testing, randomization tests, scalable statistical learning via random projections and distributed learning, uncertainty quantification for machine learning (calibration, prediction sets), robustness, fairness, and Covid-19 pooled testing via hypergraph factorization.”
- May 2024: Posted list of resources on “Statistics and machine learning: from undergraduate to research“
- Apr 2024: New paper “Uncertainty in Language Models: Assessment through Rank-Calibration“.
- Apr 2024: New paper “JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models“. Website.
- Apr 2024: New paper “Inference in Randomized Least Squares and PCA via Normality of Quadratic Forms“
- Mar 2024: New paper “Minimax Optimal Fair Classification with Bounded Demographic Disparity“
- Mar 2024: New paper “Simultaneous Conformal Prediction of Missing Outcomes with Propensity Score ε-Discretization“
- Feb 2024: Links to educational materials about stats+ML posted in the GitHub repository “Statistics and machine learning: from undergraduate to research“
- Feb 2024: New paper “Bayes-Optimal Fair Classification with Linear Disparity Constraints via Pre-, In-, and Post-processing“
- Dec 2023: New paper “SymmPI: Predictive Inference for Data with Group Symmetries“
- Oct 2023: New paper “PAC Prediction Sets Under Label Shift“
- Oct 2023: New paper “Jailbreaking Black Box Large Language Models in Twenty Queries“. Website.
- Oct 2023: New paper “A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks“
- Fall 2023: On sabbatical, visiting the Department of Statistics at Harvard University.
- August 2023: New paper “Statistical Estimation Under Distribution Shift: Wasserstein Perturbations and Minimax Theory“
- July 2023: New paper “A Framework for Statistical Inference via Randomized Algorithms“
- Edgar receives ICSA Outstanding Young Researcher Award for “remarkable contributions to the contemporary statistical and machine learning theory and methods.”
- June 2023: New paper “Efficient and Multiply Robust Risk Estimation under General Forms of Dataset Shift“
- June 2023: Shenzhen Conference on Random Matrix Theory and Applications is co-organized
- June 2023: New paper “Optimal Heterogeneous Collaborative Linear Regression and Contextual Bandits“
- April 2023: New paper “Sharp-SSL: Selective high-dimensional axis-aligned random projections for semi-supervised learning“
- March 2023: New paper “Joint Coverage Regions: Simultaneous Confidence and Prediction Sets“
- February 2023: Edgar is granted tenure, starting July 2023
- January 2023: New paper “Demystifying Disagreement-on-the-Line in High Dimensions“
- November 2022: New paper “Conformal Frequency Estimation with Sketched Data under Relaxed Exchangeability“
- October 2022: New paper “Doubly Robust Proximal Synthetic Controls“
- July 2022: New paper “PAC Prediction Sets for Meta-Learning“
- June 2022: New paper “Pursuit of a Discriminative Representation for Multiple Subspaces via Sequential Games“
- June 2022: New paper “Unified Fourier-based Kernel and Nonlinearity Design for Equivariant Networks on Homogeneous Spaces“
- June 2022: New paper “Memory Classifiers: Two-stage Classification for Robustness in Machine Learning“
- June 2022: New paper “Collaborative Learning of Distributions under Heterogeneity and Communication Constraints“
- May 2022: New paper “PAC-Wrap: Semi-Supervised PAC Anomaly Detection“
- May 2022: New paper “Fair Bayes-Optimal Classifiers Under Predictive Parity“
- Apr 2022: New paper “SE(3)-Equivariant Attention Networks for Shape Reconstruction in Function Space” with Evangelos Chatzipantazis, Stefanos Pertigkiozoglou, and Kostas Daniilidis.
- Mar 2022: New paper “Distribution-free Prediction Sets Adaptive to Unknown Covariate Shift“
- Mar 2022: New paper “T-Cal: An optimal test for the calibration of predictive models“. Talk video.
- Feb 2022: New paper “Exploring with Sticky Mittens: Reinforcement Learning with Expert Interventions via Option Templates“
- Feb 2022: New paper “Bayes-Optimal Classifiers under Group Fairness“
- Jan 2022: New paper “iDECODe: In-distribution Equivariance for Conformal Out-of-distribution Detection“
- Spring 2022: New class “Topics in Modern Statistical Learning” (STAT-991), surveying uncertainty quantification for machine learning. See the Github page.
- Nov 2021: New paper “Learning Augmentation Distributions using Transformed Risk Minimization” with Evangelos Chatzipantazis, Stefanos Pertigkiozoglou, and Kostas Daniilidis.
- Oct 2021: New paper “Solon: Communication-efficient Byzantine-resilient Distributed Training via Redundant Gradients” with Lingjiao Chen, Leshang Chen, Hongyi Wang, and Susan Davidson.
- Aug 2021: New paper “Comparing Classes of Estimators: When does Gradient Descent Beat Ridge Regression in Linear Models?“, with Dominic Richards and Patrick Rebeschini.
- June 2021: New paper on PAC Prediction Sets Under Covariate Shift, with Sangdon Park, Insup Lee, and Osbert Bastani.
- May 2021: Materials for Short Course on Deep Learning in Statistics, 2021 Symposium on Data Science & Statistics: slides, code
- Apr 2021: New paper on the consistency of invariance-based randomization tests. To appear in The Annals of Statistics.
- Mar 2021: New paper “Understanding Generalization in Adversarial Training via the Bias-Variance Decomposition” with Yaodong Yu, Zitong Yang, Jacob Steinhardt, and Yi Ma.
- Mar 2021: New paper on group testing for COVID-19 with David Hong, Rounak Dey, Xihong Lin, and Brian Cleary. See the website and a talk by David.
- Jan 2021: Edgar receives NSF CAREER award in the mathematical sciences.
- Dec 2020: New paper on selecting the number of components in PCA via random signflips with David Hong and Yue Sheng
- Nov 2020: New paper on sparse sketches with small inversion bias with Michał Dereziński, Zhenyu Liao, and Michael W. Mahoney. Accepted at COLT 2021.
- Oct 2020: Co-organizing session on “Open problems in robustness” at the CDTI Workshop on The Analytical Foundations of Deep Learning. Oct 23, 12pm-1:30pm. See the recorded session on YouTube!
- Oct 2020: New paper: What causes the test error? Going beyond bias-variance via ANOVA, with Licong Lin. Accepted by JMLR.
- Sept 2020: Three papers accepted at NeurIPS 2020: A Group-Theoretic Framework for Data Augmentation (oral presentation, 1% of papers selected), Implicit Regularization and Convergence of Weight Normalization, and Optimal Iterative Sketching with the Subsampled Randomized Hadamard Transform
- Sept 2020: Co-organizing online workshop on Equivariance and Data Augmentation with Kostas Daniilidis, Sept 4. Join us! Part of activities for NSF Tripods center FinPenn. Youtube playlist.
- Aug 2020: Edgar is a Co-PI on NSF-Simons Mathematical and Scientific Foundations of Deep Learning award THEORINET (PI: Rene Vidal, JHU). Looking forward to many exciting collaborations that this will enable!
- Aug 2020: Talks at JSM 2020: See slides for talk on stochastic gradient flow, and slides prepared as a discussant for the invited session on the theory of deep learning.
- June 2020: SIAM Mathematics of Data Science minisymposium “High-Dimensional PCA in the High-Noise Regime” co-organized with William Leeb and Amit Singer.
- June 2020: New paper on provable tradeoffs in adversarially robust classification with Hamed Hassani, David Hong, Alexander Robey
- June 2020: Paper on distributed learning with Yue Sheng accepted at the Annals of Statistics.
- June 2020: Papers accepted at ICML 2020: “WONDER: Weighted one-shot distributed ridge regression” (short version), The Implicit Regularization of Stochastic Gradient Flow for Least Squares, and “DeltaGrad: Rapid retraining of machine learning models” (with Yinjun Wu and Susan Davidson).
- May 2020: Paper on How to reduce dimension with PCA and random projections? with Fan Yang, Sifan Liu, and David P. Woodruff.
- Apr 2020: Paper on “WONDER: Weighted one-shot distributed ridge regression” with Yue Sheng accepted to JMLR.
- Mar 2020: New paper on stochastic gradient descent and flow with Alnur Ali and Ryan Tibshirani.
- Feb 2020: New paper on iterative sketching with Jonathan Lacotte, Sifan Liu, and Mert Pilanci.
- Feb 2020: Talk at UMass Amherst (cancelled due to Covid-19).
- Jan 2020: Edgar becomes an affiliate of the Warren Center.
- Dec 2019: Edgar will be teaching Continuing Education course “Machine Learning and Deep Learning,” with Annie Qu and Xiao Wang, at the 2020 Joint Statistical Meetings (JSM). Also teaching short course “Deep Learning in Statistics” at SLDS 2020.
- Dec 2019: Ridge regression paper with Sifan Liu accepted as a spotlight presentation to ICLR 2020 (top 6% of papers).
- Dec 2019: New GPU machines arrive.
- Nov 2019: New paper on Implicit Regularization of Normalization Methods
- Oct 2019: Reading group/group meeting starts.
- Sept-Nov 2019: Edgar is visiting the IAS for the Special year on Statistics, Machine Learning, and Optimization.
- Sept 2019: New seminar: Topics in Deep Learning (STAT-991), surveying advanced topics in deep learning research based on student presentations. See the Github page for the class materials.
- Sept 2019: PCA paper accepted to the Annals of Statistics
- Sept 2019: Multiple testing paper accepted to Biometrika
- Sept 2019: Sketching paper accepted to NeurIPS 2019
- Aug 2019: Edgar contributes to ASA statement “Comment on Statistics, as a Discipline and Practice, in AI Research and Development“
- Aug 2019: David Hong joins the group. Welcome David!
- July 2019: NSF TRIPODS awarded to Edgar as a co-PI, with Alejandro Ribeiro (PI, ESE), and co-PIs Robert Ghrist (Math), Kostas Daniilidis (CIS), Saswati Sarkar (ESE)
- July 2019: New paper on data augmentation.
- Summer 2019: Undergraduate researchers Tianle Liu (THU), Shuo Xie (PKU), and Weichen Zheng (Penn) work in the group
- June-Aug 2019: Edgar is attending the Summer program on the Foundations of Deep Learning at the Simons Institute.
- March 2019: New paper on distributed learning.
Miscellanea:
- I use Twitter to keep up with new research.
- I grew up in Romania, and speak Hungarian as a first language (the real spelling of my name is Dobribán Edgár). These two countries are and were the origin of many great mathematicians and statisticians, including John von Neumann, Abraham Wald, Paul Erdos, Dan-Virgil Voiculescu, etc…
Research
Talk slides: GitHub. Google Scholar.
Georgy Noarov, Soham Mallick, Tao Wang, Sunay Joshi, Yan Sun, Xinyu Xie, Mengxin Yu, Edgar Dobriban Foundations of Top-k Decoding For Language Models.
Edgar Dobriban, Yonghoon Lee, Eric Tchetgen Tchetgen Finding Distributions that Differ, with False Discovery Rate Control.
Meshi Bashari, Roy Maor Lotan, Yonghoon Lee, Edgar Dobriban, Yaniv Romano Synthetic-Powered Predictive Inference.
Sunay Joshi, Shayan Kiyani, George J. Pappas, Edgar Dobriban, Seyed Hamed Hassani Likelihood-Ratio Regularized Quantile Regression: Adapting Conformal Prediction to High-Dimensional Covariate Shifts.
Yonghoon Lee, Eric Tchetgen Tchetgen, Edgar Dobriban Batch Predictive Inference.
Yan Sun, Pratik Chaudhari, Ian J. Barnett, Edgar Dobriban A Confidence Interval for the ℓ2 Expected Calibration Error.
Behrad Moniri, Seyed Hamed Hassani, Edgar Dobriban, Evaluating the Performance of Large Language Models via Debates.
Patrick Chao, Edgar Dobriban, Seyed Hamed Hassani, Watermarking Language Models with Error Correcting Codes.
Xinmeng Huang, Shuo Li, Edgar Dobriban, Osbert Bastani, Seyed Hamed Hassani, Dongsheng Ding, One-Shot Safety Alignment for Large Language Models via Optimal Dualization.
Xinmeng Huang, Shuo Li, Mengxin Yu, Matteo Sesia, Seyed Hamed Hassani, Insup Lee, Osbert Bastani, Edgar Dobriban, Uncertainty in Language Models: Assessment through Rank-Calibration.
Teaching
Awards and Honors
- ASA Gottfried E. Noether Early Career Scholar Award, 2024
- Peter Gavin Hall IMS Early Career Prize, 2024 Description
“For deep, fundamental, and wide-ranging contributions to mathematical statistics and statistical machine learning, including high-dimensional asymptotics (ridge regression, PCA), multiple testing, randomization tests, scalable statistical learning via random projections and distributed learning, uncertainty quantification for machine learning (calibration, prediction sets), robustness, fairness, and Covid-19 pooled testing via hypergraph factorization.”
- Air Force Office of Scientific Research Young Investigator Program (AFOSR YIP) Award, 2024
- ICSA Outstanding Young Researcher Award, 2023
- Army Research Office Early Career Program Award, 2023
- Committee of Presidents of Statistical Societies (COPSS) Emerging Leader Award, 2023
- Sloan Research Fellowship in Mathematics, 2023
- Bernoulli Society New Researcher Award, 2023
- NSF CAREER Award, 2021
- T.W. Anderson Theory of Statistics Dissertation Award, Department of Statistics, Stanford University, 2017
- Howard Hughes Medical Institute International Student Graduate Research Fellowship, 2015
- Stanford Department of Statistics Teaching Award, 2013
- Middleton Miller ’29 Prize for best independent work in mathematics, Princeton University, 2012
Activity
Latest Research
Georgy Noarov, Soham Mallick, Tao Wang, Sunay Joshi, Yan Sun, Xinyu Xie, Mengxin Yu, Edgar Dobriban Foundations of Top-k Decoding For Language Models.
All Research