Publications

Confidence Sets for Causal Orderings

Y. Samuel Wang, Mladen Kolar, Mathias Drton

Journal of the American Statistical Association, 121(553), 690–703

Fast and Consistent Structure Learning in Graphical Models via Approximate Cross-Validation

Zhao Lyu, Mladen Kolar, Bryon Aragam

Advances in Neural Information Processing Systems (NeurIPS)

Gradient Clipping Beyond Vector Norms: A Spectral Approach for Matrix-Valued Parameters

Alexander Yukhimchuk, Mladen Kolar, Martin Takáč, Sayantan Choudhury

Technical report

Joint-Sparse Transfer Learning for High-Dimensional Multi-Output Regression

Sunwoo Lim, Mladen Kolar

Technical report

Muon with Nesterov Momentum: Heavy-Tailed Noise and (Randomized) Inexact Polar Decomposition

Sayantan Choudhury, Xiaoran Cheng, Martin Takáč, Sen Na, Mladen Kolar

Technical report

Privacy from Symmetry: Orthogonally Equivariant Transformers for LLM Inference

Alexander Yukhimchuk, Andrey Shulga, Mladen Kolar, Martin Takáč

Technical report

Provable Accelerated Bayesian Optimization with Knowledge Transfer

Haitao Lin, Boxin Zhao, Mladen Kolar, Chong Liu

International Conference on Artificial Intelligence and Statistics (AISTATS)

Simultaneous Inference for Covariance and Precision Matrices of Long-Range Dependent Time Series

Percy Zhai, Mladen Kolar, Wei Biao Wu

IEEE Transactions on Information Theory, 72(6), 4246–4296

SMART: A Spectral Transfer Approach to Multi-Task Learning

Boxin Zhao, Mladen Kolar, Jinchi Lv

Technical report

Trans-Glasso: A Transfer Learning Approach to Precision Matrix Estimation

Boxin Zhao, Cong Ma, Mladen Kolar

Journal of the American Statistical Association

Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism

2025

Tim Tsz-Kit Lau, Weijian Li, Chenwei Xu, Han Liu, Mladen Kolar

Conference on Parsimony and Learning (CPAL)

Adaptive Client Sampling in Federated Learning via Online Learning with Bandit Feedback

Boxin Zhao, Ziqi Liu, Chaochao Chen, Mladen Kolar, Zhiqiang Zhang, Jun Zhou

Journal of Machine Learning Research, 26(8), 1–67

High-Dimensional Differential Parameter Inference in Exponential Family using Time Score Matching

Daniel J. Williams, Leyang Wang, Qizhen Ying, Song Liu, Mladen Kolar

International Conference on Artificial Intelligence and Statistics (AISTATS)

Statistical Inference for Networks of High-Dimensional Point Processes

Xu Wang, Mladen Kolar, Ali Shojaie

Journal of the American Statistical Association, 120(550), 1014–1024

A Fast Temporal Decomposition Procedure for Long-horizon Nonlinear Dynamic Programming

2024

Sen Na, Mihai Anitescu, Mladen Kolar

Mathematics of Operations Research, 49(2), 1012–1044

Communication-Efficient Adaptive Batch Size Strategies for Distributed Local Gradient Methods

Tim Tsz-Kit Lau, Weijian Li, Chenwei Xu, Han Liu, Mladen Kolar

Technical report

Convergence Analysis of Accelerated Stochastic Gradient Descent under the Growth Condition

You-Lin Chen, Sen Na, Mladen Kolar

Mathematics of Operations Research, 49(4), 2492–2526

Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problems

Yuchen Fang, Sen Na, Michael W. Mahoney, Mladen Kolar

SIAM Journal on Optimization, 34(2), 2007-2037

High-dimensional Functional Graphical Model Structure Learning via Neighborhood Selection Approach

Boxin Zhao, Percy Zhai, Y. Samuel Wang, Mladen Kolar

Electronic Journal of Statistics, 18(1), 1042–1129

High-Dimensional Markov-switching Ordinary Differential Processes

Katherine Tsai, Mladen Kolar, Sanmi Koyejo

Technical report

Inconsistency of cross-validation for structure learning in Gaussian graphical models

Zhao Lyu, Wai Ming Tai, Mladen Kolar, Bryon Aragam

International Conference on Artificial Intelligence and Statistics (AISTATS)

Instrumental Variable Value Iteration for Causal Offline Reinforcement Learning

Luofeng Liao, Zuyue Fu, Zhuoran Yang, Mladen Kolar, Zhaoran Wang

Journal of Machine Learning Research, 25(303), 1–56

Latent Multimodal Functional Graphical Model Estimation

Katherine Tsai, Boxin Zhao, Oluwasanmi Koyejo, Mladen Kolar

Journal of the American Statistical Association, 119(547), 2217–2229

On the Lasso for Graphical Continuous Lyapunov Models

Philipp Dettling, Mathias Drton, Mladen Kolar

Causal Learning and Reasoning (CLeaR)

Personalized Binomial DAGs Learning with Network Structured Covariates

Boxin Zhao, Weishi Wang, Dingyuan Zhu, Ziqi Liu, Dong Wang, Zhiqiang Zhang, Jun Zhou, Mladen Kolar

Technical report

Pessimism Meets Risk: Risk-Sensitive Offline Reinforcement Learning

Dake Zhang, Boxiang Lyu, Shuang Qiu, Mladen Kolar, Tong Zhang

International Conference on Machine Learning (ICML)

Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Models

Yuchen Fang, Sen Na, Michael W. Mahoney, Mladen Kolar

Technical report

One Policy is Enough: Parallel Exploration with a Single Policy is Minimax Optimal for Reward-Free Reinforcement Learning

2023

Pedro Cisneros Velarde, Boxiang Lyu, Sanmi Koyejo, Mladen Kolar

International Conference on Artificial Intelligence and Statistics (AISTATS)

arXiv URL

Addressing Budget Allocation and Revenue Allocation in Data Market Environments Using an Adaptive Sampling Algorithm

Boxin Zhao, Boxiang Lyu, Raul Castro Fernandez, Mladen Kolar

International Conference on Machine Learning (ICML)

Constrained Optimization via Exact Augmented Lagrangian and Randomized Iterative Sketching

Ilgee Hong, Sen Na, Michael W. Mahoney, Mladen Kolar

International Conference on Machine Learning (ICML)

Differentially Private Matrix Completion through Low-rank Matrix Factorization

Lingxiao Wang, Boxin Zhao, Mladen Kolar

International Conference on Artificial Intelligence and Statistics (AISTATS)

URL

Inequality Constrained Stochastic Nonlinear Optimization via Active-Set Sequential Quadratic Programming

Sen Na, Mihai Anitescu, Mladen Kolar

Mathematical Programming, 202(1), 279–353

L-SVRG and L-Katyusha with Adaptive Sampling

Boxin Zhao, Boxiang Lyu, Mladen Kolar

Transactions on Machine Learning Research

Personalized Federated Learning: A Unified Framework and Universal Optimization Techniques

Filip Hanzely, Boxin Zhao, Mladen Kolar

Transactions on Machine Learning Research

Preprint Code Video Poster

2022

Provably training overparameterized neural network classifiers with non-convex constraints

You-Lin Chen, Zhaoran Wang, Mladen Kolar

Electronic Journal of Statistics, 16(2)

Gradient-Variation Bound for Online Convex Optimization with Constraints

Shuang Qiu, Xiaohan Wei, Mladen Kolar

AAAI Conference on Artificial Intelligence (to appear)

Local AdaGrad-type algorithm for stochastic convex-concave optimization

Luofeng Liao, Li Shen, Jia Duan, Mladen Kolar, Dacheng Tao

Machine Learning

arXiv PDF DOI

Pessimism meets VCG: Learning Dynamic Mechanism Design via Offline Reinforcement Learning

Boxiang Lyu, Zhaoran Wang, Mladen Kolar, Zhuoran Yang

Proceedings of the 39th International Conference on Machine Learning (ICML) 2022

PDF Video Slides arXiv

An adaptive stochastic sequential quadratic programming with differentiable exact augmented lagrangians

Sen Na, Mihai Anitescu, Mladen Kolar

Mathematical Programming

Code arXiv DOI

Dynamic Regret Minimization for Control of Non-stationary Linear Dynamical Systems

Yuwei Luo, Varun Gupta, Mladen Kolar

Proceedings of the 2022 ACM SIGMETRICS

Video Slides arXiv DOI

Personalized Federated Learning with Multiple Known Clusters

Boxiang Lyu, Filip Hanzely, Mladen Kolar

Technical report (arXiv:2204.13619)

A Nonconvex Framework for Structured Dynamic Covariance Recovery

Katherine Tsai, Mladen Kolar, Oluwasanmi Koyejo

Journal of Machine Learning Research

arXiv Code URL

FuDGE: A Method to Estimate a Functional Differential Graph in a High-Dimensional Setting

Boxin Zhao, Y. Samuel Wang, Mladen Kolar

Journal of Machine Learning Research

arXiv Code URL

Joint Gaussian Graphical Model Estimation: A Survey

Katherine Tsai, Oluwasanmi Koyejo, Mladen Kolar

WIREs Computational Statistics

arXiv URL DOI

2021

Inference for high-dimensional varying-coefficient quantile regression

Ran Dai, Mladen Kolar

Electronic Journal of Statistics, 15(2)

Two-sample inference for high-dimensional Markov networks

Byol Kim, Song Liu, Mladen Kolar

Journal of the Royal Statistical Society. Series B. Statistical Methodology, 83(5)

PDF Preprint Code DOI

Robust Inference for High-Dimensional Linear Models via Residual Randomization

Y. Samuel Wang, Si Kai Lee, Panos Toulis, Mladen Kolar

Proceedings of the 38th International Conference on Machine Learning (ICML) 2021

Estimating differential latent variable graphical models with applications to brain connectivity

Sen Na, Mladen Kolar, Oluwasanmi Koyejo

Biometrika, 108(2)

PDF Code DOI

High-dimensional Index Volatility Models via Stein's Identity

Sen Na, Mladen Kolar

Bernoulli, 27(2)

Tensor Canonical Correlation Analysis With Convergence and Statistical Guarantees

You-Lin Chen, Mladen Kolar, Ruey S. Tsay

Journal of Computational and Graphical Statistics, 30(3)

Preprint Code DOI

2020

Provably Efficient Neural Estimation of Structural Equation Model: An Adversarial Approach

Luofeng Liao, You-Lin Chen, Zhuoran Yang, Bo Dai, Zhaoran Wang, Mladen Kolar

Advances in Neural Information Processing Systems 33 (NeurIPS), 2020

Preprint PDF Video

Estimation of a Low-rank Topic-Based Model for Information Cascades

Semiparametric Nonlinear Bipartite Graph Representation Learning with Provable Guarantees

Journal of Machine Learning Research

URL Code PDF

Sen Na, Yuwei Luo, Zhuoran Yang, Zhaoran Wang, Mladen Kolar

Proceedings of the 37th International Conference on Machine Learning (ICML) 2020

Preprint PDF Video Poster

Posterior Ratio Estimation for Latent Variables

Yulong Zhang, Mingxuan Yi, Song Liu, Mladen Kolar

Technical report

Recovery of simultaneous low rank and two-way sparse coefficient matrices, a nonconvex approach

Kernel meets sieve: post-regularization confidence bands for sparse additive model

Electronic Journal of Statistics, 14(1)

Code Preprint PDF DOI

Junwei Lu, Mladen Kolar, Han Liu

Journal of the American Statistical Association, 115(532)

arXiv URL PDF DOI

Simultaneous Inference for Pairwise Graphical Models with Generalized Score Matching

Natural Actor-Critic Converges Globally for Hierarchical Linear Quadratic Regulator

Journal of Machine Learning Research

arXiv URL

2019

Yuwei Luo, Zhuoran Yang, Zhaoran Wang, Mladen Kolar

Technical report

Constrained High Dimensional Statistical Inference

arXiv:1911.07319

Partially Linear Additive Gaussian Graphical Models

Sinong Geng, Minhao Yan, Mladen Kolar, Sanmi Koyejo

Proceedings of the 36th International Conference on Machine Learning

Learning Influence-Receptivity Network Structure with Guarantee

Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics

Convergent Policy Optimization for Safe Reinforcement Learning

Ming Yu, Zhuoran Yang, Mladen Kolar, Zhaoran Wang

Advances in Neural Information Processing Systems, 32

Direct Estimation of Differential Functional Graphical Models

Boxin Zhao, Y. Samuel Wang, Mladen Kolar

Advances in Neural Information Processing Systems, 32

High-dimensional Varying Index Coefficient Models via Stein's Identity

Sen Na, Zhuoran Yang, Zhaoran Wang, Mladen Kolar

Journal of Machine Learning Research

Distributed Stochastic Multi-Task Learning with Graph Regularization

2018

Weiran Wang, Jialei Wang, Mladen Kolar, Nathan Srebro

arXiv:1802.03830

Joint Nonparametric Precision Matrix Estimation with Confounding

Sinong Geng, Mladen Kolar, Oluwasanmi Koyejo

Uncertainty in Artificial Intelligence

Post-Regularization Inference for Time-Varying Nonparanormal Graphical Models

Junwei Lu, Mladen Kolar, Han Liu

Journal of Machine Learning Research

PDF Code

Provable Gaussian Embedding with One Observation

Ming Yu, Zhuoran Yang, Tuo Zhao, Mladen Kolar, Zhaoran Wang

Advances in Neural Information Processing Systems, 31

ROCKET: Robust confidence intervals via Kendall's tau for transelliptical graphical models

Rina Foygel Barber, Mladen Kolar

Ann. Statist

Code PDF DOI

2017

Scalable Peaceman-Rachford Splitting Method with Proximal Terms

Sen Na, Mingyuan Ma, Mladen Kolar

arXiv:1711.04955

Efficient Distributed Learning with Sparsity

Jialei Wang, Mladen Kolar, Nathan Srebro, Tong Zhang

Proceedings of the 34th International Conference on Machine Learning

Sketching Meets Random Projection in the Dual: A Provable Recovery Algorithm for Big and High-dimensional Data

Jialei Wang, Jason Lee, Mehrdad Mahdavi, Mladen Kolar, Nati Srebro

Proceedings of the 20th International Conference on Artificial Intelligence and Statistics

An Influence-Receptivity Model for Topic based Information Cascades

2017 IEEE International Conference on Data Mining

Recovering block-structured activations using compressive measurements

Sivaraman Balakrishnan, Mladen Kolar, Alessandro Rinaldo, Aarti Singh

Electron. J. Statist

Sketching meets random projection in the dual: a provable recovery algorithm for big and high-dimensional data

Jialei Wang, Jason D. Lee, Mehrdad Mahdavi, Mladen Kolar, Nathan Srebro

Electronic Journal of Statistics, 11(2), 4896–4944

Sketching meets random projection in the dual: a provable recovery algorithm for big and high-dimensional data

Jialei Wang, Jason D. Lee, Mehrdad Mahdavi, Mladen Kolar, Nathan Srebro

Electron. J. Stat

The Expxorcist: Nonparametric Graphical Models Via Conditional Exponential Densities

Arun Sai Suggala, Mladen Kolar, Pradeep Ravikumar

Advances in Neural Information Processing Systems, 30

Uniform inference for high-dimensional quantile regression: linear functionals and regression rank scores

Jelena Bradic, Mladen Kolar

arXiv preprint arXiv:1702.06209

2016

Distributed Multi-Task Learning

Jialei Wang, Mladen Kolar, Nathan Srerbo

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics

Distributed Multi-Task Learning with Shared Representation

Jialei Wang, Mladen Kolar, Nathan Srebro

Technical report

Discussion of ``Coauthorship and citation networks for statisticians''

Mladen Kolar, Matt Taddy

Annals of Applied Statistics

Inference for High-dimensional Exponential Family Graphical Models

Jialei Wang, Mladen Kolar

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics

Statistical Inference for Pairwise Graphical Models Using Score Matching

Advances in Neural Information Processing Systems, 29

Learning structured densities via infinite dimensional exponential families

2015

Siqi Sun, Mladen Kolar, Jinbo Xu

Advances in Neural Information Processing Systems, 28

Optimal variable selection in multi-group sparse discriminant analysis

Irina Gaynanova, Mladen Kolar

Electron. J. Stat

A General Framework for Robust Testing and Confidence Regions in High-Dimensional Quantile Regression

2014

Tianqi Zhao, Mladen Kolar, Han Liu

ArXiv e-prints, arXiv:1412.8724

Inference for Sparse Conditional Precision Matrices

Jialei Wang, Mladen Kolar

ArXiv e-prints, arXiv:1412.7638

Mean and variance estimation in high-dimensional heteroscedastic models with non-convex penalties

James Sharpnack, Mladen Kolar

ArXiv e-prints, arXiv:1410.7874

Optimal Feature Selection in High-Dimensional Discriminant Analysis

Mladen Kolar, Han Liu

IEEE Trans. Inf. Theory

Berry-Esseen bounds for estimating undirected graphs

Larry Wasserman, Mladen Kolar, Alessandro Rinaldo

Electron. J. Stat

Graph Estimation From Multi-attribute Data

Mladen Kolar, Han Liu, Eric P. Xing

J. Mach. Learn. Res

Feature Selection in High-Dimensional Classification

2013

Mladen Kolar, Han Liu

Proceedings of the 30th International Conference on Machine Learning

Markov Network Estimation From Multi-attribute Data

Mladen Kolar, Han Liu, Eric P. Xing

Proceedings of the 30th International Conference on Machine Learning

Consistent Covariance Selection From Data With Missing Values

2012

Proceedings of the 29th International Conference on Machine Learning

Variance Function Estimation in High-dimensions

Mladen Kolar, James Sharpnack

Proceedings of the 29th International Conference on Machine Learning

Estimating Networks With Jumps

Electron. J. Stat

Marginal Regression For Multitask Learning

Mladen Kolar, Han Liu

Proceedings of the 15th International Conference on Artificial Intelligence and Statistics

Minimax Localization of Structural Information in Large Noisy Matrices

2011

Mladen Kolar, Sivaraman Balakrishnan, Alessandro Rinaldo, Aarti Singh

Advances in Neural Information Processing Systems, 24

On Time Varying Undirected Graphs

Proceedings of the 14th International Conference on Artificial Intelligence and Statistics

Statistical and computational tradeoffs in biclustering

Sivaraman Balakrishnan, Mladen Kolar, Alessandro Rinaldo, Aarti Singh, Larry Wasserman

NIPS 2011 Workshop on Computational Trade-offs in Statistical Learning

Union Support Recovery In Multi-task Learning

Mladen Kolar, John D. Lafferty, Larry A. Wasserman

J. Mach. Learn. Res

Estimating Time-varying Networks

2010

Mladen Kolar, Le Song, Amr Ahmed, Eric P. Xing

Ann. Appl. Stat

On Sparse Nonparametric Conditional Covariance Selection

Mladen Kolar, Ankur P. Parikh, Eric P. Xing

Proc. 27th Int. Conf. Mach. Learn.

Ultra-high Dimensional Multiple Output Learning With Simultaneous Orthogonal Matching Pursuit: Screening Approach

Sparsistent Estimation Of Time-varying Discrete Markov Random Fields

Proc. of AISTATS

2009

KELLER: estimating time-varying interactions between genes

ArXiv e-prints, arXiv:0907.2337

L. Song, M. Kolar, E. P. Xing

Bioinformatics

Sparsistent Learning Of Varying-coefficient Models With Structural Changes

Mladen Kolar, Le Song, Eric P. Xing

Proc. of NIPS

Time-varying Dynamic Bayesian Networks

Le Song, Mladen Kolar, Eric P. Xing

Proc. of NIPS

2008

CSMET: Comparative Genomic Motif Detection via Multi-Resolution Phylogenetic Shadowing

Pradipta Ray, Suyash Shringarpure, Mladen Kolar, Eric P. Xing

PLoS Computational Biology

Time Varying Ising Models

Comparison of collocation extraction measures for document indexing

NeurIPS 2008 Workshop on Analyzing Graphs: Theory and Applications

2006

S. Petrovic, J. Snajder, B. Dalbelo-Basic, M. Kolar

Journal of Computing and Information Technology, 14(4), 321–327