Research Overview
The four current areas of research in CLAN Labs are listed below. Each theme links to the topic page with the corresponding publications.
Reinforcement Learning and Sequential Decision-Making
We develop reinforcement learning, bandit, and online optimization algorithms with provable sample-complexity and regret guarantees. The current themes are:
- Order-optimal sample complexity and regret for discounted-reward and average-reward reinforcement learning
- Policy gradient and actor-critic methods with general (neural) policy parameterization
- Constrained, concave-utility, multi-objective, and robust reinforcement learning
- Multi-armed bandits: combinatorial, submodular, and continuous-action bandits
- Online linearizable optimization and DR-submodular maximization
- Stochastic approximation with Markovian noise and nonconvex optimization
Foundation Models and Generative AI
We study how to align large models with human preferences and what guarantees generative models can achieve. The current themes are:
- Bi-level reinforcement learning as a foundation for reinforcement learning from human feedback (RLHF)
- Online and robust preference alignment of large language models
- Reliable evaluation of adaptive LLM systems and agents
- Sample-complexity guarantees for diffusion models and flow matching
- Alignment of text-to-image diffusion models
Quantum Machine Learning
We design quantum algorithms for learning and decision-making, and the tools to train and simulate them at scale. The current themes are:
- Quantum speedups for reinforcement learning and bandits
- Variational quantum circuits, quantum neural networks, and hybrid quantum-classical models
- Quantum search (Grover's search) and quantum optimization
- Quantum causal inference
- Quantum-accelerated imaging
Applications of Machine Learning
We apply these methods to problems in healthcare, imaging, and networked systems. The current themes are:
- Generative and foundation models for drug discovery and genomics
- Clinical decision support (e.g., sepsis) and video/sensor-based ergonomic risk monitoring
- Low-photon imaging via machine learning and physics-based optimization
- AI-native networking: service function chains, intent-based control, and learning-augmented traffic engineering