Publications

An up-to-date list is available on Google Scholar.

2024

  1. ICML
    Global Reinforcement Learning: Beyond Linear and Convex Rewards via Submodular Semi-gradient Methods
    Riccardo De Santi*, Manish Prajapat*, and Andreas Krause
    International Conference on Machine Learning (ICML), 2024
  2. ICML
    Geometric Active Exploration in Markov Decision Processes: the Benefit of Abstraction
    Riccardo De Santi, Federico Arangath Joseph, Noah Liniger, and 2 more authors
    International Conference on Machine Learning (ICML), 2024
  3. ICLR
    Exploiting Causal Graph Priors with Posterior Sampling for Reinforcement Learning
    Mirco Mutti, Riccardo De Santi, Marcello Restelli, and 2 more authors
    International Conference on Learning Representations (ICLR), 2024
    Causal Representation Learning Workshop at NeurIPS 2023

2023

  1. JMLR
    Convex Reinforcement Learning in Finite Trials
    Mirco Mutti, Riccardo De Santi, Piersilvio De Bartolomeis, and 1 more author
    Journal of Machine Learning Research (JMLR), 2023
  2. AAAI
    Provably efficient causal model-based reinforcement learning for systematic generalization
    Mirco Mutti*, Riccardo De Santi*, Emanuele Rossi, and 3 more authors
    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2023
    Workshop on Spurious Correlations, Invariance, and Stability at ICML 2022 and A Causal View on Dynamical Systems Workshop at NeurIPS 2022

2022

  1. Non-Markovian Policies for Unsupervised Reinforcement Learning in Multiple Environments
    Pietro Maldini*, Mirco Mutti*, Riccardo De Santi, and 1 more author
    2022
    Decision Awareness in Reinforcement Learning Workshop and First Workshop on Pre-training: Perspectives, Pitfalls, and Paths Forward at ICML 2022
  2. NeurIPS
    Challenging common assumptions in convex reinforcement learning
    Mirco Mutti*, Riccardo De Santi*, Piersilvio De Bartolomeis, and 1 more author
    Advances in Neural Information Processing Systems (NeurIPS), 2022
    Complex Feedback in Online Learning (CFOL) Workshop at ICML 2022
  3. ICML
    The importance of non-markovianity in maximum state entropy exploration
    Mirco Mutti*, Riccardo De Santi*, and Marcello Restelli
    International Conference on Machine Learning (ICML), 2022
    Outstanding Paper Award at ICML 2022
    ICML Workshop on Reinforcement Learning Theory, 2021