Wind power

Planning and scheduling in smart grids

The emergence of renewable energy sources in distribution grids creates several important challenges. For instance, power production will be more dependent on the weather (e.g., solar panels and wind turbines), and grids become congested if many consumers use electricity at the same time (e.g., electric vehicles). In the GCP project we develop AI-based algorithms to schedule flexible consumption of consumers, taking into account the capacity constraints of the grid and uncertainty in renewable power supply. My work can be subdivided into two research lines:

1) My planning research focuses on scalable algorithms for single-agent and multi-agent planning under uncertainty using Partially Observable Markov Decision Processes, combined with convex optimization methods.

2) We apply MDP-based algorithms to match demand and supply in smart distribution grids. Computational and algorithmic challenges arise from the large number of agents, line characteristics and power flows in the grid.

Publications

Accelerated Vector Pruning for Optimal POMDP Solvers

Erwin Walraven and Matthijs T. J. Spaan
Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 3672–3678, 2017.

Bounding the Probability of Resource Constraint Violations in Multi-Agent MDPs

Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt and Matthijs T. J. Spaan
Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 3562–3568, 2017.

Resource-constrained Multi-agent MDP Planning with Bounded Violation Probability

Frits de Nijs, Erwin Walraven, Mathijs M. de Weerdt and Matthijs T. J. Spaan
NIPS workshop on Learning, Inference and Control of Multi-Agent Systems, 2016.

Planning Under Uncertainty for Aggregated Electric Vehicle Charging with Renewable Energy Supply

Erwin Walraven and Matthijs T. J. Spaan
Proceedings of the 22nd European Conference on Artificial Intelligence, pp. 904–912, 2016.

Planning under Uncertainty for Aggregated Electric Vehicle Charging using Markov Decision Processes

Erwin Walraven and Matthijs T. J. Spaan
International Workshop on Artificial Intelligence for Smart Grids and Smart Buildings, 2016.

Planning under Uncertainty with Weighted State Scenarios (extended abstract)

Erwin Walraven and Matthijs T. J. Spaan
AAAI Fall Symposium on Sequential Decision Making for Intelligent Agents, 2015.

Planning under Uncertainty with Weighted State Scenarios

Erwin Walraven and Matthijs T. J. Spaan
Proceedings of the 31st Conference on Uncertainty in Artificial Intelligence, pp. 912–921, 2015.

A Scenario State Representation for Scheduling Deferrable Loads under Wind Uncertainty

Erwin Walraven and Matthijs T. J. Spaan
The 10th Annual Workshop on Multiagent Sequential Decision Making Under Uncertainty, 2015.

Talks

Our work has been presented at the following international conferences and workshops:

AAAI Conference on Artificial Intelligence 2017, San Francisco, CA, United States
Workshop on Learning, Inference and Control of Multi-Agent Systems at NIPS-16, Barcelona, Spain
European Conference on Artificial Intelligence 2016, The Hague, The Netherlands
Workshop on AI for Smart Grids and Smart Buildings at AAAI-16, Phoenix, AZ, United States
AAAI Fall Symposium 2015, Arlington, VA, United States
Conference on Uncertainty in Artificial Intelligence 2015, Amsterdam, The Netherlands
Workshop on Multiagent Sequential Decision Making at AAMAS 2015, Istanbul, Turkey