About

I am a researcher in the field of Artificial Intelligence (AI); currently an Assistant Professor at the Department of Advanced Computing Sciences of Maastricht University.

Outside of AI research, I am also interested in programming languages (pros and cons of different languages), optimising software (reading things like “What Every Programmer Should Know About Memory”), gaming, and esports.

Prospective students who are potentially interested in having my as their supervisor (at DACS): please see this page.

Main Professional Interests

  • Reinforcement Learning
  • Search algorithms (especially, but not limited to, adversarial search)
  • AI in games
  • Game Description Languages (and other languages for describing problems/tasks for AI)
  • Optimising code
  • Open Source

Work Experience

Education

  • 2014 - 2016: M.Sc. Artificial Intelligence, Maastricht University. Graduated Summa Cum Laude.
  • 2011 - 2014: B.Sc. Knowledge Engineering, Maastricht University.

Recent posts

Linear Functions in RL, State-Action Features, and Eligibility Traces

7 minute read

Sutton and Barto’s standard textbook on Reinforcement Learning covers how state feature vectors may be constructed for linear state value functions. However, there is little explanation of the extension to state-action feature vectors. In this post I aim to fill this gap.

11 Micro-optimisation Tips for Skyrim’s Scripting Language

17 minute read

The Papyrus scripting language of The Elder Scrolls V: Skyrim is somewhat notorious in the game’s large community of third-party mod developers and users for performance-related issues (though there are also plenty of misconceptions, and it’s not necessarily as bad as many people think). There are already many relat...

Ludii Pre-Release

2 minute read

Ludii is a new general game-playing (GGP) system, of which an early pre-release version has been published today. The system comes with a wide range of built-in games, and may be interesting for game-playing enthusiasts to simply play games! Ludii’s new game description language tends to lead to game descriptions th...

The General Video Game Agent ‘‘MaastCTS2’’

13 minute read

This post provides an informal description of my MaastCTS2 agent for General Video Game Playing. It participated in the Single-Player and Two-Player tracks of the GVG-AI Competition in 2016. The results can be found here. MaastCTS2 ended up winning the Single-Player track, and was the runner-up in the Two-Player tra...