Posts by Category

MaastCTS2

The General Video Game Agent ‘‘MaastCTS2’’

13 minute read

This post provides an informal description of my MaastCTS2 agent for General Video Game Playing. It participated in the Single-Player and Two-Player tracks of the GVG-AI Competition in 2016. The results can be found here. MaastCTS2 ended up winning the Single-Player track, and was the runner-up in the Two-Player tra...

Back to top ↑

General Video Game AI

The General Video Game Agent ‘‘MaastCTS2’’

13 minute read

This post provides an informal description of my MaastCTS2 agent for General Video Game Playing. It participated in the Single-Player and Two-Player tracks of the GVG-AI Competition in 2016. The results can be found here. MaastCTS2 ended up winning the Single-Player track, and was the runner-up in the Two-Player tra...

Back to top ↑

Ludii

Ludii Pre-Release

2 minute read

Ludii is a new general game-playing (GGP) system, of which an early pre-release version has been published today. The system comes with a wide range of built-in games, and may be interesting for game-playing enthusiasts to simply play games! Ludii’s new game description language tends to lead to game descriptions th...

Back to top ↑

General Game Playing

Ludii Pre-Release

2 minute read

Ludii is a new general game-playing (GGP) system, of which an early pre-release version has been published today. The system comes with a wide range of built-in games, and may be interesting for game-playing enthusiasts to simply play games! Ludii’s new game description language tends to lead to game descriptions th...

Back to top ↑

Digital Ludeme Project

Ludii Pre-Release

2 minute read

Ludii is a new general game-playing (GGP) system, of which an early pre-release version has been published today. The system comes with a wide range of built-in games, and may be interesting for game-playing enthusiasts to simply play games! Ludii’s new game description language tends to lead to game descriptions th...

Back to top ↑

Games

Ludii Pre-Release

2 minute read

Ludii is a new general game-playing (GGP) system, of which an early pre-release version has been published today. The system comes with a wide range of built-in games, and may be interesting for game-playing enthusiasts to simply play games! Ludii’s new game description language tends to lead to game descriptions th...

Back to top ↑

Artificial Intelligence

Ludii Pre-Release

2 minute read

Ludii is a new general game-playing (GGP) system, of which an early pre-release version has been published today. The system comes with a wide range of built-in games, and may be interesting for game-playing enthusiasts to simply play games! Ludii’s new game description language tends to lead to game descriptions th...

Back to top ↑

Skyrim

11 Micro-optimisation Tips for Skyrim’s Scripting Language

17 minute read

The Papyrus scripting language of The Elder Scrolls V: Skyrim is somewhat notorious in the game’s large community of third-party mod developers and users for performance-related issues (though there are also plenty of misconceptions, and it’s not necessarily as bad as many people think). There are already many relat...

Back to top ↑

Papyrus

11 Micro-optimisation Tips for Skyrim’s Scripting Language

17 minute read

The Papyrus scripting language of The Elder Scrolls V: Skyrim is somewhat notorious in the game’s large community of third-party mod developers and users for performance-related issues (though there are also plenty of misconceptions, and it’s not necessarily as bad as many people think). There are already many relat...

Back to top ↑

Programming

11 Micro-optimisation Tips for Skyrim’s Scripting Language

17 minute read

The Papyrus scripting language of The Elder Scrolls V: Skyrim is somewhat notorious in the game’s large community of third-party mod developers and users for performance-related issues (though there are also plenty of misconceptions, and it’s not necessarily as bad as many people think). There are already many relat...

Back to top ↑

Optimisations

11 Micro-optimisation Tips for Skyrim’s Scripting Language

17 minute read

The Papyrus scripting language of The Elder Scrolls V: Skyrim is somewhat notorious in the game’s large community of third-party mod developers and users for performance-related issues (though there are also plenty of misconceptions, and it’s not necessarily as bad as many people think). There are already many relat...

Back to top ↑

Reinforcement Learning

Linear Functions in RL, State-Action Features, and Eligibility Traces

7 minute read

Sutton and Barto’s standard textbook on Reinforcement Learning covers how state feature vectors may be constructed for linear state value functions. However, there is little explanation of the extension to state-action feature vectors. In this post I aim to fill this gap.

Back to top ↑

State-Action Features

Linear Functions in RL, State-Action Features, and Eligibility Traces

7 minute read

Sutton and Barto’s standard textbook on Reinforcement Learning covers how state feature vectors may be constructed for linear state value functions. However, there is little explanation of the extension to state-action feature vectors. In this post I aim to fill this gap.

Back to top ↑

Linear Function Approximation

Linear Functions in RL, State-Action Features, and Eligibility Traces

7 minute read

Sutton and Barto’s standard textbook on Reinforcement Learning covers how state feature vectors may be constructed for linear state value functions. However, there is little explanation of the extension to state-action feature vectors. In this post I aim to fill this gap.

Back to top ↑

Eligibility Traces

Linear Functions in RL, State-Action Features, and Eligibility Traces

7 minute read

Sutton and Barto’s standard textbook on Reinforcement Learning covers how state feature vectors may be constructed for linear state value functions. However, there is little explanation of the extension to state-action feature vectors. In this post I aim to fill this gap.

Back to top ↑