Computational Model Library

This model implements a classic scenario used in Reinforcement Learning problem, the “Cliff Walking Problem”. Consider the gridworld shown below (SUTTON; BARTO, 2018). This is a standard undiscounted, episodic task, with start and goal states, and the usual actions causing movement up, down, right, and left. Reward is -1 on all transitions except those into the region marked “The Cliff.” Stepping into this region incurs a reward of -100 and sends the agent instantly back to the start (SUTTON; BARTO, 2018).


The problem is solved in this model using the Q-Learning algorithm. The algorithm is implemented with the support of the NetLogo Q-Learning Extension

This is a re-implementation of a the NetLogo model Maze (ROOP, 2006).

This re-implementation makes use of the Q-Learning NetLogo Extension to implement the Q-Learning, which is done only with NetLogo native code in the original implementation.

This simulation is of the 2003 Station Nightclub Fire and is part of the Interdependencies in Community Resilience (ICoR) project ( The git contains the simulation as well as csvs of data about the fire, smoke, building, and people involved.

Organisms, Individuals and Organizations face the dilemma of exploration vs. exploitation
Identifying the optimal trade-off between the two is a challenge
Too much exploration (e.g. gaining new knowledge) can be detrimental to day-to-day survival and too much exploitation (applying existing knowledge) could be detrimental to long term survival esp. if conditions change over time

The purpose of the model is to investigate how the amount of resources acquired (wealth/success) is related to persistence with the strategy of local exploration under different resource distributions, availability of resources over time and cost of relocation

Peer reviewed MGA - Minimal Genetic Algorithm

Cosimo Leuci | Published Tue Sep 3 07:52:29 2019

Genetic algorithms try to solve a computational problem following some principles of organic evolution. This model has educational purposes; it can give us an answer to the simple arithmetic problem on how to find the highest natural number composed by a given number of digits. We approach the task using a genetic algorithm, where the possible answers to solve the problem are represented by agents, that in logo programming environment are usually known as “turtles”.

PowerGen-ABM is an optimisation model for power plant expansions from 2010 to 2025 with Indonesian electricity systems as the case study. PowerGen-ABM integrates three approaches: techno-economic analysis (TEA), linear programming (LP), and input-output analysis (IOA) and environmental analysis. TEA is based on the revenue requirement (RR) formula by UCDavis (2016), and the environmental analysis accounts for resource consumption (i.e., steel, concrete, aluminium, and energy) and carbon dioxide equivalent (CO2e) emissions during the construction and operational stages of power plants.

The code shared here accompanies the paper at It simulates the effects of various economic trade scenarios on the phenomenon of the ‘disappearing middle’ in the Scottish beef and dairy farming industries. The ‘disappearing middle’ is a situation in which there is a simultaneous observed decline in medium-sized enterprises and rise in the number of small and large-scale enterprises.

An agent-based simulation of a game of basketball. The model implements most components of a standard game of basketball. Additionally, the model allows the user to test for the effect of two separate cognitive biases – the hot-hand effect and a belief in the team’s franchise player.


Adrian Lara | Published Mon Dec 17 19:15:01 2018

Development of a Multiagent System for the Analysis of Gentrification in Latin America, an Agent-Based Model

BorealFireSIM Model

Liliana Perez | Published Thu Dec 13 20:55:27 2018

BorealFireSIM is a cellular automaton based model that serves to identify future fire patterns in the boreal forest of Quebec, Canada. The model simulates yearly fire seasons and adjusts decadal climate variables based on two future carbon pathways (RCP45 (low emissions) and RCP85 (business as usual)). The BorealFireSIM model simulates future fire patterns up to the year 2100.

This website uses cookies and Google Analytics to help us track user engagement and improve our site. If you'd like to know more information about what data we collect and why, please see our data privacy policy. If you continue to use this site, you consent to our use of cookies.