The ODD protocol for describing agent-based and other simulation models: A second update to improve clarity, replication, and structural realism

Grimm, V, Railsback, SF, Vincenot, CE, Berger, U, Gallagher, C, Deangelis, DL, Edmonds, B ORCID: https://orcid.org/0000-0002-3903-2507, Ge, J, Giske, J, Groeneveld, J, Johnston, ASA, Milles, A, Nabe-Nielsen, J, Polhill, JG, Radchuk, V, Rohwäder, MS, Stillman, RA, Thiele, JC and Ayllón, D (2020) The ODD protocol for describing agent-based and other simulation models: A second update to improve clarity, replication, and structural realism. Journal of Artificial Societies and Social Simulation, 23 (2). ISSN 1460-7425

Preview

Published Version Download (797kB) | Preview

Abstract

The Overview, Design concepts and Details (ODD) protocol for describing Individual-and Agent-Based Models (ABMs) is now widely accepted and used to document such models in journal articles. As a standardized document for providing a consistent, logical and readable account of the structure and dynamics of ABMs, some research groups also find it useful as a workflow for model design. Even so, there are still limitations to ODD that obstruct its more widespread adoption. Such limitations are discussed and addressed in this paper: the limited availability of guidance on how to use ODD; the length of ODD documents; limitations of ODD for highly complex models; lack of sufficient details of many ODDs to enable reimplementation without access to the model code; and the lack of provision for sections in the document structure covering model design ratio-nale, the model’s underlying narrative, and the means by which the model’s fitness for purpose is evaluated. We document the steps we have taken to provide better guidance on: structuring complex ODDs and an ODD summary for inclusion in a journal article (with full details in supplementary material; Table 1); using ODD to point readers to relevant sections of the model code; update the document structure to include sections on model rationale and evaluation. We also further advocate the need for standard descriptions of simulation experiments and argue that ODD can in principle be used for any type of simulation model. Thereby ODD would provide a lingua franca for simulation modelling.