The paper “Research workflows, paradata, and information visualisation: feedback on an exploratory integration of issues and practices - MEMORIA IS” (Dudek & Blaise, 2023) describes a prototype of an information system developed to improve the traceability, transmissibility and verifiability of archaeological research workflows. A key aspect of the work with MEMORIA is to make research documentation and the workflows underpinning the conducted research more approachable and understandable using a series of visual interfaces that allow users of the system to explore archaeological documentation, including metadata describing the data and paradata that describes its underlying processes. The work of Dudek and Blaise address one of the central barriers to reproducibility and transparency of research data and propose a set of both theoretically and practically well-founded tools and methods to solve this major problem. From the reported work on MEMORIA IS, information visualisation and the proposed tools emerge as an interesting and potentially powerful approach for a major push in improving the traceability, transmissibility and verifiability of research data through making research workflows easier to approach and understand.

In comparison to technical work relating to archaeological data management, this paper starts commendably with a careful explication of the conceptual and epistemic underpinnings of the MEMORIA IS both in documentation research, knowledge organisation and information visualisation literature. Rather than being developed on the basis of a set of opaque assumptions, the meticulous description of the MEMORIA IS and its theoretical and technical premises is exemplary in its transparence and richness and has potential for a long-term impact as a part of the body of literature relating to the development of archaeological documentation and documentation tools. While the text is sometimes fairly densely written, it is worth taking the effort to read it through. Another major strength of the paper is that it provides a rich set of examples of the workings of the prototype system that makes it possible to develop a comprehensive understanding of the proposed approaches and assess their validity.

As a whole, this paper and the reported work on MEMORIA IS forms a worthy addition to the literature on and practical work for developing critical infrastructures for data documentation, management and access in archaeology. Beyond archaeology and the specific context of the discussed work discussed this paper has obvious relevance to comparable work in other fields.

References

​The paper “Percolation Package – From Script Sharing to Package Publication” by Sophie C. Schmidt and Simon Maddison (2023) describes the development of an R package designed to apply Percolation Analysis to archaeological spatial data. In an earlier publication, Maddison and Schmidt (2020) describe Percolation Analysis and provide case studies that demonstrate its usefulness at different spatial scales. In the current paper, the authors use their experience collaborating to develop the R package as part of a broader argument for the importance of code sharing to the research process. 

The paper begins by describing the development process of the R package, beginning with borrowing code from a geographer, refining it to fit archaeological case studies, and then collaborating to further refine and systematize the code into an R package that is more easily reusable by other researchers. As the review by Joe Roe noted, a strength of the paper is “presenting the development process as it actually happens rather than in an idealized form.” The authors also include a section about the lessons learned from their experience. 

Moving on from the anecdotal data of their own experience, the authors also explore code sharing practices in archaeology by briefly examining two datasets. One dataset comes from “open-archaeo” (https://open-archaeo.info/), an on-line list of open-source archaeological software maintained by Zack Batist. The other dataset includes articles published between 2018 and 2023 in the Journal of Computer Applications in Archaeology. Schmidt and Maddison find that these two datasets provide contrasting views of code sharing in archaeology: many of the resources in the open-archaeo list are housed on Github, lack persistent object identifiers, and many are not easily findable (other than through the open-archaeo list). Research software attached to the published articles, on the other hand, is more easily findable either as a supplement to the published article, or in a repository with a DOI.

The examination of code sharing in archaeology through these two datasets is preliminary and incomplete, but it does show that further research into archaeologists’ code-writing and code-sharing practices could be useful. Archaeologists often create software tools to facilitate their research, but how often?  How often is research software shared with published articles? How much attention is given to documentation or making the software usable for other researchers? What are best (or good) practices for sharing code to make it findable and usable? Schmidt and Maddison’s paper provides partial answers to these questions, but a more thorough study of code sharing in archaeology would be useful. Differences among journals in how often they publish articles with shared code, or the effects of age, gender, nationality, or context of employment on attitudes toward code sharing seem like obvious factors for a future study to consider.

Shared code that is easy to find and easy to use benefits the researchers who adopt code written by others, but code authors also have much to gain by sharing. Properly shared code becomes a citable research product, and the act of code sharing can lead to productive research collaborations, as Schmidt and Maddison describe from their own experience. The strength of this paper is the attention it brings to current code-sharing practices in archaeology. I hope the paper will also help improve code sharing in archaeology by inspiring more archaeologists to share their research code so other researchers can find and use (and cite) it. 

References

Maddison, M.S. and Schmidt, S.C. (2020). Percolation Analysis – Archaeological Applications at Widely Different Spatial Scales. Journal of Computer Applications in Archaeology, 3(1), p.269–287. https://doi.org/10.5334/jcaa.54 

Schmidt, S. C., and Maddison, M. S. (2023). Percolation Package - From script sharing to package publication, Zenodo, 7966497, ver. 3 peer-reviewed and recommended by Peer Community in Archaeology. https://doi.org/10.5281/zenodo.7966497

Tsaknaki et al. (2023) discuss a work-in-progress project in which the presentation of Cultural Heritage is communicated using Serious Games techniques in a story-centric immersive narration instead of an exhibit-centered presentation with the use of Gamification, Augmented and Virtual Reality technologies. In the introduction the authors present the project called ECHOES, in which knowledge about the past of Thessaloniki, Greece is planned to be processed as an immersive and interactive experience. After presenting related work and the methodology, the authors describe the proposed design of the Serious Game and close the article with a discussion and conclusions.

The paper is interesting because it highlights an ongoing process in the realm of the visualization of Cultural Heritage (see for example Champion 2016). The process described by the authors on how to accomplish this by using Serious Games, Gamification, Augmented and Virtual Reality is promising, although still hypothetical as the project is ongoing. It remains to be seen if the proposed visuals and interactive elements will work in the way intended and offer users an immersive experience after all. A preliminary questionnaire already showed that most of the respondents were not familiar with these technologies (AR, VR) and in my experience these numbers only change slowly. One way to overcome the technological barrier however might be the gamification of the experience, which the authors are planning to implement.

I decided to recommend this article based on the remarks of the two reviewers, which the authors implemented perfectly, as well as my own evaluation of the paper. Although still in progress it seems worthwhile to have this article as a basis for discussion and comparison to similar projects. However, the article did not mention the possible longevity of data and in which ways the usability of the Serious Game will be secured for long-term storage. One eminent problem in these endeavors is, that we can read about these projects, but never find them anywhere to test them ourselves (see for example Gabellone et al. 2016). It is my intention with this review and the recommendation, that the ECHOES project will find a solution for this problem and that we are not only able to read this (and forthcoming) article(s) about the ECHOES project, but also play the Serious Game they are proposing in the near and distant future.

References

Champion, Erik Malcolm. 2016. „Entertaining the Similarities and Distinctions between Serious Games and Virtual Heritage Projects“. Entertainment Computing 14 (Mai): 67–74. https://doi.org/10.1016/j.entcom.2015.11.003

Gabellone, Francesco, Antonio Lanorte, Nicola Masini, und Rosa Lasaponara. 2016. „From Remote Sensing to a Serious Game: Digital Reconstruction of an Abandoned Medieval Village in Southern Italy“. Journal of Cultural Heritage. https://doi.org/10.1016/j.culher.2016.01.012

Tsaknaki, Electra, Anastasovitis, Eleftherios, Georgiou, Georgia, Alagialoglou, Kleopatra, Mavrokostidou, Maria, Kartsiakli, Vasiliki, Aidonis, Asterios, Protopsalti, Tania, Nikolopoulos, Spiros, and Kompatsiaris, Ioannis. (2023). Designing Stories from the Grave: Reviving the History of a City through Human Remains and Serious Games, Zenodo, 7981323, ver. 4 peer-reviewed and recommended by Peer Community in Archaeology. https://doi.org/10.5281/zenodo.7981323

This paper (2023) describes The Living Hill project dedicated to the archaeological park and fortress of Poggio Imperiale in Poggibonsi, Italy. The project is a collaboration between the Poggibonsi excavation and Entertainment Games App, Ltd. From the start, the project focused on the question of the intended audience rather than on the used technology. It was therefore planned to involve the audience in the creation of the game itself, which was not possible after all due to the covid pandemic. Nevertheless, the game aimed towards a visit experience as close as possible to reality to offer an educational tool through the video game, as it offers more periods than the medieval period showcased in the archaeological park itself.

The game mechanics differ from a walking simulator, or a virtual tour and the player is tasked with returning three lost objects in the virtual game. While the medieval level was based on a 3D scan of the archaeological park, the other two levels were reconstructed based on archaeological material. Currently, only a PC version is working, but the team works on a mobile version as well and teased the possibility that the source code will be made available open source. Lastly, the team also evaluated the game and its perception through surveys, interviews, and focus groups. Although the surveys were only based on 21 persons, the results came back positive overall.

The paper is well-written and follows a consistent structure. The authors clearly define the goals and setting of the project and how they developed and evaluated the game. Although it has be criticized that the game is not playable yet and the size of the questionnaire is too low, the authors clearly replied to the reviews and clarified the situation on both matters. They also attended to nearly all of the reviewers demands and answered them concisely in their response. In my personal opinion, I can fully recommend this paper for publication.

For future works, it is recommended that the authors enlarge their audience for the quesstionaire in order to get more representative results. It it also recommended to make the game available as soon as possible also outside of the archaeological park. I would also like to thank the reviewers for their concise and constructive criticism to this paper as well as for their time.

References

Mariotti, Samanta. (2023) Transforming the Archaeological Record Into a Digital Playground: a Methodological Analysis of The Living Hill Project, Zenodo, 8302563, ver. 5 peer-reviewed and recommended by Peer Community in Archaeology https://doi.org/10.5281/zenodo.8302563

The paper entitled “Probabilistic Modelling using Monte Carlo Simulation for Incorporating Uncertainty in Least Cost Path Results: a Roman Road Case Study” [1] submitted by J. Lewis presents an innovative approach to applying Least Cost Path (LCP) analysis to incorporate uncertainty of the Digital Elevation Model used as the topographic surface on which the path is calculated.

The proposition of using Monte Carlo simulations to produce numerous LCP, each with a slightly different DEM included in the error range of the model, allows one to strengthen the method by proposing a probabilistic LCP rather than a single and arbitrary one which does not take into account the uncertainty of the topographic reconstruction. This new method is integrated in the R package leastcostpath [2].

The author tests the method using a Roman road built along a ridge in Cumbria, England. The integration of the uncertainty of the DEM, thanks to Monte Carlo simulations, shows that two paths could have the same probability to be the real LCP. One of them is indeed the path that the Roman road took. In particular, it is one of two possibilities of LCP in the south to north direction.

This new probabilistic method therefore strengthens the reconstruction of past pathways, while also allowing new hypotheses to be tested, and, in this case study, to suggest that the northern part of the Roman road’s location was selected to help the northward movements.

[1] Lewis, J., 2020. Probabilistic Modelling using Monte Carlo Simulation for Incorporating Uncertainty in Least Cost Path Results: a Roman Road Case Study. SocArXiv, mxas2, ver 17 peer-reviewed and recommended by PCI Archaeology, 10.31235/osf.io/mxas2.

[2] Lewis, J., 2020. leastcostpath: Modelling Pathways and Movement Potential Within a Landscape. R package. Version 1.7.4.