​​This paper [1] covers an interesting topic in that it presents through ethnography an insight into a traditional method of food production which is gradually declining in use. In addition to preserving traditional knowledge, the ethnographic study of grinding stones has the potential for showing how similar tools may have been used by people in the past, particularly from the same geographic region.

[1] Thongdok Norbu J., Nimasow Gibji, Nimasow Oyi D. (2021) Ran-thok and Ling-chhom: indigenous grinding stones of Shertukpen tribes of Arunachal Pradesh, India. Zenodo, 5118675, ver. 4 peer-reviewed and recommended by PCI Archaeo. doi: https://doi.org/10.5281/zenodo.5118675

Over the last decade, a small but growing community of archaeologists, from a diversity of intellectual and demographic backgrounds, have been striving for computational reproducibility in their published research. In their survey of the accomplishments of this thriving community, Emma Karoune and Esther Plomp (2022) analyzed the wide variety of approaches researchers have taken to enhance the reproducibility of their research. A key contribution of this paper is their excellent synthesis of diverse approaches into three levels of increasing complexity. This is helpful because it provides multiple entry points for researchers new to the challenge of fortifying their research. Many researchers assume that computational reproducibility is only achievable if they have a high degree of technical skill with computers, or is only necessary if their work is very computationally intensive. Karoune and Plomp give three compelling reasons why reproducibility is important for all archaeological research, and through their three levels they demonstrate that how these levels can be accomplished with basic, non-specialized computer skills and widely used free software. They showcase exemplary work from a variety of archaeologists to show how practical and achievable reproducible research is for all archaeologists. They advocate for archaeologists to use the most widely used and supported tools and services to support their reproducible research, such as the R and Python programming languages for data analysis, and Git and GitHub for collaboration. 

This paper, with its extensive appendix including thoughtful responses to frequently asked questions about reproducible research in archaeology, is likely to have a wide reach and influence, beyond previous works on this topic that have largely focused on technical details. Karoune and Plomp have provided the on-ramp for a generation of archaeologists who will find their questions about reproducible research answered here. They will also find an agreeable entry point to reproducible research in one of the three levels described by the authors. Will every archaeologist embrace this way of working? Should they? The work of Leonelli (2018) can help us anticipate the answers to these questions. Leonelli asks where are the limits to reproducibility, and how do the characteristics of different ways of knowing affect the desirability of reproducibility? Leonelli's work invites us to consider that there will be archaeologists coming from different epistemic cultures for whom the motivations presented by Karoune and Plomp will not resonate. For example, archaeologists engaged in mostly hermeneutical social science and humanities research, who do little or no quantitative analysis and statistics, are unlikely to see reproducibility as meaningful or desirable for their work. We can describe these researchers as working in interpretative or constructivist epistemic cultures. In these cultures, the particulars of how an individual researcher engages with their subject are exclusive and unique, and they would argue it cannot be fully captured or shared in an meaningful way (Elman and Kapiszewski 2017). Here, knowledge is situational, emerging from a specific, once-off combination of people and circumstances. One example in archaeology is the chaîne opératoire approach of stone artefact analysis, which Monnier and Missal (2014:61) describe as "based upon the analyst's experience and intuition, and it is not replicable, nor quantifiable". To make sense of this example we can draw on Galison's (1997) concept of 'image traditions' and 'logic traditions'. An image tradition is a way of knowing that is qualitative, based on composing narratives from drawings and photographs. A logic tradition is based on the use of instruments and statistical methods to collect standardised quantitative data. Chaîne opératoire approaches fall into the image tradition, along with many other ways of working in archaeology that do not generate numbers or use them to support claims about the past. Archaeologists working in a logic tradition will find reproducible research to be more meaningful than those working in an image tradition.

We should be mindful not to claim that one epistemic culture is superior to another because reproducibility is not meaningful or attainable for researchers in one culture. Such a claim would threaten the plurality that is essential for the reliability of scientific knowledge (Massimi 2022). Instead we should identify those communities in archaeology where reproducible research is both meaningful and attainable, but has not yet been widely embraced. That is the where the most beneficial effects can be expected. According to Leonelli's (2018) framework, we can recognise these communities by a few basic characteristics. For example: they are doing computationally intensive archaeology, such as using or writing software to collect, simulate, analyse or visualise data; they are doing experimental archaeology; or they are making knowledge claims that are supported by tables of numeric data and data visualisations. Archaeologists whose work shares one or more of these characteristics will find the guidance provided here by Karoune and Plomp to be highly instructive and relevant, and stand the most to benefit from it.  ​​

But it is not only individual archaeological scientists that have potential to benefit from how Karoune and Plomp have lowered the barriers to reproducible research. An especially important implication of this paper is that by lowering the barriers to reproducible research, Karoune and Plomp help us all to lower barriers to participation in archaeology in general. Documenting our research transparently, and sharing our materials (such as data and code and so on) openly, can profoundly change how others can participate in archaeology. By doing this, we are enabling students and researchers elsewhere, for example in low and middle income locations, to use our materials in their teaching and learning. Other researchers and students can apply our methods to their data, and combine their data with ours to achieve syntheses beyond what a single project can do. Similarly, for archaeologists working with local, descendant or marginalized communities, the tools of reproducible research are vital for enabling community members to have full access to the archaeological process, and thus reproducibility may be considered a necessity for decolonising the discipline. Karoune and Plomp present the CARE principles (Carroll et al. 2020) to guide archaeologists in ensuring community control of data so that reproducibility can be ethically accomplished with community safety and well-being as a priority. This may have a profoundly positive impact on the demographics of archaeology, as it lowers the barriers of meaningful participation by people far beyond our immediate groups of collaborators. 

Making archaeology more accessible is of critical importance in stemming the negative social impacts of pseudoarchaeologists, who often claim that archaeologists actively suppress the truth of the archaeological record through secrecy, elitism, and exclusiveness. The harm in this is twofold. First, that pseudoarchaeology typically erases Indigenous heritage by claiming that their past achievements were due to an ancient, extinct advanced civilization, not Indigenous people. These claims are often adopted by white supremacists to support racist and antisemitic conspiracy theories (Turner and Turner 2021), which sometimes leads to prejudice, physical violence, radicalization and extremism. A second type of harm that can come from claims of secrecy and elitism is it drains public trust in experts, leading to science denial. Not only trust in archaeologists, but trust in many kinds of experts, including those working on urgent contemporary issues such as public health and climate change. Karoune and Plomp's work is important here because it provides a practical and affordable pathway for archaeologists to fight claims of secrecy and elitism by sharing their work in ways that make it possible for non-academics to inspect the analyses and logic in detail. Claims of secrecy and elitism can be easily countered by openness, transparently and reproducibility by archaeologists. This is not only useful for tackling pseudoarchaeologists, but also in enacting an ethic of care, framing members of the public as people that not only care about archaeology as part of humanity's shared heritage, but also care for the construction of reliable interpretations of the archaeological record to provide secure and authentic foundations for their social identities and relationships (Wylie et al 2018; de la Bellacasa 2011). By striving for reproducible research in the way described by Karoune and Plomp, we are practicing a kind of reciprocal care among ourselves as archaeologists, and between archaeologists and members of the public as two communities who care about the human past. 

References

Karoune, E., and Plomp, E. (2022). Removing Barriers to Reproducible Research in Archaeology. Zenodo, 7320029, ver. 5 peer-reviewed and recommended by Peer Community in Archaeology. https://doi.org/10.5281/zenodo.7320029

de la Bellacasa, M. P. (2011). Matters of care in technoscience: Assembling neglected things. Social Studies of Science, 41(1), 85–106. https://doi.org/10.1177/0306312710380301

Carroll, S. R., Garba, I., Figueroa-Rodríguez, O. L., Holbrook, J., Lovett, R., Materechera, S., Parsons, M., Raseroka, K., Rodriguez-Lonebear, D., Rowe, R., Sara, R., Walker, J. D., Anderson, J., and Hudson, M. (2020). The CARE Principles for Indigenous Data Governance. Data Science Journal, 19(1), Article 1. https://doi.org/10.5334/dsj-2020-043​

Elman, C., and Kapiszewski, D. (2017). Benefits and Challenges of Making Qualitative Research More Transparent. Inside Higher Ed 2017,  http://web.archive.org/web/20220407064134/https://www.insidehighered.com/blogs/rethinking-research/benefits-and-challenges-making-qualitative-research-more-transparent (accessed 21 Oct, 2022). 

Galison, P. (1997). Image and logic: a material culture of microphysics. Chicago (IL): University of Chicago Press.

Leonelli, S. (2018). Re-Thinking Reproducibility as a Criterion for Research Quality [preprint]. Available online: http://philsci-archive.pitt.edu/id/eprint/14352 (Accessed 21 Oct 2022).

Massimi, M. (2022). Perspectival realism. Oxford University Press.

Monnier, G. F., and Kele M.. "Another Mousterian debate? Bordian facies, chaîne opératoire technocomplexes, and patterns of lithic variability in the western European Middle and Upper Pleistocene." Quaternary International 350 (2014): 59-83. https://doi.org/10.1016/j.quaint.2014.06.053

Turner, D. D., and Turner, M. I. (2021). “I’m Not Saying It Was Aliens”: An Archaeological and Philosophical Analysis of a Conspiracy Theory. In A. Killin and S. Allen-Hermanson (Eds.), Explorations in Archaeology and Philosophy (pp. 7–24). Springer International Publishing. https://doi.org/10.1007/978-3-030-61052-4_2

​Wylie, C., Neeley, K., and Ferguson, S. (2018). Beyond Technological Literacy: Open Data as Active Democratic Engagement? Digital Culture & Society, 4(2), 157–182. https://doi.org/10.14361/dcs-2018-0209​​​​

​

​

​

​

​

​

​​​​​

The paper “Research workflows, paradata, and information visualisation: feedback on an exploratory integration of issues and practices - MEMORIA IS” (Dudek & Blaise, 2023) describes a prototype of an information system developed to improve the traceability, transmissibility and verifiability of archaeological research workflows. A key aspect of the work with MEMORIA is to make research documentation and the workflows underpinning the conducted research more approachable and understandable using a series of visual interfaces that allow users of the system to explore archaeological documentation, including metadata describing the data and paradata that describes its underlying processes. The work of Dudek and Blaise address one of the central barriers to reproducibility and transparency of research data and propose a set of both theoretically and practically well-founded tools and methods to solve this major problem. From the reported work on MEMORIA IS, information visualisation and the proposed tools emerge as an interesting and potentially powerful approach for a major push in improving the traceability, transmissibility and verifiability of research data through making research workflows easier to approach and understand.

In comparison to technical work relating to archaeological data management, this paper starts commendably with a careful explication of the conceptual and epistemic underpinnings of the MEMORIA IS both in documentation research, knowledge organisation and information visualisation literature. Rather than being developed on the basis of a set of opaque assumptions, the meticulous description of the MEMORIA IS and its theoretical and technical premises is exemplary in its transparence and richness and has potential for a long-term impact as a part of the body of literature relating to the development of archaeological documentation and documentation tools. While the text is sometimes fairly densely written, it is worth taking the effort to read it through. Another major strength of the paper is that it provides a rich set of examples of the workings of the prototype system that makes it possible to develop a comprehensive understanding of the proposed approaches and assess their validity.

As a whole, this paper and the reported work on MEMORIA IS forms a worthy addition to the literature on and practical work for developing critical infrastructures for data documentation, management and access in archaeology. Beyond archaeology and the specific context of the discussed work discussed this paper has obvious relevance to comparable work in other fields.

References

Paleolithic archaeologists habitually measure 3-coordinate data for artifacts in their excavations. This was first done manually, and in the last three decades it is usually performed by a total station and associated hardware. While the field recording procedure is quite straightforward, visualizing and analyzing the data are not, often requiring specialized proprietary software or coding expertise. Here, Royer and colleagues (2023) present the SEAHORS application, an elegant solution for the post-excavation analysis of artifact coordinate data that seems to be instantly useful for numerous archaeologists. SEAHORS allows one to import and organize field data (Cartesian coordinates and point description), which often comes in a variety of formats, and to create various density and distribution plots. It is specifically adapted to the needs of archaeologists, is free and accessible, and much simpler to use than many commercial programs. The authors further demonstrate the use of the application in the post-excavation analysis of the Cassenade Paleolithic site (see also Discamps et al., 2019). 

While in no way detracting from my appreciation of Royer et al.’s (2023) work, I would like to play the devil’s advocate by asking whether, in the majority of cases, field recording of artifacts in three coordinates is warranted. Royer et al. (2023) regard piece plotting as “…indispensable to propose reliable spatial planimetrical and stratigraphical interpretations” but this assertion does not hold in all (or most) cases, where careful stratigraphic excavation employing thin volumetric units would do just as well.

Moreover, piece-plotting has some serious drawbacks. The recording often slows excavations considerably, beyond what is needed for carefully exposing and documenting the artifacts in their contexts, resulting in smaller horizontal and vertical exposures (e.g., Gilead, 2002). This typically hinders a fuller stratigraphic and contextual understanding of the excavated levels and features. Even worse, the method almost always creates a biased sample of “coordinated artifacts”, in which the most important items for understanding spatial patterns and site-formation processes – the small ones – are underrepresented. Some projects run the danger of treating the coordinated artifacts as bearing more significance than the sieve-recovered items, preferentially studying the former with no real justification. Finally, the coordinated items often go unassigned to a volumetric unit, effectively disconnecting them from other types of data found in the same depositional contexts.  

The advantages of piece-plotting may, in some cases, offset the disadvantages. But what I find missing in the general discourse (certainly not in the recommended preprint) is the “theory” behind the seemingly technical act of 3-coordinate recording (Yeshurun, 2022). Being in effect a form of sampling, this practice needs a rethink about where and how to be applied; what depositional contexts justify it, and what the goals are. These questions should determine if all “visible” artifacts are plotted, or just an explicitly defined sample of them (e.g., elongated items above a certain length threshold, which should be more reliable for fabric analysis), or whether the circumstances do not actually justify it. In the latter case, researchers sometimes opt for using “virtual coordinates” within in each spatial unit (typically 0.5x0.5 m), essentially replicating the data that is generated by “real” coordinates and integrating the sieve-recovered items as well. In either case, Royer et al.’s (2023) solution for plotting and visualizing labeled points within intra-site space would indeed be an important addition to the archaeologists’ tool kits.

References cited 

Discamps, E., Bachellerie, F., Baillet, M. and Sitzia, L. (2019). The use of spatial taphonomy for interpreting Pleistocene palimpsests: an interdisciplinary approach to the Châtelperronian and carnivore occupations at Cassenade (Dordogne, France). Paleoanthropology 2019, 362–388. https://doi.org/10.4207/PA.2019.ART136

Gilead, I. (2002). Too many notes? Virtual recording of artifacts provenance. In: Niccolucci, F. (Ed.). Virtual Archaeology: Proceedings of the VAST Euroconference, Arezzo 24–25 November 2000. BAR International Series 1075, Archaeopress, Oxford, pp. 41–44.

Royer, A., Discamps, E., Plutniak, S. and Thomas, M. (2023). SEAHORS: Spatial Exploration of ArcHaeological Objects in R Shiny Zenodo, 7957154, ver. 2 peer-reviewed and recommended by Peer Community in Archaeology. https://doi.org/10.5281/zenodo.7929462

Yeshurun, R. (2022). Intra-site analysis of repeatedly occupied camps: Sacrificing “resolution” to get the story. In: Clark A.E., Gingerich J.A.M. (Eds.). Intrasite Spatial Analysis of Mobile and Semisedentary Peoples: Analytical Approaches to Reconstructing Occupation History. University of Utah Press, pp. 27–35. 

The paper entitled 'Social Network Analysis, Community Detection Algorithms, and Neighbourhood Identification in Pompeii' [1] presents a significant contribution to the field of archaeological network research, particularly in the challenging task of identifying urban neighborhoods within the context of Pompeii. This study focuses on the relational dynamics within urban neighborhoods and examines their indistinct boundaries through advanced analytical methods. The methodology employed provides a comprehensive analysis of community detection, including the Louvain and Leiden algorithms, and introduces a novel Convex Hull of Admissible Modularity Partitions (CHAMP) algorithm. The incorporation of a network approach into this domain is both innovative and timely.

The potential impact of this research is substantial, offering new perspectives and analytical tools. This opens new avenues for understanding social structures in ancient urban settings, which can be applied to other archaeological contexts beyond Pompeii. Moreover, the manuscript is not only methodologically solid but also well-written and structured, making complex concepts accessible to a broad audience.

In conclusion, this study represents a valuable contribution to the field of archaeology, particularly for archaeological network research. Their results not only enhance our knowledge of Pompeii but also provide a robust framework for future studies in similar historical contexts. Therefore, this publication advances our understanding of social dynamics in historical urban environments. The rigorous analysis, combined with the innovative application of network algorithms, makes this study a noteworthy addition to the existing body of network science literature. It is recommended for a wide range of scholars interested in the intersection of archaeology, history, and network science.

Reference

[1] Notarian, Matthew. 2024. Social Network Analysis, Community Detection Algorithms, and Neighbourhood Identification in Pompeii. https://doi.org/10.5281/zenodo.8305968