Computing the Page in Early-Modern Europe, Oxford, 15 mars 2024

Teaching Room, Oxford e-Research Centre, Keble Rd, Oxford

This workshop is hosted by the Visual Geometry Group (VGG) in association with the AHRC-funded Envisioning Dante project. 


0915 Welcome and introduction

0930-1045  Papers 1 and 2


1115-1230 Papers 3 and 4


1330-1530 Papers 5, 6 and 7


1600 Discussion and next steps

1700 End

Paper One

Segmenting Dante, 1470-1620

Guyda Armstrong, Giles Bergel, Rebecca Bowen, Abhishek Dutta, Simon Gilson, Gloria Moorman, David Pinto, Prasanna Sridhar, Andrew Zisserman, Guanqi Zhang (Manchester, Oxford)

Abstract: This paper will present the initial findings from a three-year project on the almost entire corpus of early editions of Dante’s Commedia. Lead by the University of Manchester and partnering with VGG in Oxford, the project has so far digitised almost 100 books and applied various segmentation models to the resulting images. The presentation will report results using Mask R-CNN, FASTER-CNN and Mask2Former models, with ground truth established and inference reviewed using the VGG Image Annotator (VIA) tools. The project has also begun to explore computer-aided image comparison, visual search and OCR. The presentation will discuss how domain knowledge (including reading as well as seeing the page) might intersect with the visual analysis, as well as some of the complexities of early printed books that the visual analysis both surfaces and seeks to address.

Paper Two

Werck der bücher’: Rediscovering the history of early modern printing using type recognition and type shape analysis

Florian Kordon (Pattern Recognition Lab of FAU Erlangen-Nürnberg); Nikolaus Weichselbaumer (Johannes Gutenberg-Universität Mainz)

Abstract: The ‘werck der bücher’ (work of books) project challenges the conventional view of the invention of printing, focusing on the period between 1440 and 1470 as one of diverse technological experimentation. Utilizing both typographic methods and computer vision techniques, we aim to examine the variety of printing techniques from this era, from blockbooks to movable type, to understand their development and interaction. Our work seeks to clarify how these technologies coexisted and possibly shared methodologies, moving away from the idea of isolated competition. This talk will discuss the methods we developed for recognizing font groups using locally combined OCR models and recognizing glyphs in early modern prints using Joint Energy-based Models. We will further discuss our methodology for recognizing and classifying the subtle differences in shape between different glyphs from a large collection of incunables.

Paper 3

Interpretable computer vision analysis of historical prints

Mathieu Aubry, Sonat Baltaci (École des Ponts ParisTech)

Abstract: In this talk, we will present interpretable AI algorithms and their applications on curated datasets of early printed books. First, we will present the algorithms we used for  illustration extraction and interpretable similarity search and the first results of our VHS project on the diffusion of scientific illustrations. Second, we will present an interpretable clustering algorithm, and how it can be used to cluster ornaments printed from woodblocks collected by the ROIi project. Finally, we will give an overview of other projects related to historical document analysis developed in our team, emphasising the online tools we built and made available online to foster collaborations with historians.

Paper 4

Layout analysis and networks of early modern printers

Hassan El-Hajj (Max Planck Institute for the History of Science); Matteo Valleriani (Max Planck Institute for the History of Science/Technische Universität Berlin/Tel Aviv University

In a recent study conducted as part of the project “The Sphere. Knowledge System Evolution and the Shared Scientific Identity of Europe,” it was concluded that, with reference to the collection of historical sources analyzed, about 50 percent of the collection had been produced through a process of “imitation:” the printers involved “imitated” books produced by other printers. This imitation concerned both content and form, particularly book size and layout. However, it was not a single model imitated equally by all printers but a series of books that, from time to time, gave rise to such a more or less intense process of imitation.In this way it has been possible to establish networks of printers for whom it can be safely said that they knew each other’s books produced (networks of awareness).The method for reaching this result was to develop a distance metric between portions of the fingerprints of the books belonging to the collection, a metric that treats fingerprints as vectors.Through this method, books similar in content and form are automatically identified simply based on the bibliographic metadata of the fingerprint. However, only 84 percent of the identified books turn out to be actually part of such concatenations of imitated sources. This result, while important, nevertheless represents a limitation as severe as the collection of sourcea analyzed is large, as manual empirical validation is necessary to eliminate the 16% of incorrect identifications.The presentation will briefly introduce the conducted study by elaborating on (a) the concept of “network of awareness” and all its possible historical interpretations based on early modern methods of text production and sale, (b) the limitations of the developed method, and (c) how, through the integration of Machine Learning, greater accuracy can be achieved with respect to the detection of similar texts and thus networks of printers.

Paper 5

Vignettes discovery in historical ornaments: Rey database and practices, limits and advances

Sayan Chaki1†, Remi Emonet1†,3, Fabienne Vial-Bonacci 2, Amaury Habrard1†,3, Christelle Bahier-Porte2, Thierry Fournel

Univ. Lyon, UJM-St-Etienne, CNRS, Institut d’Optique Graduate School, Inria \ Laboratoire Hubert Curien UMR 5516, F-42023, Saint-Etienne, France IHRIM-Institut d’Histoire des Représentations et des Idées dans les Modernités, UMR 5317, France; IUF University Institute of France

Abstract: The Marc-Michel Rey database, currently under construction, aims to gather detailed data on the ornaments printed in books addressed to or attributed to this bookseller. The books were published in the 18th century by this bookseller-publisher, who played a central role in the dissemination of Enlightenment thought. The unsupervised decomposition of compound ornaments into vignettes can aid book attribution and provide a better understanding of editorial practices during a period of censorship. This article highlights a shortcoming that currently limits automation of the task via segmentation when the number of glyphs increases. A possible improvement based on diffusion rendering will be discussed.

Paper 6

Camels, Nautili, Trees and More: On the Digital Exploration of Ottoman Nature in Travelogues

Doris Gruber (ÖAW), Michela Vignoli (AIT), Jacopo Jandl (ÖNB), Michael Seidl (AIT)

Visiting foreign regions strongly impacts people. In the early modern period, many travelers recorded their experiences. These travelogues have survived in large numbers and inspired countless research. Nature – animals, plants and landscapes – are often a central theme of these reports. Their role, the extent to which these representations reflect desires, expectations or needs, and figured as instruments to achieve cultural, military or political aims of the people involved in their production as well as their audience has, however, hardly been investigated.

The project Ottoman Nature in Travelogues, 1501–1850: A Digital Analysis, funded by the Austrian Science Fund (FWF: FWF: P 35245), is dedicated to this question. The focus lies on printed travelogues on the Ottoman Empire. We hereby explore new computerized methods, some of which use machine learning. The presentation summarizes the most important results of the first project phase on image analysis and outlines further plans.

The following institutions collaborate in the project: the Institute for Habsburg and Balkan Studies (IHB) of the Austrian Academy of Sciences (ÖAW), the Austrian Institute of Technology (AIT) as well as the Austrian National Library (ÖNB).

Paper Seven

Multi-Modal Insights into Early Modern Religious Visual Culture 

Drew Thomas, University College Dublin

This paper presents ‘Visualizing Faith: Print, Piety and Power’, a project investigating Protestant and Catholic visual communication in the Holy Roman Empire during the Reformation era. Leveraging the Ornamento corpus, which used computer vision and the VISE image matching software to identify and track visual elements in books printed from 1450 to 1600, we employ the Wise interface by VGG for text-based image search. By integrating the Wise API with our Solr index, we can refine our searches based on visual elements and bibliographic metadata. Additionally, we integrate GPT-4 to generate captions for illustrations, enhancing our understanding of visual rhetoric. By combining these two methods, we can better understand the evolution of graphic design and visual media during Europe’s first mass media event.

Contact:; 44 7866 566982


Le 22 février 2023 à 19h30 (heure française), Hazel Wilkinson, experte dans le cadre du projet ROIi, participera à une table-ronde réunissant des professionnels – historiens de l’art, conservateurs, catalogueurs, spécialistes des collections – sur la question des pratiques et de l’avenir de la description et du catalogage des ornements.

Le colloque est accessible gratuitement en ligne: programme et inscription à cette adresse :

Ateliers ROIi: 15 et 16 juin 2022, Université Jean Monnet, Saint-Etienne

L’équipe de l’ANR ROIi organise deux journées d’échanges visant à répondre aux problématiques posées par la construction d’une base de données intégrant une fonctionnalité d’identification d’anomalies au sein d’ornements anciens en vue de l’authentification d’un ouvrage.

Programme provisoire :

Inscription gratuite mais obligatoire : formulaire d’inscription.

ANR ROIi : Rey’s Ornament Image investigation

Le projet ROIi – Rey’s Ornament Image investigation (dir. Christelle Bahier-Porte), retenu par le CE 38 de l’ANR (“La révolution numérique : rapports au savoir et à la culture”), associe des chercheurs dans les domaines de l’histoire des idées, de la littérature et de l’histoire du livre (IHRIM-UMR 5317) et de la vision par ordinateur et de l’apprentissage automatique (Laboratoire Hubert Curien – UMR 5516). L’objectif de ce projet interdisciplinaire est de concevoir une base de données des ornements du libraire Marc-Michel Rey (1720-1780) associée à un outil d’aide à l’authentification, couplant vision par ordinateur et apprentissage automatique des données, des livres publiés sous des noms ou adresses fictifs ou contrefaits au XVIIIe siècle, par l’analyse des ornements.
Ce carnet a pour vocation de présenter de manière systématique et régulière les recherches et les activités scientifiques qui se dérouleront tout au long de la réalisation du projet ROIi. II servira également de passerelle entre les partenaires.

Rechercher dans OpenEdition Search

Vous allez être redirigé vers OpenEdition Search