Projects

Projects 2020

Guidelines

For the first presentation (01.10)

(1) Choose one or two projects from the project list and invent another one.

(2) Form a group of 2-3 people and fill out the table.

(3) Prepare a short presentation (1-2 slides) for your projects.

Projects list

1. Deciphering Venetian handwriting (Raphaël)
2. Austrian cadastral map (Raphaël)
3. Paintings / Photos geolocalisation (Frederic, Paul)
4. Toponomastics (Federica)
5. Sanudo’s Diaries (Federica)
6. Venice 1100 and 1300 (Federica)
7. San Giorgio 4D Cloud Points (Albane)
8. Photogrammetric reconstruction of Venice based on Youtube movies (Albane)
9. Procedural Venice (Fabrice, Paul)
10. Photorealistic rendering of painting (GAN) (Frederic, Raphael)
11. Coherence Fact-checking (Frederic)
12. Biography generation (Frederic)
13. Venice IIIF Annotator (Frederic)
14. Homologous navigation(Frederic)
15. Open Data from Venice 1808 (Raphaël)
16. Venice 1808 immersive experience (Fabrice)
17. Quora for Venitian history (Frederic)
18. Venice underwater (Frederic) - Connection with on-going project in Venice about Aqua Alta
19. Unbuilt Venice (Fabrice)
20. Opera Rolandi archive (Frederic) - Connection with on-going project at Cini Foundation
21. Terzani archive (Frederic) - Connection with on-going project at Cini Foundation

The name of the different supervisor for the projects are: Albane Descombes Fabrice Berger Federica Pardini Raphaël Barman Frederic Kaplan

You can find email addresses on EPFL directory. Plus put the Frederic Kaplan, Paul Guhennec and Raphael Barman in copy for the first exchanges

Available ressources

Data and sources

Here is a small list of the available resources for your projects. Do not hesitate to send an e-mail if you have questions about any of them.

• Data for training a handwritten text recognition (HTR) system.
• Data for training a geometries extractor from the cadastral map.
• High-resolution images of Venice's Austrian cadastral map.
• Complete transcription of the registers (Sommarioni) of the 1808 Venice's Napoleonic cadaster (parcel number, owner name, typology of parcels).
• Complete extraction the 1808 Venice's Napoleonic cadastral map.
• Partial extraction from the proto-cadaster (Catastici) of 1740 Venice. (Owner name, tenant name, typology of parcel, link with 1808 cadaster).
• Large photo and painting archive from the Cini Foundation.
• Numerization and/or physical book of Tassini’s toponomastics, Sanudo’s Diaries, Venezia romanica.
• 4D point cloud for San Giorgio.
• 3D procedural model (in progress) of Venice.
• Data from the Garzoni project c.f. here for more information.

DHLAB skills

The current main skills of the laboratory are:

• Architecture and History of Venice.
• Cadaster information extraction and HTR.
• Photogrammetric reconstruction.
• 3D modeling.

You can however still do a project outside of these fields of expertise. We will do our best to help you.

Groups

First student name	Second student name	Third student name	Project name 1	Project name 2	Project name 3 (Optional)
Beatriz Borges	Lilia Ellouz	André Ghattas	Biography generation ***	Chat-a-ghost
Elisa Michelet	Gonxhe Idrizi		Opera Rolandi archive ***	Score Digitization	Tassini’s toponomastics
Ravinithesh Annapureddy	Maxime Jan		Colorization of Terziani Archive *** (GAN)	Immersive educational game	Instavenice (Instagram of Past Venice)
Mariko Makhmutova	Alex Rusnak	Anna Sophia Bauer	Photorealistic rendering of painting + Venice Underwater *** (GAN)	Using historical artifacts to trace trade routes	Venice underwater
Jeremy Mion	Bastien Beuchat		Deciphering Venetian handwriting ***	Venice 1808 immersive experience	Art forgery detector
Michał Bień	Graziano Conti Rossini		Biography generation ***	Facebook for Venetian Artists
Junhong Li	Yuanhui Lin	Zijun Cui	Paintings / Photos geolocalisation ***	Day matters in Venice
Hangqian Li	Linyida Zhang		Procedural Venice ***	Modern people in Venice(GAN)
Maximilian Ben Ali	Eva Laini		Austrian cadastral map ***
Ludovica Schaerf	Aurel Ruben	Harshdeep	Rolandi Librettos ***	Terzani Photo collection

Projects 2019

Guidelines

• (1) Select an image series on Paris
• (2) Make a sketch (drawing + textual description) of a final interface
• (3) Extract the maximum information out of it (Train a segmenter, Train a handwritten recognition system)
• (4) Export this information in other places in the Web or Build a website with specific services

As the focus of this year is Paris and interaction between projects is wanted, projects should ideally make use of a common system. Example of a common system is street names, addresses or in some cases name of people.

Image collections

• Gallica offers a large collection of images of a variety of types. The most useful entry point is the Paris collection.
• The Bibliothèque numérique of INHA offers a lot of resources in link with art history.
• The Archives de Paris have many administrative documents as well as a large photography collection.

Specific examples

• Photographies of Eugène Atget documents the forgotten Paris of 19th century. They can be found on Gallica and on INHA library.
• Architectural photograhy collection of Archives de Paris.
• Grand monde de Paris , address book of famous people of Paris, found on Gallica.
• Name and reservations for some theaters of Paris found on Gallica and plan of the theatre room also found on Gallica.

Resources

Tips and tricks

• Be careful about encoding when using OCR from Gallica. The XML tag says that the encoding is ISO-8859-1, but the actual encoding is UTF-8. Force the encoding when opening the file in python. Additionally, you can modify the tag directly inside the XML so that it opens correctly in your favorite text editor.
• In python, if you launch a for loop with expensive operation, it can be nice to know how long each iteration takes and to have an idea of the general progress. This can be done using the tqdm package. When wrapping an iterable with it, a progress bar will appear, e.g. for item in tqdm(list_of_items):. Note this can also be used with pandas, c.f. the documentation.

Data extraction tools

• Gallica wrapper to download documents, images and OCR from Gallica directly from Python.
• Transkribus to make your own OCR. It also offers a REST API if you prefer.
• VGG Image annotator (VIA) to annotate your documents.
• OCR and HTR available for documents who do not have it. (Caveat for HTR, the data series should be uniform and needs to be annotated by hand).
• dhSegment for segmenting visually distinct part of documents.

Databases/APIs

• Gallica document API, Gallica image extraction API, python Gallica API wrapper and python periodical corpus extractor
• INHA offers an OAI-PMH API, see here for an entry point.
• Data BNF, WikiData for general-purpose knowledge base.
• Lists of addresses of Paris

Sketches

First student name	Second student name	Third student name	Sketch 1	Sketch 2	Sketch 3
Guilhem Sicard	Todor Manev	-	Sketch of Love2Late	Sketch of The 1897 directory of businesses
Giacomo Alliata	Andrea Scalisi	-	Sketch of Influencers of the past	Sketch of Artwork origins in Paris
Leonore Guillain	Haeeun Kim	Liamarcia Bifano	Sketch of Humans of Paris 1900	Sketch of ImmoSearch Paris 1900	Sketch of Job Search Paris 1900
Arthur Parmentier	Bertil Wicht	-	Sketch of Book editing in Paris 1847	Sketch of Trip advisor Paris	Sketch of Bike from Paris
Robin Szymczak	Cédric Tomasini		Sketch of Virtual Louvre	Sketch of Diving into the Opera	Sketch of Article in context

Projects

Group number	First student name	Second student name	Third student name	Project page
1	Guilhem Sicard	Todor Manev	-	Love2Late
2	Giacomo Alliata	Andrea Scalisi	-	Influencers of the past
3	Leonore Guillain	Haeeun Kim	Liamarcia Bifano	Humans of Paris 1900
4	Arthur Parmentier	Bertil Wicht	-	Quartiers Livres / Booking Paris
5	Robin Szymczak	Cédric Tomasini		Virtual Louvre

Projects 2018

• (1) Choose a Map on Gallica https://gallica.bnf.fr/accueil/?mode=desktop
• (2) Extract the maximum information out of it (Train a segmenter, Train a handwritten recognition system)
• (3) Export this information in other places in the Web or Build a website with specific services

Projects websites

• Shortest-Path Route Extraction From City Map
• Train schedules
• Paris 1909 TripAdvisor
• A century in Beijing
• Coal supply in the German Empire
• Paris Metropolitan, an evolution

Shortest-Path Route Extraction From City Map

The goal of this project is to give people an idea of what it might have been like to find one's way around cities of the past, by building a navigation tool not unlike Google Maps or similar services - except it is for the past. The application will create and display the shortest path between user-selected start and end points, using information extracted from an old city map. The finished application will be made available via a web-interface.

On a technical level, the approach is based on extracting the road network from the map, representing it as an undirected planar graph, then applying Dijkstra's algorithm to solve the routing problem.

Members: Jonathan and Florian

Train schedules

This project aims to observe how one could travel between France, Switzerland and the North of Italy back in the middle of the 19th century. From the journey paths, schedules and prices, one will realize how easy it is now to travel through Europe and how big the impact of the evolution of both the railway network and the technology has been. These data will be extracted from a document from 1858and computed in a CFF-like website so that one can put oneself in the shoes of a railway user of the 1850's.

Members: Anna Fredrikson and Olivier Dietrich

Paris 1909 TripAdvisor

The project intends to recreate the cultural geography of Paris in the Belle Époque, immersing a user into the world of cabarets, balls, theatres, the universe described by Zola and Proust, and painted by Renoir and Toulouse-Lautrec. In order to give a new perspective on how this legendary world was actually structured and perceived, we are going to digitize the authentic Plan des plaisirs et attractions de Paris created in 1909 and augment it with the pieces of evidence and descriptions from the Guide dés plaisirs à Paris: timetables, advice and guidance on what to wear, what to say, and where to go.

- Alina, Maryam, and Paola

A century in Beijing

Using this map by France's Service Géographique de l'Armée from 1900 we will follow the evolution of the urban landscape of the central part of China's capital over the last hundred years.

The planned goals

• To align maps from different time periods and see how the landscape changed. The town's straightforward rectangular planning will allow us to make matches more easily.
• The map has a rich legend with toponymic information in French and the dated French system of transliteration of Mandarin. The plan is to extract and match these place names with their modern counterparts.
• Add the old pictures of significant buildings that are no longer there if it's possible to find them.

Members: Jimin and Anton

Coal supply in the German Empire

Main ideas

• To study the coal supply and demand of the German Empire for the year 1881.
• Interactive visualization of Germany's main coal production and consumption centers.
• Dynamic visualization of coal transport flows according to the different mining basins and transport routes.
• Differentiating the production and consumption centers from the transport hubs.
• Creation of a website to present the results.

Members : Axel Matthey and Rémi Petitpierre

Paris Metropolitan, an evolution

Definition of the project

This group will analyze the evolution of the Paris Metropolitan system from its inception. The group will look at two maps of the planning of the metro, from the definition of the routes to the addition of stations, a first map from 1908 of the actual metro after its construction in 1990, a second map from 1915, with already visible impacts of the first war, and a third map from 1950, a more contemporain look at the metro as we know it today. The goal is to analyze how different areas of major cultural attractions evolved around or hand in hand with the metro stations and the overall Paris metro system - basically answering the chicken and the egg question, and how the metro was impacted by catastrophic events such as wars.

Selected maps

The different maps selected for the project are the following:

Plan de Paris, avec le tracé du chemin de fer métropolitain (projet de l'administration) et les différentes lignes d'omnibus et de tramways, 1882
Plan de Paris [indiquant les lignes projetées du chemin de fer métropolitain en souterrain, tranchée, Viaduc, 1895
Paris, chemin de fer métropolitain ; lignes en exploitation, 1908
Paris Nouveau plan de Paris avec toutes les lignes du Métropolitain et du Nord-Sud, 1915
Paris. Plan d'ensemble par arrondissements. Métropolitain : [vers 1950]

Members: Evgeniy Chervonenko and Valentine Bernasconi

Projects 2017

All the projects are pieces of a larger puzzle. The goal is to experiment a new approach to knowledge production and negociation based on a platform intermediary between Wikipedia and Twitter.

The platform is called ClioWire

ClioWire: Platform management and development

This group will manage the experimental platform of the course. They will have to run platform and develop additional features for processing and presenting the pulses. The initial code base is Mastodon.

The group will write bots for rewritting pulses and progressively converging towards articulation/datafication of the pulses.

Knowledge required : Python, Javascript, basic linux administration.

Resp. Vincent and Orlin

- Albane - Cédric
Platform management and development : State of art and Bibliography

Platform management and development : methodology

Platform management and development : Quantitative analysis of performance

GitHub page of the project : [1]

Secondary sources

The goal is to extract from a collection of 3000 scanned books about Venice all the sentences containing at least two named entities and transforming them into pulses. This should consiste a de facto set of relevant information taking a large base of Venetian documents.

Resp. Giovanni / Matteo

- Hakim - Marion

Named Entity Recognition

GitHub page of the project : [2]

Primary sources

This group will look for named entities in digiitized manuscript and post pulses about these mentions.

• The group will use Wordspotting methods based on commercial algorithm. During the project, the group will have to set up a dedicated pipeline for indexing and searching the document digitized in the Venice Time Machine project and other primary sources using the software component provided.
• The group will have to search for list of names or regular expressions. A method based on predefined list will be compared with a recursive method based on the results provided by the Wordspotting components.
• Two types of Pulses will be produced : (a) "Mention of Francesco Raspi in document X" (b) "Franseco Raspi and Battista Nanni linked (document Y)"
• The creation of simple web Front end to test the Wordspotting algorithm would help assessing the quality of the method

Supervisor : Sofia

Skills : Java, simple Linux administration

- Raphael - Mathieu

Primary sources

Image banks

The goal is to transform the metadata of CINI which have been OCRed into pulses. One challenge is to deal with OCR errors and possible disambiguation.

Supervision: Lia

Newspaper, Wikipedia, Semantic Web

The goal is to find all the sentences in a large newspaper archive that contains at least 2 names entities. These sentences should be posted as pulses.

The named entity detection have already been done. The only challenge to retrieve the corresponding sentences in the digitized transcriptions.

In addition, this group should look for ways for importing massively element of knowledge from other sources (DBPedia, RDF databases)

Resp. Maud

Skills: Python or Java

- Laurene and Santiago

Newspaper, Wikipedia, Semantic Web : State of art and Bibliography