Projects: Difference between revisions
No edit summary |
No edit summary |
||
Line 71: | Line 71: | ||
| Yinghui Jiang | | Yinghui Jiang | ||
| | | | ||
| '''[http://fdh.epfl.ch/index.php/ | | '''[http://fdh.epfl.ch/index.php/Switzerland_road_extraction_from_historical_maps Switzerland: road extraction from historical maps]''' | ||
| Venice: Building height detection from drone videos | | Venice: Building height detection from drone videos | ||
|- | |- |
Revision as of 18:16, 24 November 2021
Projects 2021
Projects list
- Venice: 3D Model of a Venetian Island (Albane)
- Venice: Building height detection from drone videos (Albane, Paul)
- Venice: Segmentation of roofs from 1940 aerial images (Paul, Didier)
- Venice: Families and real estate in 1808 (Didier)
- Venice: Genealogy in 1808 based on scanned documents available here (Dider)
- Venice: Upgrading the cadaster with 3D models [2 groups] (Paul)
- Venice: Aligning the 1808 cadaster with the present [2 groups] (Paul)
- Venice: Commercial activities, the Mestieri in 1741 (Didier)
- Venice: Reconstruction of the Venetian population of 1741 and 1808 (Didier)
- Venice: Urban morphology and ownership between 1100 and 1300 (Paul, Federica)
- Jerusalem: Roof segmentation in 1917-8 and 1944-5 aerial images (Beatrice, Paul)
- Jerusalem: Road extraction and alignment in 1840-9 maps (Beatrice, Paul)
- Jerusalem: Advertisement in 1925-50 newspapers (Beatrice)
- Switzerland: Roads and lands in 1864-1940 historical maps (Didier)
- France: Automatic alignment of XIXth century cadasters (Federica, Paul)
The name of the different supervisor for the projects are:
- Albane Descombes
- Didier Dupertuis
- Paul Guhennec
- Federica Pardini
- Beatrice Vaienti
You can find email addresses on EPFL directory. Plus put Frederic Kaplan, Paul Guhennec, Didier Dupertuis, and Beatrice Vaienti in copy for the first exchanges. You can however still do a project outside of the DHLAB's fields of expertise. We will do our best to help you.
Guidelines
For the first presentation (07.10):
- (1) Choose one or two projects from the project list and invent another one.
- (2) Form a group of 2 people and fill out the table.
- (3) Prepare a short presentation (1-2 slides) for your projects.
Student groups
Group Number | First Student | Second Student | Third Student | Project 1 | Project 2 |
---|---|---|---|---|---|
1 | Yichen Wang | Amina Matt | Colonial heritage in Switzerland | Venice: Families and real estate in 1808 | |
2 | Junzhe Tang | Zhipeng Mao | 1741 - Venice "mestieri" | Jerusalem 1840-1949: Road extraction and alignment | |
3 | Veniamin Veselovsky | Hannah Casey | Venice 1741/1808: Families and Real Estate | Venice 1741/1808: Families and Real Estate | |
4 | Irina Serenko | Yinghui Jiang | Switzerland: road extraction from historical maps | Venice: Building height detection from drone videos | |
5 | Yuxiao Li | Yuhan Bi | Sruti Bhattacharjee | Venice 2020: Detection of height of building based on drone’s videos | Jerusalem 1917-18 / 1944-45 : Roof segmentation |
6 | Yurui Zhu | Siyi Wang | Venice 1808: Upgrading the cadaster with 3D models | Venice: Genealogy in 1808 based on scanned documents | |
7 | Loïc Rochat | Davide Chemin | Venice 1808 Genealogy | Venice 1808 Upgrading the cadaster with 3D models | |
8 | Marin Piguet | Noé Durandard | Jerusalem: Advertisement in 1925-50 newspapers | Automatic alignment of XIXth century cadasters |
Projects 2020
Guidelines
For the first presentation (01.10)
(1) Choose one or two projects from the project list and invent another one.
(2) Form a group of 2-3 people and fill out the table.
(3) Prepare a short presentation (1-2 slides) for your projects.
Projects list
- Deciphering Venetian handwriting (Raphaël)
- Austrian cadastral map (Raphaël)
- Paintings / Photos geolocalisation (Frederic, Paul)
- Toponomastics (Federica)
- Sanudo’s Diaries (Federica)
- Venice 1100 and 1300 (Federica)
- San Giorgio 4D Cloud Points (Albane)
- Photogrammetric reconstruction of Venice based on Youtube movies (Albane)
- Procedural Venice (Fabrice, Paul)
- Photorealistic rendering of painting (GAN) (Frederic, Raphael)
- Coherence Fact-checking (Frederic)
- Biography generation (Frederic)
- Venice IIIF Annotator (Frederic)
- Homologous navigation(Frederic)
- Open Data from Venice 1808 (Raphaël)
- Venice 1808 immersive experience (Fabrice)
- Quora for Venitian history (Frederic)
- Venice underwater (Frederic) - Connection with on-going project in Venice about Aqua Alta
- Unbuilt Venice (Fabrice)
- Opera Rolandi archive (Frederic) - Connection with on-going project at Cini Foundation
- Terzani archive (Frederic) - Connection with on-going project at Cini Foundation
The name of the different supervisor for the projects are: Albane Descombes Fabrice Berger Federica Pardini Raphaël Barman Frederic Kaplan
You can find email addresses on EPFL directory. Plus put the Frederic Kaplan, Paul Guhennec and Raphael Barman in copy for the first exchanges
Available ressources
Data and sources
Here is a small list of the available resources for your projects. Do not hesitate to send an e-mail if you have questions about any of them.
- Data for training a handwritten text recognition (HTR) system.
- Data for training a geometries extractor from the cadastral map.
- High-resolution images of Venice's Austrian cadastral map.
- Complete transcription of the registers (Sommarioni) of the 1808 Venice's Napoleonic cadaster (parcel number, owner name, typology of parcels).
- Complete extraction the 1808 Venice's Napoleonic cadastral map.
- Partial extraction from the proto-cadaster (Catastici) of 1740 Venice. (Owner name, tenant name, typology of parcel, link with 1808 cadaster).
- Large photo and painting archive from the Cini Foundation.
- Numerization and/or physical book of Tassini’s toponomastics, Sanudo’s Diaries, Venezia romanica.
- 4D point cloud for San Giorgio.
- 3D procedural model (in progress) of Venice.
- Data from the Garzoni project c.f. here for more information.
DHLAB skills
The current main skills of the laboratory are:
- Architecture and History of Venice.
- Cadaster information extraction and HTR.
- Photogrammetric reconstruction.
- 3D modeling.
You can however still do a project outside of these fields of expertise. We will do our best to help you.
Groups
Group number | First student name | Second student name | Third student name | Project name 1 | Project name 2 | Project name 3 (Optional) |
---|---|---|---|---|---|---|
Group 1 | Beatriz Borges | Lilia Ellouz | André Ghattas | VenBioGen: Biography generation *** | Chat-a-ghost | |
Group 2 | Elisa Michelet | Gonxhe Idrizi | Opera Rolandi archive": Opera Rolandi Archive *** | Score Digitization | Tassini’s toponomastics | |
Group 3 | Ravinithesh Annapureddy | Maxime Jan | Terzani online museum | Immersive educational game | Instavenice (Instagram of Past Venice) | |
Group 4 | Mariko Makhmutova | Alex Rusnak | Anna Sophia Bauer | Photorealistic rendering of painting + Venice Underwater *** (GAN) | Using historical artifacts to trace trade routes | Venice underwater |
Group 5 | Jeremy Mion | Bastien Beuchat | Deciphering Venetian handwriting *** | Venice 1808 immersive experience | Art forgery detector | |
Group 6 | Michał Bień | Graziano Conti Rossini | WikiBio: Biography generation *** | Facebook for Venetian Artists | ||
Group 7 | Junhong Li | Yuanhui Lin | Zijun Cui | Paintings / Photos geolocalisation *** | Day matters in Venice | |
Group 8 | Hangqian Li | Linyida Zhang | Procedural Venice *** | Modern people in Venice(GAN) | ||
Group 9 | Maximilian Ben Ali | Eva Laini | Austrian cadastral map *** | |||
Group 10 | Ludovica Schaerf | Aurel Ruben | Harshdeep | Rolandi Librettos *** | Terzani Photo collection |
Projects 2019
Guidelines
- (1) Select an image series on Paris
- (2) Make a sketch (drawing + textual description) of a final interface
- (3) Extract the maximum information out of it (Train a segmenter, Train a handwritten recognition system)
- (4) Export this information in other places in the Web or Build a website with specific services
As the focus of this year is Paris and interaction between projects is wanted, projects should ideally make use of a common system. Example of a common system is street names, addresses or in some cases name of people.
Image collections
- Gallica offers a large collection of images of a variety of types. The most useful entry point is the Paris collection.
- The Bibliothèque numérique of INHA offers a lot of resources in link with art history.
- The Archives de Paris have many administrative documents as well as a large photography collection.
Specific examples
- Photographies of Eugène Atget documents the forgotten Paris of 19th century. They can be found on Gallica and on INHA library.
- Architectural photograhy collection of Archives de Paris.
- Grand monde de Paris , address book of famous people of Paris, found on Gallica.
- Name and reservations for some theaters of Paris found on Gallica and plan of the theatre room also found on Gallica.
Resources
Tips and tricks
- Be careful about encoding when using OCR from Gallica. The XML tag says that the encoding is ISO-8859-1, but the actual encoding is UTF-8. Force the encoding when opening the file in python. Additionally, you can modify the tag directly inside the XML so that it opens correctly in your favorite text editor.
- In python, if you launch a for loop with expensive operation, it can be nice to know how long each iteration takes and to have an idea of the general progress. This can be done using the tqdm package. When wrapping an iterable with it, a progress bar will appear, e.g.
for item in tqdm(list_of_items):
. Note this can also be used with pandas, c.f. the documentation.
Data extraction tools
- Gallica wrapper to download documents, images and OCR from Gallica directly from Python.
- Transkribus to make your own OCR. It also offers a REST API if you prefer.
- VGG Image annotator (VIA) to annotate your documents.
- OCR and HTR available for documents who do not have it. (Caveat for HTR, the data series should be uniform and needs to be annotated by hand).
- dhSegment for segmenting visually distinct part of documents.
Databases/APIs
- Gallica document API, Gallica image extraction API, python Gallica API wrapper and python periodical corpus extractor
- INHA offers an OAI-PMH API, see here for an entry point.
- Data BNF, WikiData for general-purpose knowledge base.
- Lists of addresses of Paris
Sketches
First student name | Second student name | Third student name | Sketch 1 | Sketch 2 | Sketch 3 |
---|---|---|---|---|---|
Guilhem Sicard | Todor Manev | - | Sketch of Love2Late | Sketch of The 1897 directory of businesses | |
Giacomo Alliata | Andrea Scalisi | - | Sketch of Influencers of the past | Sketch of Artwork origins in Paris | |
Leonore Guillain | Haeeun Kim | Liamarcia Bifano | Sketch of Humans of Paris 1900 | Sketch of ImmoSearch Paris 1900 | Sketch of Job Search Paris 1900 |
Arthur Parmentier | Bertil Wicht | - | Sketch of Book editing in Paris 1847 | Sketch of Trip advisor Paris | Sketch of Bike from Paris |
Robin Szymczak | Cédric Tomasini | Sketch of Virtual Louvre | Sketch of Diving into the Opera | Sketch of Article in context |
Projects
Group number | First student name | Second student name | Third student name | Project page |
---|---|---|---|---|
1 | Guilhem Sicard | Todor Manev | - | Love2Late |
2 | Giacomo Alliata | Andrea Scalisi | - | Influencers of the past |
3 | Leonore Guillain | Haeeun Kim | Liamarcia Bifano | Humans of Paris 1900 |
4 | Arthur Parmentier | Bertil Wicht | - | Quartiers Livres / Booking Paris |
5 | Robin Szymczak | Cédric Tomasini | Virtual Louvre |
Projects 2018
- (1) Choose a Map on Gallica https://gallica.bnf.fr/accueil/?mode=desktop
- (2) Extract the maximum information out of it (Train a segmenter, Train a handwritten recognition system)
- (3) Export this information in other places in the Web or Build a website with specific services
Projects websites
- Shortest-Path Route Extraction From City Map
- Train schedules
- Paris 1909 TripAdvisor
- A century in Beijing
- Coal supply in the German Empire
- Paris Metropolitan, an evolution
Shortest-Path Route Extraction From City Map
The goal of this project is to give people an idea of what it might have been like to find one's way around cities of the past, by building a navigation tool not unlike Google Maps or similar services - except it is for the past. The application will create and display the shortest path between user-selected start and end points, using information extracted from an old city map. The finished application will be made available via a web-interface.
On a technical level, the approach is based on extracting the road network from the map, representing it as an undirected planar graph, then applying Dijkstra's algorithm to solve the routing problem.
Members: Jonathan and Florian
Train schedules
This project aims to observe how one could travel between France, Switzerland and the North of Italy back in the middle of the 19th century. From the journey paths, schedules and prices, one will realize how easy it is now to travel through Europe and how big the impact of the evolution of both the railway network and the technology has been. These data will be extracted from a document from 1858and computed in a CFF-like website so that one can put oneself in the shoes of a railway user of the 1850's.
Members: Anna Fredrikson and Olivier Dietrich
Paris 1909 TripAdvisor
The project intends to recreate the cultural geography of Paris in the Belle Époque, immersing a user into the world of cabarets, balls, theatres, the universe described by Zola and Proust, and painted by Renoir and Toulouse-Lautrec. In order to give a new perspective on how this legendary world was actually structured and perceived, we are going to digitize the authentic Plan des plaisirs et attractions de Paris created in 1909 and augment it with the pieces of evidence and descriptions from the Guide dés plaisirs à Paris: timetables, advice and guidance on what to wear, what to say, and where to go.
- Alina, Maryam, and Paola
A century in Beijing
Using this map by France's Service Géographique de l'Armée from 1900 we will follow the evolution of the urban landscape of the central part of China's capital over the last hundred years.
The planned goals
- To align maps from different time periods and see how the landscape changed. The town's straightforward rectangular planning will allow us to make matches more easily.
- The map has a rich legend with toponymic information in French and the dated French system of transliteration of Mandarin. The plan is to extract and match these place names with their modern counterparts.
- Add the old pictures of significant buildings that are no longer there if it's possible to find them.
Members: Jimin and Anton
Coal supply in the German Empire
Main ideas
- To study the coal supply and demand of the German Empire for the year 1881.
- Interactive visualization of Germany's main coal production and consumption centers.
- Dynamic visualization of coal transport flows according to the different mining basins and transport routes.
- Differentiating the production and consumption centers from the transport hubs.
- Creation of a website to present the results.
Members : Axel Matthey and Rémi Petitpierre
Paris Metropolitan, an evolution
Definition of the project
This group will analyze the evolution of the Paris Metropolitan system from its inception. The group will look at two maps of the planning of the metro, from the definition of the routes to the addition of stations, a first map from 1908 of the actual metro after its construction in 1990, a second map from 1915, with already visible impacts of the first war, and a third map from 1950, a more contemporain look at the metro as we know it today. The goal is to analyze how different areas of major cultural attractions evolved around or hand in hand with the metro stations and the overall Paris metro system - basically answering the chicken and the egg question, and how the metro was impacted by catastrophic events such as wars.
Selected maps
The different maps selected for the project are the following:
Plan de Paris, avec le tracé du chemin de fer métropolitain (projet de l'administration) et les différentes lignes d'omnibus et de tramways, 1882
Plan de Paris [indiquant les lignes projetées du chemin de fer métropolitain en souterrain, tranchée, Viaduc, 1895
Paris, chemin de fer métropolitain ; lignes en exploitation, 1908
Paris Nouveau plan de Paris avec toutes les lignes du Métropolitain et du Nord-Sud, 1915
Paris. Plan d'ensemble par arrondissements. Métropolitain : [vers 1950]
Members: Evgeniy Chervonenko and Valentine Bernasconi
Projects 2017
All the projects are pieces of a larger puzzle. The goal is to experiment a new approach to knowledge production and negociation based on a platform intermediary between Wikipedia and Twitter.
The platform is called ClioWire
ClioWire: Platform management and development
This group will manage the experimental platform of the course. They will have to run platform and develop additional features for processing and presenting the pulses. The initial code base is Mastodon.
The group will write bots for rewritting pulses and progressively converging towards articulation/datafication of the pulses.
Knowledge required : Python, Javascript, basic linux administration.
Resp. Vincent and Orlin
- Albane
- Cédric
Platform management and development : State of art and Bibliography
Platform management and development : methodology
Platform management and development : Quantitative analysis of performance
GitHub page of the project : [1]
Secondary sources
The goal is to extract from a collection of 3000 scanned books about Venice all the sentences containing at least two named entities and transforming them into pulses. This should consiste a de facto set of relevant information taking a large base of Venetian documents.
Resp. Giovanni / Matteo
- Hakim - Marion
GitHub page of the project : [2]
Primary sources
This group will look for named entities in digiitized manuscript and post pulses about these mentions.
- The group will use Wordspotting methods based on commercial algorithm. During the project, the group will have to set up a dedicated pipeline for indexing and searching the document digitized in the Venice Time Machine project and other primary sources using the software component provided.
- The group will have to search for list of names or regular expressions. A method based on predefined list will be compared with a recursive method based on the results provided by the Wordspotting components.
- Two types of Pulses will be produced : (a) "Mention of Francesco Raspi in document X" (b) "Franseco Raspi and Battista Nanni linked (document Y)"
- The creation of simple web Front end to test the Wordspotting algorithm would help assessing the quality of the method
Supervisor : Sofia
Skills : Java, simple Linux administration
- Raphael - Mathieu
Image banks
The goal is to transform the metadata of CINI which have been OCRed into pulses. One challenge is to deal with OCR errors and possible disambiguation.
Supervision: Lia
Newspaper, Wikipedia, Semantic Web
The goal is to find all the sentences in a large newspaper archive that contains at least 2 names entities. These sentences should be posted as pulses.
The named entity detection have already been done. The only challenge to retrieve the corresponding sentences in the digitized transcriptions.
In addition, this group should look for ways for importing massively element of knowledge from other sources (DBPedia, RDF databases)
Resp. Maud
Skills: Python or Java
- Laurene and Santiago
Newspaper, Wikipedia, Semantic Web : State of art and Bibliography