Paris: address book of the past: Difference between revisions

From FDHwiki
Jump to navigation Jump to search
Line 85: Line 85:


== Alignment ==
== Alignment ==
'''OCR Mistakes'''
* OCR mistakes together with abbreviations leading to wrong fuzzy matching -> idea: use customized distance function which punishes character substitutions/insertions at the end of the string more than at the beginning of the string (EXAMPLE)
'''Missing streets'''
* streets not in either one of the two datasets of 1836 or 2022: rue d'Allemagne -> get other street data from 19th century
* given data in Bottin dataset not necessarily a street, e.g. "cloître"
'''Ambiguous streetnames'''
* many aligned on "short streetname", while this streetname might refer to many different streets (in this time clear?) -> try to incorporate when which street was built


== Analysis ==
== Analysis ==

Revision as of 15:46, 19 December 2022

Introduction

This project works with around 4.4 million datapoints which have been extracted from address books in Paris (Bottin Data). The address books date from the period 1839-1922 and contain the name, profession and place of residence of Parisian citizens. In a first step, we align this data with geodata of Paris’s city network, in order to be able to conduct a geospatial analysis on the resulting data in a second step.

Motivation

In the 19th century, Paris was a place of great transformations. Like in many other European cities, the industrialization led to radical changes in people’s way of life, completely reordering the workings of both economy and society. At the same time, the city grew rapidly. While only half a million people lived there in 1800, the number of inhabitants increased by the factor of nearly 7 within one century. To get control over the expansion of the city and to improve people’s living conditions, the city underwent constructional changes during the Haussmann Period (1853-1870), leading to the grand boulevards and general cityscape that we know today.

While all those circumstances have been well documented and studied extensively, they could mainly be described in a qualitative manner, e. g. by looking at the development of certain streets. The Bottin dataset, providing information on persons, their professions and locations during exactly the time of change described above, will be able to open new perspectives on the research, as it permits to analyze the economic and social transformation on a grander scale. With this data, it will be possible to follow the development of a chosen profession over the whole city, or to look at the economic transformation of an Arrondissement throughout the century.

This project will give an idea of the potential which lies in the Bottin Data to contribute to the research on Paris’s development during the 19th century.

Deliverables

  • Github
  • Google Drive

Datasets

The project is mainly based on three datasets: The Bottin Data, which is the main focus of the analysis, and two street networks of Paris (of 1836 and 2022), providing information about the geolocation of every street. In the following, the datasets are introduced with more detail.

Bottin Data

word[1]

word[2]

Tagged Professions

Street Networks

Vasserot Data (1836)

Open Street Data (2022)

Organisation

Planning:

Part Tasks
Week 4 Alignment tba
Week 5 tba
Week 6 tba
Week 7
Week 8
Week 9
Week 10
Week 11 Analysis
Week 12
Week 13
Week 14

Alignment

Aligning Street Datasets

Aligning Bottin Data with Street Data

Analysis

Limitations of the Project

Alignment

OCR Mistakes

  • OCR mistakes together with abbreviations leading to wrong fuzzy matching -> idea: use customized distance function which punishes character substitutions/insertions at the end of the string more than at the beginning of the string (EXAMPLE)

Missing streets

  • streets not in either one of the two datasets of 1836 or 2022: rue d'Allemagne -> get other street data from 19th century
  • given data in Bottin dataset not necessarily a street, e.g. "cloître"

Ambiguous streetnames

  • many aligned on "short streetname", while this streetname might refer to many different streets (in this time clear?) -> try to incorporate when which street was built

Analysis

Outlook

References

  1. di Lenardo, Isabella; Barman, Raphaël; Descombes, Albane; Kaplan, Frédéric, 2019, "Repopulating Paris: massive extraction of 4 Million addresses from city directories between 1839 and 1922.", https://doi.org/10.34894/MNF5VQ, DataverseNL, V2
  2. di Lenardo, Isabella; Barman, Raphaël; Descombes, Albane; Kaplan, Frédéric, 2019, "Repopulating Paris: massive extraction of 4 Million addresses from city directories between 1839 and 1922.", https://doi.org/10.34894/MNF5VQ, DataverseNL, V2