Paris: address book of the past: Difference between revisions

From FDHwiki
Jump to navigation Jump to search
Line 83: Line 83:


= Limitations of the Project =
= Limitations of the Project =
faced some challenges when working on project


== Alignment ==
== Alignment ==
Line 97: Line 99:
'''Ambiguous streetnames'''
'''Ambiguous streetnames'''


* many aligned on "short streetname", while this streetname might refer to many different streets (in this time clear?) -> try to incorporate when which street was built
* in 1836 street network dataset: datapoints with same streetname, but not located near each other
* many bottin datapoints aligned on "short streetname", while this streetname might refer to many different streets (at point in time when address book published clear?) -> try to incorporate when which street was built


== Analysis ==
== Analysis ==


'''Matching on street level'''
* worked with centroids of streets in order to represent each data point, which especially for long streets is imprecise -> additional step to clean and align address numbers
'''Small part of potential analysis'''
* time constraint: semester project, already resources for alignment
* knowledge constraint: get more (historical) knowledge about Paris to be able to put analysis into context


= Outlook =
= Outlook =


= References =
= References =

Revision as of 15:54, 19 December 2022

Introduction

This project works with around 4.4 million datapoints which have been extracted from address books in Paris (Bottin Data). The address books date from the period 1839-1922 and contain the name, profession and place of residence of Parisian citizens. In a first step, we align this data with geodata of Paris’s city network, in order to be able to conduct a geospatial analysis on the resulting data in a second step.

Motivation

In the 19th century, Paris was a place of great transformations. Like in many other European cities, the industrialization led to radical changes in people’s way of life, completely reordering the workings of both economy and society. At the same time, the city grew rapidly. While only half a million people lived there in 1800, the number of inhabitants increased by the factor of nearly 7 within one century. To get control over the expansion of the city and to improve people’s living conditions, the city underwent constructional changes during the Haussmann Period (1853-1870), leading to the grand boulevards and general cityscape that we know today.

While all those circumstances have been well documented and studied extensively, they could mainly be described in a qualitative manner, e. g. by looking at the development of certain streets. The Bottin dataset, providing information on persons, their professions and locations during exactly the time of change described above, will be able to open new perspectives on the research, as it permits to analyze the economic and social transformation on a grander scale. With this data, it will be possible to follow the development of a chosen profession over the whole city, or to look at the economic transformation of an Arrondissement throughout the century.

This project will give an idea of the potential which lies in the Bottin Data to contribute to the research on Paris’s development during the 19th century.

Deliverables

  • Github
  • Google Drive

Datasets

The project is mainly based on three datasets: The Bottin Data, which is the main focus of the analysis, and two street networks of Paris (of 1836 and 2022), providing information about the geolocation of every street. In the following, the datasets are introduced with more detail.

Bottin Data

word[1]

word[2]

Tagged Professions

Street Networks

Vasserot Data (1836)

Open Street Data (2022)

Organisation

Planning:

Part Tasks
Week 4 Alignment tba
Week 5 tba
Week 6 tba
Week 7
Week 8
Week 9
Week 10
Week 11 Analysis
Week 12
Week 13
Week 14

Alignment

Aligning Street Datasets

Aligning Bottin Data with Street Data

Analysis

Limitations of the Project

faced some challenges when working on project

Alignment

OCR Mistakes

  • OCR mistakes together with abbreviations leading to wrong fuzzy matching -> idea: use customized distance function which punishes character substitutions/insertions at the end of the string more than at the beginning of the string (EXAMPLE)

Missing streets

  • streets not in either one of the two datasets of 1836 or 2022: rue d'Allemagne -> get other street data from 19th century
  • given data in Bottin dataset not necessarily a street, e.g. "cloître"

Ambiguous streetnames

  • in 1836 street network dataset: datapoints with same streetname, but not located near each other
  • many bottin datapoints aligned on "short streetname", while this streetname might refer to many different streets (at point in time when address book published clear?) -> try to incorporate when which street was built

Analysis

Matching on street level

  • worked with centroids of streets in order to represent each data point, which especially for long streets is imprecise -> additional step to clean and align address numbers

Small part of potential analysis

  • time constraint: semester project, already resources for alignment
  • knowledge constraint: get more (historical) knowledge about Paris to be able to put analysis into context

Outlook

References

  1. di Lenardo, Isabella; Barman, Raphaël; Descombes, Albane; Kaplan, Frédéric, 2019, "Repopulating Paris: massive extraction of 4 Million addresses from city directories between 1839 and 1922.", https://doi.org/10.34894/MNF5VQ, DataverseNL, V2
  2. di Lenardo, Isabella; Barman, Raphaël; Descombes, Albane; Kaplan, Frédéric, 2019, "Repopulating Paris: massive extraction of 4 Million addresses from city directories between 1839 and 1922.", https://doi.org/10.34894/MNF5VQ, DataverseNL, V2