Crowdsourcing Bib - RGC Grant

From metadata-mediawiki.slis.ua.edu
Jump to navigation Jump to search

(Temporary spot until account is established on other wiki)

Research Study

Transcribing Handwritten Records

Data Extraction and Using Spreadsheets

Transcription Tools

Methods Articles 

This article provides an overview of the LIS literature on crowdsourcing and describes a number of crowdsourced cultural heritage projects and describes the “revolutionary cataloging interface” provided by Operation War Diary (OWD) – a major crowdsourcing transcription project administered by the UK’s National Archives and The Imperial War Museum. It includes detailed discussion of a usability testing survey administered to measure the OWD tutorial and interface and quality control mechanisms built into this crowdsourcing model.

This report is framed around five key questions: is the crowdsourcing of manuscript transcription cost effective; is it exploitative; is the product high quality; is the project sustainable and the product permanent; and how can success be measured. It provide a review of major crowdsourcing projects to extract data, correct OCR, and transcribe indexes while noting that the transcription of manuscript collections is more complicated. The meat of the article addresses conceptualization and execution of the project including: development of the transcription tool (a customized MediaWiki allowing for encoding of linguistic and bibliographic data using TEI XML tags); the contributions of transcribers, which were significant; moderation by staff, which was intensive; and assessment of impact and success. A large portion of the budget was spent on digitizing materials in high resolution so that they could be used by transcribers and also on employing full-time staff to moderate volunteer transcriptions and provide feedback – both important points to consider in designing and managing a project like this on any scale. Finally, this project employed a user survey to gauge factors that either motivated or discouraged volunteers, which provides a useful model of an assessment instrument for crowdsourcing feasibility in LAM environments.




Feasibility Study


Background Readings

According to this article, what we are doing can be characterized as a form of "content crowdsourcing" (CS) that they refer to as "Integrative Crowdsourcing":

Integrative CS will be relevant when the client firm seeks to build data or information bases. Therefore Integrative CS is a form of content Crowdsourcing. While gathering information or data at an individual’s level can be unproblematic, building a data base generally requires significant amounts of resources. The rationale of integrative CS therefore lies in the cost of building large data or information bases. Since individuals within the crowd are heterogeneous, Crowdsourcing enables the client firm to gather a variety of contents. The firm seeking to implement integrative CS should however be aware of integration issues. Data or information stemming from various origins might be incompatible or redundant if no precaution is taken. Precautions include the definition of a data format and the sound selection of data sources. [Emphasis added]

There are other relevant sections of this paper including:

  1. A way to distinguish 1992 data transcription tasks and the more complex cognitive efforts required for data extraction from the written articles from the 1961 season. See these sections of the paper:
    1. Crowdsourcing of simple tasks
    2. Crowdsourcing of complex tasks
  2. Discussion of incentives in this section: Discussion: benefits and pitfalls

This article has a great Guide to Crowdsourcing!!! (it's a subsection near the end of the article)

This should be one of our "go to" resources. It's a short book. This quote is indicative of its usefulness:

Crowdsourcing is a problem-solving model because it enables an organization confronted with a problem and desiring a goal state to scale up the task environment dra-matically and enlarge the solver base by opening up the problem to an online community through the Internet.

This quote is from Chapter 1 of the book

  • Terras, M.M. (2016). Crowdsourcing in the Digital Humanities In Schreibman, S., Siemens, R., and Unsworth, J. (eds), (2016) "A New Companion to Digital Humanities", (p. 420 –439). Wiley-Blackwell.

This chapter has a section that is a nice background discussion of historical document transcription.

Retrieved from "https://metadata-mediawiki.slis.ua.edu/index.php?title=Crowdsourcing_Bib_-_RGC_Grant&oldid=571"