The Icelandic Parliamentary Corpus

The Icelandic Parliamentary Corpus (IPC) contains debates in the Icelandic parliament (Alþingi) from 1911 to 2017 — about 235 million running words of text. The corpus is tagged, which means that each running word is accompanied by a morphosyntactic tag and lemma, and each text is accompanied by bibliographic information. The corpus is intended for linguistic research and for use in Language Technology projects.

The corpus is available in two ways.

  • Search. The corpus is available for search where the tags (linguistic annotation) can be used to define the search more accurately. The search gives a KWIC index and information about the source of each text example. The search interface is based on Korp developed by Språkbanken in Gothenburg.
  • Download. The corpus can be downloded in its entirety. The texts are in a special XML format, TEI P5, which is defined by TEI (Text Encoding Initiative). All texts are accompanied by metadata (bibliographic for published works). The texts can be used with a CC BY license. All users are registered with their e-mail address when they accept the user license.

When publishing results based on the texts in the Icelandic Parliamentary Corpus please refer to: Steingrímsson, Steinþór, Sigrún Helgadóttir, Eiríkur Rögnvaldsson, Starkaður Barkarson and Jón Guðnason. 2018. Risamálheild: A Very Large Icelandic Text Corpus. Proceedings of LREC 2018, pp. 4361-4366. Myazaki, Japan.

About IPC

What is a tagged corpus?

A tagged corpus is a collection of electronic texts in a standard format. The texts are analyzed in various ways to make them suitable for linguistic research and Language Technology projects. Each running word in the text is followed by a tag which shows part-of-speech and often also morphosyntactic elements like case, number and gender for nominals and person, number and tense for verbs. Each running word is also accompanied by a lemma, e.g. nominals in the nominative singular and the infinitive for verbs. Each text is also accompanied by metadata (bibliographic information for published texts).

Tagging the corpus

The corpus was tagged by automatic means. The texts were divided into sentences and running words and then tagged and lemmatized. IceNLP was used to divide the text into sentences and running words. Tagging was performed with IceStagger (Loftsson and Östling, 2013). Lemmatization was performed with the lemmatizer Nefnir. Nefnir is a new lemmatizer by Jón Friðrik Daðason and has not been described yet, but it gives better results than the previously used lemmatizer (Lemmald, (Ingason et al., 2008)). Tags and lemmas are not manually corrected. The tagset used for tagging IPC was developed for the making of the Icelandic Frequency Dictionary (IFD) with a few changes: proper nouns are not analyzed specially as person names, place names and other names as was done in the IFD; the tag v is used for URLs and e-mail addresses; abbreviations are not divided into individual words and are tagged with the tag as; all number constants are tagged with the tag ta. A corpus made by concatenating the IFD corpus and the MIM-GOLD corpus was used to train IceStagger. Dictionaries used when tagging were augmented with the dictionary of The Database of Modern Icelandic Inflection BÍN.

Tagset for the Icelandic Parliamentary Corpus

Cooperation and financing

The corpus is a subset of the Icelandic Gigaword Corpus which was compiled during the years 2015 to 2017 at the Árni Magnússon Institute for Icelandic Studies and was funded mostly by the Infrastructure Fund (no. 151110-0031, project manager Eiríkur Rögnvaldsson), the Contribution grants fund (Mótframlagasjóður) at the University of Iceland and the Ministry of Education and Culture.

Project group

Software development

  • Gunnar Thor Örnólfsson
  • Kristján Rúnarsson
  • Starkaður Barkarson

Contact

E-mail: malfong[hja]malfong.is

References

Further reading

  • Steingrímsson, Steinþór, Sigrún Helgadóttir, Eiríkur Rögnvaldsson, Starkaður Barkarson and Jón Guðnason. 2018. Risamálheild: A Very Large Icelandic Text Corpus. Proceedings of LREC 2018, p. 4361-4366. Myazaki, Japan.
  • Steingrímsson, Steinþór, Sigrún Helgadóttir and Eiríkur Rögnvaldsson. 2018. An Icelandic Gigaword Corpus. Ásta Svavarsdóttir, Halldóra Jónsdóttir, Helga Hilmisdóttir og Þórdís Úlfarsdóttir (eds.): Rapport fra 14. Konference om Leksikografi i Norden Reykjavík 30. maj–2. juni 2017. In Nordiske Sudier i Leksikografi 14, pp. 246–254. Nordisk Forening for Leksikografi, Skrift nr. 15.