Quantitative Analysis of Culture Using Millions of Digitized Books

Michel, Jean-Baptiste; Shen, Yuan; Aiden, Aviva Presser; Veres, Adrian; Gray, Matthew K.; Pickett, Joseph P.; Hoiberg, Dale; Clancy, Dan; Norvig, Peter; Orwant, Jon; Pinker, Steven; Nowak, Martin A.; Aiden, E

doi:10.1126/science.1199644

Cited by 2,272 publications

(1,815 citation statements)

References 17 publications

Supporting

Mentioning

1,696

Contrasting

Unclassified

Order By: Relevance

“…Mais tarde, apareceu o primeiro corpus electrónico, o corpus Brown, a partir do qual se extraíram as normas de frequência mais utilizadas em língua inglesa: as normas de Kučera e Francis (1967). Contudo, apesar da sua popularidade, a validade destas normas tem sido questionada (ex., Balota, Cortese, Sergent-Marshall, Spieler, & Yap, 2004;Brysbaert & Cortese, 2011;Brysbaert & New, 2009 (Lund & Burgess, 1996); e, mais recentemente, o Google Ngram Viewer (Michel et al, 2011) Cattell (1886), se tem demonstrado de forma sistemática que as palavras mais frequentes são reconhecidas (ex., Forster & Chambers, 1973;Murray & Forster, 2004), nomeadas (ex., Balota & Chumbley, 1985;Dahan, Magnuson, & Tanenhaus, 2001) e/ou classifi cadas (ex., Forster & Hector, 2002;Forster & Shen, 1996) de forma mais rápida e precisa do que palavras de baixa frequência. Além disso, estudos recentes (ex., Brysbaert & Cortese, 2011;Brysbaert & New, 2009;Thompson & Desroches, 2009;Zevin & Seidenberg, 2002), têm também comprovado que a frequência de uso das palavras é a variável mais potente na explicação do desempenho linguístico dos sujeitos, capturando mais de 40% da variância dos resultados.…”

unclassified

Procura-PALavras (P-Pal): uma nova medida de frequência lexical do português europeu contemporâneo

Soares¹,

Iriarte²,

Almeida³

et al. 2014

Psicol. Reflex. Crit.

View full text Add to dashboard Cite

ResumoNeste trabalho apresentamos as estratégias e os procedimentos adoptados na constituição de uma nova medida de frequência lexical do Português Europeu contemporâneo, o Procura-PALavras (P--PAL). Baseado num corpus de mais de 227 milhões de palavras, o P-PAL é uma aplicação web que oferece, por defeito, valores de frequência lexical para todas as suas entradas lexicais (lemas e formas) e que permite a computação de uma grande diversidade de outras medidas objectivas (lexicais e sublexicais) e subjectivas. Descrevemos ainda o processo de defi nição das suas entradas lexicais e da extracção dos respectivos valores de frequência. O elevado número de índices e de entradas lexicais tornam o P-PAL numa aplicação web avançada e indispensável à promoção e internacionalização da investigação em Portugal. O P-PAL encontra-se disponível em http://p-pal.di.uminho.pt/tools Palavras-chave: Frequência lexical, bases lexicais, corpus/corpora, português europeu. AbstractIn this paper we present the strategies and procedures undertaken in the development of a new measure of lexical frequency of the contemporary European Portuguese -Procura-PALavras (P-PAL). Based on a corpus of over 227 million words, P-PAL offers the default frequency per million words (lemmas and wordforms), and the computation of several other objective (lexical and sublexical) and subjective word metrics. We also describe lexical entry integration and word frequency extraction. The high number of indices and lexical entries makes P-PAL an advanced and indispensable web application for the promotion and internationalization of Portuguese research. P-PAL is available at http://p-pal.di.uminho.pt/tools

show abstract

unclassified

Procura-PALavras (P-Pal): uma nova medida de frequência lexical do português europeu contemporâneo

Soares¹,

Iriarte²,

Almeida³

et al. 2014

Psicol. Reflex. Crit.

View full text Add to dashboard Cite

show abstract

“…In some fields legal issues around access have been side-stepped by constructing a "shadow" dataset that summarises key features of the data while still restricting access to the data itself. For example, by extracting phrases comprising a set of n words (n-grams) from Google Books it is possible to create a data set that contains valuable information without exposing the full text [23]. However for taxonomic work, there does not seem to be an obvious way to extract a shadow.…”

Section: Digitising the Taxonomic Literaturementioning

confidence: 99%

DNA barcoding and taxonomy: dark taxa and dark texts

Page

2016

Preprint

View full text Add to dashboard Cite

Both classical taxonomy and DNA barcoding are engaged in the task of digitising the living world. Much of the taxonomic literature remains undigitised. The rise of open access publishing this century, and the freeing of older literature from the shackles of copyright has greatly increased the online availability of taxonomic descriptions, but much of the literature of the mid-to late twentieth century remains offline ("dark texts"). DNA barcoding is generating a wealth of computable data that in many ways is much easier to work with than classical taxonomic descriptions, but many of the sequences are not identified to species level. These "dark taxa" hamper the classical method of integrating biodiversity data using shared taxonomic names. Voucher specimens are a potential common currency of both the taxonomic literature and sequence databases, and could be used to help link names, literature, and sequences. An obstacle to this approach is the lack of stable, resolvable specimen identifiers. The paper concludes with an appeal for a global "digital dashboard" to assess the extent to which biodiversity data is available online.

show abstract

“…The intention is build upon some the tentative assertions we offered in an earlier editorial commentary (By, Burnes and Oswick, 2011). To this end, we have explored meta-level trends using the "Google Ngram Viewer" 1 (Michel et al, 2011). The Ngram Viewer is an application which enables phrase-usage to be charted according to the yearly count of words or phrases appearing within a large corpus of texts.…”

Section: Trends In Organizational Changementioning

confidence: 99%