Emojis and gestures: a new typology

Pierini, Francesco

doi:10.18148/sub/2021.v25i0.963

Cited by 7 publications

(6 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the next section, we discuss two experiments testing precisely this for cospeech sound effects and co-text emoji. The results of the two experiments replicate those of the gestural experiments reported in Tieu et al (2018), supporting claims by Pasternak (2019) and Pierini (2021) that co-speech sound effects and co-text emoji behave like gestures.…”

Section: Iconic Vocal Modulations Schlenker (2018b) Discusses An Exam...supporting

confidence: 83%

“…Co-text emoji. Yet another case, discussed in detail by Pierini (2021), are co-text emoji. Emoji are small images encoded as text, often integrated with writing on social media and in digital messaging.…”

Section: Iconic Vocal Modulations Schlenker (2018b) Discusses An Exam...mentioning

confidence: 99%

“…On separate grounds, emoji have previously been argued to serve a communicative function similar to gestures (Gawne & McCulloch, 2019). With respect to interactions with logical operators, Pierini (2021) argues that emoji behave like gestures in a variety of environments, including co-text emoji as a particular sub-case. In illustrating Pierini's point, we will modify the presentation of examples somewhat: Whereas Pierini's examples involve emoji simply following the text of the sentence, as in (18), in our examples both in this article and in the reported experiment, emoji "bracket" the verb phrase on either side, as in ( 19):…”

Section: Iconic Vocal Modulations Schlenker (2018b) Discusses An Exam...mentioning

confidence: 99%

See 2 more Smart Citations

Co-linguistic content inferences: From gestures to sound effects and emoji

Pasternak

Tieu

2022

Quarterly Journal of Experimental Psychology

View full text Add to dashboard Cite

Among other uses, co-speech gestures can contribute additional semantic content to the spoken utterances with which they coincide. A growing body of research is dedicated to understanding how inferences from gestures interact with logical operators in speech, including negation ("not"/"n’t"), modals (e.g., "might"), and quantifiers (e.g., "each", "none", "exactly one"). A related but less-addressed question is what kinds of meaningful content other than gestures can evince this same behavior; this is in turn connected to the much broader question of what properties of gestures are responsible for how they interact with logical operators. We present two experiments investigating sentences with co-speech sound effects and co-text emoji in lieu of gestures, revealing a remarkably similar inference pattern to that of co-speech gestures. The results suggest that gestural inferences do not behave the way they do because of any traits specific to gestures, and that the inference pattern extends to a much broader range of content.

show abstract

Section: Iconic Vocal Modulations Schlenker (2018b) Discusses An Exam...supporting

confidence: 83%

Section: Iconic Vocal Modulations Schlenker (2018b) Discusses An Exam...mentioning

confidence: 99%

Section: Iconic Vocal Modulations Schlenker (2018b) Discusses An Exam...mentioning

confidence: 99%

See 1 more Smart Citation

Co-linguistic content inferences: From gestures to sound effects and emoji

Pasternak

Tieu

2022

Quarterly Journal of Experimental Psychology

View full text Add to dashboard Cite

show abstract

“…In the online public context, emojis alter the lexical diversity of text, which may point to a compensatory relationship between emojis and words in communication (Feldman et al 2021). Additionally, there is a link between emojis and gestures, with emojis denoting objects and activities interacting with logical operators in a text in a similar way as gestures do with speech (Pierini 2021).…”

Section: Technological Adaptationsmentioning

confidence: 99%

Language: Its Origin and Ongoing Evolution

2023

View full text Add to dashboard Cite

With the present paper, we sought to use research findings to illustrate the following thesis: the evolution of language follows the principles of human evolution. We argued that language does not exist for its own sake, it is one of a multitude of skills that developed to achieve a shared communicative goal, and all its features are reflective of this. Ongoing emerging language adaptations strive to better fit the present state of the human species. Theories of language have evolved from a single-modality to multimodal, from human-specific to usage-based and goal-driven. We proposed that language should be viewed as a multitude of communication techniques that have developed and are developing in response to selective pressure. The precise nature of language is shaped by the needs of the species (arguably, uniquely H. sapiens) utilizing it, and the emergence of new situational adaptations, as well as new forms and types of human language, demonstrates that language includes an act driven by a communicative goal. This article serves as an overview of the current state of psycholinguistic research on the topic of language evolution.

show abstract

“…This is one important reason why emojis, which can take over many of the functions of such body movements, have become so popular. They have been argued to fulfill the role of gestures (McCulloch & Gawne, 2018;Pasternak & Tieu, 2022;Pierini, 2021) facial expressions (e.g., Weiß et al, 2020), particles (Beisswenger & Pappert, 2019), or discourse connectives (Beisswenger & Pappert, 2019) and to facilitate the understanding of indirect meaning (Holtgraves & Robinson, 2020).…”

Section: Introductionmentioning

confidence: 99%

Semantic differences in visually similar face emojis

Fricke,

Grosz,

Scheffler

2024

Lang. cogn.

View full text Add to dashboard Cite

The literature on face emojis raises the central question whether they should be treated as pictures or conventionalized signals. Our experiment addresses this question by investigating semantic differences in visually similar face emojis. We test a prediction following from a pictorial approach: small visual features of emojis that do not correspond to human facial features should be semantically less relevant than features that represent aspects of facial expressions. We compare emoji pairs with a visual difference that either does or does not correspond to a difference in a human facial expression according to an adaptation of the Facial Action Coding System. We created two contexts per pair, each fitted to correspond to a prominent meaning of one or the other emoji. Participants had to choose a suitable emoji for each context. The rate at which the context-matching emoji was chosen was significantly above chance for both types of emoji pairs and it did not differ significantly between them. Our results show that the small differences are meaningful in all pairs whether or not they correspond to human facial differences. This supports a lexicalist approach to emoji semantics, which treats face emojis as conventionalized signals rather than mere pictures of faces.

show abstract

Emojis and gestures: a new typology

Cited by 7 publications

References 0 publications

Co-linguistic content inferences: From gestures to sound effects and emoji

Co-linguistic content inferences: From gestures to sound effects and emoji

Language: Its Origin and Ongoing Evolution

Semantic differences in visually similar face emojis

Contact Info

Product

Resources

About