9.2 The Study: Emoji and Emotion

Emoji are pictographs representing a wide range of facial expressions, symbols, and objects, and are administered by the Unicode Consortium (Unicode, 2019). As of November 2019 (Unicode, 2019), there are 1719 standard emoji currently in use. While the first emoji were developed in 1999, they have become increasingly common and influential since 2010, when Apple began supporting emoji on iPhone software (Bai et al., 2019; Novak et al., 2015). Emoji are frequently used across a variety of online platforms, and although they originated in Japan, they are currently used worldwide (Bai et al., 2019; Ljubešić & Fišer, 2016). In fact, the “face with tears of joy” emoji was even selected as the Oxford Dictionaries Word of the Year in 2015 (Wang, 2015).

Emoji in Computer-Mediated Communication

Much of the research on emoji has focused on their functions within computer-mediated communication (CMC) (Bai et al., 2019). One of the core limitations of using CMC for interpersonal relationship development and maintenance is that it precludes many of the non-verbal cues available in face-to-face interactions (such as facial expression and body language). At the same time, social information processing theory (SIP) suggests that CMC users adapt to the cues that are available in order to produce effective interpersonal communications (Walther, 1992, 2011). One such cue is emoji, which can perform a number of important communication functions. Emoji are adept at conveying information typically communicated through facial expressions, as neural responses to emoji and their corresponding facial expressions are largely similar (Gantiva et al., 2019). Furthermore, emoji may be particularly effective when used as a substitute for nonverbal cues in asynchronous electronic communication, when conversation partners respond after a delay rather than in real time (Alshenqeeti, 2016).

Interview- and survey-based research has also supported the hypothesis that emoji are important for conveying emotional information in computer-mediated contexts. For example, Kelly & Watts (2015) interviewed people about their use of emoji, and found that they were important for expressing emotion and maintaining relational connection during computer-mediated communication. Similarly, Cramer et al. (2016) identified several reasons people use emoji in mobile messaging, including adding emotional meaning or situational context, adjusting tone, and maintaining conversations and relationships. CMC users express themselves through emoji, using them to establish emotional tone and communicate friendly intentions (Kaye et al., 2016). Users can also express their personality through emoji, which can enhance interpersonal connections by filling in nonverbal cues typically absent from computer-mediated messages (Chairunnisa & Benedictus, 2017). Emoji may be particularly suited for communicating positive emotions like joy, and so may contribute to maintaining and enhancing social relationships online (Riordan, 2017). Finally, emoji can enable people to express ideas that they find difficult to express using words (Prada et al., 2018).

In addition to expressing emotion, emoji can also be used to modify the emotional content expressed in the text of an electronic message. For example, they can be used to reduce ambiguity in electronic communication, such as by establishing emotional tone and lightening the mood in a message that could be interpreted as sarcastic or negative (Kaye et al., 2016). Similarly, among Spanish WhatsApp users, emoji are used both to upgrade (intensify) and downgrade (soften) speech acts, which can include emotional content (Sampietro, 2019). Additionally, Zhou et al. (2017) found that Chinese WeChat users employed emoji to both amplify and modulate the emotional content of their instant messages. Finally, Prada et al. (2018) studied motivations for using emoji; their research suggests that emoji are often used to indicate irony or sarcasm. Thus, emoji are critical to understanding the emotional content of social media posts, text messages, or other computer-mediated communication.

The Current Study

The current study investigates the emotional content of emoji, as well as how they differ based on the categories assigned by Unicode. Unicode, the governing body that administers emoji, classifies them in eight categories: Smileys and Emotion, People and Body, Animals and Nature, Food and Drink, Travel and Places, Activities, Objects, Symbols, and Flags. We predict that emoji’s emotional content will differ based on their category. Specifically, we tested the hypothesis that…

Method

The sample for this study consisted of approximately 1,000,000 English tweets gathered from Twitter in November 2019. Approximately 25% of these tweets contained at least one emoji. Emotional scores for each emoji were produced by averaging the scores on the NRC Emotion Lexicon for the tweets containing that emoji. We only retained emoji that occurred at least 50 times in the sample, yielding a total of 549 emoji rated on ten emotional dimensions.

References

Alshenqeeti, H. (2016). Are emojis creating a new or old visual language for new generations? A socio-semiotic study. Advances in Language and Literary Studies, 7(6). https://doi.org/10.7575/aiac.alls.v.7n.6p.56
Bai, Q., Dan, Q., Mu, Z., & Yang, M. (2019). A systematic review of emoji: Current research and future perspectives. Frontiers in Psychology, 10, 2221. https://doi.org/10.3389/fpsyg.2019.02221
Chairunnisa, S., & Benedictus, A. S. (2017). Analysis of emoji and emoticon usage in interpersonal communication of blackberry messenger and WhatsApp application user. International Journal of Social Sciences and Management, 4(2), 120–126. https://doi.org/10.3126/ijssm.v4i2.17173
Cramer, H., Juan, P. de, & Tetreault, J. (2016). Sender-intended functions of emojis in US messaging.
Gantiva, C., Sotaquirá, M., Araujo, A., & Cuervo, P. (2019). Cortical processing of human and emoji faces: An ERP analysis. Behaviour & Information Technology, 1–9. https://doi.org/10.1080/0144929X.2019.1632933
Kaye, L. K., Wall, H. J., & Malone, S. A. (2016). "Turn that frown upside-down": A contextual account of emoticon usage on different virtual platforms. Computers in Human Behavior, 60, 463–467. https://doi.org/10.1016/j.chb.2016.02.088
Kelly, R., & Watts, L. (2015). Characterising the inventive appropriation of emoji as relationally meaningful in mediated close personal relationships. Proceedings of Experiences of Technology Appropriation: Unanticipated Users, Usage, Circumstances, and Design.
Ljubešić, N., & Fišer, D. (2016). A global analysis of emoji usage. Proceedings of the 10th Web as Corpus Workshop (WAC-x) and the EmpiriST Sharet Task.
Novak, P. K., Smailović, J., Sluban, B., & Mozetič, I. (2015). Sentiment of emojis. PLOS ONE, 10(12), e0144296. https://doi.org/10.1371/journal.pone.0144296
Prada, M., Rodrigues, D. L., Garrido, M. V., Lopes, D., Cavalheiro, B., & Gaspar, R. (2018). Motives, frequency and attitudes toward emoji and emoticon use. Telematics and Informatics, 35(7), 1925–1934. https://doi.org/10.1016/j.tele.2018.06.005
Riordan, M. A. (2017). Emojis as tools for emotion work: Communicating affect in text messages. Journal of Language and Social Psychology, 36(5), 549–567. https://doi.org/10.1177/0261927X17704238
Sampietro, A. (2019). Emoji and rapport management in spanish WhatsApp chats. Journal of Pragmatics, 143, 109–120. https://doi.org/10.1016/j.pragma.2019.02.009
Unicode. (2019). Full emoji list, v12.1. https://unicode.org/emoji/charts/full-emoji-list.html
Walther, J. B. (1992). Interpersonal effects in computer-mediated interaction: A relational perspective. Communication Research, 19(1), 52–90. https://doi.org/10.1177/009365092019001003
Walther, J. B. (2011). Theories of computer-mediated communication and interpersonal relations. In M. L. Knapp & J. A. Daly (Eds.), The handbook of interpersonal communication (Vol. 4, pp. 443–479). SAGE.
Wang, Y. (2015). For the first time ever, an emoji is crowned oxfort dictionaries’ word of the year. The Washington Post.
Zhou, R., Hentschel, J., & Kumar, N. (2017). Goodbye text, hello emoji: Mobile communication on WeChat in china. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI ’17, 748–759. https://doi.org/10.1145/3025453.3025800