On Monday I’ll be speaking at the Emoji2021 workshop
@icwsm, so I figured it’d be a good time to do an emoji thread, because I’ve now been involved both with creating emoji and with doing research about their cognition /1 emoji2021.aiisc.ai
The latest emoji update has now started hitting phones, including the Face Exhaling/Breath Face Emoji (😮‍💨) which I actually proposed along with @jenniferdaniel! So, here's a bit about how it came to be /2 emojipedia.org/face-exhaling/
Several years ago @jenniferdaniel and I started discussing how to improve on the emoji faces. Many emoji began as influenced from the vocabulary of Japanese manga ( 😣🍆💢💩😍😱😰😅🥺😭😪), as you can see in our list of manga symbology /3 visuallanguagelab.com/A/jvlmorpholog…
So we started compiling a list comparing existing and possible emoji to other symbology from comics and manga. You’ll see both the breath face 😮‍💨 and face in the clouds 😶‍🌫️ on that list /4 unicode.org/L2/L2019/19390…
The puff of smoke for a sigh was what we called a “breath mushroom” in our original analyses of symbology (“morphology”) from Japanese manga, which often uses a slightly more stylized version of it /5 visuallanguagelab.com/A/jvlmorpholog…
The breath face had actually been a Samsung emoji that had disappeared because of cross-platform consistency. We proposed to bring it back /6 unicode.org/L2/L2020/20066…
The version that @jenniferdaniel made in our proposal was actually based on my own drawing we’ve used in experiments! The actual ones now vary depending on the platform /7 thevisuallinguist.com/2016/09/new-pa…
We looked to comics symbology as already established conventions, which might make them easier to be adopted as emoji. Sometimes, new emoji weren’t proposed if existing emoji could combine, like 😮💡, which is “close enough” to the bulb above the head in a single emoji /8
Once emoji are proposed, they are then discussed and possibly approved by the Unicode Consortium, which actually receives many proposals every year for new emoji, only a fraction of which get selected /9 home.unicode.org
For more about emoji, here’s my blog post where I dispel some myths about emoji, like how emoji are not like Egyptian hieroglyphs, and there’s no such thing as a “universal language” even in graphics /10 thevisuallinguist.com/2015/11/dispel…
I go into these issues a bit more in my older article for @BBC_Future on “Will emoji become a new language?” where I point out that emoji are limited in their ability to combine, and lack a natural grammar /11 bbc.com/future/article…
This aspect of emoji grammar was also explored in our experimental paper, "The grammar of emoji? Constraints on communicative pictorial sequencing” which showed that emoji sequencing doesn’t use the type of sequencing characterized by a complex syntax /12 …itiveresearchjournal.springeropen.com/articles/10.11…
I also have some follow up work on the emoji lexicon and grammar coming soon with @bpweissman, who along with @AdricDirac previously did work on how emoji can imply irony when combined with sentences /13 journals.plos.org/plosone/articl…
We have several additional face emoji that are under review inspired by conventions from comics, so hopefully you’ll see some more coming soon! /end unicode.org/L2/L2020/Regis…

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Dr. Neil Cohn

Dr. Neil Cohn Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @visual_linguist

21 Mar
Many people feel they “can’t draw”, which seems odd given assumptions about drawing as a direct pathway to visual concepts. We can all see, so why can’t we draw? So here’s a thread why everything you know about learning to draw is wrong… 1/
First off, here’s what I think are predominant beliefs about learning to draw:
1. Drawing is about what you see, either by eye or in your “imagination”
2. People have talent or they don’t
3. Having your “own” style is good
4. Thus copying is bad

Do these sound familiar? 2/
These beliefs are a relatively recent invention, and date back to the philosophy of Jean Jacques Rousseau, who proposed that culture might taint our more “natural” instincts. This is where they “copying is bad” part comes in 3/
Read 17 tweets
1 Jan
The Calvin and Hobbes comic strip ended 25 years ago, so let’s celebrate a New Years treat by analyzing it! Awhile back I had a students annotate structures in every C&H strip, so we have data on the whole thing. As Calvin says: let’s go exploring! 1/ gocomics.com/calvinandhobbes
An interesting feature of this strip is that Watterson took a few sabbaticals during its run, and came back with more artistic freedom. So, I’ll focus here on how a few aspects of the strip change over time. Here’s what every panel per strip looks like (all 14,712 panels!) 2/
Let’s start with storytelling. Overall, the strip shifts to becoming more visual and multimodality balanced in meaning over time. In this graph, higher numbers mean more meaning carried by pictures than words (0=balanced) 3/
Read 12 tweets
31 Dec 20
I’ve been reading several research papers lately with drawing as a task, and it’s gotten me riled up enough that it’s time for a rant thread. The short of it: Stop treating drawing as if there are no systems, no conventions, and that it’s an unmediated link to visual concepts 1/
First off, drawing is a complex cognitive activity involving numerous subsystems, not some direct pathway from perception (or visual imagery) to motor control as is assumed when using drawing in clinical contexts 2/
sciencedirect.com/science/articl…
Drawings are not direct pathways to visual concepts, because they require a “visual vocabulary” to be learned and developed. People who “can’t draw” simply have not developed an extensive vocabulary 3/ karger.com/Article/Fullte…
Read 12 tweets
22 Jan 18
A few days ago @matt_thorn_en had an excellent thread about layouts in manga. Here I want to expand on that, from the perspective of cognition and psychology. It may surprise people, but there’s been actual science done on the rules of #comics page layouts…
As explained in that thread, manga readers use meeting points between panels to signal whether to read horizontally or vertically. These are cued by "T" shapes or "+" shapes between panels
As described in my book and some papers, these panel junctions do indeed give readers layout cues, and we've articulated these rules explicitly. But, they are just the to deeper strategies... visuallanguagelab.com/vloc.html
Read 19 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!

:(