Day 2 of #LingCologne starts with Wendy Sandler giving her keynote on the compositionality of theatrical sign language.
Wendy acknowledges the important work of Svetlana Dachkovsky ("our resident squintologist") who has done extensive work on squinting in Israeli SL, for example as a marker of shared information and subordinate clauses. #LingCologne
Facial actions — as a finite set — are grammatical across sign languages, and mostly correspond to spoken language intonation (mainly upper face). Thus, different parts of the body are composite pieces of the linguistic system. #LingCologne
The use of the two hands has been shown to be associated with plurality, across sign languages (citing work by @ryanlepic and myself and colleagues, some together with Wendy herself and Gal Belsitzman). #LingCologne
In theatrical sign language, not only do signers combine or partition their individual articulators to express meaning, but several signers can jointly express parts of a larger while — e.g. a dragon! 🐉 #LingCologne
Conclusions:
— language is multimodal and dynamic
— art forms unpack and recombine and thus illuminate structural elements of language
— the human body provides important clues to language structure and meaning #LingCologne
@ozyurek_a notes (building on Carol Padden's comment at #FMU recently) that theatrical signing suggests that iconicity is something complex and layered: by realizing the combinatorial potential of it, you can express #iconicity on more levels. #LingCologne
• • •
Missing some Tweet in this thread? You can try to
force a refresh
Last night I was playing a little with Openpose data in #RStats. I realized it's not too hard to wrangle the Openpose output and plot signing directly using #ggplot2 and #gganimate, like so:
But I decided to make some tweaks so you can change the color of the signer+clothes, which makes seeing the hands a bit easier (contrast!)...
But also, why not give your signer a pretty turtleneck to wear?
You guys know that IKEA products are basically just #Swedish words and place names, right? Walking around an IKEA store is like walking through a dictionary.
This is a script simulating the idea in Swedish and other places/languages: github.com/borstell/fakea
So you can now input a video and it outputs it slower and/or repeated. Here's an example of a sign for 'deaf' in STS rendered with a repeated 30% speed playback!
(Oh, and passed to the make_gif() function as well!)
And the automatic face blurring works great! Even with multiple people in the image (or, like here, multiple repetitions of the same person in one composite image)!
So, it's like *very* easy to process and reconstruct actual images with only a few lines of code. As in plotting software redrawing the image, pixel by pixel.
Here's is a gif of me made with #ggplot2 and #gganimate. Sunday = fun day!