Manoel Profile picture
Computational Social Science, Platforms, GenAI, Moderation

Aug 23, 2019, 15 tweets

In our new pre-print, we find significant evidence of user radicalization on #YouTube. Tracking >79M comments across >300k videos, we show that those who comment on the so-called Intellectual Dark Web/Alt-lite consistently migrate to Alt-right channels. arxiv.org/abs/1908.08313

Really grateful towards my co-authors @raphaottoni , @cervisiarius, @virgilioalmeida , @wagnermeirajr . Also, thanks @jhblackb (a.k.a. Mr. Jimmy Black) for giving me tons of feedback. If you want a tl;dr on the paper, stick with me for a few more tweets below! 👇👇👇

In late 2017, I got surprised by the presence of fringe ideologies (e.g. White Supremacy) on YouTube. In 2018 I got redirected to one of such channels from an "Anti-SJW"-style video. Later that year, when I read @zeynep and @beccalew pieces on the alleged phenomena of...

...user radicalization on YouTube it all just clicked in my head. I still thought that the evidence indicating this phenomenon was happening was very anecdotal. Spent months devising a careful data collection method with @raphaottoni. By the end of this period...

...we collected and annotated a YouTube dataset of unprecedented size. 360 channels, more than 79 million comments, more than 2 million recommendations. We broadly categorized channels into Alt-right, Alt-lite, and Intellectual Dark Web...

...These communities were broadly defined by non-profits, by the media, and by the own content creators. We also collected control channels from large media outlets. Our findings blew my mind a little bit:

1) We looked at the growth of the I.D.W., the Alt-lite and the Alt-right throughout the last decade in terms of videos, likes, and views, finding a steep rise in activity and engagement in the communities of interest when compared with the control channels;

2) We inspect the intersection of commenting users within the communities, finding they increasingly share the same user base. For example, we find that more than half of users who commented on Alt-right channels in 2018 also comment on Alt-lite and on I.D.W. channels;

3) We also find that the intersection is not only growing due to new users but that there is significant user migration among the communities being studied. Users that initially comment only on content from the I.D.W. or the Alt-lite throughout the years consistently start to...

> on Alt-right content. These users are a significant fraction of the Alt-right commenting user base. Interestingly, although control channels share, on a yearly basis, a significant number of users with Alt-right channels, we cannot observe significant user migration from them.

4) Lastly, we take a look at the impact of YouTube's recommendation algorithms, running simulations on recommendation graphs. Our analyses show that, particularly through the channel recommender system,...

> Alt-lite channels are easily discovered from I.D.W. channels, and that Alt-right channels may be reached from the two other communities (!).

I believe our research has implications for content creators and for YouTube:

a) I believe that popular content creators like those in the Intellectual Dark Web, should be aware that this process is happening I genuinely believe this is not what they want, and they are in a good position to try to weaken fringe ideologies like white supremacy.

b) YouTube has to be held accountable and take action. I believe our work presents significant evidence that a large scale radicalization happened on the website. This process has led to horrific acts of terrorism, and should be addressed accordingly.

Lastly, I will tag some people whom I want this work to reach. They are a mix of scholars and YT personalities I think are making a difference! Hope you forgive my lack of
etiquette :)! @yaso @zeynep @beccalew @shaun_jen @ContraPoints @_DanArrows @Hbomberguy @PhilosophyTube

Share this Scrolly Tale with your friends.

A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.

Keep scrolling