David Rozado Profile picture
Research Scientist. Interested in underexplored research topics, institutional dynamics and AI bias.
3 subscribers
Jun 20 9 tweets 3 min read
1/ Is Wikipedia politically biased? To explore this question, I averaged the sentiment (negative/neutral/positive) associated with a set of politically loaded terms used in English Wikipedia content (N=175,205 sentiment annotations).
davidrozado.substack.com/p/is-wikipedia…Image 2/ There is a quantifiable mild to moderate tendency in Wikipedia articles to associate right-of-center U.S. politicians with more negative sentiment compared to left-of-center politicians. Image
Feb 2 5 tweets 2 min read
The Political Preferences of AIs: When probed with questions with political connotations, LLMs tend to generate responses that are diagnosed by most political orientations tests as manifesting preferences for left-of-center viewpoints, 11 political orientation tests, 24 SOTA LLMs Image In contrast, base models (precursors of conversationsl LLMs) responses to political orientation tests do not skew politically. This is surprising given the likely unbalanced representation of political viewpoints in pretraining corpora. Caveats apply though (see preprint). Image
Dec 8, 2023 6 tweets 2 min read
Grok's political preferences are similar to those of ChatGPT Image Grok's results on different test: Political Spectrum Quiz Image
May 8, 2023 9 tweets 2 min read
Image Image
Apr 6, 2023 8 tweets 3 min read
Great Awokening is a global phenomenon. No evidence it started in US media. Analysis of 98 million news articles across 36 countries quantifies. Exception: state-controlled media from China/Russia/Iran using wokeness terminology to criticize/mock the West
davidrozado.substack.com/p/gag Image Different geographical regions and countries emphasize distinct types of prejudice with varying degrees of intensity. Image
Mar 8, 2023 8 tweets 4 min read
La desproporción con la que los medios de comunicación españoles utilizan palabras tales como machismo, sexismo o misoginia es de tal magnitud que triplican a las de cualquiera de los medios de otros 35 países analizados davidrozado.substack.com/p/epg Entre los años 2000 y 2003 los medios españoles se referían al machismo con una frecuencia similar a la de sus homólogos europeos. En el periodo 2004-2008 dichos medios se convirtieron en una anomalía internacional por su alto número de referencias a este tipo de palabras
Feb 24, 2023 6 tweets 3 min read
1. Regarding whether The Great Awokening is winding down: There appears to be a decoupling in Twitter content between positive terminology associated with Social Justice/focus on victims and negative terminology suggestive of bad/deviant behavior
davidrozado.substack.com/p/taw
🧵 2. Terms with a negative payload suggestive of bad/deviant behavior (such as prejudice) have decreased in frequency in Twitter chatter. But... plot twist coming...🧵
davidrozado.substack.com/p/taw
Feb 16, 2023 11 tweets 4 min read
1. Behold RightWingGPT. An AI model fine-tuned to manifest the opposite political biases of ChatGPT (i.e. to be right wing). Let me describe how I did it and the dangers of politically aligned AIs given their potential to induce societal polarization davidrozado.substack.com/p/rightwinggpt
🧵 2. I have previously documented the left-leaning political biases embedded in ChatGPT as manifested in the bot responses to political tests' questions
davidrozado.substack.com/p/political-bi…
Feb 5, 2023 5 tweets 2 min read
1. We really need to know where ChatGPT biases come from. Training data? human raters in the fine-tuning phase rating the quality of the model responses? the instructions that those raters were given? intentionally placed filters? ... 2. It would be very congruent with OpenAI name and mission to allow external auditors to determine where these biases come from.
Jan 20, 2023 7 tweets 3 min read
1. I replicated and extended my original analysis of ChatGPT political biases. 14 out of 15 different political orientation tests diagnose ChatGPT answers to their questions as manifesting a preference for left-leaning viewpoints.
davidrozado.substack.com/p/political-bi… Image 2. On December 6th, I published a preliminary analysis about the left-leaning political bias embedded in the first release of ChatGPT (November 30, 2022).
davidrozado.substack.com/p/the-politica…
Jan 19, 2023 11 tweets 3 min read
1. El modelo de inteligencia artificial ChatGPT muestra una clara predilección por puntos de vista a la izquierda del centro político cuando se le somete a un test de orientación política en español.
davidrozado.substack.com/p/el-sesgo-pol… 2. A pesar del claro sesgo político de sus respuestas, cuando se le pregunta directamente por sus preferencias políticas, ChatGPT responde que no tiene preferencias políticas y que su objetivo es tan solo proporcionar información precisa y objetiva.
Dec 23, 2022 7 tweets 3 min read
1. ChatGPT no longer displays a clear left-leaning political bias. A mere few weeks after I probed ChatGPT with several political orientation quizzes, something appears to have been changed in ChatGPT that makes it more neutral and viewpoint diverse. 🧵
davidrozado.substack.com/p/chatgpt 2. Between December 5-6, I applied 4 political orientation tests to ChatGPT. Results were consistent across the tests. All 4 tests diagnosed ChatGPT answers to their questions as politically left-leaning. I described my analysis in detail here
davidrozado.substack.com/p/the-politica…
Dec 5, 2022 6 tweets 4 min read
ChatGPT answers to Political Compass Test: anti death penalty, pro-abortion, skeptic of free markets, corporations exploit poor countries, more tax the rich, pro gov subsidies, pro-benefits to those refuse to work, pro-immigration, pro-sexual liberation, morality without religion Image ImageImageImageImage
Dec 5, 2022 5 tweets 2 min read
I carried out another test to determine the political leanings of ChatGPT dialogues using the more comprehensive Political Compass Test. Results hold. ChatGPT dialogues display substantial left-leaning and libertarian political bias.
davidrozado.substack.com/p/the-politica… Some example answers of ChatGPT AI system to the Political Compass Test
Dec 5, 2022 10 tweets 6 min read
I just applied the Political Typology Quiz from Pew Research to ChatGPT, a state-of-the-art AI language model. Results are consistent through several trials: ChatGPT answers exhibit moderate left-leaning political orientation
davidrozado.substack.com/p/the-politica… The disparity between ChatGPT and the wider public is substantial. Establishment liberalism ideology represents just 13% of the American public.
Oct 19, 2022 6 tweets 2 min read
1/n The anger, fear and sadness conveyed by news media headlines is increasing over time.
Summary of published paper: davidrozado.substack.com/p/the-increasi… Image 2/n News media headlines from right-leaning news outlets display, on average, more anger than headlines from left-leaning news media. Emotionally neutral headlines are consistently decreasing across news media regardless of their ideological leanings Image
Oct 19, 2022 6 tweets 2 min read
1/n News media headlines are becoming more negative over time. Headlines conveying anger, fear and sadness also increasing markedly. Right-leaning news outlets more prone to convey negativity and anger in their headlines.
Summary of published paper: davidrozado.substack.com/p/the-increasi…
🧵 Image 2/n Headlines from right-leaning news outlets tend to have a more negative sentiment than headlines from left-leaning news outlets Image
Sep 26, 2022 6 tweets 2 min read
Frequency of Terms Denoting Political Extremism in News Media
davidrozado.substack.com/p/iftdpe
Sep 14, 2022 4 tweets 2 min read
Aug 10, 2022 6 tweets 3 min read
1. Can the seeds of so-called wokeness be traced back to the academic literature from the 1970/1980s? New paper about the increasing emphasis on prejudice and social justice in scholarly publications
Paper: nas.org/academic-quest…
Summary: davidrozado.substack.com/p/tialpasj Image 2. Previously, I documented a post-2010 marked increase of terms denouncing prejudice in news media.
Thread:
Paper summary: davidrozado.substack.com/p/ppdwnmd Image
Sep 5, 2021 6 tweets 3 min read