Designing recommender systems to depolarize:
- algorithmic social media isn't primary driver of polarization, but could be useful intervention
- goal: to transform conflict, not to suppress or eliminate it
- 3 stages: moderation, ranking, & user interface
paper by @jonathanstray
Polarization is involved in variety of feedback loops:
- it leads to less intergroup contact, which causes polarization
- it is a precursor to violence, which causes
- polarization it leads to selective information exposure, which causes polarization
3 key places where changes to recommender systems could be used for depolarization:
- which content is available (moderation)
- which content is selected (ranking)
- how content is presented (interface)
Important to distinguish btwn community moderation vs algorithm-assisted moderation at scale
Community moderators state reasons for actions, discuss policy, consider appeals
Algorithmic-assisted moderation at scale is acontextual, impersonal, hard to appeal, high false positive
Above quotes are from "Designing Recommender Systems to Depolarize" by @jonathanstray
We need more nuanced ways to talk about medical & public health disagreements, without the simplistic black-and-white reductions that you either trust ALL doctors in ALL matters OR you must be anti-science. 1/
"Science is less the parade of decisive blockbuster discoveries that the press often portrays, and more a slow, erratic stumble toward ever less uncertainty." @zeynep 2/
My new essay: In topics ranging from covid-19 to HIV research to the long history of wrongly assuming women’s illnesses are psychosomatic, we have seen again and again that medicine, like all science, is political.
We are not prepared for the surge in disability due to #LongCovid. The physiological damage covid causes can include cognitive dysfunction, GI immune system damage, immune dysfunction, increased risk of kidney outcomes, dysfunction in T cell memory generation, pancreas damage, 2/
We are seeing concerted efforts to downplay the long-term health effects of covid using strategies straight out of the climate change denial playbook... Many have a significant financial interest in distorting the science around long term effects of covid. 3/
Pundits urge people to “listen to the science,” as if “the science” is a tome of facts and not an amorphous, dynamic entity. The naive desire for science to remain above politics meant many researchers were unprepared for a crisis that was both scientific & political to its core.
The pandemic hasn’t just been a science story. It is an omnicrisis. One must understand not just virology, but also the history of racism & genocide, the carceral state, nursing homes, historical attitudes toward medicine, social media algorithms, & more. theatlantic.com/science/archiv…
Much of journalism is fragmentary. For science, that means treating individual papers as a sacrosanct atomic unit and writing about them one at a time. But for an omnicrisis, this approach leads only to a messy, confusing, & ever-shifting mound of jigsaw pieces. @edyong209
"My concern is that reducing humans to acting as data sources is fundamentally inhumane."
-- Alan Blackwell 1/ dl.acm.org/doi/abs/10.714…
"But whereas the core problem of symbol-processing AI was its lack of connection to context – the problem of situated cognition – the core problem of machine learning is the way in which it reduces the contextualised human to a machine-like source of interaction data." 2/
The user is effectively submitting to a comparison between their own actions and those of other people from which the model has been derived. In many such comparisons, the effect will be a regression toward the mean. 3/
When patients reject a mental health (mis)diagnosis for symptoms they know have physiological origins, it is *not* bc they are devaluing mental health.
Patients do this bc they know that it will lead to ineffective treatments & useless research. 1/5
There's a pernicious cycle: label a poorly understood illness as psychogenic ➡️ don't invest money in researching the physiological origins ➡️ claim the lack of evidence on physiological mechanism proves it's psychogenic ➡️ repeat
2/5
Bonus: if patients are not "rational" enough in their suffering as medical establishment offers them nothing ➡️ use this as further evidence that their symptoms can't have physiological origins 3/5
Medicine, like all of science, is political:
- which questions get asked
- which projects get funded
- how debates get framed
- who the researchers are
- context of data (what categories, what labels, which biases, what is left out)
- whose suffering is counted 1/
Science does not just progress inevitably, independent of funding and politics and framing and biases. 2/
Activists of ACT UP pushed USA govt & medical establishment to stop ignoring HIV/AIDS in the late 80s/early 90s, and to invest more in researching & addressing it. The huge progress that has happened in HIV/AIDS research & treatment would not have happened otherwise. 3/