To rush CS students through simplified, condensed overviews of ethical understanding & position them to be the primary arbiter of change promotes engineers' inclination towards seeing themselves as solitary savior, to the detriment of the quality of the solution. 1/
Incidents of algorithmic misuse, unethical deployments, or harmful bias cannot be addressed by developing moral integrity at an individual level. The current issues are the result of collective failure. 2/
Less about a single engineer’s efforts to enforce their understanding of diverse representation into the model, and more about a form of participatory design where other stakeholders are actively & humbly welcomed to join in creation of more just & equitable systems 3/
For most modern disasters, responsibility lies somewhere between individual agency and bureaucratic control... In actuality, an ethical challenge would not get resolved by an individual or even a group of technologists but will require an inherently interdisciplinary effort. 4/
The lack of cross-citation across disciplinary lines (found in analysis of 254 AI ethics syllabi) indicates that findings from one discipline are not respected as adequate evidence to inform researchers from another and that, even if valued, are insufficiently accessible. 6/
• • •
Missing some Tweet in this thread? You can try to
force a refresh
Big news: @jeremyphoward & I have moved to his home country of Australia (he is not a USA citizen & has been wanting to return for years). I’m excited about the move, although it is bittersweet 1/
The last year in the USA has been horrifying. I’m lucky in so many ways: we were able to isolate pretty strictly as a family of 3 (a privilege that many did not have) & our daughter thrived at home with us, although it was still hard to go for a year with... 2/
no in-person childcare; not seeing any of my friends; hearing regularly that mass preventable death is okay as long as it is mostly people with chronic illness (like me), the elderly, & BIPOC dying; and worry of not being able to access an ER or ICU 3/
Calculating the souls of Black folk: predictive analytics in the child welfare system
powerful & informative talk by @UpFromTheCracks at @DataInstituteSF Center for Applied Data Ethics seminar series, video now online
If there was a material benefit from the family regulation system (child welfare system), middle class white people would be seeking it out for their kids.
The child welfare system is not biased, it is racist.
Racist in the Ruth Wilson Gilmore sense of the word: racism is a state-sanctioned and/or extralegal production & exploitation of group differentiated vulnerability to premature death.
Is your machine learning solution creating more problems than it solves? @JasmineMcNealy on how in focusing narrowly on one problem, we may be missing many others @DataInstituteSF CADE Seminar Series
21 States Are Now Vetting Unemployment Claims With a ‘Risky’ Facial Recognition System:
"legitimate claimants have also been rejected by the company’s machine learning & facial recognition systems — leading to massive delays in life-sustaining funds"
Central considerations when designing algorithms:
- *Who* is the prototype?
- Continuous evaluation & auditing
- We need to normalize STOPPING the use of a tool when harm is occurring. We don't need to keep using a tool just because we've already started. @JasmineMcNealy
The founder of @gridai_ (@_willfalcon) has been sharing some falsehoods about fastai as he promotes the pytorch lighting library. I want to address these & to share some of our fast ai history. 1/
Because our MOOC is so well-known, some assume fast.ai is just for beginners, yet we have always worked to take people to the state-of-the-art (including through our software library). 2/
I co-founded fast.ai w/ @jeremyphoward in 2016 & worked on it full-time until 2019. I've been focused on the USF Center for Applied Data Ethics for the past 2 yrs, so I can’t speak about the current as much, but I can share our history. 3/
In computational systems, we are often interested in unobservable theoretical constructs (eg "creditworthiness", "teacher quality", "risk to society"). Many harms are result of a mismatch between the constructs & their operationalization -- @az_jacobs@hannawallach
A measurement model is "valid" if the theoretical understanding matches the operationalization. There are many ways validity can fail.
Some types of Validity
content: does measurement capture everything we want
convergent: match other measurements
predictive: related to other external properties
hypothesis: theoretically useful
consequential: downstream societal impacts
reliability: noise, precision, stability
I made a playlist of 11 short videos (most are 7-13 mins long) on Ethics in Machine Learning
This is from my 2 hrs ethics lecture in Practical Deep Learning for Coders v4. I thought these short videos would be easier to watch, share, or skip around
What are Ethics & Why do they Matter? Machine Learning Edition
- 3 Case Studies to know about
- Is this really our responsibility?
- What is ethics? @scuethics
- What do we teach when we teach tech ethics? @cfiesler
Software systems have bugs, algorithms can have errors, data is often incorrect.
People impacted by automated systems need timely, meaningful ways to appeal decisions & find recourse, and we need to plan for this in advance