Hey computing academics! What are you favorite examples of ethical considerations/discussions in published papers? e.g. research ethics, broader impacts. Please share papers! I would love examples from a range of subfields. 🙏
Clarification: I’m not looking for papers ABOUT research ethics (though you’re welcome to share if you like :) ); I’m looking for papers that discuss ethical decisions or implications of the research they describe. e.g. a paragraph about ethics in the methods section!
I would actually especially love good examples of broader impacts statements in NeurIPS papers or similar! Help? 🙏 #neurips#NeurIPS2021
Also in exchange for the help I will share the curriculum I’m creating for CS students on how to write about ethics in papers. :)
• • •
Missing some Tweet in this thread? You can try to
force a refresh
This is a bad headline. But the findings themselves (about teen girls' perspectives of how multiple social media platforms impact their well-being) are interesting! Let me tell you what they actually are. 🧵 washingtonpost.com/education/2023…
This report (commonsensemedia.org/research/teens…) is based on a demographically representative national (U.S.) survey of 1,300 girls age 11-15, in which they were asked about their perceptions of how different social media platforms and specific design features impact their well-being.
First, it really is troubling that almost half (45%) of the girls in their sample said that they feel “addicted” or use TikTok for a longer period than they intended at least weekly. This is higher than other platforms (e.g. Snapchat is 37%, YouTube is 34%).
The @huggingface GPT detector works very well on ChatGPT-created text. I ran 5 student essays and 5 ChatGPT essays for the same prompt through it, and it was correct every time with >99.9% confidence. huggingface.co/openai-detecto…
So re: deception use cases (e.g. cheating)...
... it's also against OpenAI's TOS to pass off outputs as being generated by humans. So though people keep telling me "it will get 'smart' enough to fool the detectors!" I would expect @OpenAI to release its own detector in response to ethical concerns.
Clarification: This GPT detector WAS developed by OpenAI as part of the release. I just saw the demo that’s hosted on HuggingFace! github.com/openai/gpt-2-o…
So I give a lot of advice to PhD applicants. My video about statements of purpose has 60k views on YouTube. Anyway, I asked #ChatGPT to write a statement of purpose for admission to our PhD program. And... it was pretty darn good. But there are some VERY important cautions:
The first version I gave it was very specific: our PhD program, a specific type of research experience and interest, and the names of three specific faculty members. It came back with this as part of the statement. If I read this I would 100% think it was a real applicant. But...
Next I gave it the same prompt, but instead of faculty names, just said "the applicant should mention three faculty members by name and describe how their research interests relate to the applicant."
The three faculty named here are all at different universities, none at mine.
ChatGPT says that its own creation was unethical, and then makes a number of suggestions for mitigating harm, none of which appear to be in place. (Maybe the TOS suggestion, which is the least useful one anyway, if cheating falls under the broad umbrella of "deception.")
Since ChatGPT does say that it is "trained to decline inappropriate requests" and one of its second suggestions for mitigating cheating might have fallen into this category, I fed it 10 algebra problems from a worksheet I found online. It gave great answers to all of them!
I do think it's great that when ChatGPT solves math problems, it provides thorough explanation. There are tons of algebra solvers online that just give you the answer. So though you could argue it's bad to also provide "show your work," I see this as helping people learn.
On the topic of students using ChatGPT, this is an essay assignment for my tech ethics & policy class. ChatGPT picked "I, Robot." I then used the same prompt but specified "Ex Machina." Decent essays... with identical final three paragraphs, including fabricated citations. So...
If one student thinks of using ChatGPT to write their essay by giving it the assignment prompt, another student might as well. Resulting in nearly identical essays. Also you'd have to find real sources to cite to replace the bogus ones.