Thread by @TheProductiveR3

ChatGPT & BingAI can 10X your academic productivity & well-being.

But many academics don't know when to use which.

I carried out experiments to help you know when to use ChatGPT or BingAI.

Sample prompts, comparisons, & lessons learnt.

⬇️

#AcademicTwitter @PhDVoice

@PhDVoice A primer on what they are

Both are text-based AI models that generate text based on your prompts.

ChatGPT is the AI model that sparked this craze.

BingAI is a tweaked chatGPT + Microsoft’s search engine (Bing).

@PhDVoice 🧪 Methods

• Give the same prompts to ChatGPT & BingAI
• Repeat three times
• Display the 'best result' from each
• Repeat across five different academic tasks.

@PhDVoice Task 1: Academic writing

Prompt: "Please rephrase this text for an academic audience."

🥇 chatGPT, follows the prompt, gives a good quality rephrasing.

🥈 BingAI, follows the prompt, phrasing is less suited to an academic journal.

@PhDVoice Task 2: Reading papers

Prompt: "Please discuss the limitations of this study as discussed by the authors"

🥇 ChatGPT: mostly followed prompt, mentioned 'limitations' authors didn't

✖️ BingAI: performed poorly, wouldn't accept all of prompt text, didn't follow prompt

@PhDVoice Task 3: Academic coding

Prompt: "Here is my data. I want to plot whether rainfall impacts bird activity as a scatterplot with a regression line using ggplot"

🥇 ChatGPT: correct code, recognises sample data, assumes it's in R

🥈 BingAI: simplified code, makes wrong assumptions

@PhDVoice Task 4: Finding papers

Prompt: "Are there any references on whether bat mortality is impacted by wind turbines in Northern Europe?"

🥇 BingAI: all refeences real & on right topic

🥈 chatGPT: 3 references real; 2 references on right topic; 1 reference in right area

@PhDVoice Task 5: Writing emails

Prompt: "Please rephrase the below email. It should be semi-formal. This is to a professor I know."

Hi Jane,
Thank you for the manuscript comments.
Could you expand on the thing you said about the corellation?
Thanks
"

🥇 chatGPT & bingAI: both do well

@PhDVoice Here's a summary of the winners and losers for each task:

Writing:
🥇 ChatGPT
🥈 BingAI

Reading papers:
🥇 ChatGPT
✖️ BingAI

Coding:
🥇 ChatGPT
🥈 BingAI

Finding references:
🥇 BingAI
🥈 ChatGPT

Writing emails:
🥇 ChatGPT
🥇 BingAI

@PhDVoice Key takeaways:

Both ChatGPT & BingAI are powerful tools

ChatGPT typically gave better outputs than BingAI.

For many, it may come down to preference

Here's the rule-of-thumb I follow:

• Use BingAI when you're searching for online resources
• Use ChatGPT for everything else

@PhDVoice If you enjoyed this thread, here's 2 things for you:

1. Follow me, @TheProductiveR3, for more tips on using AI in academia.

2. Jump back to the top of the thread and share it with others.

Bonus points for hitting reply with your favourite AI use cases!