Thread by @DrPetra

I’ve been training people in how to peer review today.

Here are the top things they didn’t know before the class that they thought you might find helpful 🧵 #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

1. Peer reviewing is an essential research skill. And as with any skill it takes tuition, time, practice, respect and accountability to get right. The more you do it the better you’ll be.

#AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

2. Peer reviewing doesn’t just benefit the person who’s work you’re checking. The more research proposals and publications you review the better your research will become.
#AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

3. Most of us think peer review = journals, but you can also review
- book proposals
- book drafts
- published books
- grant proposals
- event plans
- conference submissions
- project tenders
#AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

4. Lots of peer reviewing is done voluntarily as in the past it was supposedly part of an academic job (never really was, it was always extra). Some peer reviewing is paid (in cash,vouchers or books)

#AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

5. Editors,publishers,or others organising reviews should provide clear instructions on your remit. Some offer training. Useful if you’re new to reviewing or need a refresher. Ask if it isn’t offered
#AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

6. People are never sure how many peer reviews they should be doing; so a good rule is for every paper, grant etc you submit do a review in return. You can always do more if time allows. #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

7. How do you get to be a peer reviewer? You can contact journal editors, funders, or publishers directly. Volunteer via professional organisations. Or respond to calls for reviewers #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

8. Can I peer review without a PhD? Yes! People can also peer review using professional or personal experience. You can indicate your areas of expertise and interest and will be selected on that basis #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

9. Can I refuse to review? Absolutely! If you’re too busy or it’s not in your area of expertise then a swift “no” lets the editor move on. It won’t be held against you. You can say yes next time #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

10. “Why are reviews taking so long right now? It’s really poor I’ve had to wait so long!” There’s a pandemic on. Inequalities have widened. People have other priorities. Not enough reviewers. #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

11. “What helps me be a better reviewer?” Learning how to close read/critically appraise. Your library might have courses or guidance on this. Again, practice makes perfect 🤩 #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

12. Checklists (like these from EQUATOR equator-network.org) can help structure your review and give you ideas on what makes a strong piece of work. Be critical about checklists too, it’s more than box ticking! #AcademicChatter #AcademicTwitter #gradschool #ResearchTip

13. “Do I have to be anonymous?” Depends on the journal. For minoritised scholars and ECRs being identifiable could be risky. My preference is to be identified but it isn’t always the journal’s policy #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

14. Always alert editors, publishers, or other organisers if you are concerned about fraud, plagiarism, bribes, misconduct or other violations. Even if you aren’t sure, raise that “uh oh” feeling #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

15. “How do I avoid being Reviewer 2?”
- follow the tips in this thread
- imagine you’re doing the review in person
- take your time
- check/revise feedback for clarity
- put yourself in their shoes

#AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

16. Remember alongside any guidance or instructions you’ll have been given, you can also refer to thinkchecksubmit.com and publicationethics.org which cover ethical publishing and authorship #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

17. “What if the other reviewers disagree with me?” They often will. It’s okay. Don’t try to second guess them. The editor’s job is to make it make sense for the author #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

18. If you believe other reviewers are majorly wrong or acting unethically or unkindly you should report this to the editor/publisher #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

19. “What if the author is angry or upset with me?” You can be clear in feedback and constructive with your criticism so they can benefit from your ideas. And they can respond and rebut. #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

20. But remember reviewees should not threaten, badmouth, bribe, or bully you because they didn’t like your review. If this happens you can let editors, publishers, ethics committees or employers know. #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

21. Some papers can leave you feeling anxious, sad or angry because of the standard of work,topic,or concerns for the author. It’s okay to discuss with editors/publishers or supervisors in confidence #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

22. As a reviewer you must respect author confidentiality so that means not telling other people a paper was trash, divulging results before publication, stealing ideas, or anything that exposes researchers or participants to risk #AcademicChatter #AcademicTwitter #gradschool

23. “Can I stop reviewing once I’ve started?” Yes. If your personal or work situation changes, or if you recognise a conflict of interest, or if it feels beyond you at present #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

24. “If I’m not sure about something based on my limitations should I flag it?” Yes! For example I struggle with numbers so if I’m not confident about quant analysis I’ll ask if a statistician can check #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

25. “Can I put that I’m a reviewer on my CV?” Yes! You can note that you’ve reviewed for named funders, charities, book publishers, journals etc. You don’t need to list what you’ve reviewed, nor imply that work is your own #AcademicChatter #AcademicTwitter #gradschool #PhDChat

Hope that’s useful 😊 you might have your own tips or questions so please feel free to add them #AcademicChatter #AcademicTwitter #gradschool #PhDChat #HigherEd #ResearchTip

27. In response to the fantastic responses many of you have kindly shared ❤️Peer reviewing needs reframing in relation to inclusion, accessibility and the pandemic. A lot of rules you’ve been taught on peer review work only for fully funded, secure, abled folk - not in a pandemic

28. Something I raise in all training on peer review, which is relevant to this thread, is if working conditions are not supportive for reviewers then even if people want to review they will struggle. Payment, accessibility, job security, training and support all matter.

29. A fear shared at other training courses on peer reviewing is “are minority scholars harmed?” and the answer is “yes” as they may be less likely to be asked to review and more likely to be in insecure or unsafe roles so under pressure to do more reviewing with little credit 😢

Scholars that are already overworked and unsupported (especially PGRs, ECRs and part timers) may push themselves (or be pushed) to do more of *everything* - including reviewing. There is also talk of reviewing and other academic tasks taking space meant for rest and recuperation

30. “How could we improve peer reviewing?” Suggestions people have shared
- training to review
- better working conditions
- dedicated, protected and rewarded time for reviewing
- paying reviewers
Not everyone agrees with these when we discuss, nor how much you should review 😀