Just posted in @PsyArXiv a short where I collected some suggestions concerning "how to prepare a rebuttal letter". Journals do not provide explicit guidance on this and, in my experience as a reviewer and editor, a great diversity exists in their format..
.. however, not all formats are, in my modest and personal opinion, as effective. And by effective here I mean the capacity of delivering all the relevant information (how are you responding to the Reviewer's point) in a clear and efficient manner. I mostly focused on formatting
Tip 0: Before the rebuttal, the cover letter.
I find it extremely helpful when the cover letter mentions, in a narrative manner, the main modifications undertaken during the revision and how they are related to the Reviewers’ main points and the final story of the manuscript
Tip 1: do not modify or rephrase the Reviewers’ comments
This may appear to be a more obvious (or unnecessary) tip, but since I have actually observed this situation a couple of times, I thought it may be useful to explicitly state it.
Tip 2: numbering the reviewers’ comments.
More specifically, in our rebuttals, numbering takes the simple form of adding Rx.y just before (or after) the Reviewer’s remark, where x is the number of the Reviewer (usually, R1, R2, R3) and y is the number of the point.
Tip 3: use a different color for the reviewers’ points and your response
I personally prefer leaving the reviewers’ comments in black and using a different, but readable, color for the response. The goal of this is to make the navigation in the document as easy as possible.
Tip 4: Quote the modifications you have made in the manuscript
By including the modifications in the rebuttal you will spare the Editor and the Reviewers the necessity of continuous back-and-forth between the rebuttal letter and the manuscript.
Tip 5: Report the figures in the rebuttal
For similar reasons, I also strongly suggest systematically including the revised figures in the rebuttal. The figures included can be of two types: figures displayed in the final manuscript or just used to make a point in the rebuttal
Tip 6: beyond the rebuttal, the revised manuscript with modifications highlighted
the best way of presenting the modifications exploits the “comment” function that exists in all word-processing softwares. Select the revised text and add a comment indicating the point addressed
Implementing all tips can cost some time. However, I believe that it is marginal compared to the time gained overall in terms of speeding up the evaluation process. I also believe (in my experience) that these tips facilitate the preparation of the revision with your co-authors
I want to acknowledge that want I did here was merely to compile things that already exist in the form of "collective knowledge" and I am not really inventing anything. I also want to thank @NeuroKMC for the great feedback on the first drafts of this note.
@NeuroKMC @threadreaderapp unroll
• • •
Missing some Tweet in this thread? You can try to
force a refresh
I just finished reading an all-time classic of experiment psychology “Principles of Behavior” by Clark Hull (1943). In the book, the author tries to delineate the first principles of a scientific theory of behaviour, based on a capillary survey of (mainly) animal experiments 1/n
The first chapter presents his epistemological manifesto in favour of a mathematical (logico-deductive) formalization. It reminded me of the preface of “Theory of games" (1944). Back then use of formal approaches to social sciences was presented as a necessary paradigm shift
In chapter II, we dive into the specifics of what an objective theory of behaviour should be. Of prime importance here is the introduction of the notions of intervening variables and observables, which illustrate how the standard narrative about behaviourists is false
I just finished reading this paper by Meehl on appraisal theory selection in Psychology (and beyond). The paper essentially proposes to amend rigid falsificationism (Popper0) in favor of a more flexible approach including a step of “strategic retreat and defense” (Lakatos)
The point here is that when one tests a theory, they never test the Theory "alone", but also a series of ancillary elements (how does the measurement work?) and assumptions (e.g., the ceteribus paribus clause: which is always false in psychology)...
Therefore, an apparent falsification could, in principle derive, from the theory being false OR by any other of the ancillary elements and assumption being false. The question: how do we decide whether or not a “strike is fatal” for a theory? Not an easy question, which…
🚨🥳Very glad to share the publication by @TrendsCognSci of this review paper entitled “The computational roots of positivity and confirmation bias in human reinforcement learning” with my usual partner in scientific crime @mael_lebreton (long) thread 🧵 doi.org/10.1016/j.tics…
In this paper we summarise the evidence allowing answering this fundamental question: do we (reinforcement) learn equally well from positive or negative prediction errors? From outcomes that confirm our current choices?
We started by recognizing that similar biases have already been identified and documented by psychologists and economists in the past in belief updates. However, they are traditionally understood as specific to high-level processing
Just finished reading this old-ish gem by Herbert Simon (1992) that I strongly suggest reading for all interested in the epistemological foundations of behavioural sciences. Many key ideas are extremely clearly and convincingly laid down 1/n
The first great thing to mention about the paper is that even one of the "fathers" of cognitive revolution did not believe that a cognitive revolution ever happened 2/n
I wrote about this topic in another thread about Leahey's great paper (link below). A cognitive "revolution" never happened: let's get over it. 3/n
Just finished reading this that I strongly recommend to anyone interested in history of cognitive science (and more broadly in questions related to the advancement of science) and is curious about what happened during the “cognitive revolutions” 1/n citeseerx.ist.psu.edu/viewdoc/downlo…
The paper starts by (extremely clearly and sharply) reminding the elements of Kuhn’s hypothetical structure of scientific revolutions and illustrate criteria proposed by later scholars to “empirically” (or at least more objectively) assess whether a revolution occurred.
The paper then analyses the historical contexts and records of the behaviouristic and cognitive revolution and provides compelling arguments to the claim that neither period actually witnessed a scientific revolution (according to Kuhnian -or common sense - definition).
Will huge sample sizes (alone) solve psychology problems (as for example it is claimed they solved behavioural genetics problems)? This classic article clearly illustrate that "not quite". It start from recognising a key difference between psychology and physics 1/n
Physical theories allow point estimate predictions (what the exact value of an empirical measure should be), therefore increasing the number of measures will increase the precision and represent a more stringent test for the theory 2/n
In psychology the situation was (it still is) quite different: theories often make only directional prediction (i.e., RT should higher in condition 1 compared condition 2, but how much higher is not specified). 3/