📢🗳️ #poll is over. Check-out the results about double-blind (DBP) vs. single-blind (SBP) policy preference for #CVPR2021. Thanks 4 participating ❤️
🧵 With the reason behind it, *my* #takeaways, and open #questions
c.c. @CVPR @eccvconf @ICCV_2021
1/11
https://twitter.com/3scorciav/status/1316854311733862401?s=20
🧵 With the reason behind it, *my* #takeaways, and open #questions
c.c. @CVPR @eccvconf @ICCV_2021
1/11
Why?
TLDR; I feel that #reviewer judgement is RUINed by #oveR #enthUsiam, #PR & #clIeNtelism. RUIN got into our #peer_review system by using #arxiv. Our #players weren't ready for this. The community is more diverse, bigger and the scale of the conferences is unprecedented.
2/11
TLDR; I feel that #reviewer judgement is RUINed by #oveR #enthUsiam, #PR & #clIeNtelism. RUIN got into our #peer_review system by using #arxiv. Our #players weren't ready for this. The community is more diverse, bigger and the scale of the conferences is unprecedented.
2/11
🙋🏽🙋🏿 if it's OK to run a startup in this way. We become viral & need to keep up the pace.
Actions. Increase the number of employees, (hopefully) hiring ppl with the bare minimum badges. Provide no training whatsoever, only updating the company guidelines.
3/11
Actions. Increase the number of employees, (hopefully) hiring ppl with the bare minimum badges. Provide no training whatsoever, only updating the company guidelines.
3/11
Operate almost as we were operating with less traction. In particular, using the same tools and providing no feedback to our employees.
#challenge reply how to pitch that, and lead the expansion of our company or get funding.
4/11
#challenge reply how to pitch that, and lead the expansion of our company or get funding.
4/11
Facts
- A significant number of spectators or undecided folks, +10% than the runner-up. Thanks for participating, and not adding noise.
- I’ll remove those from the analysis.
- And the results are 🥁🥁🥁
5/11
- A significant number of spectators or undecided folks, +10% than the runner-up. Thanks for participating, and not adding noise.
- I’ll remove those from the analysis.
- And the results are 🥁🥁🥁
5/11
-The majority prefers to retain double-blind (DBP) over SBP, 70% vs. 7.5%
- Runner-up with 22.4% is to not care much about the peer-review policy. Let’s post in arxiv!
- Even assuming one posting on #arxiv prefers SBP, the majority prefers DBP. The gap is 40.1%.
6/11
- Runner-up with 22.4% is to not care much about the peer-review policy. Let’s post in arxiv!
- Even assuming one posting on #arxiv prefers SBP, the majority prefers DBP. The gap is 40.1%.
6/11
Takeaways
- My personal choice: arxiv after a cycle of reviews&updates isn’t pragmatic.
If one already has published, it’s plausible that one’s “fame” can persuade undecided reviewers to lean towards acceptance. So, why wouldn’t one post on arxiv if 22.4% plan to do it?
7/11
- My personal choice: arxiv after a cycle of reviews&updates isn’t pragmatic.
If one already has published, it’s plausible that one’s “fame” can persuade undecided reviewers to lean towards acceptance. So, why wouldn’t one post on arxiv if 22.4% plan to do it?
7/11
- Let’s review it from the POV of Kant’s #ethics (I think)
K: If you see everyone sticking bricks onto a wall, will you do it?
me: If the wall is for a good reason, yes!
K: If you see then peeing on the wall afterward, will you do it?
8/11
K: If you see everyone sticking bricks onto a wall, will you do it?
me: If the wall is for a good reason, yes!
K: If you see then peeing on the wall afterward, will you do it?
8/11
me: No, I didn’t build the wall to damage it. Even if I didn’t build it, it’s not OK.
K: How do you feel by behaving like the crowd? They might know why sticking bricks onto or peeing on the wall is good.
me: I'll review the categorical imperative🙄
plato.stanford.edu/entries/kant-m…
9/11
K: How do you feel by behaving like the crowd? They might know why sticking bricks onto or peeing on the wall is good.
me: I'll review the categorical imperative🙄
plato.stanford.edu/entries/kant-m…
9/11
Questions
- If you post on arxiv, tell us what would you prefer DBP or SBP?
- If you don’t post on arxiv, are you still considering doing so or not? why?
Be subjective, feel free to let us know if you operate in accordance with an ethical framework.
10/11
- If you post on arxiv, tell us what would you prefer DBP or SBP?
- If you don’t post on arxiv, are you still considering doing so or not? why?
Be subjective, feel free to let us know if you operate in accordance with an ethical framework.
10/11
Departing words
We might run an official survey with the help of #ECVA with #ECCV2020's reviewers&ACs pool. Get in touch if you wanna help.
Let’s go back to running experiments, and writing for #CVPR2021 😉
11/11
We might run an official survey with the help of #ECVA with #ECCV2020's reviewers&ACs pool. Get in touch if you wanna help.
Let’s go back to running experiments, and writing for #CVPR2021 😉
11/11
@threadreaderapp unroll
• • •
Missing some Tweet in this thread? You can try to
force a refresh
