Sergey Ivanov Profile picture
AI Applied Scientist. Follow for cool AI stuff. Opinions are NOT my own, they are part of the simulation.
Potato Of Reason Profile picture 1 subscribed
Dec 4, 2022 7 tweets 4 min read
If ChatGPT were playing Jeopardy grand finale in November 2022, it would destroy the opponents.

58 correct answers out of 61.

Not only that, there are some emerging behaviors while it plays. 🧵⤵️ Before we jump in, here is a quote from the first human battle against IBM Watson: "People don't realize how tough it is to write a program that can read in a natural language and understand all the double meanings, the puns, the red herrings, unpack the meaning of the clue."
Dec 1, 2022 11 tweets 4 min read
IQ of ChatGPT is 83.

It corresponds to low average.

Here is where it failed🧵1/11 Image It knows what the the force of gravity but equating 115+85 and 200 is still hard. 2/11 Image
Nov 9, 2021 4 tweets 2 min read
ICLR 2022 reviews are out.

Here is an aggregated list of all papers and their scores:

docs.google.com/spreadsheets/d…

3325 available submissions.
12981 reviews in total.

More stats are below.🧵 Avg rating in 2022 is 4.93 +- 1.15.
Avg score in 2021 (after rebuttal) is 5.37 +- 0.96.

32 papers received 8 average score.

39 papers received a review with the highest rating of 10. None of the papers received 2+ reviews with 10.
Jun 3, 2021 12 tweets 5 min read
ICML 2021 papers are out: icml.cc/Conferences/20…

Here are some stats:
5513 submitted (4990 in 2020)
1184 accepted: 166/1018 long/short talks (1088 in 202)
21.5% acceptance rate (21.8% in 2020)

Thread on the top authors, countries, organizations, etc. 🧵 Top authors:
Masashi Sugiyama is #1 for the second year (11 in 2020 -> 14 in 2021).
Sergey Levine is #2 (5 -> 13)
Z. Yang, Z. Wang, G. Niu are # 3 (all with 11 accepted)
Jan 12, 2021 5 tweets 2 min read
So here is an analysis of #ICLR2021 decisions.

860 accepted out of 2997 -> 29% acceptance rate
53 Orals, 114 Spotlights, 693 Posters, 1756 Rejected, 381 Withdrawn.

Thread 🧵

All decisions in one table: docs.google.com/spreadsheets/d… Distribution of decisions based on average rating.
Jul 13, 2020 4 tweets 2 min read
Compared to virtual #ICLR2020, I found virtual #ICML2020 lacks a few features.

1. Papers are scheduled for 2 days. instead of 1. I prefer to collect all papers of interest for the day and then attend only those. Now I need to keep in mind if I attended a poster previously.

1/n
2. Videos are 10-15 minutes long. This forces me to *really* want to attend the poster. Having tl;dr version (<5 min) or short/long videos as in ICLR is preferred.