Yisong Yue Profile picture
ML Prof @Caltech (group: @YueLabCaltech); Principal Scientist at Latitude AI (https://t.co/riZHAmvKpZ). Senior Program Chair @iclr_conf; Communication Co-Chair @icmlconf. He/Him
Zhenjie Zhao Profile picture 1 subscribed
Mar 8, 2021 8 tweets 3 min read
When I was a PhD student, a professor told me:

"There are only three papers worth writing on a given topic: the first paper, the best paper, and the last paper."

It's obv a bit tongue-in-cheek, but I've often used the underlying heuristic to aid in choosing research directions. Of course, no one can exactly predict the outcome of a research project a priori, but in my experience this heuristic can manifest in a few ways.

(Note that the following examples are from my biased viewpoint as an academic ML researcher.)
Nov 24, 2020 7 tweets 5 min read
I've found GPs to be very useful in real-world applications where data is scarce and uncertainty quantification is useful for (sequential) decision making.

Thread below 🧵👇

1/ Preamble: I'm giving a talk on this topic at the Directions in AutoML Webinar series hosted by @MSFTResearch:
microsoft.com/en-us/research…

The slide deck I'll be using is here:
yisongyue.com/talks/ai_exper…

2/
Aug 25, 2020 23 tweets 21 min read
Seems like a great time to plug AI/ML research at @Caltech!

A thread below 👇

1/N We studied how to personalize the (implanted) neuromodulation of paralyzed subjects to help them stand. Led to novel bandit & Bayesian opt algs that learn via subjective preferences while exploring safely. Work by @YananSui

arxiv.org/abs/1806.07555
arxiv.org/abs/1705.00253

2/N
Aug 20, 2020 4 tweets 2 min read
Great article. For those feeling similar frustrations, a few recommendations on how to engage more productively with the ML community.

1/N **Organize a Workshop**

Workshops are a great way to explore ideas of how ML can be applied to new domains.

Check out the @NeurIPSConf workshops this year for examples:
nips.cc/Conferences/20…
There are many cool applications-focused ones!

2/N