New workshop at @icmlconf: Updatable Machine Learning (UpML 2022)!

Training models from scratch is expensive. How can we update a model post-deployment but avoid this cost? Applications to unlearning, domain shift, & more!

Deadline May 12
upml2022.github.io #ICML2022 (1/3)
Ft stellar lineup of invited speakers including: Chelsea Finn (@chelseabfinn), Shafi Goldwasser, Zico Kolter (@zicokolter), Nicolas Papernot (@NicolasPapernot), & Aaron Roth (@Aaroth)
They've studied UpML in a variety of contexts, including unlearning, robustness, fairness (2/3)
Workshop is co-organized with lead organizer Ayush Sekhari (@ayush_sekhari) and Jayadev Acharya (@AcharyaJayadev), and supported by an excellent program committee (being finalized).

We look forward to seeing your best work in this emerging area! (3/3)
@ayush_sekhari @AcharyaJayadev Since @savvyRL asked, I'm organizing this and also TPDP (). We'd love to have your help as a fellow organizer in the future!

(Maybe we'd get the announcement out on time though... we were 16 minutes late from the prescribed 8 AM😅)

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Gautam Kamath

Gautam Kamath Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @thegautamkamath

Mar 7
🧵One of the important principles in technical communication (i.e., writing a paper, giving a talk) of complex ideas is *organization*.
That is, making it clear what the major components are & how they fit together. If you do this well you are probably 90% of the way there. (1/n)
A "top down" approach is usually the tried and true method. First communicate the high-level ideas/steps, before delving into their details. This is good because it's "truncatable": at some point "down the tree" it's ok if the audience misses a step (and they know this). (2/n)
On the other hand, if this is not clear, the audience must maintain constant attention. They don't know what's important and what's not, so they can't miss a thing. And everyone gets lost in a technical talk/paper sometimes, so this is key. (3/n)
Read 8 tweets
Jan 2
How many of your research papers do you think will be relevant a year from now? Five years from now? 100 years from now? How do you feel about your answer?
Thinking back to the time in 2017 (arxiv.org/abs/1704.03866) we used a result from a 120 year old math paper written in German (degruyter.com/document/doi/1…). Though we actually trusted an English language simplification... from 1941 (projecteuclid.org/journals/bulle…).
I think most works written right now will not be too relevant in a decade. And that's totally fine! Maybe it has its day in the sun, is interesting for a bit, may be useful if you're lucky, but then the community progresses. Hopefully it inspires new ideas in others along the way
Read 6 tweets
Nov 30, 2021
Paper awards for @NeurIPSConf have been announced!🎉#NeurIPS2021 blog.neurips.cc/2021/11/30/ann…

Congrats to all the winners, I'll link to the Outstanding Paper Awards 🧵

1. A Universal Law of Robustness via Isoperimetry, by @SebastienBubeck & @geoishard.

arxiv.org/abs/2105.12806 (1/n)
Outstanding Paper Award 2. On the Expressivity of Markov Reward, by @dabelcs, @wwdabney, @aharutyu, @Mark_Ho_, @mlittmancs, Doina Precup, and Satinder Singh.

arxiv.org/abs/2111.00876 (2/n)
Outstanding Paper Award 3. Deep Reinforcement Learning at the Edge of the Statistical Precipice, by @agarwl_, @max_a_schwarzer, @pcastr, @AaronCourville, @marcgbellemare.

arxiv.org/abs/2108.13264 (3/n)
Read 6 tweets
Nov 30, 2021
New paper on arXiv: "Efficient Mean Estimation with Pure Differential Privacy via a Sum-of-Squares Exponential Mechanism," with @Samuel_BKH and @mahbodm_.

Finally resolves an open problem on my mind since April 2019 (~2.5 years ago).

arxiv.org/abs/2111.12981
🧵Thread ⬇️ 1/n
We give the 1st algorithm for mean estimation which is simultaneously:
-(ε,0)-differentially private
-O(d) sample complexity
-poly time
The fact we didn't have such an algorithm before indicates something was missing in our understanding of multivariate private estimation. 2/n
This algorithm is an instance of a broader framework which employs Sum-of-Squares for private estimation. This is the first application of SoS for DP that I am aware of. We apply this framework for two sub-problems, I'm sure there are more applications lurking. 3/n
Read 15 tweets
Sep 9, 2020
(Thread) How can I say no to this? My course will be made public! Stay tuned.
I was pulling your leg here. Here's my (hot? cold?) take: academics have a *moral obligation* to make as much of their material public as possible. Not just papers, but code, talks, and lectures. 1/n
95% of the work for most content is preparing it. So why not present it so the whole world can appreciate it? arXiv, Github, and video sites.
All academics should learn how to record videos in high quality, say using @OBSProject (not just Zoom). It's imperative for the future 2/n
Let me note that my course will be inspired by a number of books and courses, including by Dwork, Honaker, @thesasho, @Aaroth, Smith, @thejonullman, Vadhan, and more. I will acknowledge them whenever I can. See @DiffPriv's Resources for more: differentialprivacy.org/resources/ 3/n
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(