New insights about the limitations of density-based anomaly detection!
With @laurent_dinh, we show that perfect density model *cannot* guarantee anomaly detection.
📜Paper: arxiv.org/abs/2012.03808
(1/8)
We demonstrate that the widespread intuition that an anomaly should have low density does not quite apply in general, irrespective of the dimension of the data or the inductive bias of the model.
(2/8)
We deconstruct this expectation through the lens of invertible reparametrizations (e.g., Cartesian to polar coordinates). While density changes with the underlying representation, the status of inlier/outlier *does not*.
(3/8)
In particular, it is possible to impose an arbitrary score to any point in a new representation of the same problem, which can mislead density-based anomaly detection methods into wrong anomaly detection results.
(4/8)
What if we consider a fixed distribution (eg. the 2d gaussian below) which regular regions are known?🤔
Even in this case, we find that the status of inlier/outlier of two points can be swapped with a continuous invertible map.
(5/8)
Density only conveys meaningful information for anomaly detection in a particular representation space. Density-based methods therefore need to make this underlying hypothesis explicit for reliable anomaly detection.
(6/8)
We cannot fix density-based anomaly detection with more data 📊 or capacity 🗄 but we might require additional *prior knowledge*, e.g., about the task or meaning of the data.
(7/8)
Excited to talk about our work at ICBINB @ #NeurIPS2020 workshop this Saturday!🌟
Poster: bit.ly/37LaUme
Slides: bit.ly/3gtGDMs
Workshop: neurips.cc/virtual/2020/p…
(8/8)

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Charline Le Lan

Charline Le Lan Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!