Thread by @rohanpaul_ai

Outlier Detection with Alibi Detect Library - A Thread
1/n

#DataScience #DeepLearning #MachineLearning #ComputerVision #100DaysOfMLCode #Python #DataScientist #Statistics #programming #Data #Math #Stat #pythoncode #AI #ArtificialIntelligence

2/n

Alibi Detect is a Python library for detecting outliers, adversarial data, and drift. Accommodates tabular data, text, images, and time series that can be used both online and offline. Both TensorFlow and PyTorch backends are supported

#DataScience #DeepLearning

3/n

Supports a variety of outlier detection techniques, including Mahalanobis distance, Isolation forest, and Seq2seq

#DataScience #DeepLearning #MachineLearning #ComputerVision #100DaysOfMLCode #Python #DataScientist #Statistics #programming #Data #Math #Stat #pythoncode

4/n

Mahalanobis Distance - Predict anomalies in tabular data. The algorithm computes an outlier score, which is a measure of distance from the feature distribution’s center (Mahalanobis distance).
#DataScience #DeepLearning #MachineLearning #ComputerVision #100DaysOfMLCode

5/n

Mahalanobis Distance - If this outlier score exceeds a user-specified threshold, the observation is marked as an outlier.

#DataScience #DeepLearning #MachineLearning #ComputerVision #100DaysOfMLCode #Python #DataScientist #Statistics #programming #Data #Math #Stat

6/n

Mahalanobis Distance - The algorithm is online, which means it begins with no knowledge of feature distribution and learns as requests arrive. As a result, you should expect the output to be poor at first and improve over time.

#DataScience #DeepLearning #MachineLearning

7/n

Variational Auto-Encoders - This is first trained on a batch of unlabeled but normal (Linear) data. Because labeled data is often scarce, unsupervised or semi-supervised training is preferable.

#DataScience #DeepLearning #MachineLearning #ComputerVision #100DaysOfMLCode

8/n

Variational Auto-Encoders - The VAE detector makes an attempt to reconstruct the data it receives. The reconstruction error is high if the input data cannot be reconstructed well, and the data can be flagged as an outlier.

#DataScience #DeepLearning #MachineLearning

9/n

Variational Auto-Encoders - The mean squared error (MSE) between the input and the reconstructed instance or the probability that both the input and the reconstructed instance are generated by the same process is used to calculate the reconstruction error.

#DataScience #AI

10/n
Variational Auto-Encoders - Usage Syntax

#DataScience #DeepLearning #MachineLearning #ComputerVision #100DaysOfMLCode #Python #DataScientist #Statistics #programming #Data #Math #Stat #pythoncode #AI #ArtificialIntelligence