The Adversarial Robustness Toolbox (ART) = framework that uses generative adversarial neural networks (GANs) to protect deep learning models from security attacks
Thread⬇️
GANs = the most popular form of generative models.
GAN-based attacks:
+White Box Attacks: The adversary has access to the training environment, knowledge of the training algorithm
+Black Box Attacks: The adversary has no additional knowledge
2/⬇️
The goal of ART = to provide a framework to evaluate the robustness of a neural network.
The current version of ART focuses on four types of adversarial attacks:
+evasion
+inference
+extraction
+poisoning
3/⬇️
ART is a generic Python library. It provides native integration with several deep learning frameworks such as @TensorFlow, @PyTorch, #Keras, @ApacheMXNet
If you'd like to find a concentrated coverage of ART, click the link below. You'll move to TheSequence Edge#7, our educational newsletter. thesequence.substack.com/p/edge7 5/5
• • •
Missing some Tweet in this thread? You can try to
force a refresh
Pre-trained language models have been one of the most important breakthroughs in the recent years of deep learning.
What models are used in super large-scale language tasks?
Thread👇
Pre-trained language models are trained in massive text datasets.
Thanks to transformer architectures, we can implement pre-trained language models adapted to specific tasks. For example, question-answering or language modeling.
2/⬇️
Transformers opened the door to a new era of innovation in NLU. And the attention mechanism used in transformers = one of the most impactful developments in the last years of ML.
🤖@Uber Ludwig = Open Source Framework for Creating ML Models Without Writing Any Code.
To use Ludwig all you need is a data file with the inputs attributes and the desired outputs, Ludwig does the result.
Thread🧵👇
The main innovation behind Ludwig = idea of data-type specific encoders and decoders. Ludwig uses specific encoders and decoders for any given data type supported.
2/6⬇️
Ludwig is based on a series of principles:
+No Coding Required
+Generality
+Flexibility
+Extensibility
+Interpretability
3/6⬇️
The centralized nature of AI makes it difficult for startups to compete with the large tech incumbents that have access to:
+massive datasets
+virtually unlimited computing resources
+world-class research talent
Decentralized AI is the key
Thread⬇️
The research in decentralized ML is nothing new and can be traced back to the late 1970s
But the space has caught new momentum w/ blockchains and distributed ledger technologies
2/⬇️
However, blockchains are not the only technology trend influencing decentralized ML
Decentralized ML has benefited from:
+Blockchains
+Federated Learning
+Private ML
3/⬇️