AllenNLP provides a simple & modular programming model for:
1. Applying advanced deep learning techniques to NLP research 2. Streamlining the creation of NLP experiments 3. Abstracting the core building blocks of NLP models
2/5
Portfolio of NLP tasks under AllenNLP:
- Text Generation
- Language Modeling
- Multiple Choice
- Pair Classification
- Structured Prediction
- Sequence Tagging
- Text + vision
3/5
It's built on @PyTorch and has quickly become a favorite of the NLP research and development community.
Data scientists can orchestrate the interactions between the main components of an NLP workflow using configuration files instead of code. 4/5
AllenNLP is free and open-sourced.
To deep dive into its core capabilities explained in a 5 min read, we recommend you to read this Edge: thesequence.substack.com/p/edge104
Thank you for being with us!
5/5
• • •
Missing some Tweet in this thread? You can try to
force a refresh
.@OpenAI ImageGPT is one of the first transformer architectures applied to computer vision scenarios.👇
In language, unsupervised learning algorithms that rely on word prediction (like GPT-2 and BERT) are extremely successful.
One possible reason for this success is that instances of downstream language tasks appear naturally in the text.
2/4
In contrast, sequences of pixels do not clearly contain labels for the images they belong to.
However, OpenAI believes that sufficiently large transformer models:
- could be applied to 2D image analysis
- learn strong representations of a dataset
3/4