Andrew Carr (e/🤸) Profile picture
science @getcartwheel AI writer @tldrnewsletter advisor @arcade_ai Past - Codegen @OpenAI, Brain @GoogleAI, world ranked Tetris player
2 subscribers
Jul 29, 2021 • 7 tweets • 3 min read
Want to learn a new programming language? There are 5 key things you need to figure out in the process

1. syntax
2. semantics
3. idioms
4. libraries
5. tools

👇1/ Syntax: What do you write down to make your program "textually wellformed". This include symbols, formatting, whitespace, operators, and keywords.

New languages are hard because syntax is unfamiliar

For example APL vs Python showcases the vast difference in syntax
2/
May 7, 2021 • 7 tweets • 3 min read
Formal methods are a cool way to verify that your hardware or software is working as intended™

Z3 is a one stop shop for FM with theorem proving, SAT, SMT, and computer algebra capabilities.

Let's look at some fun examples

👇

1/6
A nice usage is constraint solving for non-linear polynomial equations.

2/6
Mar 19, 2021 • 5 tweets • 2 min read
I'm super excited to share our work on self-supervised learning for audio. We extend the permutation pre-text task by using differentiable ranking and show improved performance on low-resource tasks (it also works great on images and video)

1/ Image When using permutations in pretraining, a subset of permutations are used to train a classifier which predicts permutations as classes.

However, since there are n! different permutations of length n, it's not feasible to use any reasonable fraction of them for classes.

2/