finally got around to reading this eccv20 best paper award winner work on optical flow that has interesting ideas: multi-scale 4D correlation volumes, learned-upsampling (using convex weights of lower res pixels), and iterative refinement of flow.

arxiv.org/abs/2003.12039
correlation volumes
upsampling module
better optical flow helps in better depth estimation

also useful in learning vision based policies with rl

vladlen.info/papers/FlowRL.…
RAFT iteratively refines optical flow with GRU. Differentiable primal-dual is another interesting approach to iteratively refine solutions

arxiv.org/abs/1607.07988
optical flow

- teaches euler-lagrange, primal-dual optimisation methods
- shows how to add regularisation to ill-posed problems.
- often a doorway to understanding inverse problems in computer vision e.g. depth estimation, denoising, inpainting, superres.
@ducha_aiki is this any different to transposed convolution/upconvolution/deconvolution?

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Ankur Handa

Ankur Handa Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @ankurhandos

26 Sep
starting a thread of interesting python features / modules / libraries that I found over time 🧵
first up, joblib's memory. If you are reading a huge file Memory class helps you cache that on your disk during the first call. Successive calls load the data much faster. Assuming you didn't change both the function as well as the contents of the file.
Read 5 tweets
16 Sep
This is one of the finest lecture notes in computer vision by Svetlana Lazebnik. Highly recommended to everyone in CV. It mentions the origins, various historic perspectives and anecdotes in CV. Also talks about ethical and societal impacts of CV.

slazebni.cs.illinois.edu/spring20/ Image
How computer vision evolved over the decades. Image
Some of these issues may still be prevalent 😉 Image
Read 7 tweets
15 Sep
Some recent interesting work on hand tracking and pose estimation that I liked. Creating a thread 🧵
MEgATrack: Monochrome Egocentric Articulated Hand Tracking for Virtual Reality

research.fb.com/wp-content/upl…
The Phong Surface: Efficient 3D Model Fitting using Lifted Optimization

arxiv.org/abs/2007.04940
Read 10 tweets
9 Sep
A slower speed of light is a fun 3D game where speed of light slows down progressively as you collect points. While playing, you come across many relativistic effects: Doppler, the searchlight, time dilation, Lorentz transformation and the runtime effect. gamelab.mit.edu/games/a-slower… ImageImageImageImage
came across this game while watching this video "What happens as you approach the speed of light?"

The game was created using OpenRelativity, an open-source toolkit for the Unity game development environment. gamelab.mit.edu/research/openr…
Read 8 tweets
3 Sep
Nice use of Q-Networks and MCTS to do scene arrangement. Given an initial layout it learns to find a sequence of moves (actions) that bring it close to the target layout all with a collision free path.

github.com/HanqingWangAI/…

full video:
Q-Network used in this work Image
Scenes can also be obtained via generative modelling

Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Models

arxiv.org/abs/1811.12463 Image
Read 4 tweets
31 Aug
Impressive and inspiring demos of brain implants in humans by BrainGate some time ago



braingate.org
paralyzed woman uses thoughts to sip coffee.

Kevin Warwick was brave enough to have an implant in his arm about 20 years ago and controlled a robot hand.

full video: Image
Read 7 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!