Tweet

The vOICe vision 😷

Mar 18 • 4 tweets • 2 min read

@louislongin

Augmenting perception: How artificial intelligence transforms sensory substitution sciencedirect.com/science/articl… by @louislongin and @OpheliaDeroy; #AI #AR

"When implementing AI methods into the classic vOICe architecture, the final auditory signal can now convey much richer and more accessible information"

This is why The vOICe for Android apart from "raw vision" via visual-to-auditory sensory substitution also includes a talking GPS locator for street names, as well as talking object recognition, face detection and real-time OCR for reading short texts play.google.com/store/apps/det… #AI

https://twitter.com/seeingwithsound/status/1489523516701650944

An earlier thread about this paper is at

https://twitter.com/seeingwithsound/status/1489523516701650944

• • •

Missing some Tweet in this thread? You can try to force a refresh

This Thread may be Removed Anytime!

Twitter may remove this content at anytime! Save it as PDF for later use!

More from @seeingwithsound

The vOICe vision 😷

@seeingwithsound

Mar 19

#AI maps psychedelic "trip" experiences to regions of the brain – opening new route to psychiatric treatments theconversation.com/ai-maps-psyche… "psychedelics temporarily reduce top-down executive function"

This suggests that deliberate/active mental imagery and involuntary/passive hallucinations may involve kind of opposite mechanisms despite both giving visuals: enhanced top-down versus disinhibited bottom-up

It also hints at possible fundamental limitations in hallucinogenic drug treatment, by involving mostly passive processes whereas practice, training and deliberate mental imagery involve active processes that may thereby have a different spectrum of effects on the brain

Read 4 tweets

The vOICe vision 😷

@seeingwithsound

Mar 19

(YouTube) Mental imagery engineering: sensory substitution via soundscapes of procedurally generated images Dark gray (soft stereo panning noise) background may help with shape localization

Beat blindness without surgery? Help us find out by practicing your visualization of the rectangle and line segment and tweeting about your progress over the course of weeks: how vision-like does the experience becomes over time? Practicing 15 minutes a day probably suffices

Hint: when frustrated about your inability to get a full mental image in time, try for a while listening *only* for a rectangle (or a line) while ignoring the other shape, and you will likely find it much easier to localize and visualize the attended shape with decent accuracy

Read 6 tweets

The vOICe vision 😷

@seeingwithsound

Mar 17

A belt-like assistive device for visually impaired people: Toward a more collaborative approach tandfonline.com/doi/full/10.10… "Future research endeavors in this field might be benefited from more collaborative participation between end-users, researchers, and institutes for VI people"

Background section 2.1 on head-mounted assistive devices: "Based on the argument that the human brain is powerful enough to process complex auditory information, Meijer developed The vOICe system, which uses a single camera as an input source"

"The vOICe system is currently a mature commercial product (see: seeingwithsound.com). Still, it requires extensive training due to the complicated sound patterns."

Read 4 tweets

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Share this page!

The vOICe vision 😷

People who liked this thread also liked...

Try unrolling a thread yourself!

More from @seeingwithsound

The vOICe vision 😷

The vOICe vision 😷

The vOICe vision 😷

Did Thread Reader help you today?

Don't want to be a Premium member but still want to support us?

Like this author's thread?