1/ THREAD covering @Meta's #MetaConnect, which is starting now.
I'll be covering all of the announcements, watching all new videos, & reading all of their press releases. They usually dump a ton of new info
Follow here: facebook.com/events/6307993…
Or here:
I'll be covering all of the announcements, watching all new videos, & reading all of their press releases. They usually dump a ton of new info
Follow here: facebook.com/events/6307993…
Or here:
2/ Zuckerberg saying we're going to be taking another big step forward with VR after walking through a history of VR tech since the Oculus acquisition.
3/ @boztank talking about some ecosystem stats for VR apps.
Philosophically they want to make ecosystem more open & how some apps have onboarded via the App Lab. Will push towards openness.
Philosophically they want to make ecosystem more open & how some apps have onboarded via the App Lab. Will push towards openness.
4/ Boz & Zuckerberg talking about social apps within VR.
They say that the top apps in the store are social metaverse apps, but they don't name them (I'm assuming i.e. RecRoom, VRChat, PopulationOne).
Presence.
Can build tech centered around people as Metaverse is first person.
They say that the top apps in the store are social metaverse apps, but they don't name them (I'm assuming i.e. RecRoom, VRChat, PopulationOne).
Presence.
Can build tech centered around people as Metaverse is first person.
5/ They actually gave a should out to #VRChat as one of the most popular apps, and emphasized ability to choose avatar representation (something that Horizon Worlds doesn't allow)
6/ Highlights YouTube VR.
Talking about video apps coming to Quest. Deal announced with NBCUniversal and Peacock app coming.
Talking about video apps coming to Quest. Deal announced with NBCUniversal and Peacock app coming.
7/ Metaverse needs to be accessible across many screens.
They're developing Horizon Worlds for the Web ( They've alluded to this, but really glad to see this).
It'll be a stopgap until enough VR HMDs are out there.
Working on capturing Reel from within VR to post directly to IG.
They're developing Horizon Worlds for the Web ( They've alluded to this, but really glad to see this).
It'll be a stopgap until enough VR HMDs are out there.
Working on capturing Reel from within VR to post directly to IG.
8/ Mentioning Crayta engine to build interactive worlds that works with TypeScript, and they're going to allow the importing of content (finally, everything in Horizon has been needed to be made in game)
10/ Showing personal home space that you launch into Horizon Worlds now.
11/ Melissa Brown talking about the most developed part of the ecosystem of gaming & showing some stats.
12/ $1.5B spent on games & apps on the store.
Showing an Iron Man VR Marvel game from Oculus Studios from Camoflaj, and Endeavor1.
PopulationOne Sandbox is coming for user generated maps.
Showing an Iron Man VR Marvel game from Oculus Studios from Camoflaj, and Endeavor1.
PopulationOne Sandbox is coming for user generated maps.
13/ Among Us VR coming on Nov 10th and pre-orders opening today. Showing a trailer for AmongUs.
14/ Showing trailer for Saints and Sinners Chapter 2: Retribution coming October 1, 2022.s
15/ Now showing teaser trailer from Skydance Interactive for Behmoth coming in 2023.
16/ Mentioned promise of Mixed Reality.
Now talking about fitness apps like Supernatural ,FitXr, & Body Combat, which have remarkable retention.
Knees coming to Supernatural.
Gym Class graduating from the App Lab.
Active Pack for fitness coming soon.
Now talking about fitness apps like Supernatural ,FitXr, & Body Combat, which have remarkable retention.
Knees coming to Supernatural.
Gym Class graduating from the App Lab.
Active Pack for fitness coming soon.
17/ Fitness tracking on the mobile app and iOS.
Fitness API Beta coming in the Fall, and can share stats with friends.
Fitness API Beta coming in the Fall, and can share stats with friends.
18/ Moving onto work & productivity apps now.
Planning for more distributed work.
Goal to make people who are not there to feel more present.
VR great for creative work in a shared space.
Logitech using @ShapesXR.
@GravitySketch to design shoes.
Other shoutouts to Nano & Arthur.
Planning for more distributed work.
Goal to make people who are not there to feel more present.
VR great for creative work in a shared space.
Logitech using @ShapesXR.
@GravitySketch to design shoes.
Other shoutouts to Nano & Arthur.
19/ Adding ability to join Workrooms via Zoom.
Adding Review 3D objects.
Launching personal workspaces today to have 3 large monitors.
Adding Review 3D objects.
Launching personal workspaces today to have 3 large monitors.
20/ About to announce new headset focused on work.
21/ Meta Quest Pro teaser trailer plays.
22/ Going into Meta Quest Pro environment to talk about the features (I'm sure @SadlyItsBradley is excited to see the CAD drawing transparencies shown here)
Pancake lenses
Pancake lenses
23/ New Qualcomm XR2+ chip.
Touch controllers can track on their own to have true 6DoF tracking.
Talking about the haptics.
Charging dock.
Built-in Mixed Reality & showing some different use cases in the work environment.
Scene understanding + anchoring brings new use cases.
Touch controllers can track on their own to have true 6DoF tracking.
Talking about the haptics.
Charging dock.
Built-in Mixed Reality & showing some different use cases in the work environment.
Scene understanding + anchoring brings new use cases.
24/ Showing examples of Gravity Sketch, Wooorld, and Arkio
Movement SDK to capture facial expressions & body language.
Big step forward for communication, especially for remote work.
Building "Magic Room" as a better way for mixed reality collaborative work spaces
Price: $1499
Movement SDK to capture facial expressions & body language.
Big step forward for communication, especially for remote work.
Building "Magic Room" as a better way for mixed reality collaborative work spaces
Price: $1499
25/ Meta Quest Pro will have integrations with Workrooms, Workplace, & Meta Portal.
Autodesk building integrations with Meta Quest Pro, and Adobe working on a suite of XR apps with VR integrations.
Autodesk building integrations with Meta Quest Pro, and Adobe working on a suite of XR apps with VR integrations.
26/ Woah... Now talking about collaboration with Microsoft.
27/ Microsoft CEO @satyanadella announcing integrations with Microsoft Teams Meeting in VR.
Neta is enabling Horizon Workrooms for Microsoft Teams.
Microsoft 365 coming to Quest for Word, Excel, and Outlook.
Neta is enabling Horizon Workrooms for Microsoft Teams.
Microsoft 365 coming to Quest for Word, Excel, and Outlook.
28/ Microsoft Azure Active Directory and Microsoft Intune will have integrations for Meta Quest Pro for enterprise provisioning.
Also announcing that they're bringing XCloud Gaming to Quest
Also announcing that they're bringing XCloud Gaming to Quest
29/ Now talking how Accenture using VR.
They have 700k employees & have onboarded 60k using VR.
Talking about Nth Floor VR experience (on @AltspaceVR) that's being used to onboard new employees.
Partnering with Meta & Microsoft for cos.
Quest for business
They have 700k employees & have onboarded 60k using VR.
Talking about Nth Floor VR experience (on @AltspaceVR) that's being used to onboard new employees.
Partnering with Meta & Microsoft for cos.
Quest for business
https://twitter.com/kentbye/status/1448827787112943618
30/ Meta Quest Pro will accelerate future of work
Beat Games put together a demo using Mixed Reality to show a glimpse for what's possible.
Working on creator tools
Beat Games put together a demo using Mixed Reality to show a glimpse for what's possible.
Working on creator tools
31/ Integrations of Spark AR Studio to bring 3D objects to AR player.
32/ Now within Horizon Worlds Preview of next generation of avatars (coming later next year).
Enabling avatars across the Meta's apps
Enabling avatars across the Meta's apps
33/ Avatars coming to IG Reels and video chats
Making avatars available across different apps.
New integrations with Zoom, and to iOS and Android apps via the Meta Avatars SDK.
Making avatars available across different apps.
New integrations with Zoom, and to iOS and Android apps via the Meta Avatars SDK.
34/ Avatar store launching later this year to start selling virtual goods and clothing with brand integrations.
Look out for digital outfits from Netflix (? yep )
More representation
Look out for digital outfits from Netflix (? yep )
More representation
35/ More representation in Avatars.
Legs coming soon as well as full-body avatars & talking about AI prediction to pull it off.
Bringing legs to Horizon first.
Legs coming soon as well as full-body avatars & talking about AI prediction to pull it off.
Bringing legs to Horizon first.
36/ Avatars key at the intersection of expression, social interaction, creation, and commerce.
Highlighting some Horizon Worlds
[NOPE world is on the cooler ones I've seen so far]
Highlighting some Horizon Worlds
[NOPE world is on the cooler ones I've seen so far]
37/ Zuckerberg now talking about Augmented Reality.
AR need to be able to wear outside & all-day long.
Building full AR glasses from all VR HMDs possible and then starting from ideal form factor & expanding from there.
Now updates on Rayban Stories
AR need to be able to wear outside & all-day long.
Building full AR glasses from all VR HMDs possible and then starting from ideal form factor & expanding from there.
Now updates on Rayban Stories
38/ Spotify Tap feature within Rayban Stories
Transition glasses.
Building a portal into the Metaverse (different than what they're doing with Project Nazare)
Transition glasses.
Building a portal into the Metaverse (different than what they're doing with Project Nazare)
39/ Now showing far-future prototype of neural interface of CTRL Labs watch and showing neuromotor interfaces for how small movements can be new embodied interactions and HCI.
See my interview w the Reality Labs director of Neuromotor Interfaces for more:
voicesofvr.com/987-the-neuros…
See my interview w the Reality Labs director of Neuromotor Interfaces for more:
voicesofvr.com/987-the-neuros…
40/ Playing arcade game with wrist-based EMG and able to interact with technology with almost no movement.
Being able to target individual motor neurons is truly groundbreaking. Again, see my 2 interviews on this:
voicesofvr.com/987-the-neuros…
voicesofvr.com/814-neuroscien…
Being able to target individual motor neurons is truly groundbreaking. Again, see my 2 interviews on this:
voicesofvr.com/987-the-neuros…
voicesofvr.com/814-neuroscien…
41/ Now talking about collaborating with Carnegie Mellon on making AR for assistive technologies for wayfinding.
42/ Helping the hearing impaired.
Abrash lists an AR use case: Right click on a real object. 🤯
Abrash lists an AR use case: Right click on a real object. 🤯
43/ Now talking about techniques to build & manipulate 3D objects:
1.) Neural Radiance Fields (NeRF) captured from a phone.
2.) Inverse Rendering - uses dynamic lighting and showing virtual object next to physical object within SparkAR
1.) Neural Radiance Fields (NeRF) captured from a phone.
2.) Inverse Rendering - uses dynamic lighting and showing virtual object next to physical object within SparkAR
44/ Full-body codec avatars to be able to photorealistically reproduce people via avatars.
Will require encryption capabilities
Change avatar outfit
Will require encryption capabilities
Change avatar outfit
45/ WOAH, the next generation of Codec avatars have gone WAY past the uncanny valley.
"Instant Avatars" are also -- to my eye -- pretty indistinguishable from video or volumetric capture.
Pretty mind-blowing speculative design that "may not end up in their products"
"Instant Avatars" are also -- to my eye -- pretty indistinguishable from video or volumetric capture.
Pretty mind-blowing speculative design that "may not end up in their products"
46/ @Meta's Zuckerberg says we're at the beginning of a new era of computing.
Two Values:
1.) Put people at the center of everything we build. Aim to bring you closer to other people.
2.) Openness & cultivating open & interoperable ecosystems & Metaverse. Wants open to win out.
Two Values:
1.) Put people at the center of everything we build. Aim to bring you closer to other people.
2.) Openness & cultivating open & interoperable ecosystems & Metaverse. Wants open to win out.
47/ Now watching the Developer State of the Union presentation by @c_pruett, which is happening on the livestream on the Reality Labs livestream here:
facebook.com/RealityLabs/
facebook.com/RealityLabs/
48/ This post is pretty good overview of everything that was announced today: tech.fb.com/ar-vr/2022/10/…
https://twitter.com/boztank/status/1579902039760326657
49/ @c_pruett showing some stats for the gaming ecosystem.
1/3 of 400+ apps are making million dollar revenue
33 titles have made over $10M in gross revenue since Feb
55 titles made over $5M, & double since last year.
1/3 of 400+ apps are making million dollar revenue
33 titles have made over $10M in gross revenue since Feb
55 titles made over $5M, & double since last year.
50/ Over 2000 apps on App lab & the response time is now less than 3 days. Pruett says that they consider this a success.
[By my last count there's ~424 apps on the Quest store]
[By my last count there's ~424 apps on the Quest store]
51/ Highlighting Cubism's use of the Presence platform & the types of innovation coming from apps including Magic Keys app for playing the piano in mixed reality.
52/ Preview of Meta Quest Pro & Presence Platform session.
Meta Quest Pro controllers are self-tracked, which support new movements + true touch haptics
New passthrough Mixed Reality features for Presence Platform + Hands & Voice
Some APIs like scene understanding coming to WebXR
Meta Quest Pro controllers are self-tracked, which support new movements + true touch haptics
New passthrough Mixed Reality features for Presence Platform + Hands & Voice
Some APIs like scene understanding coming to WebXR
53/ Teams & Windows 365 coming to Quest.
12GB of RAM will allow more Progressive web apps to be overlaid on top of other apps for productivity functionality.
3 sections of talk on how to Build faster, Realize App's potential, & make more money.
Meta XR Simulator coming early 2023
12GB of RAM will allow more Progressive web apps to be overlaid on top of other apps for productivity functionality.
3 sections of talk on how to Build faster, Realize App's potential, & make more money.
Meta XR Simulator coming early 2023
54/ Will be launching new ways to bring players into your multiplayer apps.
55/ New monitization options:
Offering new A/B testing options for devs
Try before you buy
Self Serve Sales & Bundles
Immersive Promotions [sign that immersive ads are indeed coming into VR]
Avatar store will be a new way to monitize your IP via digital goods & fashion
Offering new A/B testing options for devs
Try before you buy
Self Serve Sales & Bundles
Immersive Promotions [sign that immersive ads are indeed coming into VR]
Avatar store will be a new way to monitize your IP via digital goods & fashion
56/ 4 categories of XR experiences that Meta is now highlighting beyond just gaming:
1.) Work & Productivity Tools
2.) Creator Tools
3.) Fitness, Wellness, & Sports
4.) Learning & Exploration
This was an extended section of the talk that highlighted more apps in each section.
1.) Work & Productivity Tools
2.) Creator Tools
3.) Fitness, Wellness, & Sports
4.) Learning & Exploration
This was an extended section of the talk that highlighted more apps in each section.
57/ Some headlines highlighting the opportunities that are happening within XR.
58/ Next part of #MetaConnect will have 5 concurrent tracks.
Build Immersive Experiences
Create Natural Interactions
Design for Everyone
Extend the Metaverse
Grow Your Business
All sessions will be made available on demand afterwards.
Here's the schedule
metaconnect.com/en-us/program/…
Build Immersive Experiences
Create Natural Interactions
Design for Everyone
Extend the Metaverse
Grow Your Business
All sessions will be made available on demand afterwards.
Here's the schedule
metaconnect.com/en-us/program/…
59/ I'm going to take a break from live Twitter coverage to check out the Horizon Worlds experience of Meta Square to see how it shapes up. More context on that below:
https://twitter.com/Oculus_Dev/status/1578075949551083520
60/ The @ID_AA_Carmack Unscripted is happening in a couple of hours.
It says it "unlocks" at 2:30 PDT, & so I don't know if that means it's pre-recorded.
Usually there's a particular liveness to his live talks.
Either way, I'll be covering it live here.
metaconnect.com/en-us/program/…
It says it "unlocks" at 2:30 PDT, & so I don't know if that means it's pre-recorded.
Usually there's a particular liveness to his live talks.
Either way, I'll be covering it live here.
metaconnect.com/en-us/program/…
61/ Some Meta Quest Pro Hands-On Reviews:
@testedcom's @nchan
@cnet's @jetscott
@roadtovr
roadtovr.com/hands-on-meta-…
@uploadvr
uploadvr.com/meta-quest-pro…
@SteveKnowsVR
@DiscoVRTetiana
@testedcom's @nchan
@cnet's @jetscott
@roadtovr
roadtovr.com/hands-on-meta-…
@uploadvr
uploadvr.com/meta-quest-pro…
@SteveKnowsVR
@DiscoVRTetiana
62/ More Meta Quest Pro Hands-On Reviews
@TheVerge5 @thedextriarchy
theverge.com/23393115/meta-…
@axios @inafried
axios.com/2022/10/11/met…
@engadget @samrutherford
engadget.com/meta-quest-pro…
@tomsguide @Romudeth
tomsguide.com/reviews/meta-q…
@pcworld @markhachman
pcworld.com/article/134678…
@TheVerge5 @thedextriarchy
theverge.com/23393115/meta-…
@axios @inafried
axios.com/2022/10/11/met…
@engadget @samrutherford
engadget.com/meta-quest-pro…
@tomsguide @Romudeth
tomsguide.com/reviews/meta-q…
@pcworld @markhachman
pcworld.com/article/134678…
63/ New Supplemental Privacy Policy Notices from @Meta dropped.
meta.com/legal/quest/pr…
Eye Tracking Privacy Notice
meta.com/help/quest/art…
Natural Facial Expressions Privacy Notice
meta.com/help/quest/art…
Fit Adjustment Privacy Notice
meta.com/help/quest/art…
cc @avibarzeev
meta.com/legal/quest/pr…
Eye Tracking Privacy Notice
meta.com/help/quest/art…
Natural Facial Expressions Privacy Notice
meta.com/help/quest/art…
Fit Adjustment Privacy Notice
meta.com/help/quest/art…
cc @avibarzeev
64/ When people are skeptical about the future of XR, I don't think they really quite understand how revolutionary neural interfaces will be for HCI to
detect individual motor neurons firing means agency without motion.
Interviews:
voicesofvr.com/987-the-neuros…
voicesofvr.com/814-neuroscien…
detect individual motor neurons firing means agency without motion.
Interviews:
voicesofvr.com/987-the-neuros…
voicesofvr.com/814-neuroscien…
65/ Here's the brief video of Zuckerberg shows how their CTRL Labs, wrist-based EMG [watch] device will eventually be able to translate subtle finger gestures into actions in AR or VR.
ML + Neuroscience = "co-adaptive learning."
Blog post with more info: tech.fb.com/ar-vr/2022/10/…
ML + Neuroscience = "co-adaptive learning."
Blog post with more info: tech.fb.com/ar-vr/2022/10/…
66/ @Meta keeps returning to their photoreal CODEC avatars during the R&D portions of their keynotes, but I'm not sure any of it will actually ever be translated into a product.
They keep taking incremental steps towards utility.
Here's a demo of CODEC avatar switching clothing.
They keep taking incremental steps towards utility.
Here's a demo of CODEC avatar switching clothing.
67/ Here's the demo video of Instant Codec Avatar shown during the R&D portion of #MetaConnect via Meta's media press kit.
It's seems like pretty spectacular quality for a phone-based scan.
I also don't think I'd ever want anyone else ever to be able to drive my Codec avatar.
It's seems like pretty spectacular quality for a phone-based scan.
I also don't think I'd ever want anyone else ever to be able to drive my Codec avatar.
68/ Meta acknowledged power of VRChat's range of avatar expression during the keynote, but I wonder if they'll really take @JCorvinusVR's comment seriously on how photorealism isn't how everyone wants to express identity in VR & breaks presence for some
https://twitter.com/JCorvinusVR/status/1579925118092214272
69/ Knee strikes from Supernatural was probably one of the more low-key, super interesting announcements today at #MetaConnect in terms of the future of the full-body interactions because it it's an incremental step towards using CV tracking to bring parts of the lower body.
70/ @ID_AA_Carmack's unscripted talk has started & he's in Horizon Worlds [as a 2D video transmission in a custom build], but not like he imagined as an interactive experience.
Always a breath of fresh air cutting through the hype.
Follow along live: facebook.com/RealityLabs/vi…
Always a breath of fresh air cutting through the hype.
Follow along live: facebook.com/RealityLabs/vi…
71/ Talking about Homes & perf details.
He's been arguing for general purpose navigation.
Notes that people like to hang out in VRChat with other people & mirrors.
He wants to unlock screensharing & PWA for shared apps.
Wants to get voice quality to be better than cell phones.
He's been arguing for general purpose navigation.
Notes that people like to hang out in VRChat with other people & mirrors.
He wants to unlock screensharing & PWA for shared apps.
Wants to get voice quality to be better than cell phones.
72/ Talking about differences between Home vs World, & what to do where.
Now supporting triangular meshes in Horizon Worlds, which should improve aesthetic quality but originally optimized for UGC.
Carmack personally favors low-cost but good VR rather than Meta Quest Pro.
Now supporting triangular meshes in Horizon Worlds, which should improve aesthetic quality but originally optimized for UGC.
Carmack personally favors low-cost but good VR rather than Meta Quest Pro.
73/ Carmack says Meta is working with Qualcomm on next gen chips, & there's people internally who want to control their own silicon destiny like Apply, but Carmack has been arguing against that position.
Carmack says don't ask him for advice on fashion or social trends in VR. :D
Carmack says don't ask him for advice on fashion or social trends in VR. :D
74/ Diving into some of the more wonky technical details of the Meta Quest Pro.
It has variable IPD, most will notice the crisper display, pancake lenses tech details, local dimming to get deeper blacks, can't do extra high dynamic range yet & implications for mixed reality uses.
It has variable IPD, most will notice the crisper display, pancake lenses tech details, local dimming to get deeper blacks, can't do extra high dynamic range yet & implications for mixed reality uses.
75/ Casts some doubts on foveated rendering eye tracking. Retracting some previous promises based upon where tech is at. Needs to know where eye. Dealing with around 50ms latency for aspects of it. Need to work with Qualcomm to get something in. Probably won't be a big speed up.
76/ Carmack is using Meta Quest Pro, but eye tracking not implemented for him yet.
Likely to be like hand tracking for incremental software improvements over time.
Should be able to open in-game Quest Browser on the Meta Quest Pro [hopefully possible in Quest eventually as well].
Likely to be like hand tracking for incremental software improvements over time.
Should be able to open in-game Quest Browser on the Meta Quest Pro [hopefully possible in Quest eventually as well].
77/ Carmack isn't all-in for mixed reality.
Not quite sure it'll for sure be a mass market use.
Meta Quest Pro has open air between screen & physical reality, & so he can easily look down at his notes while being embodied in a VR as an avatar.
Not quite sure it'll for sure be a mass market use.
Meta Quest Pro has open air between screen & physical reality, & so he can easily look down at his notes while being embodied in a VR as an avatar.
78/ Full computer tracking native to each of the trackers allow Carmack to put his hands behind his back & still can be tracked.
Not sure if it'll be totally worth it.
It does mess up Carmack's Beat Saber claw grip.
Not sure if it'll be totally worth it.
It does mess up Carmack's Beat Saber claw grip.
79/ Carmack pushing for $250 and 250g as a target VR HMD.
Interesting bit on dynamics of subsidized VR HMDs, because if they sell at a loss, & then internal discussions around whether or not free apps really good for the ecosystem when they're not getting revenue stream from it.
Interesting bit on dynamics of subsidized VR HMDs, because if they sell at a loss, & then internal discussions around whether or not free apps really good for the ecosystem when they're not getting revenue stream from it.
80/ Talks about Never Facebookers & migration over to Meta accounts.
Mentions some features that killed off due to privacy audits.
Headset tracking robustness
Controller extrapolation has improved as stress tested by table tennis players as Vive was performing better for experts.
Mentions some features that killed off due to privacy audits.
Headset tracking robustness
Controller extrapolation has improved as stress tested by table tennis players as Vive was performing better for experts.
81/ Airlink has improved
App Lab has been going great. Field complaints of people in reviews for 5 weeks
In-app purchase added for App Lab
120 fps support non-experimental feature. Turns out it's great for video.
Meta Quest Pro fps will be limited to 90 fps (120 fps only Quest 2)
App Lab has been going great. Field complaints of people in reviews for 5 weeks
In-app purchase added for App Lab
120 fps support non-experimental feature. Turns out it's great for video.
Meta Quest Pro fps will be limited to 90 fps (120 fps only Quest 2)
82/ Hand interactions improvements
Wonder how it'll perform in fitness
Eventually want to have hands as primary input & be controller free.
Productivity slowly getting better. Bluetooth keyboard just worked, but doing research totally in VR is overall just not there yet for him.
Wonder how it'll perform in fitness
Eventually want to have hands as primary input & be controller free.
Productivity slowly getting better. Bluetooth keyboard just worked, but doing research totally in VR is overall just not there yet for him.
83/ XR devices Need to eventually displace other devices
Camera has gotten better & motion stabilization
Casting to phone has improved
Mixed reality capture exists - Carmack beat Zuckerberg in Beat Saber final.
Has glTF support implemented but not opened up yet. Embrace the UGC
Camera has gotten better & motion stabilization
Casting to phone has improved
Mixed reality capture exists - Carmack beat Zuckerberg in Beat Saber final.
Has glTF support implemented but not opened up yet. Embrace the UGC
84/ Final parts will be Carmack being grumpy
Demo'ing VR is still a pain with updates, etc.
It should be a delight to demo for friends.
Carmack writing lots of internal posts complaining about things that could be better & starting to get traction.
adb logcat horror show of perf.
Demo'ing VR is still a pain with updates, etc.
It should be a delight to demo for friends.
Carmack writing lots of internal posts complaining about things that could be better & starting to get traction.
adb logcat horror show of perf.
85/ Sometimes Carmack has urges to flip table & burn it all down [re performance]
(╯°□°)╯︵ ┻━┻
One of Carmack's post got removed for not being sensitive enough.
New OS build from ground up?
Android build environment is horrible, but he can get answers from StackOverflow
(╯°□°)╯︵ ┻━┻
One of Carmack's post got removed for not being sensitive enough.
New OS build from ground up?
Android build environment is horrible, but he can get answers from StackOverflow
86/ @ID_AA_Carmack begs to go over time, but a "no."
He hopes to return to the days of Connect will people would swarm around him for literally hours listening to him answer questions (see below👇).
Hopes to eventually be able to do that in Horizon Worlds
He hopes to return to the days of Connect will people would swarm around him for literally hours listening to him answer questions (see below👇).
Hopes to eventually be able to do that in Horizon Worlds
https://twitter.com/kentbye/status/1176970567653580801
87/ It looks like the live portion of #MetaConnect is now over.
But you can find the on-demand videos for the 5 different tracks here:
metaconnect.com/en-us/program/…
Build Immersive Experiences
Create Natural Interactions
Design for Everyone
Grow Your Business
Extend the Metaverse
But you can find the on-demand videos for the 5 different tracks here:
metaconnect.com/en-us/program/…
Build Immersive Experiences
Create Natural Interactions
Design for Everyone
Grow Your Business
Extend the Metaverse
88/ @boztank did a post-keynote Q&A .
instagram.com/stories/boztan…
Says "it's a very fair question" implying US should perhaps restrict ByteDance (TikTok & Pico)
"Yes!" Quest Pro compatible w Quest 2 games
Will to better job supporting ISVs & deployment SW
Custom silicon vital for AR
instagram.com/stories/boztan…
Says "it's a very fair question" implying US should perhaps restrict ByteDance (TikTok & Pico)
"Yes!" Quest Pro compatible w Quest 2 games
Will to better job supporting ISVs & deployment SW
Custom silicon vital for AR
89/ Going through the press kit, and there's this AMAZING video for @wooorldXR, which is a launch title for the Meta Quest Pro coming out Oct 25th.
This looks like the type of Google Earth VR social app that we always dreamed about, but never got.
This looks like the type of Google Earth VR social app that we always dreamed about, but never got.
https://twitter.com/haltor/status/1579914546231533568
90/ The mixed reality app for @tribe_vr looks like it'll have a lot of functional utility for aspiring DJs.
I'm not convinced a $1500 price point will necessarily be within the range for most normal consumers.
More likely for folks who already have one for work using it at night.
I'm not convinced a $1500 price point will necessarily be within the range for most normal consumers.
More likely for folks who already have one for work using it at night.
91/ Here's the @PaintingVr trailer from Meta's Press Kit that includes 1 single shot of a Painting Passthrough mode featuring Meta Quest Pro footage, but otherwise it looks most of the other footage is shot within their virtual studio.
MR isn't most impressive feature of this app
MR isn't most impressive feature of this app
92/ There's a GIF for @PaintingVr that shows the ability to pull up an in-game browser, which feels like a unique ability for Meta Quest Pro to have multi-tasking functionality. Overall, the app looks amazing, & I'd love to see some comparisons showing how Quest Pro improves it.
93/ Here's the @FigminXR trailer that's included within Meta's Press Kit for the Meta Quest Pro.
It looks like lots of great mixed reality demos that were included in the suite of apps shown to press for review including also @tribe_vr, @PaintingVr, & @wooorldXR.
It looks like lots of great mixed reality demos that were included in the suite of apps shown to press for review including also @tribe_vr, @PaintingVr, & @wooorldXR.
94/ Here are the three images for Horizon Workrooms that are included in Meta's Press Kit for the Meta Quest Pro section.
95/ Here's the video that they played to reveal the Meta Quest Pro during the keynote, which highlights:
* Next Generation Optics
* Premium Comfort
* Meta Quest Pro Controllers
* Transformative Mixed Reality
* Next Generation Optics
* Premium Comfort
* Meta Quest Pro Controllers
* Transformative Mixed Reality
96/ 1 of 3 Meta Quest Pro ads in Press Kit
New Ways to Work
New Ways to Create
Introducing Meta Quest Pro
All AR/VR screens simulated & reformatted to fit your screen
Arkio
Gravity Sketch
Immersed (Requires Compatible PC & PC App)
PaintingVR
Meta Horizon Workrooms
Rezzil Player
New Ways to Work
New Ways to Create
Introducing Meta Quest Pro
All AR/VR screens simulated & reformatted to fit your screen
Arkio
Gravity Sketch
Immersed (Requires Compatible PC & PC App)
PaintingVR
Meta Horizon Workrooms
Rezzil Player
97/ 2 of 3 Meta Quest Pro ads in Press Kit.
This is a shorter 30-second version featuring just the music collaboration use case that uses Immersed app (Requires Compatible PC & PC App)
New Ways to Work
New Ways to Create
New Ways to Collaborate
Introducing Meta Quest Pro
This is a shorter 30-second version featuring just the music collaboration use case that uses Immersed app (Requires Compatible PC & PC App)
New Ways to Work
New Ways to Create
New Ways to Collaborate
Introducing Meta Quest Pro
98/ 3 of 3 Meta Quest Pro ads in Press Kit
30-second cut focuses on Mixed Reality design review of spatial objects
Gravity Sketch
All AR/VR screens simulated & reformatted to fit your screen
New Ways to Work
New Ways to Create
New Ways to Collaborate
Introducing Meta Quest Pro
30-second cut focuses on Mixed Reality design review of spatial objects
Gravity Sketch
All AR/VR screens simulated & reformatted to fit your screen
New Ways to Work
New Ways to Create
New Ways to Collaborate
Introducing Meta Quest Pro
99/ Clip of @ImmersedVR adding additional screens with Meta Quest Pro.
Res now high enough to be useful.
They've iterated on different business models over the year & used to have this gated as a subscription, but it looks like that may have lifted.
Res now high enough to be useful.
They've iterated on different business models over the year & used to have this gated as a subscription, but it looks like that may have lifted.
https://twitter.com/ImmersedVR/status/1579925595441762305
100/ As per usual, @RtoVR's @benz145 has the full Meta Quest Pro specs here:
roadtovr.com/meta-quest-pro…
Some highlights:
1800 × 1920 (3.5MP) per-eye, LCD (2x) Resolution
IPD Adjustment Range 55–75mm
Snapdragon XR2+ Processor
12GB RAM
Eye Tracking
Face Tracking
$1499 USD price
roadtovr.com/meta-quest-pro…
Some highlights:
1800 × 1920 (3.5MP) per-eye, LCD (2x) Resolution
IPD Adjustment Range 55–75mm
Snapdragon XR2+ Processor
12GB RAM
Eye Tracking
Face Tracking
$1499 USD price
101/ I'm hearing some unconfirmed reports that PCVR #VRChat users will likely NOT be able to use the eye tracking & face tracking features on Meta Quest Pro as Oculus Link is currently blocked from working properly.
Source:
forums.oculusvr.com/t5/Ideas/Enabl…
More:
reddit.com/r/virtualreali…
Source:
forums.oculusvr.com/t5/Ideas/Enabl…
More:
reddit.com/r/virtualreali…
102/ Privacy Blog Summary (1 of 2):
Opt-in to enable eye/face tracking features
Clear notices of how they work
Privacy notices links
"decide whether to turn them on, & they are not used to identify you."
Easy to pause those features
oculus.com/blog/meta-ques…
Opt-in to enable eye/face tracking features
Clear notices of how they work
Privacy notices links
"decide whether to turn them on, & they are not used to identify you."
Easy to pause those features
oculus.com/blog/meta-ques…
https://twitter.com/joejerome/status/1579912804936863744
103/ Privacy Blog Summary (2 of 2)
Turns off automatically on sleep
Raw Images Are Never Shared w Meta or 3rd Parties
Apps will always ask whether you want to turn them on
Bystander Signaling: external LED lights for Passthrough camera
Choose to share additional data during setup
Turns off automatically on sleep
Raw Images Are Never Shared w Meta or 3rd Parties
Apps will always ask whether you want to turn them on
Bystander Signaling: external LED lights for Passthrough camera
Choose to share additional data during setup
104/ @KavyaPearlman takes a look at some of the privacy modal dialogues and notes the confirmation buttons are color-coded in a way to nudge affirmation.
Context: @XRSIdotorg links to this FTC document of Dark Patterns for consent
ftc.gov/system/files/f…
Context: @XRSIdotorg links to this FTC document of Dark Patterns for consent
ftc.gov/system/files/f…
https://twitter.com/KavyaPearlman/status/1579924087257804800
105/ @alexeheath + Zuckerberg (1/n):
Rebrand would be harder if done today.
Work is big part of computing
Emphasized eye tracking data staying on device
Realistic expressions & eye contact biggest blockers to social presence in VR
Rebrand would be harder if done today.
Work is big part of computing
Emphasized eye tracking data staying on device
Realistic expressions & eye contact biggest blockers to social presence in VR
https://twitter.com/alexeheath/status/1579901081584545792
106/ @alexeheath + Zuckerberg (2/n)
Won't confirm ~10M Quests
2 customers for Meta Quest Pro: want best VR device or productivity
Wants VR to be primary workstation
Meta still doesn't want to profit on XR hardware
Deal w Microsoft sign Meta wants to build more enterprise collabs
Won't confirm ~10M Quests
2 customers for Meta Quest Pro: want best VR device or productivity
Wants VR to be primary workstation
Meta still doesn't want to profit on XR hardware
Deal w Microsoft sign Meta wants to build more enterprise collabs
107/ @alexeheath + Zuckerberg (3/n)
Not trying to do enterprise all by themselves
Wants to collaborate w Accenture
Believes open ecosystem comes from broader partnerships
Not fated whether closed vs open will win as iOS is winning mobile
Q: Apple's tracking prompt cost Meta ~$10B
Not trying to do enterprise all by themselves
Wants to collaborate w Accenture
Believes open ecosystem comes from broader partnerships
Not fated whether closed vs open will win as iOS is winning mobile
Q: Apple's tracking prompt cost Meta ~$10B
108/ @alexeheath + Zuckerberg (4/n)
Hard to know what Apple is doing
Not as altruistic as they claim to be
[Heath seems certain Apple's 1st XR headset is coming soon & he wonders if Apple may not let Meta's apps on their headset]
Zuckerberg says he enjoys being doubted [laughs]
Hard to know what Apple is doing
Not as altruistic as they claim to be
[Heath seems certain Apple's 1st XR headset is coming soon & he wonders if Apple may not let Meta's apps on their headset]
Zuckerberg says he enjoys being doubted [laughs]
109/ @alexeheath + Zuckerberg (5/5)
Social media trends.
Doesn't know solution for TikTok.
Meta has many different formats & recommendation engine mixes modalities.
Most meaningful interactions come from DMs
Big role of professionalization, creator economy, connect to an audience
Social media trends.
Doesn't know solution for TikTok.
Meta has many different formats & recommendation engine mixes modalities.
Most meaningful interactions come from DMs
Big role of professionalization, creator economy, connect to an audience
110/ Here's an extended clip of @tovanbo's CUBISM using the passthrough mixed reality mode via Presence Platform on a Meta Quest Pro.
Some really slick 3DUI here.
Some really slick 3DUI here.
https://twitter.com/tovanbo/status/1579918917853581312
111/ @Zimtok5 heard via "Several network contacts" the "Touch Pro controllers last ~2 hours."
Huge downgrade from the existing controller battery life if true.
Add CV cameras + computer on the controllers makes them more 6DoF, but trade battery life.🤔
Huge downgrade from the existing controller battery life if true.
Add CV cameras + computer on the controllers makes them more 6DoF, but trade battery life.🤔
https://twitter.com/Zimtok5/status/1580040061768245248
112/ Meta News 1 of 2
VR News at Meta Connect 2022
oculus.com/blog/vr-news-c…
Evolving the Future of Work at Meta Connect 2022
oculus.com/blog/future-of…
Games at Connect 2022: ‘Marvel’s Iron Man VR,’ Xbox Cloud Gaming, an ‘Among Us VR’ Release Date, and More
oculus.com/blog/vr-games-…
VR News at Meta Connect 2022
oculus.com/blog/vr-news-c…
Evolving the Future of Work at Meta Connect 2022
oculus.com/blog/future-of…
Games at Connect 2022: ‘Marvel’s Iron Man VR,’ Xbox Cloud Gaming, an ‘Among Us VR’ Release Date, and More
oculus.com/blog/vr-games-…
113/ Meta News 2 of 2 from #MetaConnect
Meta Avatars Highlights from Connect 2022
developer.oculus.com/blog/meta-avat…
Developer News at Meta Connect 2022
developer.oculus.com/blog/developer…
Reality Labs Research at Meta Connect 2022
tech.fb.com/ar-vr/2022/10/…
Meta Avatars Highlights from Connect 2022
developer.oculus.com/blog/meta-avat…
Developer News at Meta Connect 2022
developer.oculus.com/blog/developer…
Reality Labs Research at Meta Connect 2022
tech.fb.com/ar-vr/2022/10/…
114/ Building for Metaverse on Web w @jacobrossi
facebook.com/RealityLabs/vi…
New parental supervision features for Quest Browser
LastPass
Progressive Web Apps
Overlays coming to Quest Pro
Partnering w Microsoft's PWABuilder Studio
docs.pwabuilder.com/#/builder/meta
MR passthrough for #WebXR
facebook.com/RealityLabs/vi…
New parental supervision features for Quest Browser
LastPass
Progressive Web Apps
Overlays coming to Quest Pro
Partnering w Microsoft's PWABuilder Studio
docs.pwabuilder.com/#/builder/meta
MR passthrough for #WebXR
115/ Links from the Metaverse/WebXR session:
@jacobrossi mentioned Project Flowerbed #WebXR demo to push the cutting edge:
flowerbed.metademolab.com
Meta Quest Browser
developer.oculus.com/documentation/…
Progressive Web Apps
developer.oculus.com/pwa
WebXR
developer.oculus.com/webxr
@jacobrossi mentioned Project Flowerbed #WebXR demo to push the cutting edge:
flowerbed.metademolab.com
Meta Quest Browser
developer.oculus.com/documentation/…
Progressive Web Apps
developer.oculus.com/pwa
WebXR
developer.oculus.com/webxr
116/ Building Great WebXR App session
facebook.com/RealityLabs/vi…
Pipeline from Blender to glTF to Three.js
gjTF using KTX2 textures. gltf-transform and gltfpack
Used *.webm for audio
Used remote Chrome dev tools + Oculus developer hub
RenderDoc for Oculus works on WebXR content
facebook.com/RealityLabs/vi…
Pipeline from Blender to glTF to Three.js
gjTF using KTX2 textures. gltf-transform and gltfpack
Used *.webm for audio
Used remote Chrome dev tools + Oculus developer hub
RenderDoc for Oculus works on WebXR content
117/ Meta acquired Unit 2 games to bring @CraytaGame tools to Horizon worlds.
facebook.com/RealityLabs/vi…
Super vague here because it doesn't appear as though integrations between Crayta & Horizon Worlds are completed yet. Lots of speculation.
Building Blocks:
Avatar
Identity
Travel
facebook.com/RealityLabs/vi…
Super vague here because it doesn't appear as though integrations between Crayta & Horizon Worlds are completed yet. Lots of speculation.
Building Blocks:
Avatar
Identity
Travel
118/ One of the things @SadlyItsBradley pointed out after the #MetaConnect keynote was all of the various peripherals Meta will be selling now.
The VR mode of the Quest Pro doesn't block out light by default so the Full Light Blocker is additional $49.99
The VR mode of the Quest Pro doesn't block out light by default so the Full Light Blocker is additional $49.99
https://twitter.com/Thrilluwu/status/1580222306290667521
119/ I’ve been thinking a lot about this comment from @dankvr contextualizing the Meta Quest Pro as more than half the price of a HoloLens 2 or Magic Leap 2.
@jetscott made the same comment at the end of his hands-on review that it reminded him more of these AR devices than VR.
@jetscott made the same comment at the end of his hands-on review that it reminded him more of these AR devices than VR.
https://twitter.com/dankvr/status/1579897013436809217
• • •
Missing some Tweet in this thread? You can try to
force a refresh
