Thread by @jonstephens85

Follow along as I do a series of structured @Apple RoomPlan tests and share my findings/notes in this thread.

First up, I tried tricking RoomPlan with a large mirror. Surprisingly it wasn't fooled! Also, it was way off on french doors height.

#WWDC22 #AR #ARKit #AI @Scobleizer

Test #2 - vaulted ceilings. I noticed that the wall shapes have to be rectangular. It could not follow the slant angle of the ceiling line. This made parts of my walls much taller than in reality.

It did a great job at picking out the desks and bedroom furniture.

Test #3 - cramped closet. It did a great job at figuring out the walls when almost NOTHING was visible. It couldn't pick up the bend in the wall between the mirror and the door.

Most surprising note: couldn't fool mirror #2!

If my wife sees this thread I am in the doghouse.

Test #4 - Door open and closing. People ask this a lot with reality capture. What happens if a door changes position? It looks like it updated the model to be a bigger wall opening. It did not change back to a small opening once the door was re-opened.

Well done @apple.

@Apple Test #5 - the mess test! My kid's play room is a TERRIBLE mess. Yet, RoomPlan picked everything out just fine. It hard a hard time with my IKEA wall unit that I hacked together.

I also put the couch in that odd configuration to see how it would detect it. It passed this test!

This was my first attempt at the media console. The TV was not placed correctly, nor could I get it to reorient to the right place on the wall. Small failure. Also the console in general is odd shaped.

Test #6 - the whole second floor. Then I started downstairs and decided not to. However, it did WEIRD things to the model. All of the objects float midair. Now I need to do upstairs and downstairs as one.

Here is probably the coolest find so far. When I look top down, the walls correct themselves based on some assumptions from Apple.

the more I look at the "correction" the more I realize it is making the rooms WORSE in specific areas. FAIL

I cut this one down for time. I did up and downstairs and the app couldn't make sense of multi floor scans. Notice how tall the walls are at the end.

Taking a break to pick up my son from school. I’ll pick back up in 30 minutes. Going to test my patio and my garage.

Back at it! Here is a huge opening in the wall that RoomPlan could NOT figure out. When I completed the session. It deleted the whole cutout section down to the floor. I would have rather kept this an entire wall in the model.

The wall generalization is subtle and I don't see how to control it - yet. I would have rather kept the OG wall layout from the raw scan.

I am moving outside! I did a great job at scanning my porch. However, one of the Adirondack chairs wouldn't pick up. The garage doors works out perfectly!!
Let's move INTO the garage, shall we?

We should call this GarageScan. It NAILED my disaster of a garage. This is embarrassingly messy. What I will do for science...

Moving to the backyard. I was SHOCKED how well this worked. Until I moved below the deck and all a sudden the deck objects were floating in the air. It does not seem to detect and index where the floor perpetually exists.

Here is another look at the floating furniture objects. Also, the fence turned into a comically tall wall. I can't figure out why.

Last test for now. The kitchen picked up all of the appliances but could not figure out the non-90 degree bend at the sink. When I finished the scan, the corner filled in wrong. Good enough for #AR

As a bonus, I left the system audio on, I literally blasted dance music the day.

Anything you would like me to test? I was hoping to get to my friend's massive open office, however, I didn't have time. I will try that tomorrow.

Update: here is the model of my bathroom on my desktop and my thoughts of the model.

https://twitter.com/jonstephens85/status/1534618942261497856