Apple is taking small but important steps here. Notice how most of the content is 2d rendered onto a plane in 3d space.

Meta and previously Magicleap perhaps bit off more processing than they could chew with 3d models in a 3d world mesh.