it looks like they're basing the infilling on 360 photos / videos. that's why you can't walk around freely: the inpainting must be done from the center of the sphere