Vision Pro lacks the sensors for that. They skimped out on direction finding capabilities, despite already having the tech in their phones (for their tags)

In their infinite wisdom they built it as a standalone single user sandbox instead of as an environmentally aware terminal