Grok's frontend lead Evan Bacon says Grok Bot built itself an Apple Vision Pro app with bots he can place around his apartment
Asked Grok Bot to build itself an Apple Vision Pro app. I now have interactive bots that I can talk to and place around my apartment.
Context
The demo shows Grok Bot building, installing and running a native visionOS app largely on its own, and Bacon has published the bot that did it as a template anyone can add.
Evan Bacon is the frontend lead for Grok at SpaceXAI, so this is a demo from inside the company. Grok Bot is SpaceXAI's agent that works on its own computer and can drive a user's connected Mac. Grok Bot templates package a bot's skills, instructions and plugins so others can add their own copy.
Deep dive
On October 11, Evan Bacon posted that he asked Grok Bot to build itself an Apple Vision Pro app, and that he now has interactive bots he can talk to and place around his apartment. His video shows a Grok window in the headset, titled Your crew of curious minds, with bot characters such as Orb Bot, Mac Fleet, Chief of Staff and Director Bot.
Bacon then published the bot that built it as a template.
According to its template page, Vision Pro Bot builds Apple Vision Pro apps in SwiftUI and RealityKit on the owner's connected Mac, checks them in the visionOS simulator, installs them on the headset and sends screenshots as it goes. The page says Apple toolchain work, such as Xcode, simulators and device installs, runs on the owner's Mac rather than on the bot's own Linux machine.
SpaceXAI's guide describes templates as a recipe rather than a copy: they carry a bot's skills, plugins and instructions, while each new owner's bot builds its own version without personal information.
What to expect next
Watch whether more developers use the Vision Pro Bot template to build their own visionOS apps, and whether SpaceXAI promotes spatial computing as a Grok Bot use case.
Also watch for independent demos that test how much of an app like this Grok Bot can build without hands on help, since this showcase comes from a SpaceXAI employee, and whether Apple responds to agents building and installing apps on its headset.