Optimizes tee shots with GPT-4

Image: Swing Genius

AR golf training app for Quest 3 analyzes tees using AI. Quest Pro owners can already try the alpha version.

Golf is one sport that can be played incredibly well in virtual reality with motion controls. Golf+ and the VR hit Walkabout Mini Golf prove it. new program, Swing geniusfrom the studio of the same name, now brings this principle to your actual site with augmented reality and AI analysis.

Owners of Meta Quest Pro (and later Meta Quest 3) will see a small patch of grass on the real floor where they will jump out of the virtual ball. The golf ball then travels through a virtual portal in the wall – almost like a real driving range with open walls style Top Golf or Drive Shack.

AR golf practice with Quest 3 and Quest Pro

The equipment is many types of virtual clubs. Alternatively, the manufacturer also offers a hardware extension to attach real hips to the controller. Various statistics provide information about the execution, such as how evenly the batting curve and speed were maintained.

Meanwhile, an AI co-pilot connected to the GPT-4 language model from Open AI provides improvement suggestions via voice output and text (Golf+ developers are also working on an AI caddy).

In addition to the many markers to align on the ground, the space also has lines and swing planes. Players use them to use their clubs, analyze the last tee shot or the trajectory of the ball. All of this is calculated in real time by the Unreal Engine.

Interested players with Meta Quest Pro can apply to participate in the closed alpha phase, which is already underway. To request access, go to the Swing Genius website. Since the Quest Pro has eye tracking, the VR headset even analyzes the player’s gaze.

In the recently introduced Quest 3, gaze analysis will not be possible due to the lack of eye and face tracking. However, a depth sensor built into future VR headsets could provide even more accurate tracking.

Note: links to online stores in articles may be so-called affiliate links. If you make a purchase through this link, MIXED receives a commission from the provider. The price does not change for you.