OpenAI, a trailblazer in artificial intelligence research, has unveiled its latest milestone: the ChatGPT app for the Apple Vision Pro headset. This innovative release allows users to engage with the powerful GPT-4 Turbo model in a highly immersive augmented reality (AR) setting.
With the integration of ChatGPT into Vision Pro, users can expect a paradigm shift in how they interact with AI. The ability to dictate queries, showcase real-world problems through the headset’s camera, and receive information intuitively opens new possibilities for tasks such as troubleshooting, meal planning, and educational activities.
Generate images and content directly in AR with ChatGPT and Vision Pro
The ChatGPT app for Vision Pro signifies a pivotal moment for OpenAI, offering users a glimpse into the future of human-AI interaction. This AR-powered application allows users to seamlessly communicate with the GPT-4 Turbo model through natural language queries, voice commands, and visual inputs. The app’s versatility enables users to ask questions, seek advice, learn new topics, and even generate images and text directly within the AR environment.
As one of the pioneer apps for visionOS, the operating system driving Apple Vision Pro, ChatGPT leverages advanced features such as Optic ID for biometric authentication, Spatial Audio for realistic sound effects, and VisionKit for comprehensive app development. Although specifics about the utilization of these features remain unclear, the potential for enhanced AI interactions using text, speech, and visual inputs is substantial.
The app aligns with the industry trend toward multimodal AI, enabling the processing and understanding of various inputs, including text, speech, images, and videos. This adaptability makes it more versatile and suitable for diverse applications, from troubleshooting mechanical issues to planning meals based on real-world visual input.
chat has now entered the 3D world.
you can find it in the visionOS App Store. pic.twitter.com/TethfMEc9j
— ChatGPT (@ChatGPTapp) February 2, 2024
ChatGPT is available for free on the visionOS App Store, with an optional subscription, ChatGPT Plus, offering access to GPT-4’s advanced features and faster response times. The App Store boasts a diverse ecosystem with over 600 apps tailored for various purposes, ensuring a rich environment for Vision Pro users.
Read more:
