Apple’s iPhone 15 Pro and Pro Max redefined mobile videography by introducing spatial video capture. With the upcoming iOS 18 update, Apple is taking this innovation a step further by opening the door for third-party apps to leverage this groundbreaking technology.
This expansion will allow users to capture videos with 3D depth, offering a more immersive viewing experience, especially when played back on the Apple Vision Pro headset. Initially, this feature was limited to the built-in Camera app on iPhone 15 Pro and Pro Max models running iOS 17.2 or later. However, with iOS 18, Apple is introducing an API that allows third-party apps to leverage this technology.
During a recent WWDC 2024 coding session, Apple unveiled an API that integrates with existing camera-related frameworks, making it easy for developers to add spatial video recording capabilities to their apps. This move aims to increase the functionality of the Vision Pro headset and expand its user base by enabling more apps to create spatial content. The API is built into current camera-related frameworks, simplifying the implementation process for developers.
Spatial video recording requires vertically aligned cameras. While currently limited to the iPhone 15 Pro models, this feature is expected to extend to the iPhone 16 and iPhone 16 Plus, which are rumored to have vertically aligned rear cameras. The API handles synchronization, camera calibration, encoding, and metadata writing, allowing developers to focus on enhancing user experience without delving into complex technical details.
With the release of iOS 18, third-party camera apps on the App Store can now offer spatial video recording. This expansion is a technical enhancement and a strategic move to boost the adoption of the Vision Pro headset. Apple’s partnership with Canon to introduce mirrorless cameras for creating spatial videos further demonstrates the company’s commitment to advancing this technology.
Moreover, Apple plans to introduce the Vision Pro headset to new markets, including China, Japan, and Singapore, expanding its global reach. This broadened availability, coupled with the integration of spatial video recording in third-party apps, is expected to enhance the appeal and versatility of the Vision Pro headset.
Beyond spatial video recording, iOS 18 introduces several other noteworthy features. Enhanced security options will allow users to lock and hide apps with Face ID, protecting sensitive information. The messaging experience will be improved with creative new text effects, while updates to Notes, Calendar, and Calculator apps will offer better functionality and user experience.
