Apple’s groundbreaking Math Notes in iPadOS 18 transforms how you tackle calculations. This innovative feature goes beyond the Calculator app, seamlessly integrating with Notes for effortless budgeting, expense tracking, and more. In a recent interview, Apple executives Ty Jordan and Jenny Chen delved into the development and capabilities of Math Notes and Smart Script.
Math Notes allows users to write equations by hand, which the app then solves instantaneously. This feature is designed to harness the natural input of the Apple Pencil, combined with on-device machine learning models and the power of Apple Silicon, providing an almost magical user experience. Users can type equations in Notes, such as listing expenses, and let Math Notes calculate the totals. This functionality makes daily tasks like budgeting simpler and more efficient.
The interview highlighted how Math Notes extends beyond simple calculations. For instance, while on vacation, users can utilize a shared note to track spending without repeatedly accessing banking apps. The public beta of iOS 18 doesn’t include Apple Intelligence features, but future enhancements are expected to integrate calculations with other iOS elements like Siri and Mail, further increasing the utility of Math Notes.
In addition to Math Notes, iPadOS 18 introduces the Calculator app for iPad, designed to be the best in its category. Apple took the time to reimagine how users could perform math, integrating Math Notes and Calculator to leverage the unique capabilities of the iPad and Apple Pencil. Ty Jordan explained that the company aimed to create a seamless and intuitive experience by combining handwriting recognition with machine learning.
Jenny Chen elaborated on the technology behind Math Notes, emphasizing its roots in the Scribble feature, which recognizes and converts handwriting to typed text. Math Notes builds on this technology by not only recognizing but also synthesizing text similar to the user’s handwriting. This allows for manipulating handwritten text, such as moving words around within a paragraph.
Smart Script, another feature discussed in the interview, uses machine learning to refine and improve handwriting. As users write, Smart Script straightens and smooths text, making it more legible while preserving the personal touch of the user’s handwriting. It also offers spell check and contextual suggestions, enhancing the overall note-taking experience. The ability to paste typed text as handwritten text and reflow text within a paragraph brings a new level of functionality to handwritten notes.
Check out the full interview below:
