Apple scientists have made significant progress in developing a new AI technology that could revolutionize the capabilities of iPhones. In two recently published articles on the arXiv website, Apple researchers describe methods that could enable iPhones to host and run large language models (LLMs), paving the way for advanced AI generative functions in future iPhone models.
The main challenge in implementing LLMs on mobile devices is the limited available memory. To address this issue, Apple researchers propose two techniques. The first technique, known as windowing, allows for the reuse of processed data by the AI on board, instead of utilizing new information. This reduces the hardware load. The second technique, called row-column bundling, organizes data into larger blocks for processing by the AI, enhancing the LLM’s ability to understand and generate language.
The impact of these techniques is significant. Research suggests that iPhones could potentially run AI models twice the size of the available memory, enabling the deployment of advanced models even in resource-constrained environments. This opens up a world of possibilities for Apple, including on-device avatars, real-time language translation, and new photographic features.
One of the exciting applications of this breakthrough is the potential improvement of Siri. There have been rumors of a smarter version of Siri with enhanced AI capabilities, and this research could bring that possibility to life. Integration with the Messages app and the ability to effectively answer difficult questions and complete sentences are just some of the potential uses. Speculations have also emerged about the development of a conversational AI called Ajax and the introduction of “Apple GPT” as a potential project name.
While the exact timeline for implementing these AI advancements remains unknown, there are speculations that we may see some progress by the end of 2024 with the introduction of iOS 18 and iPadOS 18. Apple’s groundbreaking research brings us one step closer to fully utilizing the potential of AI on mobile devices, promising an exciting future for iPhone users.
FAQ
The source of the article is from the blog newyorkpostgazette.com