In the world of artificial intelligence and large language models, Apple has not been massive in what it has to deliver, particularly as the company did not ride the wave like its competitors, Google and Microsoft did. In their latest research, they highlighted that the goal for their AI is to run it directly to hardware, particularly with iPhones, and not via the cloud as other companies did.
Apple's AI is Set to Run on Hardware, Not the Cloud
Apple researchers have released a new study that suggests the future of Cupertino's take on the artificial intelligence developments in the world, centering on the ideology to run it via hardware and not the cloud. This recent highlight from Hugging Face made the research famous, with the platform known for showcasing the work of AI researchers, with this being Apple's second paper on generative AI.
The research entitled "LLM in a Flash" detailed the focus on hardware devices to run the AI developments, centering on a new approach towards large-language models on devices.
"Our integration of sparsity awareness, context-adaptive loading, and a hardware-oriented design paves the way for effective inference of LLMs on devices with limited memory," said the researchers.
Will Siri Get the Best of Apple's AI for Hardware?
If this development arrives, it is unknown if Apple will focus on Siri, centering on being the face of its AI for iPhones.
By developing an inference cost model that aligns with these hardware constraints, we have introduced two innovative techniques: 'windowing' and 'row-column bundling.' These methods collectively contribute to a significant reduction in the data load and an increase in the efficiency of memory usage.
The shift towards running AIs in hardware is seen in different companies now, with Google looking to integrate its Gemini AI into Pixel. On the other hand, Qualcomm is also looking to develop chips that would run AI in smartphones natively.
Apple's AI Development
While there is not much to see and expect from Apple going big in AI developments in its current technology, there are massive claims from people familiar with the matter and other sources that it is making one. A report from before talked about a ChatGPT-style AI coming to the Apple platform, most probably an AI chatbot, speculated to improve Siri's technology.
It was also regarded before that Siri is falling out of the competition as the AI assistant feature was only pushing in small upgrades for the feature, remaining stagnant to what it has to offer. That being said, it was said that Apple's development of Siri has been affected by massive privacy concerns alongside internal conflict, allegedly held back to get enhancements.
For many years, Siri has become an icon for iPhone users, and the proprietary AI has proved to be useful for a hands-free experience, but it remained that way for a long time. Still, it is not yet a forgotten technology within Apple, as the company has more plans to integrate LLM into iPhones, centering on hardware as its star to run the experience, not via the cloud-possibly related to Siri.
