Raw LLM Responses

>1/29 update: The latest update on Apple’s own efforts to introduce generative AI into iOS suggests its intent to keep everything on the device might not be as firm as expected. Code just discovered by 9to5Mac in the new iOS 17.4 beta paints a picture as to the progress being made. “Apple is continuing to work on a new version of Siri powered by large language model technology, with a little help from other sources.” As Bloomberg’s Mark Gurman pointed out last fall “Apple largely sat on the sidelines when OpenAI’s ChatGPT took off like a rocket… It watched as Google and Microsoft rolled out generative AI versions of their search engines… The only noteworthy AI release from Apple was an improved auto-correct system in iOS 17.” Unsurprisingly then, one of the “sources” helping out Apple, according to 9to5Mac, is ChatGPT, “Apple appears to be using OpenAI’s ChatGPT API for internal testing to help the development of its own AI models.” According to 9to5Mac, “iOS 17.4 code suggests Apple is testing four different AI models. This includes two versions of \[Apple’s internal model\] AjaxGPT, including one that is processed on-device and one that is not.” Apple is seemingly checking results from its own AI models against ChatGPT, is including an iMessage interface as part of this, and it’s not all on-device. Seems to me that they're entertaining the idea of computing in the cloud as well.