The challenge from Apple’s perspective is to both ensure user data security and prevent malicious AI agents that target user data and digital wallets. At the same time, an AI agent should be able to access as many functions as possible so that it makes any sense at all. To this end, Apple wants to develop a framework that equips both Siri 2 and AI agents from other manufacturers with extensive capabilities.
App intents as a basis?
To provide system and app functions for automation and Siri, Apple has been offering the App Intents framework for years. App developers can use this to specifically control which functions are available in Siri and the shortcuts app. It is possible that Apple will use this as a basis for agentic interactions with artificial intelligence. At WWDC 2024, Apple announced a dozen app intent domains with over a hundred actions. There are now 15 domains listed in the developer documentation.
Interaction with Third Party Services
According to The Information, Apple has contacted app developers who themselves provide functions for AI agents, namely flight bookings and calendar invitations. Apple apparently spoke to providers such as Baidu, Alibaba and Tencent. They reacted cautiously because they feared that the company would demand a commission if the mediation was successful – similar to the 30 percent that Apple charges for all digital app sales. Apple responded that it wanted to forego a percentage stake in the early phase, but did not rule out a brokerage fee in the future.