SIAgentNews.com
← All news

Apple plans autonomous AI agent to navigate apps and write code

New job listings reveal Apple is developing an agentic AI capable of performing multi-step tasks across different software and web browsers.

· First reported by NDTV Profit on MSN

14steps required for third-party agent access in macOS 27.3

The short version

  • Apple's new agent aims to browse the web, write code, and navigate devices autonomously.
  • The system will use specialized subagents to coordinate complex, multi-step tasks.
  • Apple is adding friction for third-party agents in macOS 27.3, requiring 14 steps for some tools.
  • The company aims to launch the service as early as the end of next year.

Why it matters

This shift moves AI from a chatbot you talk to into a tool that actually performs work for you. It signals a transition toward 'agentic' computing where software can navigate interfaces independently.

The shift to agentic AI

Apple is moving toward a new era of artificial intelligence by developing an autonomous agent designed to perform tasks for users. Unlike standard chatbots that simply provide information, these agents are built to take action across various platforms. The company recently posted a job listing seeking a senior engineering manager to lead this proactive project.

The proposed system will be capable of browsing the web, controlling various apps, and navigating devices on a user's behalf. It is intended to handle complex workflows that currently require a human to switch between different windows and tools. According to the job listing, the agent will choose the correct tool for each step of a given task.

This development follows the success of other tools like Meta's Muse, which can book travel and make restaurant reservations. Apple's goal is to create a system that feels polished and private while maintaining the ability to run commands. The company is currently building the foundation for this future and intends to make it a reality soon.

How the technology works

The technology behind these agents relies on the ability to plan and carry out multi-step tasks across different interfaces. This includes interacting with browsers, command lines, and application programming interfaces, which are sets of rules that allow different software programs to talk to each other. The system will coordinate specialized subagents to handle specific parts of a larger goal.

A key component of this project is 'general-purpose computer-use' technology. This allows the AI to interact with a computer screen much like a human would, clicking buttons and moving through menus. This is the same type of functionality that currently allows tools from OpenAI and Google to control Mac computers.

Apple is also focusing heavily on the security architecture of these agents. Because the AI will need to use user credentials and run code, the company plans to build in strong permission models. They are utilizing sandboxing, a process that keeps the software isolated so it cannot break out into the broader internet or the rest of the operating system.

Competition and market reaction

Apple's move into the agent space puts it in direct competition with several major tech companies. OpenAI, Anthropic, and Meta are all racing to build similar tools, with some already seeing significant consumer adoption. For instance, Meta's Muse has already become a popular app for preparing news briefings and making bookings.

The market reacted quickly to news of Apple's plans. Shares of Meta and Anthropic fell in late trading after reports surfaced regarding Apple's efforts. Meta's stock fell nearly 2%, while Anthropic saw a drop of more than 3% during that period.

Other tech giants are also iterating on their agent offerings. Google recently overhauled its agent, now called Tasks, which can make phone calls for users. Meanwhile, Anthropic has widened testing for its agent, Duet, and OpenAI has expanded the capabilities of its Dots system.

Friction for third-party tools

While Apple develops its own agent, it is simultaneously making it harder for competitors to gain control over its hardware. In the beta version of macOS 27.3, the company introduced new warning screens for users. These screens prompt people to think twice before giving third-party agents permission to control their computers.

These changes have significantly increased the difficulty of setting up competing tools. For example, users of ChatGPT now have to complete 14 distinct steps to enable third-party computer-use tools, a major increase from the previous four steps. Apple describes this as a move to protect customer safety.

However, some observers view these hurdles as a way to slow down the competition. The company has previously faced legal scrutiny from the US Justice Department for blocking third-party access to hardware and features. This creates a complex landscape as Apple balances its own product development with its stance on an open ecosystem.

The road to next year

Apple is still in the early stages of developing its full-fledged AI agent. While the company has eyed a potential launch as soon as the end of next year, the work is ongoing. For now, the company is focusing on integrating its existing Siri assistant more deeply into third-party applications.

The upcoming iOS 27.3 release will lay the groundwork for this deeper collaboration. It will allow Siri to perform actions like booking a car or a restaurant reservation within outside apps. This is a step toward the agentic future, though it is not yet as autonomous as the planned system.

The ultimate goal is to create an assistant that can work in the background with minimal instructions. This would allow users to move fluidly between tasks without manual intervention. Apple's leadership is pushing for a bolder approach to software engineering to ensure they remain competitive in this fast-moving market.

What to watch

  • Whether Apple meets its goal of launching a full agent by the end of next year.
  • How users react to the increased friction for third-party AI tools in macOS 27.3.

Try it

Check your macOS settings to see if you have any third-party 'computer use' permissions enabled.

Sources and links

First reported by NDTV Profit on MSN. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.

Liked it? Say why

Add a line for other readers.

No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.

More AI news