Apples New Siri AI Brings Personal Context, On-Screen Awareness, and a Step Closer to Competitors
Apple’s newest AI‑powered assistant just got a major makeover. Revealed at the 2024 Worldwide Developers Conference and now in beta, Siri now pulls in personal context and on‑screen awareness—two features that were first hinted at in June 2024. These upgrades sit inside the larger Apple Intelligence suite that launched with iOS 18, iPadOS 18 and macOS Sequoia.
Personal context lets Siri read and use data from your emails, messages, calendar, files and apps. In beta tests on iPhone, iPad and Mac, the assistant could move a calendar appointment, change an event title, or swap a dial‑in number for an in‑person address—all from a single voice command. It could also dig up a TV recommendation that was shared weeks earlier, find an order‑related email, pull restaurant suggestions from messages and emails, create calendar events using data displayed inside a third‑party app, search for travel plans discussed at different times, and draft a message while attaching a relevant photo.
On‑screen awareness gives Siri the ability to interpret what’s currently visible on the device’s display. That means the assistant can respond to requests that involve content inside other apps—editing a photo, adjusting settings shown on the screen, or pulling up a link that’s on the page.
Bloomberg’s Mark Gurman calls these capabilities “among the most important Apple Intelligence features announced in 2024,” even though Apple had previously said they were only part of a broader roadmap.
Beyond context and awareness, the new Siri shows a sharper grasp of user requests. Earlier versions sometimes misinterpreted navigation commands, sending users to a city that shared a name with a nearby restaurant. The new architecture handles such requests more accurately. Siri can now perform many common AI‑assistant tasks: web searches, recipe and historical information lookups, text and email editing, practical information retrieval and checking local entertainment listings.
When compared to leading AI chatbots, the updated Siri is roughly on par with what those services were six months ago. Apple’s built‑in AI tools may be enough for everyday tasks, potentially cutting the need for third‑party AI apps. However, Siri still lags behind ChatGPT, Gemini and Claude in more advanced workloads—deep research, long‑form report writing, programming assistance, data analysis, complex travel planning, legal document reviews, tax‑related tasks, large PDF analysis and spreadsheet or presentation generation.
Apple Intelligence goes beyond Siri. The beta also includes improvements to Image Playground’s image generation, Genmoji creation, image expansion tools that add content within a scene, and a new Clean Up feature that removes unwanted objects and people from photos.
Engineering chief Mike Rockwell described the new Siri architecture as “a completely modern architecture” that can be extended in the future. Software chief Craig Federighi called the category experimental and said development focuses on finding the right user experience.
Despite the progress, the beta still has notable issues: slow response times, canceled queries, misinterpreted requests, inconsistent HomeKit controls, lost conversation history and failures to understand some on‑screen content. The report suggests many of these problems could be addressed before the public release later this year.
The significance of these updates lies in Apple’s attempt to position Siri and Apple Intelligence as privacy‑focused AI features while narrowing the gap with competing platforms. If Apple can offer AI capabilities on par with leading competitors, it may alleviate concerns about the company’s AI strategy and support future product launches, including a foldable iPhone, the 20th‑anniversary iPhone and other AI‑powered hardware.
In short, Apple’s new Siri AI brings tangible improvements in personal context and on‑screen awareness, making the assistant more useful for everyday tasks. While it still falls short of the advanced capabilities of top‑tier chatbots, the foundation laid by the new architecture and Apple Intelligence could enable more sophisticated AI features in future iOS, iPadOS and macOS releases.
