Visual Intelligence

Apple has introduced a new generation of Siri that goes far beyond voice commands. In WWDC 2026, the company unveiled Siri AI, a rebuilt version powered by the latest Apple Intelligence, with deeper personal context, stronger on-screen awareness, and broader support across apps. The update marks one of Apple’s most ambitious efforts to turn Siri into a more capable virtual assistant. It can now search messages, emails, and photos, while also pulling in information from the web and taking action across apps in a more automated way. Built to Understand Personal Context Apple says Siri AI was designed from the ground up as a new version of Siri. Craig Federighi, Apple’s Senior Vice President of Software Engineering, described it as a more capable and natural conversational assistant that helps users find information and complete tasks throughout the day. The assistant can search personal data stored on the device, including messages, email, and photos. That means users can ask Siri to find a restaurant recommendation sent in iMessage, locate a hotel confirmation number from an old email, or show photos from a specific family trip. Apple also plans to expand this capability to third-party apps through Spotlight integration, giving Siri more context tied to a user’s daily activity. Seeing What Is On Screen One of the most notable additions is on-screen awareness. Siri AI can understand what is currently displayed on the device and use that context in its responses. For example, if a user receives a potluck invitation, Siri can suggest what food to bring and save a recipe directly into Notes. On Mac, users can control-click an image or file and ask Siri about the content immediately. This same idea extends to questions about text, documents, and images shown on screen, making Siri more useful in everyday interactions across Apple devices. Searching The Web And Continuing Conversations Apple is also positioning Siri AI as a more modern web-aware assistant. It now has broad world knowledge and can fetch current information from the web before presenting a short, easy-to-understand answer. Users can ask about a wide range of topics, from the next solar eclipse to when a favorite musician will perform again. Apple also added conversational continuity, allowing follow-up questions without repeating the original context. A Dedicated Siri App And Richer Visual Intelligence For the first time, Apple is offering a dedicated Siri app. The app lets users review conversation history stored privately through iCloud and synced across Apple devices. A conversation can start on a Mac and continue on an iPhone, iPad, Apple Watch, or Vision Pro. Apple is also widening Visual Intelligence, which now understands images and objects in a more multimodal way. On iPhone, a new mode in the Camera app lets users press the shutter button so Siri can inspect an object in front of the camera and provide relevant information. The feature can help with nutrition details, object identification, and even splitting bills with Apple Cash. Visual Intelligence is also coming to iPad, Mac, and Vision Pro, allowing users to ask Siri about what appears on screen or around them in the physical world. Writing Tools Across The System Siri AI also brings Writing Tools across the system. Users can describe what they want to write, and Siri will create a draft automatically. If revisions are needed, users can describe the changes and Siri will update the text. Apple says the assistant can also adapt tone based on how a user usually communicates with different people. That means Siri can write more formal emails to a manager or more casual messages to a friend. It can also check spelling and grammar automatically in different apps, including third-party software. Apple Intelligence Expands Further Apple paired the Siri update with a wider upgrade to Apple Intelligence. In Photos, new tools such as Spatial Reframing, Extend, and Clean Up bring more advanced AI-assisted editing. Safari can now automatically group tabs by topic and monitor page changes with a Notify Me feature. Image Playground has also been updated to generate photorealistic AI images. Messages, Mail, Calendar, and the Home app are also gaining new AI features meant to make daily tasks faster and more efficient. Privacy Remains Central Despite the expanded capabilities, Apple says privacy remains at the center of Siri AI. The system uses a combination of on-device processing and Private Cloud Compute. Apple says user data is not stored or accessible to the company when processed in the cloud, and independent parties can verify that claim at any time. The company calls Siri AI the most private digital assistant it has ever built. Availability And Regional Limits Apple has opened developer testing for Siri AI today through iOS 27, iPadOS 27, macOS 27, and visionOS 27. A public beta is planned for later this year, starting with English support before expanding to other languages. The assistant will be available on iPhone 16 series and newer, iPhone 15 Pro and iPhone 15 Pro Max, iPads with M1 and later chips, Macs with M1 and later chips, Apple Vision Pro, and the latest Apple Watch models connected to devices that support Apple Intelligence. Apple says Siri AI will not be available on iPhone and iPad in the European Union when iOS 27 and iPadOS 27 launch, due to Digital Markets Act requirements. Users in the EU will still be able to access Siri AI through macOS 27, watchOS 27, and visionOS 27. In China, Siri AI and other new Apple Intelligence features will remain unavailable for now while Apple completes regulatory requirements. Source: inet.detik.com

Apple Unveils Siri AI, It Can Read Emails and Pull Details from Photos