Apple is pushing Siri beyond voice commands and into a more visual role. With iOS 27, the company is adding a new Siri mode inside the iPhone Camera app that can identify what the camera sees and respond with actions.
The change marks one of the clearest signs yet that Apple wants Siri to understand context, not just words. By combining image recognition with multimodal input, the assistant is being positioned to read what is in front of the user and help immediately.
How the new Camera experience works
Apple says users will be able to switch to a Siri tab while pointing the iPhone camera at an object. From there, they can ask for information or request an action based on whatever appears in view.
In Apple’s demonstration, the phone was pointed at a bill and Siri helped split it with a friend through Apple Cash. Another example showed the camera aimed at a plate of food, with Siri providing nutritional insight about the meal.
Visual Intelligence gets a larger role
The new mode arrives alongside a major upgrade to Apple’s Visual Intelligence system. Apple says the updated Siri will include stronger image understanding and broader multimodal support.
That means Siri can combine visual input with a user’s request, rather than relying only on spoken or typed instructions. The result is a more direct interaction style, especially when people want quick answers without describing an object in detail.
The move also reflects Apple’s broader direction in blending AI with core device functions. The camera is no longer just for photos and video, but also for finding information and completing tasks.
Apple is extending the feature beyond iPhone
Apple says Visual Intelligence with Siri will also come to iPad and Mac later this year. The experience is designed to support visual search, questions, and actions based on what appears on screen.
On iPad, the feature can be accessed through the screenshot tool so users can focus on a specific part of the display. On Mac, Apple is planning a dedicated keyboard shortcut to make the visual tools easier to launch.
Apple is also bringing Visual Intelligence to Apple Vision Pro. There, users can ask Siri about what they see, from content inside app windows to physical objects around them.
Part of Apple’s wider OS update cycle
The new Siri and Visual Intelligence capabilities will arrive through iOS 27, iPadOS 27, macOS 27, and visionOS 27. Apple introduced the updates at WWDC 2026 as part of its latest operating system lineup.
The company also unveiled iPadOS 27 and macOS 27 at the same event. Across the set of updates, the focus is clearly on Siri and a wider rollout of Apple Intelligence across more devices.
Apple is also adding Writing Tools that work with Siri. The feature lets users write with help from Siri AI in nearly any place where they are typing.
Siri AI will also get a dedicated app designed to help users revisit conversations across Apple products. Together, these additions show that Apple’s Siri overhaul is moving beyond the camera and into productivity and continuity between devices.
Supported devices
Apple says Apple Intelligence will be supported on iPhone 16 models and later. Support also includes iPhone 15 Pro and iPhone 15 Pro Max.
That compatibility matters because not every iPhone will get the full set of new AI features. The camera-based Siri experience will therefore depend on whether the device meets Apple’s requirements.
With this approach, Apple is shaping Siri into a more active assistant for everyday situations. Whether the camera is pointed at a bill, a meal, a screen, or a nearby object, Siri is being set up not just to explain what is visible, but to help users take the next step.
