Apple has announced the next generation of Apple Intelligence, introducing a significantly upgraded AI system that brings photorealistic image generation, enhanced photo editing tools, and a completely redesigned Siri experience across all Apple devices.
The updated system represents Apple’s biggest AI push yet, integrating advanced Foundation Models directly into iOS, iPadOS, macOS, watchOS, and visionOS. The improvements touch nearly every aspect of the Apple ecosystem, from automatic tab organization in Safari to AI-powered home security monitoring.
This announcement comes as Apple faces increasing pressure to compete with AI leaders like OpenAI and Google. The company’s partnership with Google for certain AI capabilities shows a pragmatic approach to catching up in the AI race while maintaining its privacy-focused brand identity.
Major photo editing overhaul with AI watermarking
The Photos app receives several powerful new editing capabilities powered by improved image models. The standout feature is Spatial Reframing, which lets users adjust photo composition after capture by touching and dragging to shift perspective as if repositioning the original camera.
Other new photo editing tools include:
- Extend tool for expanding images and adjusting aspect ratios without cropping
- Enhanced Clean Up tool for removing distractions with better quality infill
- Automatic SynthID watermarking for AI-edited photos to identify modifications
These editing capabilities address growing concerns about AI-manipulated imagery by building transparency directly into the system. The hidden watermarking ensures edited photos can be identified without interfering with the user experience.
Safari gets smarter with tab organization and monitoring
Web browsing becomes more intelligent with several new Safari features. The browser can now automatically organize tabs into relevant topics, grouping related browsing sessions like travel planning or research projects.
The new Notify Me feature lets users ask Safari to monitor web pages for changes like price drops or product restocks. When changes are detected, users receive notifications to take action.
Perhaps most notably, the Passwords app can now automatically update weak passwords by navigating websites and changing credentials on the user’s behalf. Users can also create custom Safari extensions simply by describing what they want the extension to do.
Photorealistic Image Playground transforms creativity
Image Playground receives a major upgrade with the ability to generate photorealistic images, not just stylized illustrations. The feature runs on Private Cloud Compute and automatically includes SynthID watermarks to identify AI-generated content.
Users can create images for Lock Screen wallpapers, Contact Posters, and Messages backgrounds while choosing specific aspect ratios for different use cases. The interface allows both text descriptions and touch-based editing for modifying generated images.
Smarter communication and home automation
Messages and Mail get more contextual features, including one-tap suggestions based on conversation content. The system can help find specific photos when someone requests them and create reminders or notes from message context.
The Home app becomes more intelligent by grouping related notifications into single activities and generating video descriptions for security cameras. Users can search through camera footage and receive highlighted noteworthy clips automatically.
Call Context in the Phone app proactively surfaces relevant information like confirmation codes when calling businesses, running entirely on-device for privacy.
Enhanced accessibility and system-wide improvements
VoiceOver receives significant upgrades for users who are blind or have low vision, providing richer image descriptions and improved environmental recognition through the Action button on iPhone.
Voice Control becomes more intuitive, letting users describe interface elements naturally instead of memorizing specific labels. The Accessibility Reader now works with more complex content and provides on-demand summaries.
System-wide improvements include better spell check and grammar suggestions, intelligent file naming based on content, and expanded language support for Workout Buddy on Apple Watch.
Privacy-first architecture with Google partnership
The new capabilities run on Apple’s Foundation Models, built in collaboration with Google’s Gemini models. Processing happens both on-device and through Private Cloud Compute, which Apple says ensures personal data is never stored or accessible to the company.
Independent experts can verify Apple’s privacy claims at any time. The architecture represents Apple’s attempt to offer competitive AI features while maintaining its privacy-focused positioning in the market.
Developer testing begins immediately, with public beta access coming next month. The features will roll out to users this fall with iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27 across supported devices including iPhone 15 Pro models and newer, iPads with M1 chips, and Macs with Apple Silicon.
