Apple has finally introduced ton of new AI updates coming to iPhone, iPad and Mac. These include a brand new AI model called Apple intelligence as well as ChatGPT integration across all Apple devices.
Here is the full breakdown.
1. Apple Intelligence - New AI from Apple
Language and Text Creation:
- Creates language and text using large language models.
- Powered by brand new writing tools.
- Ability to rewrite and summarize text within Mail, Pages, and third-party apps.
Image Creation:
- Capable of creating images.
- Personalizes images using access to your photo library.
- Supports sketching, illustration, and animation.
2. Actions:
Cross-App Actions:
- Take actions across your apps.
- Example: Pull up files shared with you.
- Example: Play the podcast your wife sent the other day.
3. Personal Context:
Contextual Retrieval:
- Retrieves and analyzes context from your different apps.
4. Privacy:
On-Device Intelligence:
- Utilizes on-device intelligence.
- Employs private cloud compute.
- Models run on Apple Silicon servers designed for this purpose.
- Tries to process on-device first; if more compute is needed, it sends to the private cloud compute.
5. Siri:
5.1. Enhanced Natural Interaction:
- More natural, relevant, and personal.
- Offers Type to Siri functionality.
- Allows switching between text and voice.
5.2. On-Screen Awareness:
- Siri can see what's on your screen and use the content as needed.
5.3. Siri Actions:
- Example: "Show me my photos and make them pop."
- Example: "Add this to my note with bio."
6. App Intents:
6.1. New Framework:
- Apps can define a set of actions for Siri and Apple Intelligence to take advantage of.
6.2. Siri Updates:
- Updates coming to Mac and iPad.
7. System-Wide Writing Tools:
Capabilities:
- Rewrite text.
- Proofread documents.
- Change tone of writing.
- Summarize content.
8. Email Features:
8.1. Smart Reply:
- Offers smart replies in Mail.
8.2. Email Summarization:
- Provides email summaries at the top of your inbox.
- Allows tapping to get a summary of long emails.
- Prioritizes emails based on their context.
8.3. Notification Management:
- Prioritizes notifications and offers summaries.
- Reduces interruptions by surfacing only essential notifications.
9. AI in Messages:
Genmoji:
- Create AI-generated emojis (Genmoji) based on descriptions.
- Create Genmoji that resemble people in your contacts using your photo library.
10. Image Playground:
10.1. On-Device Image Creation:
- Create as many images as you want on-device.
- Integration within Pages, Keynote, and Numbers.
10.2. Image Playground App:
- Dedicated app for creating images.
10.3. Image Playground API:
- API available for developers.
11. Image Wand in Notes App:
Sketch to images:
- Turns sketches into images.
12. Photo Editing Updates:
12.1. Clean-Up Tool:
- Tools to improve your images.
12.2. Natural Language Search:
- Search for photos and videos using natural language.
12.3. Memory Movies:
- Create movies based on your photos and videos using prompts.
13. Notes App Enhancements:
Audio Features:
- Record and transcribe audio.
- Provides summaries of recordings.
14. ChatGPT Integrations:
14.1. Siri Integration:
- ChatGPT integrated into Siri.
14.2. Content Creation:
- Create content with ChatGPT in Pages using the compose feature.
14.3. Access and Features:
- Free access to ChatGPT.
- Paid subscribers have access to additional features on Mac.
15. Availability:
- Available this summer.
- Public beta coming in iOS 18 this fall.
Access Top Courses on ChatGPT and 50+ AI Tools on Our E-Learning Platform: bit.ly/skillleap
9 июн 2024
