14-Huge Improvements to Meta AI Include Voice Chat and AI Photo Editing

The Llama 3.2 multimodal models 11B and 90B have been released, opening up additional applications for Meta’s AI chatbot. The business unveiled a number of new Meta AI technologies at the Meta Connect 2024 event that let consumers engage with different modalities like voice and pictures.

Communicate with Meta AI.

First and importantly, Meta AI can now be spoken to by speech, and it will respond aloud. You are free to ask questions on anything and to carry on the conversation. The finest thing is that it can search the internet and get even the most recent information.

Although it lacks the conversational quality of ChatGPT Advanced audio and Gemini Live, it still has a conventional two-way audio chat interface. Interruptions are not supported, though.

The release of ChatGPT Advanced Voice Mode to users began today, therefore the timing of this announcement couldn’t be more ideal. Via the Meta AI chatbot on Facebook, Instagram Direct Message, WhatsApp, and Messenger, Meta Voice conversation is accessible. You have the option to select from a variety of AI voices, including those of famous people like Dame Judi Dench, Awkwafina, John Cena, and Kristen Bell.

You can submit a picture to Meta AI for analysis, as it is now powered by the Llama 3.2 11B and 90B multimodal models. For example, you can upload a picture of a mountain, inquire about its location, and discover more details as you go. Additionally, you have the option to upload diagrams and charts and deduce meaning from your visual input.

AI-Powered Image Editing

Next, Meta AI updates its social media apps with AI photo editing. The AI chatbot can perform several tasks on an uploaded image, such as altering the background, removing undesired items, switching clothes, and more.

Basically, Meta’s social stack—which includes Facebook, Instagram, WhatsApp, and Messenger—now has easy access to AI photo editing. It functions similarly to Google’s Magic Editor, except you can share them as stories and access it directly from within your social network apps.

Make Your Own AI Images

The best part is that you can now make AI-generated portraits of yourself with the Reimagine AI tool. By adding a prompt, you may instantly rethink your feed, stories, and Facebook profile images. Meta AI will then create an image based on your suggestion. It implies that in order to develop AI-generated photographs of oneself, you do not need to train your images using LoRA.

Devinder, my supervisor and coworker, is attending Meta Connect 2024 in Palo Alto. He had the opportunity to experiment with WhatsApp’s new Meta AI feature firsthand and produce some amazing images.

AI-Powered Reel Translation

Finally, the automatic translation of Reels is one of the intriguing aspects of Meta AI. If a creator has released a Reel in a language you don’t understand, Meta AI will automatically translate the audio, ensuring flawless lip-synch. The functionality is currently only available in English and Spanish in the US and Latin America. According to Meta, additional languages and locations will soon be able to use the service.

Next, depending on user interest or current trends, users of Facebook and Instagram may see Meta AI-generated photographs in their user feeds. In order to create fresh content for your feed, you may also modify the prompt. Finally, users will be able to customize themes in their private direct messages by utilizing AI.

These then are the new Meta AI features that will be available on Facebook, Instagram, WhatsApp, and Messenger. Are you eager to explore them? Tell us in the comments section below.