OpenAI announces: ChatGPT now has voice, hearing and even vision; understand

A OpenAI recently unveiled a series of innovative features for the ChatGPT that promise to revolutionize digital interaction, enabling you to speak, listen and even understand images.

The advanced text-to-speech model now allows ChatGPT to reproduce human voices with impressive accuracy.

ChatGPT now has voice, hearing and vision

This voice ability opens the door to more natural and engaging communication with AI. Furthermore, the introduction of image recognition gives the chatbot a deeper understanding of queries, making interactions with ChatGPT even richer and more informative.

To enable speech functionality, the OpenAI collaborated with renowned voice actors to create five distinct voice tones, giving ChatGPT a variety of authentic intonations.

In an innovative partnership with Spotify, OpenAI has made it possible for the platform’s podcasters to translate their shows from English into Spanish, French or German, while maintaining their original voice.

Image: OpenAI/Reproduction

This promises to open new horizons for the accessibility and global reach of podcasts, with contributions from well-known figures such as Dax Shepard, Monica Padman, Lex Fridman, Bill Simmons and Steven Bartlett.

The update that incorporates the ability to process images is made possible by the integration of ChatGPT with DALL-E 3, also developed by OpenAI.

With the addition of these speaking, hearing, vision, and voice and image understanding abilities, ChatGPT transforms into a truly multimodal AI.

Image: OpenAI/Reproduction

These advancements not only greatly expand the usefulness of ChatGPT, but also point to a future in which AI platforms can have a more complete understanding of the world around them.

However, OpenAI is fully aware of the challenges and risks associated with making ChatGPT multimodal. Therefore, the rollout of these features will be gradual and carefully monitored.

The ChatGPT update will be available to Plus and Enterprise subscribers in the coming weeks, with support for Android and Android apps. iOSdemonstrating OpenAI’s commitment to ensuring a safe transition to these innovative technologies.

In relation :  ChatGPT announces long-awaited feature for premium users