Today: 24 May 2025
26 September 2023
2 mins read

OpenAI’s ChatGPT can now see, hear and speak

Image understanding is powered by multimodal GPT-3.5 and GPT-4. These models apply their language reasoning skills to a wide range of images, such as photographs, screenshots, and documents containing both text and images…reports Asian Lite News

Sam Altman-run OpenAI on Monday announced it is rolling out new voice and image capabilities in ChatGPT that can now help the AI chatbot see, hear and speak.

These capabilities offer a new, more intuitive type of interface by allowing you to have a voice conversation or show ChatGPT what you’re talking about, the company said in a statement.

“Voice mode and vision for chatGPT! really worth a try,” Altman posted on X. The company said it is rolling out voice and images in ChatGPT to Plus and Enterprise users over the next two weeks.

“Voice is coming on iOS and Android (opt-in in your settings) and images will be available on all platforms,” said the Microsoft-backed company. The new voice capability is powered by a new text-to-speech model, capable of generating human-like audio from just text and a few seconds of sample speech.

“We collaborated with professional voice actors to create each of the voices. We also use Whisper, our open-source speech recognition system, to transcribe your spoken words into text,” said OpenAI.

Image understanding is powered by multimodal GPT-3.5 and GPT-4. These models apply their language reasoning skills to a wide range of images, such as photographs, screenshots, and documents containing both text and images.

The new voice technology opens doors to many creative and accessibility-focused applications. However, “these capabilities also present new risks, such as the potential for malicious actors to impersonate public figures or commit fraud,” the company noted.

“This is why we are using this technology to power a specific use case — voice chat. Voice chat was created with voice actors we have directly worked with,” it added. Spotify is using the power of this technology for the pilot of their Voice Translation feature, which helps podcasters expand the reach of their storytelling by translating podcasts into additional languages in the podcasters’ own voices.

“We’ve also taken technical measures to significantly limit ChatGPT’s ability to analyze and make direct statements about people since ChatGPT is not always accurate and these systems should respect individuals’ privacy,” said the company.

ALSO READ-Twitter seizes @x handle without warning or paying owner

Previous Story

EAM holds bilateral with Madagascar counterpart

Next Story

Google to shut Basic HTML version of Gmail in Jan 2024

Latest from -Top News

UAE bakery aid reaches Gaza

The convoy is a crucial component of the UAE’s ongoing humanitarian strategy under Operation Chivalrous Knight 3, which prioritises urgent food aid. A major humanitarian relief convoy has successfully entered the Gaza

Tech giants unite for Stargate UAE

This marks the beginning of a strategic partnership involving G42, OpenAI, Oracle, NVIDIA, Cisco, and SoftBank Group, all coming together under the banner of international AI leadership. In a landmark announcement that

‘Make It in Emirates’ boosts Dh11b projects

The event welcomed more than 122,000 visitors — a 20-fold increase over its previous edition — and drew participation from over 720 local and international industrial, financial, and technology entities. The fourth

UAE leads Arab health push in Genevaa

UAE Health Minister Al Owais highlights Arab unity at WHO Assembly, reaffirming commitment to global health, crisis response, and sustainable healthcare innovation for the future. The UAE underscored its regional leadership in

Will tackle terrorism together: UAE backs India 

The UAE reaffirmed strong support for India’s fight against terrorism during a high-level Indian delegation visit, highlighting shared security goals and condemning cross-border terrorism after the Pahalgam attack. In a powerful show
Go toTop

Don't Miss

Meet Pragya Misra, OpenAI’s First India Hire

Misra, who earlier worked at Meta-owned WhatsApp and caller identification

OpenAI’s ChatGPT finally enters classrooms in US

The three key areas of concentration include: enhancing student success,