OpenAI updates ChatGPT to let AI tool 'see, hear and speak'

foxbusiness.com:

Fox News medical contributor Dr. Marc Siegel discusses ChatGPT's accuracy in making medical decisions on 'The Big Money Show.'

OpenAI is updating the capabilities of ChatGPT to allow the artificial intelligence (AI) tool to «see, hear, and speak» in the latest upgrades to the viral chatbot.

OpenAI is rolling out updates that will allow ChatGPT to understand verbal prompts and respond in a back-and-forth conversation with the user using the chatbot’s new voice. The chatbot will also be able to respond to image prompts. The changes give ChatGPT capabilities more along the lines of those supported by Siri; Google Lens and voice assistant; and Amazon’s Alexa.

«Voice and image give you more ways to use ChatGPT in your life,» OpenAI said in the announcement. «Snap a picture of a landmark while traveling and have a live conversation about what’s interesting about it. When you’re home, snap pictures of your fridge and pantry to figure out what’s for dinner (and ask follow-up questions for a step-by-step recipe). After dinner, help your child with a math problem by taking a photo, circling the problem set, and having it share hints with you.»

WHAT IS CHATGPT?

OpenAI is updating ChatGPT to allow the AI tool to see, hear and speak in its interactions with users. (LIONEL BONAVENTURE/AFP via Getty Images / Getty Images)

ChatGPT’s new voice capability is powered by a text-to-speech model capable of generating human-like audio from text and a few seconds of sample speech. 

The company also used professional voice actors to create its voices and utilizes OpenAI’s open-source speech recognition system called Whisper to transcribe spoken words into text.

WHAT IS ARTIFICIAL INTELLIGENCE (AI)?

ChatGPT's new voice capabilities will be