OpenAI new Realtime API

Hi there,
Today OpenAI released their new API, which is multi modal GenAI. It has the famous adavnced voice mode. But it seems the API is in java and not python. Does anyone know how to use that in streamlit?
Here’s the link to their explaintion page: https://platform.openai.com/docs/guides/realtime

Thank you!

1 Like

Hi! Check out this GitHub repo by mdagost: openai-realtime-streamlit. He implemented it using websockets in Streamlit. Super handy example!

2 Likes

Checkout my implementation. This implementation uses JavaScript with WebRTC to handle real-time audio streaming directly in the browser.

1 Like