Show HN: I open-sourced my AI toy company that runs on ESP32 and OpenAI realtime https://ift.tt/M2eQd0Y

Show HN: I open-sourced my AI toy company that runs on ESP32 and OpenAI realtime https://ift.tt/M2eQd0Y

Show HN: I open-sourced my AI toy company that runs on ESP32 and OpenAI realtime Hi HN! Last year the project I launched here got a lot of good feedback on creating speech to speech AI on the ESP32. Recently I revamped the whole stack, iterated on that feedback and made our project fully open-source—all of the client, hardware, firmware code. This Github repo turns an ESP32-S3 into a realtime AI speech companion using the OpenAI Realtime API, Arduino WebSockets, Deno Edge Functions, and a full-stack web interface. You can talk to your own custom AI character, and it responds instantly. I couldn't find a resource that helped set up a reliable, secure websocket (WSS) AI speech to speech service. While there are several useful Text-To-Speech (TTS) and Speech-To-Text (STT) repos out there, I believe none gets Speech-To-Speech right. OpenAI launched an embedded-repo late last year which sets up WebRTC with ESP-IDF. However, it's not beginner friendly and doesn't have a server side component for business logic. This repo is an attempt at solving the above pains and creating a great speech to speech experience on Arduino with Secure Websockets using Edge Servers (with Deno/Supabase Edge Functions) for fast global connectivity and low latency. https://ift.tt/eLFf7Sm April 22, 2025 at 07:40PM

Related Articles

0 Comments: