Show HN: I open-sourced my AI toy company that runs on ESP32 and OpenAI realtime Hi HN! Last year the project I launched here got a lot of good feedback on creating speech to speech AI on the ESP32. Recently I revamped the whole stack, iterated on that feedback and made our project fully open-source—all of the client, hardware, firmware code. This Github repo turns an ESP32-S3 into a realtime AI speech companion using the OpenAI Realtime API, Arduino WebSockets, Deno Edge Functions, and a full-stack web interface. You can talk to your own custom AI character, and it responds instantly. I couldn't find a resource that helped set up a reliable, secure websocket (WSS) AI speech to speech service. While there are several useful Text-To-Speech (TTS) and Speech-To-Text (STT) repos out there, I believe none gets Speech-To-Speech right. OpenAI launched an embedded-repo late last year which sets up WebRTC with ESP-IDF. However, it's not beginner friendly and doesn't have a server side component for business logic. This repo is an attempt at solving the above pains and creating a great speech to speech experience on Arduino with Secure Websockets using Edge Servers (with Deno/Supabase Edge Functions) for fast global connectivity and low latency. https://ift.tt/eLFf7Sm April 22, 2025 at 07:40PM
Show HN: I open-sourced my AI toy company that runs on ESP32 and OpenAI realtime https://ift.tt/M2eQd0Y
Related Articles
Show HN: A retrainable subtitle synchronizer you can now build your own https://ift.tt/3tgYDQfShow HN: A retrainable subtitle synchronizer you can now build your ow… Read More
Show HN: Pleke – free personal finance app for Android and iOS https://ift.tt/3oTdNIbShow HN: Pleke – free personal finance app for Android and iOS https:/… Read More
Show HN: Time tracking with plain text files https://ift.tt/3ra3CAsShow HN: Time tracking with plain text files https://ift.tt/3rdEQzk Fe… Read More
Show HN: That $100 you didn't invest in Bitcoin because they said so https://ift.tt/3a2oEvmShow HN: That $100 you didn't invest in Bitcoin because they said so h… Read More
Show HN: M1 Chart – The stock market adjusted for the US-dollar money supply https://ift.tt/3tTfdpMShow HN: M1 Chart – The stock market adjusted for the US-dollar money … Read More
Show HN: I wrote a rust program to translate images into textual line art https://ift.tt/3rj8KT7Show HN: I wrote a rust program to translate images into textual line … Read More
Show HN: Hacker News Discourse turns HN stories into Clubhouse-style audio rooms https://ift.tt/3q8zeGwShow HN: Hacker News Discourse turns HN stories into Clubhouse-style a… Read More
Show HN: Version tracker for graphic designers and artists https://ift.tt/3r6h743Show HN: Version tracker for graphic designers and artists https://ift… Read More
0 Comments: