Show HN: Inngest 1.0 – Open-source durable workflows on every platform https://ift.tt/ncG1BQ9

Ads by Eonads

Show HN: Inngest 1.0 – Open-source durable workflows on every platform Hi HN! I’m Tony, one of the co-founders of Inngest ( https://inngest.com/ ) Inngest is an open-source durable workflow platform that works on any cloud. Durable workflows are stateful, long running step functions written in code, which automatically retry on failure. It abstracts everything about queues, event streams and state for you, letting you focus on code. Some examples of uses: managing stateful AI chained step functions; managing search/rag indexes and data pipelines; integrations and webhooks; billing and payment flows. Technical details: unlike other solutions, we put lots of effort into designing our SDK’s step.run APIs to make them extremely easy to use — developer experience is the most important thing for us. We had to design and build our own queueing system to work with multi-tenancy, batching, and debouncing, and we’re iterating on this as we move to FoundationDB. It’s largely all Go in the backend, with a bunch of caching, clickhouse, event streams, and coordination on our behalf. Workers are shared nothing, and run based off of the queue and execution state. We did a post last year as we iterated on our TS SDK. The product has changed a lot since then and wanted to show the community what’s changed as we reach 1.0: * Golang, Java, and Python SDKs with cross-language function invocation (across clouds, too) * Multi-tenant aware flow control (concurrency, throttling, debounce) * Batching, grouping many events into a single function call * Much improved dashboard, with tracing and metrics built in * Advanced recovery tools like function replay, temporary pausing, bulk cancellation (with optional expressions). No more dead letter queues! * Branch deploys built in, with staging env support out of the box * Full local testing with production parity There's a ton on the roadmap, with more launching next week. We’re hiring systems & infra engineers, too — it’s a fun job with lots of challenges! Wanted to say thank you to the HN community for feedback so far! Happy Friday :) https://ift.tt/s4nidcy September 20, 2024 at 11:03PM