Show HN: Gentrace – connect to your LLM app code and run/eval it from a UI Hey HN - Doug from Gentrace here. We originally launched Gentrace via Show HN in August of 2023. Since then, a million products have emerged in the LLM ops category. And what we've noticed is that almost none of them solve the core workflow: testing prompts, parameters, and other changes in your actual app, from a frontend where people can collaborate on the dataset, evals, or experiments to be run. So, we built that and are relaunching the company around that idea. Gentrace is the collaborative LLM app testing and experimentation platform that brings together engineers, PMs, subject matter experts, and more to run and test your actual end-to-end app. To do this, use our SDK to: - connect your app to Gentrace as a live runner over websocket (local) / via webhook (staging, prod) - wrap your parameters (eg prompt, model, top-k) so they become tunable knobs in the front end - edit the parameters and then run / evaluate the actual app code with datasets and evals in Gentrace We think it's great for tuning retrieval systems, upgrading models, and iterating on prompts. It's free to trial. Would love to hear your feedback / what you think. https://gentrace.ai/ December 11, 2024 at 02:05AM
Show HN: Gentrace – connect to your LLM app code and run/eval it from a UI https://ift.tt/ia3N1Qs
Related Articles
Show HN: We made a fast audio editor for podcasting https://ift.tt/pj9WDPnShow HN: We made a fast audio editor for podcasting https://teapodo.co… Read More
Show HN: Sciagraph, performance+memory profiler for production Python batch jobs https://ift.tt/atpyv0QShow HN: Sciagraph, performance+memory profiler for production Python … Read More
Show HN: Movably – Protect your health, move more while you work https://ift.tt/UZ0vCmXShow HN: Movably – Protect your health, move more while you work https… Read More
Show HN: Piano Trainer – Learn piano scales, chords and more using MIDI https://ift.tt/q8SvT2LShow HN: Piano Trainer – Learn piano scales, chords and more using MID… Read More
Show HN: Copy React code from any site https://ift.tt/8l1LE6YShow HN: Copy React code from any site https://ift.tt/AM4FfSu July 9, … Read More
Show HN: Easily Convert WARC (Web Archive) into Parquet, Then Query with DuckDB https://ift.tt/S4J1Is7Show HN: Easily Convert WARC (Web Archive) into Parquet, Then Query wi… Read More
Show HN: Heat Pump Cost Comparison https://ift.tt/Xt9ES5AShow HN: Heat Pump Cost Comparison https://ift.tt/rWjagBX June 30, 202… Read More
Show HN: Whatcha – the social network for digital media https://ift.tt/nRlFckVShow HN: Whatcha – the social network for digital media https://ift.tt… Read More
0 Comments: