Show HN: ChainFactory – Run Structured LLM Inference with Easy Parallelism Hi HN! Disclaimer: I submitted another post about ChainFactory a few days ago. Here's what has changed since: - Added hash based caching of auto-generated prompts and masks. - Did some internal restructuring and cleanup. - Updated the order in which README doc introduces concepts and terminology. Posting this again because honestly, I am kinda puzzled about what to add/fix/change due to having 0 users and no genuine feedback. By genuine feedback, I mean feedback from strangers who do not have a social pressure to be polite and pull punches. Please take a look if you find this interesting and leave a comment. If you think it's an deranged or stupid idea not worth your time, please at least leave a 'no' - I'd still be delighted as it's an honest opinion. Thanks a lot! PS: Is it okay to post updates and changes at regular intervals? https://ift.tt/H65a2ip July 30, 2024 at 07:18AM
Show HN: ChainFactory – Run Structured LLM Inference with Easy Parallelism https://ift.tt/mJSBAOl
Related Articles
Show HN: I created an extension for direct streaming of videos, bypassing ads https://ift.tt/ytksL0rShow HN: I created an extension for direct streaming of videos, bypass… Read More
Show HN: Lume – automate data mappings using AI https://ift.tt/3XyCZiPShow HN: Lume – automate data mappings using AI Hi HN! I'm Nicolas, co… Read More
Show HN: Eliminate video buffering with a Chrome extension https://ift.tt/HwoZMYaShow HN: Eliminate video buffering with a Chrome extension This extens… Read More
Show HN: Telemetry – Predict when you'll reach your goals https://ift.tt/ymBJe6QShow HN: Telemetry – Predict when you'll reach your goals Hey HN! I've… Read More
Show HN: Online RPG Game with AI being dungeon master https://ift.tt/jB7u1WOShow HN: Online RPG Game with AI being dungeon master Hi I've created … Read More
Show HN: Open-Source AI Adventure Game https://ift.tt/VMTC1sWShow HN: Open-Source AI Adventure Game Hi HN! I'd love your feedback f… Read More
Show HN: Biblos – Semantic Search the Church Fathers https://ift.tt/5Rx4WPeShow HN: Biblos – Semantic Search the Church Fathers I'm pleased to pr… Read More
Show HN: Launch your product within hours https://ift.tt/oRYf0BHShow HN: Launch your product within hours https://shipped.club/ Decemb… Read More
0 Comments: