Show HN: ChainFactory – Run Structured LLM Inference with Easy Parallelism https://ift.tt/mJSBAOl

Ads by Eonads

Show HN: ChainFactory – Run Structured LLM Inference with Easy Parallelism Hi HN! Disclaimer: I submitted another post about ChainFactory a few days ago. Here's what has changed since: - Added hash based caching of auto-generated prompts and masks. - Did some internal restructuring and cleanup. - Updated the order in which README doc introduces concepts and terminology. Posting this again because honestly, I am kinda puzzled about what to add/fix/change due to having 0 users and no genuine feedback. By genuine feedback, I mean feedback from strangers who do not have a social pressure to be polite and pull punches. Please take a look if you find this interesting and leave a comment. If you think it's an deranged or stupid idea not worth your time, please at least leave a 'no' - I'd still be delighted as it's an honest opinion. Thanks a lot! PS: Is it okay to post updates and changes at regular intervals? https://ift.tt/H65a2ip July 30, 2024 at 07:18AM