Show HN: ChainFactory – Run Structured LLM Inference with Easy Parallelism Hi HN! Disclaimer: I submitted another post about ChainFactory a few days ago. Here's what has changed since: - Added hash based caching of auto-generated prompts and masks. - Did some internal restructuring and cleanup. - Updated the order in which README doc introduces concepts and terminology. Posting this again because honestly, I am kinda puzzled about what to add/fix/change due to having 0 users and no genuine feedback. By genuine feedback, I mean feedback from strangers who do not have a social pressure to be polite and pull punches. Please take a look if you find this interesting and leave a comment. If you think it's an deranged or stupid idea not worth your time, please at least leave a 'no' - I'd still be delighted as it's an honest opinion. Thanks a lot! PS: Is it okay to post updates and changes at regular intervals? https://ift.tt/H65a2ip July 30, 2024 at 07:18AM
Show HN: ChainFactory – Run Structured LLM Inference with Easy Parallelism https://ift.tt/mJSBAOl
Related Articles
Show HN: Directional antenna alignment using phone motion sensors https://ift.tt/pRH7GW1Show HN: Directional antenna alignment using phone motion sensors http… Read More
Show HN: Last CLI tool you will need https://ift.tt/6Qj1U9YShow HN: Last CLI tool you will need https://ift.tt/GNaYEhI November 7… Read More
Show HN: GitQuill – free cross-platform GUI for Git, inspired by GitKraken https://ift.tt/PgYK5yHShow HN: GitQuill – free cross-platform GUI for Git, inspired by GitKr… Read More
Show HN: Krixik – Easily sequence small/specialized AI models (pip-installable) https://ift.tt/H8fbrOmShow HN: Krixik – Easily sequence small/specialized AI models (pip-ins… Read More
Show HN: Samsar One Version One is now live https://ift.tt/LEHhnk4Show HN: Samsar One Version One is now live Hi all, 6 months ago I sta… Read More
Show HN: Take a Moment and Breathe https://ift.tt/CjSPbMUShow HN: Take a Moment and Breathe A simple web app to help your breat… Read More
Show HN: HN Push – Web push notifications for top stories on Hacker News https://ift.tt/FZ9bM24Show HN: HN Push – Web push notifications for top stories on Hacker Ne… Read More
Show HN: NewsCatcher's Hyperlocal News API – Granular City-Level News Feeds https://ift.tt/0FE2W1hShow HN: NewsCatcher's Hyperlocal News API – Granular City-Level News … Read More
0 Comments: