Show HN: Patchwork – Open-source framework to automate development gruntwork Hi HN! We’re Asankhaya and Rohan and we are building Patchwork. Patchwork tackles development gruntwork—like reviews, docs, linting, and security fixes—through customizable, code-first 'patchflows' using LLMs and modular code management steps, all in Python. Here's a quick overview video: https://youtu.be/MLyn6B3bFMU From our time building DevSecOps tools, we experienced first-hand the frustrations our users faced as they built complex delivery pipelines. Almost a third of developer time is spent on code management tasks[1], yet backlogs remain. Patchwork lets you combine well-defined prompts with effective workflow orchestration to automate as much as 80% of these gruntwork tasks using LLMs[2]. For instance, the AutoFix patchflow can resolve 82% of issues flagged by semgrep using gpt-4 (or 68% with llama-3.1-8B) without fine-tuning or providing specialized context [3]. Success rates are higher for text-based patchflows like PR Review and Generate Docstring, but lower for more complex tasks like Dependency Upgrades. We are not a coding assistant or a black-box GitHub bot. Our automation workflows run outside your IDE via the CLI or CI scripts without your active involvement. We are also not an ‘AI agent’ framework. In our experience, LLM agents struggle with planning and rarely identify the right execution path. Instead, Patchwork requires explicitly defined workflows that provide greater success and full control. Patchwork is open-source so you can build your own patchflows, integrate your preferred LLM endpoints, and fully self-host, ensuring privacy and compliance for large teams. As devs, we prefer to build our own ‘AI-enabled automation’ given how easy it is to consume LLM APIs. If you do, try patchwork via a simple 'pip install patchwork-cli' or find us on Github[4]. Sources: [1] https://ift.tt/3wcBC5t... [2] https://ift.tt/LlpIvis... [3] https://ift.tt/OQfrKJT [4] https://ift.tt/89o7aLB [Sample PRs] https://ift.tt/t7pVFZO https://ift.tt/89o7aLB July 27, 2024 at 02:04AM
Show HN: Patchwork – Open-source framework to automate development gruntwork https://ift.tt/v8fSNac
Related Articles
Show HN: Interactive Demo of a Tag-Based Bookmark Manager https://ift.tt/C8osm9jShow HN: Interactive Demo of a Tag-Based Bookmark Manager https://ift.… Read More
Show HN: Llm.f90 fast, hackable transformer implementation in Fortran https://ift.tt/AR9eCrLShow HN: Llm.f90 fast, hackable transformer implementation in Fortran … Read More
Show HN: Docker Swarm Multi Tenant Proxy https://ift.tt/Ze3BHOSShow HN: Docker Swarm Multi Tenant Proxy You might know this issue wit… Read More
Show HN: "Interactive LinkedIn profile" for better networking/job hunting https://ift.tt/HX3S7K9Show HN: "Interactive LinkedIn profile" for better networking/job hunt… Read More
Show HN: Bitemporal, Binary JSON Database System and Event Store https://ift.tt/Sy6Ro1UShow HN: Bitemporal, Binary JSON Database System and Event Store I had… Read More
Show HN: LoRA Tune LLM in Lightning on GPU https://ift.tt/6v0VC5QShow HN: LoRA Tune LLM in Lightning on GPU https://ift.tt/E7AbLl6 Nove… Read More
Show HN: GPT-4-Vision UX audit for your landing page (relaunch) https://ift.tt/cBFP8HEShow HN: GPT-4-Vision UX audit for your landing page (relaunch) Last w… Read More
Show HN: Twogether AI – Multi-Person Photo Generation API https://ift.tt/w37nhzSShow HN: Twogether AI – Multi-Person Photo Generation API Hey everyone… Read More
0 Comments: