Show HN: Grammar Generator App for Llama.cpp https://ift.tt/ZWYviTl

Ads by Eonads

Show HN: Grammar Generator App for Llama.cpp llama.cpp added context-free grammar guided generation functionality. It requires passing a file in a derivative of BNF notation, which gets messy very quickly for things like JSON. To improve the experience, we built a small compiler from TypeScript interfaces to the grammar file format and have it hosted in a little browser app. See more in discussion at https://ift.tt/KxUZeAV https://ift.tt/de7jBD1 August 3, 2023 at 02:09AM