Show HN: Protobuf Based Schema Centric Logging Framework https://ift.tt/qBo0EXg

Ads by Eonads

Show HN: Protobuf Based Schema Centric Logging Framework Hi HN, have been working on this as a side project, would appreciate any feedback :) LogUnify is built around schemas based on protobuf and all the events in LogUnify are structured. By schematizing events, we offer the following benefits: - Consistency: All the events across all platforms and languages are produced in a uniform way with the generated type-safe SDKs, which ensures data consistency from the root. - Shared Understanding: Event schemas with rich data types and metadata are self-explained, which enables different departments from developers to business stakeholders to share the same understanding when consuming the events. - Flexibility: LogUnify offers flexibility in terms of integrating with different systems, as the schemas can be easily converted into different formats and protocols without requiring dedicated transformations from developers. The platform currently offers seamless integration with BigQuery and is expanding to support other systems. - Reliability: Structured events are more reliable as they are logged in the desired format from the start by developers who have full control over the producing logic. While traditional solutions require developers to log events in an unstructured manner and then set up the transformation on the server side. Data Analysis: Structured events enable better and more accurate data analysis naturally, as they provide a standardized and consistent format that can be easily processed and analyzed using various data analysis tools and techniques. https://ift.tt/BxHSRlv October 27, 2023 at 11:04PM