[CT-1514] [Feature] Finalize and Merge Binary Logging

[peterallenwebb]

Is this your first time submitting a feature request?

• I have read the expectations for open source contributors
• I have searched the existing issues, and I could not find an existing issue for this feature
• I am requesting a straightforward extension of existing dbt functionality, rather than a Big Idea better suited to a discussion

Describe the feature

We created a binary structured-logging prototype in branch for issue #6138 and are now ready to incorporate feedback and merge the branch. In order to complete the work, we will:

• Encode event blocks using Consistent Overhead Byte Stuffing. This will provide the ability to recover from errors in the event stream, make it easier to document the format, and allow downstream consumers to use standard protobuf and COBS libraries for processing.
• Work with Gerda to finalize message modeling in protobuf, preferring to use a single message type to frame more specific messages, so that we can use the simplest format possible and guarantee binary format stability in the future.

Describe alternatives you've considered

No response

Who will this benefit?

No response

Are you interested in contributing this feature?

No response

Anything else?

No response

[github-actions]

This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please comment on the issue or else it will be closed in 7 days.

[github-actions]

Although we are closing this issue as stale, it's not gone forever. Issues can be reopened if there is renewed community interest. Just add a comment to notify the maintainers.