You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
After outlining the individual commands, we should think about the data transformation that this CLI tool will do. Specifically, how are the data structures from the ingestion system transformed to the outputs sent to BigQuery? Investigating the former will build familiarity with the ingestion system. It's also likely more technically complex than the latter, which will most likely be a basic serialization/deserialization using an appropriate existing framework.
So, with that in mind, here's a checklist of the different data structures to track. In comments on this issue, you should indicate (1) which function from the ingestion system's ledgerbackend package you would call in implementation; (2) the data structure that that results in; and (3) the struct you eventually want to output to BQ. This will also help us figure out which command-line tools have more direct implementations from the ingestion system, and which require more work.
After outlining the individual commands, we should think about the data transformation that this CLI tool will do. Specifically, how are the data structures from the ingestion system transformed to the outputs sent to BigQuery? Investigating the former will build familiarity with the ingestion system. It's also likely more technically complex than the latter, which will most likely be a basic serialization/deserialization using an appropriate existing framework.
So, with that in mind, here's a checklist of the different data structures to track. In comments on this issue, you should indicate (1) which function from the ingestion system's
ledgerbackend
package you would call in implementation; (2) the data structure that that results in; and (3) the struct you eventually want to output to BQ. This will also help us figure out which command-line tools have more direct implementations from the ingestion system, and which require more work.The text was updated successfully, but these errors were encountered: