Skip to content

Save loki-build status messages into a log file in csv format #17

@van-truong

Description

@van-truong

Is your feature request related to a problem? Please describe.
Currently loki-build prints out status messages in the terminal command-line, but these outputs don't appear to be saved to a log file. The strings are not easy to parse either.

Describe the solution you'd like

  • Change the string structure for status messages when running loki-build. Turn it into a pattern that will be easier to parse or for users to check their DB build quality & completeness especially if it gets interrupted
  • Possible format: Start datetime, Database source, Filename, Process, End datetime
  • Print status messages on command-line AND write to a csv text file

Describe alternatives you've considered
Tried to write a bash script to parse the current free form string messages but some lines break due to unpredictable indents, non-uniform string/message structure, etc

Additional context
Attaching example files
20240728_log-messages-and-times-for-loki-parallel-downloads-BLJ.txt
20240730_loki-downloading-output-parsed-by-van.csv

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions