Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parsing from (un)compressed Streams. #220

Merged
merged 3 commits into from
Apr 5, 2019

Commits on Apr 4, 2019

  1. Several Improvements to the turtle parser

    - Made BZIP2 parsing work efficiently (the decompression is done in parallel in chunks so we have almost no overhead)
      This allows us to pipe in from wget, bzip2, etc...
    - Allowed redirecting the LOG(...) macros to another stream. Useful if we want to use stdout for the triple output (piping).
      (In this case we can redirect to stderr)
    
    - IndexBuilder and TurtleParser now take two arguments: one for the input file, and one for its format.
      If the input file is empty or "-" we parse from stdin, if the file format is empty, we try to decide on the
      file extension, else we assume turtle.
    
    - Moved many of the longer parsing methods from the header to the cpp file to keep the structure clean
    - Completely got rid of BZIP2, since we can pipe in now.
    joka921 committed Apr 4, 2019
    Configuration menu
    Copy the full SHA
    fdf3723 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d523959 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    455c1b5 View commit details
    Browse the repository at this point in the history