Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature: Update Tika and text components to process derivative images extracted from PDFs. #266

Merged
merged 30 commits into from
Jul 14, 2022
Merged

Feature: Update Tika and text components to process derivative images extracted from PDFs. #266

merged 30 commits into from
Jul 14, 2022

Commits on Jun 28, 2021

  1. Updating Tika and Tesseract components to process derivative media.

    @hhuangMITRE
    hhuangMITRE committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    b766694 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2021

  1. Update text extraction components to skip any generic feed-forward TE… 

    …XT tracks.
    @hhuangMITRE
    hhuangMITRE committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    b8c5664 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' of https://github.com/openmpf/openmpf-components… 

    … into feature/tika-pdf-tesseract-pipeline
    @hhuangMITRE
    hhuangMITRE committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    e83a992 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2021

  1. Cleanup.

    @jrobble
    jrobble committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    a6d5e20 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2021

  1. WIP.

    @jrobble
    jrobble committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    a275274 View commit details
    Browse the repository at this point in the history

  2. Now use FACECV.

    @jrobble
    jrobble committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    a78f1ef View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2021

  1. Merge branch 'develop' into jrobble/tika-pdf-tesseract-pipeline

    @jrobble
    jrobble committed Aug 9, 2021
    Configuration menu
    Copy the full SHA
    9041874 View commit details
    Browse the repository at this point in the history

  2. Revert some changes.

    @jrobble
    jrobble committed Aug 9, 2021
    Configuration menu
    Copy the full SHA
    8adcf55 View commit details
    Browse the repository at this point in the history

  3. Cleanup merge. Fix tests.

    @jrobble
    jrobble committed Aug 9, 2021
    Configuration menu
    Copy the full SHA
    d5cf75f View commit details
    Browse the repository at this point in the history

  4. Save in "derivatives" dir instead of "artifacts" dir.

    @jrobble
    jrobble committed Aug 9, 2021
    Configuration menu
    Copy the full SHA
    7a10fe8 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2021

  1. Add task merging.

    @jrobble
    jrobble committed Aug 10, 2021
    Configuration menu
    Copy the full SHA
    a819c4e View commit details
    Browse the repository at this point in the history

  2. Switch from DERIVATIVE_MEDIA_URI to DERIVATIVE_MEDIA_PATH.

    @jrobble
    jrobble committed Aug 10, 2021
    Configuration menu
    Copy the full SHA
    66e0337 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2021

  1. Move source-only and derivative-only actions, tasks, and pipelines in… 

    …to the correct descriptor.json files.
    @jrobble
    jrobble committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    201fd48 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2021

  1. Code cleanup, fix UUID issue, and remove unused job parameter.

    @hhuangMITRE
    hhuangMITRE committed Aug 30, 2021
    Configuration menu
    Copy the full SHA
    25909ce View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2021

  1. Documentation update.

    @hhuangMITRE
    hhuangMITRE committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    37c5357 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2022

  1. Use DERIVATIVE_MEDIA_TEMP_PATH.

    @jrobble
    jrobble committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    0ba824f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into feature/tika-pdf-tesseract-pipeline

    @jrobble
    jrobble committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    82e1597 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2022

  1. Test tika changes (#297) 

    Co-authored-by: Brian Rosenberg <brosenberg@mitre.org>
    @jrobble @brosenberg42
    jrobble and brosenberg42 committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    ef42fdf View commit details
    Browse the repository at this point in the history

  2. Improve extension detection.

    @jrobble
    jrobble committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    2710dd0 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2022

  1. Update tests for new document formats.

    @jrobble
    jrobble committed Jul 5, 2022
    Configuration menu
    Copy the full SHA
    d294aa2 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2022

  1. Fix test.

    @jrobble
    jrobble committed Jul 6, 2022
    Configuration menu
    Copy the full SHA
    de78315 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2022

  1. Refactor.

    @jrobble
    jrobble committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    11531eb View commit details
    Browse the repository at this point in the history

  2. Refactor.

    @jrobble
    jrobble committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    217a97d View commit details
    Browse the repository at this point in the history

  3. Minor update.

    @jrobble
    jrobble committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    ab7a10f View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2022

  1. Update text tests for new document formats.

    @jrobble
    jrobble committed Jul 8, 2022
    Configuration menu
    Copy the full SHA
    873e1f0 View commit details
    Browse the repository at this point in the history

  2. Remove blanket catch clause.

    @jrobble
    jrobble committed Jul 8, 2022
    Configuration menu
    Copy the full SHA
    9013988 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2022

  1. Use PAGE_NUM = -1 where appropriate.

    @jrobble
    jrobble committed Jul 9, 2022
    Configuration menu
    Copy the full SHA
    d893dc0 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2022

  1. Fix ODP test.

    @jrobble
    jrobble committed Jul 11, 2022
    Configuration menu
    Copy the full SHA
    829b9aa View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2022

  1. Remove leading 0's to PAGE_NUM and SECTION_NUM.

    @hhuangMITRE
    hhuangMITRE committed Jul 12, 2022
    Configuration menu
    Copy the full SHA
    7ae11fe View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2022

  1. Updating Tika (and associated PDF parser code) to version 2.4.1. (#298) 

    Co-authored-by: jrobble <jrobble@mitre.org>
    @hhuangMITRE @jrobble
    hhuangMITRE and jrobble committed Jul 13, 2022
    Configuration menu
    Copy the full SHA
    de8edad View commit details
    Browse the repository at this point in the history