Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enhancement/dataset export #1799

Merged
merged 38 commits into from
Apr 25, 2022
Merged

Enhancement/dataset export #1799

merged 38 commits into from
Apr 25, 2022

Commits on Apr 20, 2022

  1. Install pandas

    @Hironsan
    Hironsan committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    a95030d View commit details
    Browse the repository at this point in the history

  2. Add ExportedCategory model

    @Hironsan
    Hironsan committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    ae19d37 View commit details
    Browse the repository at this point in the history

  3. Add exported model manager

    @Hironsan
    Hironsan committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    9d84164 View commit details
    Browse the repository at this point in the history

  4. Add labels for data export

    @Hironsan
    Hironsan committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    54dc28e View commit details
    Browse the repository at this point in the history

  5. Add dataset class to represent export data

    @Hironsan
    Hironsan committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    bd55097 View commit details
    Browse the repository at this point in the history

  6. Add JoinedCategoryFormatter

    @Hironsan
    Hironsan committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    5985508 View commit details
    Browse the repository at this point in the history

  7. Add formatters for category label

    @Hironsan
    Hironsan committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    a0a3943 View commit details
    Browse the repository at this point in the history

  8. Update constant name in data export

    @Hironsan
    Hironsan committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    a22d0ea View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2022

  1. Update export writers

    @Hironsan
    Hironsan committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    03981d3 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2022

  1. Enable to export dataset

    @Hironsan
    Hironsan committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    aa13d5c View commit details
    Browse the repository at this point in the history

  2. Add span model for export dataset

    @Hironsan
    Hironsan committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    3e63dea View commit details
    Browse the repository at this point in the history

  3. Enable to accept multiple label types in export dataset

    @Hironsan
    Hironsan committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    549e909 View commit details
    Browse the repository at this point in the history

  4. Add test cases for exporting relation data

    @Hironsan
    Hironsan committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    d533896 View commit details
    Browse the repository at this point in the history

  5. Update factories

    @Hironsan
    Hironsan committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    d3b0b47 View commit details
    Browse the repository at this point in the history

  6. Add test cases for export task

    @Hironsan
    Hironsan committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    ce18476 View commit details
    Browse the repository at this point in the history

  7. Update typing to pass mypy

    @Hironsan
    Hironsan committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    e332381 View commit details
    Browse the repository at this point in the history

  8. Add test cases for exporting intent detection dataset

    @Hironsan
    Hironsan committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    5a956fc View commit details
    Browse the repository at this point in the history

  9. Remove unused code

    @Hironsan
    Hironsan committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    96b9984 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2022

  1. Remove duplication from formatter

    @Hironsan
    Hironsan committed Apr 23, 2022
    Configuration menu
    Copy the full SHA
    d2c6f0f View commit details
    Browse the repository at this point in the history

  2. Extract export catalog as files

    @Hironsan
    Hironsan committed Apr 23, 2022
    Configuration menu
    Copy the full SHA
    18880ec View commit details
    Browse the repository at this point in the history

  3. Change attribute name from field_name to column

    @Hironsan
    Hironsan committed Apr 23, 2022
    Configuration menu
    Copy the full SHA
    bf94da0 View commit details
    Browse the repository at this point in the history

  4. Remove ExportedLabelManager

    @Hironsan
    Hironsan committed Apr 23, 2022
    Configuration menu
    Copy the full SHA
    375fe8a View commit details
    Browse the repository at this point in the history

  5. Add remove files function

    @Hironsan
    Hironsan committed Apr 23, 2022
    Configuration menu
    Copy the full SHA
    04f9ddf View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2022

  1. Refactor test_task.py

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    1e0f5fc View commit details
    Browse the repository at this point in the history

  2. Move filter_examples feature to ExportedExampleManager

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    dac6fb0 View commit details
    Browse the repository at this point in the history

  3. Add test cases for ExportedExample

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    e186bf5 View commit details
    Browse the repository at this point in the history

  4. Add test cases for labels

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    a0a96c7 View commit details
    Browse the repository at this point in the history

  5. Add a test case for dataset

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    f7fb8bf View commit details
    Browse the repository at this point in the history

  6. Add test cases for formatters

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    328658a View commit details
    Browse the repository at this point in the history

  7. Add FastTextFormatter and FastTextWriter

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    389e482 View commit details
    Browse the repository at this point in the history

  8. Add RenameFormatter

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    5277001 View commit details
    Browse the repository at this point in the history

  9. Remove unused options from data export catalog

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    75707d8 View commit details
    Browse the repository at this point in the history

  10. Update factories of data export

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    12573ec View commit details
    Browse the repository at this point in the history

  11. Rename exported dataset columns to match the imported dataset columns

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    1d37ec9 View commit details
    Browse the repository at this point in the history

  12. Rename parameter name

    @Hironsan
    Hironsan committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    cfcdcf2 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2022

  1. Boost performance for data export 

    Remove is_text_project from ExportedExample because this queries db every time
    @Hironsan
    Hironsan committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    45ddacb View commit details
    Browse the repository at this point in the history

  2. Replace zip_files with shutil.make_archive

    @Hironsan
    Hironsan committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    e83bc92 View commit details
    Browse the repository at this point in the history

  3. Remove duplication from export task

    @Hironsan
    Hironsan committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    a6928fd View commit details
    Browse the repository at this point in the history