Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GIO] New Implementation of IOGEN #1672

Closed
wants to merge 86 commits into from
Closed

[GIO] New Implementation of IOGEN #1672

wants to merge 86 commits into from

Commits on Jan 25, 2022

  1. Start reimplement IOGEN

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    cf6ab0a View commit details
    Browse the repository at this point in the history

  2. Start change to new CodeGen

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    6e8b649 View commit details
    Browse the repository at this point in the history

  3. Update CodeGen

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    bdc9ce8 View commit details
    Browse the repository at this point in the history

  4. Update CodeGen

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    7a1cf72 View commit details
    Browse the repository at this point in the history

  5. Fix MappingTrie Bug

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    360f570 View commit details
    Browse the repository at this point in the history

  6. Add CodeGen for Frame

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    8dedf85 View commit details
    Browse the repository at this point in the history

  7. Add row scattered column support

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    6ab2921 View commit details
    Browse the repository at this point in the history

  8. Add Multi Line Identification

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    c7daac6 View commit details
    Browse the repository at this point in the history

  9. Add Row Prefix Identification and Key Pattern Build for Row Index

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    0ab6ddc View commit details
    Browse the repository at this point in the history

  10. Update CodeGen

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    239e781 View commit details
    Browse the repository at this point in the history

  11. Update JAVA CodeGen

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    2f40135 View commit details
    Browse the repository at this point in the history

  12. Fixed some bugs in Identification section 

    Update CodeGen part
Add some tests for Matrix
    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    00f6d65 View commit details
    Browse the repository at this point in the history

  13. removed an old code

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    b92a88c View commit details
    Browse the repository at this point in the history

  14. Minor

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    d866f10 View commit details
    Browse the repository at this point in the history

  15. Fix a bug in ReaderMapping 

    Add tests for Frame flat data
    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    89b2ae0 View commit details
    Browse the repository at this point in the history

  16. Add tests for Frame nested data

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    0110eb9 View commit details
    Browse the repository at this point in the history

  17. Fix Code Style

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    a828d14 View commit details
    Browse the repository at this point in the history

  18. Minor rollback

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    030f15e View commit details
    Browse the repository at this point in the history

  19. Minor

    @fathollahzadeh
    fathollahzadeh committed Jan 25, 2022
    Copy the full SHA
    87c4e8c View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2022

  1. Init commit for multi row CodeGen

    @fathollahzadeh
    fathollahzadeh committed Jan 26, 2022
    Copy the full SHA
    ee8c972 View commit details
    Browse the repository at this point in the history

  2. Update multi row CodeGen

    @fathollahzadeh
    fathollahzadeh committed Jan 26, 2022
    Copy the full SHA
    cc0394e View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2022

  1. support duplicate values

    @fathollahzadeh
    fathollahzadeh committed Jan 27, 2022
    Copy the full SHA
    f9d8f89 View commit details
    Browse the repository at this point in the history

  2. Experiments VLDB2022

    @fathollahzadeh
    fathollahzadeh committed Jan 27, 2022
    Copy the full SHA
    3db25e3 View commit details
    Browse the repository at this point in the history

  3. minor merge

    @fathollahzadeh
    fathollahzadeh committed Jan 27, 2022
    Copy the full SHA
    c4b8ec7 View commit details
    Browse the repository at this point in the history

  4. minor merge

    @fathollahzadeh
    fathollahzadeh committed Jan 27, 2022
    Copy the full SHA
    f3a2b62 View commit details
    Browse the repository at this point in the history

  5. UP a Test

    @fathollahzadeh
    fathollahzadeh committed Jan 27, 2022
    Copy the full SHA
    409c06d View commit details
    Browse the repository at this point in the history

  6. Fix duplicate string mapping bug

    @fathollahzadeh
    fathollahzadeh committed Jan 27, 2022
    Copy the full SHA
    c1f1799 View commit details
    Browse the repository at this point in the history

  7. up

    @fathollahzadeh
    fathollahzadeh committed Jan 27, 2022
    Copy the full SHA
    bd4cbef View commit details
    Browse the repository at this point in the history

  8. up

    @fathollahzadeh
    fathollahzadeh committed Jan 27, 2022
    Copy the full SHA
    28ae8b9 View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2022

  1. Fix a bug in code gen

    @fathollahzadeh
    fathollahzadeh committed Jan 28, 2022
    Copy the full SHA
    72b7507 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2022

  1. optimization

    @fathollahzadeh
    fathollahzadeh committed Jan 29, 2022
    Copy the full SHA
    078266c View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2022

  1. optimization 

    fix some code style
fix some bug
    @fathollahzadeh
    fathollahzadeh committed Jan 31, 2022
    Copy the full SHA
    951f3c3 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2022

  1. up

    @fathollahzadeh
    fathollahzadeh committed Feb 1, 2022
    Copy the full SHA
    897d3e8 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2022

  1. Add Baselines

    @fathollahzadeh
    fathollahzadeh committed Feb 6, 2022
    Copy the full SHA
    bb4394c View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2022

  1. Add Baselines

    @fathollahzadeh
    fathollahzadeh committed Feb 11, 2022
    Copy the full SHA
    5c7190f View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2022

  1. Update Exp branch

    @fathollahzadeh
    fathollahzadeh committed Feb 14, 2022
    Copy the full SHA
    2aae0ee View commit details
    Browse the repository at this point in the history

Commits on Feb 17, 2022

  1. Add CodeGen for Spars Datasets

    @fathollahzadeh
    fathollahzadeh committed Feb 17, 2022
    Copy the full SHA
    3baaca0 View commit details
    Browse the repository at this point in the history

  2. Update GIO Exp

    @fathollahzadeh
    fathollahzadeh committed Feb 17, 2022
    Copy the full SHA
    350282a View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2022

  1. Update GIO Exp

    @fathollahzadeh
    fathollahzadeh committed Feb 18, 2022
    Copy the full SHA
    d84c3e9 View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2022

  1. Update GIO Exp

    @fathollahzadeh
    fathollahzadeh committed Feb 26, 2022
    Copy the full SHA
    1d3895a View commit details
    Browse the repository at this point in the history

  2. Update GIO Exp

    @fathollahzadeh
    fathollahzadeh committed Feb 26, 2022
    Copy the full SHA
    d26aafd View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2022

  1. Update GIO, Move from 2D Array to MatrixBlock

    @fathollahzadeh
    fathollahzadeh committed Feb 27, 2022
    Copy the full SHA
    4b98c6d View commit details
    Browse the repository at this point in the history

  2. Revert "Update GIO, Move from 2D Array to MatrixBlock" 

    This reverts commit 4b98c6d.
    @fathollahzadeh
    fathollahzadeh committed Feb 27, 2022
    Copy the full SHA
    2b9e79e View commit details
    Browse the repository at this point in the history

  3. Update GIO EXp, SystemDS Reader

    @fathollahzadeh
    fathollahzadeh committed Feb 27, 2022
    Copy the full SHA
    a34cd64 View commit details
    Browse the repository at this point in the history

  4. Update GIO EXp

    @fathollahzadeh
    fathollahzadeh committed Feb 27, 2022
    Copy the full SHA
    c09aac0 View commit details
    Browse the repository at this point in the history

  5. Update GIO Exp

    @fathollahzadeh
    fathollahzadeh committed Feb 27, 2022
    Copy the full SHA
    6c1e602 View commit details
    Browse the repository at this point in the history

  6. Update GIO Exp

    @fathollahzadeh
    fathollahzadeh committed Feb 27, 2022
    Copy the full SHA
    5fe869a View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2022

  1. Update for new custom properties

    @fathollahzadeh
    fathollahzadeh committed Apr 6, 2022
    Copy the full SHA
    28b9f0e View commit details
    Browse the repository at this point in the history

Commits on May 30, 2022

  1. Extend ReaderMapping t support symmetric, skew-symmetric and pattern … 

    …properties of matrix
    @fathollahzadeh
    fathollahzadeh committed May 30, 2022
    Copy the full SHA
    29d83fa View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2022

  1. Fix Symmetric and Skew-Symmetric properties bugs

    @fathollahzadeh
    fathollahzadeh committed Jun 7, 2022
    Copy the full SHA
    d377fd0 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2022

  1. New synchronization with the paper background section

    @fathollahzadeh
    fathollahzadeh committed Jun 9, 2022
    Copy the full SHA
    93c6e9e View commit details
    Browse the repository at this point in the history

  2. Fix row index identity detection bug

    @fathollahzadeh
    fathollahzadeh committed Jun 9, 2022
    Copy the full SHA
    9cdba95 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2022

  1. Update codegen section based on the new implementation

    @fathollahzadeh
    fathollahzadeh committed Jun 10, 2022
    Copy the full SHA
    ff3a5e9 View commit details
    Browse the repository at this point in the history

  2. Update codegen section with row-index identity and col-index exist

    @fathollahzadeh
    fathollahzadeh committed Jun 10, 2022
    Copy the full SHA
    893c43d View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2022

  1. Initial commit of multi-line format identification

    @fathollahzadeh
    fathollahzadeh committed Jun 12, 2022
    Copy the full SHA
    3d4b36c View commit details
    Browse the repository at this point in the history

  2. Add record delimiter in seq-scattered record formats

    @fathollahzadeh
    fathollahzadeh committed Jun 12, 2022
    Copy the full SHA
    e1b2ff5 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2022

  1. First commit of the seq-scattered reader code gen

    @fathollahzadeh
    fathollahzadeh committed Jun 14, 2022
    Copy the full SHA
    caf01d8 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2022

  1. Init commit of parallel code gen

    @fathollahzadeh
    fathollahzadeh committed Jun 15, 2022
    Copy the full SHA
    0c27ee2 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2022

  1. Init commit of parallel code gen for Frame

    @fathollahzadeh
    fathollahzadeh committed Jun 16, 2022
    Copy the full SHA
    cefabd0 View commit details
    Browse the repository at this point in the history

  2. Parallel implementation of Frame reader

    @fathollahzadeh
    fathollahzadeh committed Jun 16, 2022
    Copy the full SHA
    bbf0f70 View commit details
    Browse the repository at this point in the history

  3. minor update, code style

    @fathollahzadeh
    fathollahzadeh committed Jun 16, 2022
    Copy the full SHA
    3ffecd5 View commit details
    Browse the repository at this point in the history

  4. Add Gson, Jackson parallel readers, update experiment source code

    @fathollahzadeh
    fathollahzadeh committed Jun 16, 2022
    Copy the full SHA
    283e83a View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2022

  1. Minor update, clean-up

    @fathollahzadeh
    fathollahzadeh committed Jun 17, 2022
    Copy the full SHA
    1091058 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/sf-GIOEXPVLDB2022V2' into sf-GIO 

    # Conflicts:
#	pom.xml
    @fathollahzadeh
    fathollahzadeh committed Jun 17, 2022
    Copy the full SHA
    3284b7b View commit details
    Browse the repository at this point in the history

  3. Fix nrow calc in parallel frame reader

    @fathollahzadeh
    fathollahzadeh committed Jun 17, 2022
    Copy the full SHA
    bd84592 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2022

  1. Fix multi-line reader bug

    @fathollahzadeh
    fathollahzadeh committed Jun 21, 2022
    Copy the full SHA
    014a987 View commit details
    Browse the repository at this point in the history

  2. Add AMiner Dataset Reader to SystemDS

    @fathollahzadeh
    fathollahzadeh committed Jun 21, 2022
    Copy the full SHA
    9afaf2a View commit details
    Browse the repository at this point in the history

  3. Add AMiner Dataset Parallel Reader to SystemDS

    @fathollahzadeh
    fathollahzadeh committed Jun 21, 2022
    Copy the full SHA
    31fe364 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2022

  1. Update experiment code

    @fathollahzadeh
    fathollahzadeh committed Jun 22, 2022
    Copy the full SHA
    0443417 View commit details
    Browse the repository at this point in the history

  2. Fix Aminer parallel reader bug

    @fathollahzadeh
    fathollahzadeh committed Jun 22, 2022
    Copy the full SHA
    95d8bce View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2022

  1. Fix Frame code gen bug

    @fathollahzadeh
    fathollahzadeh committed Jun 23, 2022
    Copy the full SHA
    f39ef6f View commit details
    Browse the repository at this point in the history

  2. Fix frame single thread reader

    @fathollahzadeh
    fathollahzadeh committed Jun 23, 2022
    Copy the full SHA
    c1253a9 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2022

  1. Fix some bugs

    @fathollahzadeh
    fathollahzadeh committed Jun 24, 2022
    Copy the full SHA
    36b1c98 View commit details
    Browse the repository at this point in the history

  2. Minor

    @fathollahzadeh
    fathollahzadeh committed Jun 24, 2022
    Copy the full SHA
    2489647 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2022

  1. Improve performance and fix multi-line detection mapping

    @fathollahzadeh
    fathollahzadeh committed Jun 25, 2022
    Copy the full SHA
    9d98d58 View commit details
    Browse the repository at this point in the history

  2. Improve performance and fix multi-line detection mapping

    @fathollahzadeh
    fathollahzadeh committed Jun 25, 2022
    Copy the full SHA
    d541fd3 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2022

  1. Cleanup, fixed bugs in codegen, update tests, remove unnecessary tests

    @fathollahzadeh
    fathollahzadeh committed Jul 27, 2022
    Copy the full SHA
    cd9b54a View commit details
    Browse the repository at this point in the history

  2. minor

    @fathollahzadeh
    fathollahzadeh committed Jul 27, 2022
    Copy the full SHA
    5ee9d77 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/sf-GIO' into GIO

    @fathollahzadeh
    fathollahzadeh committed Jul 27, 2022
    Copy the full SHA
    d630726 View commit details
    Browse the repository at this point in the history

  4. Remove benchmark codes from GIO PR

    @fathollahzadeh
    fathollahzadeh committed Jul 27, 2022
    Copy the full SHA
    46f3c1b View commit details
    Browse the repository at this point in the history

  5. Minor Cleanup

    @fathollahzadeh
    fathollahzadeh committed Jul 27, 2022
    Copy the full SHA
    b4d4fd3 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2022

  1. Initial Integration of GIO with SystemDS (DML)

    @fathollahzadeh
    fathollahzadeh committed Aug 4, 2022
    Copy the full SHA
    2f66e41 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2022

  1. Fix Code Style

    @fathollahzadeh
    fathollahzadeh committed Aug 5, 2022
    Copy the full SHA
    d612708 View commit details
    Browse the repository at this point in the history

  2. Minor Rename Input File Name

    @fathollahzadeh
    fathollahzadeh committed Aug 5, 2022
    Copy the full SHA
    21bddc0 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2022

  1. Formatting, resolve some comments,and rename class name

    @fathollahzadeh
    fathollahzadeh committed Aug 24, 2022
    Copy the full SHA
    f096a22 View commit details
    Browse the repository at this point in the history

  2. Minor

    @fathollahzadeh
    fathollahzadeh committed Aug 24, 2022
    Copy the full SHA
    ac02ff1 View commit details
    Browse the repository at this point in the history