Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DoNotMerge] Integrate GraphBolt with DistDGL #7006

Open
wants to merge 30 commits into
base: master
Choose a base branch
from
Open

[DoNotMerge] Integrate GraphBolt with DistDGL #7006

wants to merge 30 commits into from

Commits on Oct 23, 2023

  1. [gb_distdgl] add demo py

    @Rhett-Ying
    Rhett-Ying committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    d94e52f View commit details
    Browse the repository at this point in the history

  2. [gb_distdgl] enable to store node_attributes into CSCSamplingGraph

    @Rhett-Ying
    Rhett-Ying committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    9de41c6 View commit details
    Browse the repository at this point in the history

  3. [gb_distdgl] refine convert_dgl_partition_to_csc_sampling_graph to co… 

    …ntrol orig_nids/eids storage
    @Rhett-Ying
    Rhett-Ying committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    ddce1d4 View commit details
    Browse the repository at this point in the history

  4. [gb_distdgl] TODO: control dtype more rigidly when construct CSCSampl… 

    …ingGraph
    @Rhett-Ying
    Rhett-Ying committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    59825dc View commit details
    Browse the repository at this point in the history

  5. [gb_distdgl] add graph file size of ogbn-mag for comparision btw DGL … 

    …and GB
    @Rhett-Ying
    Rhett-Ying committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    174dc37 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. [gb_distdgl] Add use_graphbolt to control save CSCSamplingGraph when … 

    …partition, load_partition, tests are added
    @Rhett-Ying
    Rhett-Ying committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    4b767b3 View commit details
    Browse the repository at this point in the history

  2. [gb_distdgl] enable copy to sharedMem and back

    @Rhett-Ying
    Rhett-Ying committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    d76004f View commit details
    Browse the repository at this point in the history

  3. [gb_distdgl] successfully load graph in server and client from shared… 

    … mem
    @Rhett-Ying
    Rhett-Ying committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    222dd2b View commit details
    Browse the repository at this point in the history

  4. [gb_distdgl] update todo list

    @Rhett-Ying
    Rhett-Ying committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    1cabe94 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. [gb_distdgl] dataloader is created

    @Rhett-Ying
    Rhett-Ying committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    70c3a9d View commit details
    Browse the repository at this point in the history

  2. [gb_distdgl] create ItemSet with dict input

    @Rhett-Ying
    Rhett-Ying committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    9362afe View commit details
    Browse the repository at this point in the history

  3. [gb_distdgl] _distributed_access works with graph.sample hacked

    @Rhett-Ying
    Rhett-Ying committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    f440df1 View commit details
    Browse the repository at this point in the history

  4. [gb_distdgl] Not worked as crashed in csc_sampling_graph::_check_samp… 

    …ler_arguments(). seeds should be converted from dict to list
    @Rhett-Ying
    Rhett-Ying committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    93feb0b View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. [gb_distdgl] only replace sample_neigbors with GB and it does not crash

    @Rhett-Ying
    Rhett-Ying committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    8da2a4a View commit details
    Browse the repository at this point in the history

  2. [gb_distdgl] train is ready though acc and time drops

    @Rhett-Ying
    Rhett-Ying committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    1b06f14 View commit details
    Browse the repository at this point in the history

  3. multiply fanout with num_etypes

    @Rhett-Ying
    Rhett-Ying committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    b3eecae View commit details
    Browse the repository at this point in the history

  4. [WAHAHA] sample_etype_neighbors is applied truely except metadata shm… 

    … hack
    @Rhett-Ying
    Rhett-Ying committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    896ad9b View commit details
    Browse the repository at this point in the history

  5. [WAHAHA] gb_metadata is generated on-fly for obtain CSCSamplingGraph … 

    …from shm
    @Rhett-Ying
    Rhett-Ying committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    5c8c612 View commit details
    Browse the repository at this point in the history

  6. ------ LAUNCH DistDGL with GraphBolt on heterograph -------

    @Rhett-Ying
    Rhett-Ying committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    438d8ca View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. standalone with use_graphbolt is not supported

    @Rhett-Ying
    Rhett-Ying committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    6d5d240 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. format dtype when converting to CSCSamplingGraph

    @Rhett-Ying
    Rhett-Ying committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    a99b192 View commit details
    Browse the repository at this point in the history

  2. update README about partition size

    @Rhett-Ying
    Rhett-Ying committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    c0099a1 View commit details
    Browse the repository at this point in the history

  3. clean up unnecessary return edge types

    @Rhett-Ying
    Rhett-Ying committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    ebb6cea View commit details
    Browse the repository at this point in the history

  4. update graph partition size with eids

    @Rhett-Ying
    Rhett-Ying committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    be3f7f2 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2023

  1. [WAHAHA] node classfication on homogeneous graph with GraphBolt is ready

    @Rhett-Ying
    Rhett-Ying committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    591f60e View commit details
    Browse the repository at this point in the history

  2. Homo/Hetero + NC is verified

    @Rhett-Ying
    Rhett-Ying committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    50c7be2 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2023

  1. add comments for EID in DGL block creation

    @Rhett-Ying
    Rhett-Ying committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    aac0d6f View commit details
    Browse the repository at this point in the history

  2. add assertion for num_samplers > 0 as not supported yet

    @Rhett-Ying
    Rhett-Ying committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    f806ece View commit details
    Browse the repository at this point in the history

  3. add crash log for num_samplers>0

    @Rhett-Ying
    Rhett-Ying committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    b15c931 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2023

  1. add script to check mem footprint

    @Rhett-Ying
    Rhett-Ying committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    19f12bb View commit details
    Browse the repository at this point in the history