Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[autoparallel] refactored the autoparallel module for organization #1706

Conversation

FrankLeeeee
Copy link
Contributor

What is the problem?

The previous code is kind-of mixed between old and new versions. Therefore, a cleanup is required to well organize the module structure.

What does this PR do?

This PR organizes the new version code into colossalai.auto_parallel.tensor_shard according to the structure below:

- tensor_shard
  - deprecated
  - solver
    - solver
    - graph_analyser
    - strategy_constructor
    - cost_graph
    - options
  - node_handler
    - strategy
  - sharding_strategy
  - runtime
  - constants
  - utils

The unit tests have been refactored accordingly.

Test Results

With AUTO_PARALLEL=1, the result is shown below. The next step is to fix these faulty but skipped test cases (which have been broken for quite a while).

Screen Shot 2022-10-14 at 12 04 16

@YuliangLiu0306 YuliangLiu0306 merged commit 6c331a5 into hpcaitech:main Oct 14, 2022
@FrankLeeeee FrankLeeeee deleted the hotfix/refactor-latest-auto-parallel-code branch January 26, 2023 07:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants