Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

output demo(pagerank) #72

Merged
merged 3 commits into from Aug 26, 2021
Merged

output demo(pagerank) #72

merged 3 commits into from Aug 26, 2021

Conversation

zhoney
Copy link
Contributor

@zhoney zhoney commented Jul 22, 2021

No description provided.

@codecov
Copy link

codecov bot commented Jul 27, 2021

Codecov Report

Merging #72 (3ed4b67) into master (b6341ca) will decrease coverage by 0.51%.
The diff coverage is 66.54%.

Impacted file tree graph

@@             Coverage Diff              @@
##             master      #72      +/-   ##
============================================
- Coverage     88.10%   87.58%   -0.52%     
- Complexity     2632     2685      +53     
============================================
  Files           270      281      +11     
  Lines          9926    10206     +280     
  Branches        836      847      +11     
============================================
+ Hits           8745     8939     +194     
- Misses          770      850      +80     
- Partials        411      417       +6     
Impacted Files Coverage Δ
.../core/output/hg/exceptions/WriteBackException.java 0.00% <0.00%> (ø)
...computer/core/output/hg/task/SingleInsertTask.java 0.00% <0.00%> (ø)
.../computer/core/output/hg/task/BatchInsertTask.java 23.80% <23.80%> (ø)
...raph/computer/core/output/hg/task/TaskManager.java 62.50% <62.50%> (ø)
...h/computer/core/output/hg/metrics/LoadMetrics.java 80.00% <80.00%> (ø)
...h/computer/core/output/hg/metrics/LoadSummary.java 80.00% <80.00%> (ø)
...graph/computer/core/output/hg/task/InsertTask.java 83.33% <83.33%> (ø)
...graph/computer/core/output/hg/metrics/Printer.java 94.73% <94.73%> (ø)
.../hugegraph/computer/core/output/hg/HugeOutput.java 95.83% <95.83%> (ø)
...mputer/algorithm/rank/pagerank/PageRankParams.java 100.00% <100.00%> (ø)
... and 18 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b6341ca...3ed4b67. Read the comment docs.

@zhoney zhoney force-pushed the pagerank-output branch 9 times, most recently from ff29dab to e2fd20d Compare July 29, 2021 12:13
Comment on lines +220 to +268
public static final ConfigOption<Integer> OUTPUT_BATCH_SIZE =
new ConfigOption<>(
"output.batch_size",
"The batch size of output",
positiveInt(),
500
);

public static final ConfigOption<Integer> OUTPUT_BATCH_THREADS =
new ConfigOption<>(
"output.batch_threads",
"The threads number used to batch output",
positiveInt(),
1
);

public static final ConfigOption<Integer> OUTPUT_SINGLE_THREADS =
new ConfigOption<>(
"output.single_threads",
"The threads number used to single output",
positiveInt(),
1
);

public static final ConfigOption<Integer>
OUTPUT_THREAD_POOL_SHUTDOWN_TIMEOUT =
new ConfigOption<>(
"output.thread_pool_shutdown_timeout",
"The timeout seconds of output threads pool shutdown",
positiveInt(),
60
);

public static final ConfigOption<Integer> OUTPUT_RETRY_TIMES =
new ConfigOption<>(
"output.retry_times",
"The retry times when output failed",
positiveInt(),
3
);

public static final ConfigOption<Integer> OUTPUT_RETRY_INTERVAL =
new ConfigOption<>(
"output.retry_interval",
"The retry interval when output failed",
positiveInt(),
10
);

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

copy a copy to the driver

positiveInt(),
Integer.class
);

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can move some options of ComputerOptions to api module?

Copy link
Contributor

@javeme javeme left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

expect codecov improvement: codecov/patch — 66.54% of diff hit (target 88.10%)

@@ -42,6 +42,6 @@ public void setAlgorithmParameters(Map<String, String> params) {
this.setIfAbsent(params, ComputerOptions.WORKER_COMBINER_CLASS,
DoubleValueSumCombiner.class.getName());
this.setIfAbsent(params, ComputerOptions.OUTPUT_CLASS,
LimitedLogOutput.class.getName());
PageRankOutput.class.getName());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

need to update other algorithms?

"output.retry_interval",
positiveInt(),
Integer.class
);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can move some options of ComputerOptions to api module?

<groupId>org.apache.commons</groupId>
<artifactId>commons-lang3</artifactId>
<version>3.9</version>
</dependency>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

seems it's included by hugegraph-common

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The version depended by hugegraph-common is low, so need to include explicitly

@zhoney zhoney merged commit 65d287b into master Aug 26, 2021
@zhoney zhoney deleted the pagerank-output branch August 26, 2021 12:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants