Skip to content
This repository has been archived by the owner on Feb 8, 2019. It is now read-only.

fix GEARPUMP-110, try streaming kmeans on Gearpump #5

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

gy910210
Copy link
Contributor

No description provided.

@manuzhang
Copy link
Contributor

+1, Thanks.

previousNumber += currentNumber
currentNumber = 0
}
val newPoint = dataQueue.take()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a blocking call. We suggest against block in Task. You may use "poll" instead.

@manuzhang
Copy link
Contributor

sorry, I was too optimistic previously. This example contains a cycle which cause the generation of process levels into dead loop. Please check https://github.com/apache/incubator-gearpump/blob/master/core/src/main/scala/io/gearpump/util/Graph.scala#L380

@gy910210
Copy link
Contributor Author

gy910210 commented May 3, 2016

@manuzhang Yes, I find that vertexHierarchyLevelMap() can cause dead loop if graph contains circle. But for topology sorting, the graph will call topologicalOrderWithCirclesIterator() if contains circle. So can we make vertexHierarchyLevelMap() possible to support circles in graph?

@manuzhang
Copy link
Contributor

Yes, please create a jira issue and open an PR if you've got a solution.

manuzhang added a commit to manuzhang/incubator-gearpump that referenced this pull request Jan 24, 2017
Author: manuzhang <owenzhang1990@gmail.com>

Closes apache#5 from manuzhang/upgrade.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
2 participants