Skip to content

Commit

Permalink
Revert a small change that affected streaming
Browse files Browse the repository at this point in the history
DStream#transform isn't cleaning closures correctly. It is passing
an RDD to ClosureCleaner#clean. We should fix this separately
outside of this patch.
  • Loading branch information
Andrew Or committed May 2, 2015
1 parent 0bbe77f commit cd46230
Showing 1 changed file with 0 additions and 3 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -92,9 +92,6 @@ private[spark] object ClosureCleaner extends Logging {
* Return a list of classes that represent closures enclosed in the given closure object.
*/
private def getInnerClosureClasses(obj: AnyRef): List[Class[_]] = {
if (!isClosure(obj.getClass)) {
throw new IllegalArgumentException(s"Expected a closure object; got ${obj.getClass.getName}")
}
val seen = Set[Class[_]](obj.getClass)
var stack = List[Class[_]](obj.getClass)
while (!stack.isEmpty) {
Expand Down

0 comments on commit cd46230

Please sign in to comment.