[Core][WIP] Make the object in TorrentBroadcast as transient #18055
Conversation
|
I am not sure if I am missing something. But looks like we serialize the object in |
|
Test build #77168 has started for PR 18055 at commit |
| * @param id A unique identifier for the broadcast variable. | ||
| */ | ||
| private[spark] class TorrentBroadcast[T: ClassTag](obj: T, id: Long) | ||
| private[spark] class TorrentBroadcast[T: ClassTag](@transient val obj: T, id: Long) |
There was a problem hiding this comment.
For the old code, obj is not a field, it is just a ctor argument
There was a problem hiding this comment.
I think the compiler will automatically create a field for it? No?
There was a problem hiding this comment.
OK. I see. As there is no other places except val numBlocks: Int = writeBlocks(obj) use it, there is no field created for it.
|
Test FAILed. |
4 participants
What changes were proposed in this pull request?
WIP
How was this patch tested?
Jenkins test.
Please review http://spark.apache.org/contributing.html before opening a pull request.