Skip to content
This repository was archived by the owner on Jun 7, 2021. It is now read-only.

APEXCORE-606-RV: review only: optimise kryo output stream.#455

Closed
brightchen wants to merge 1 commit intoapache:masterfrom
brightchen:APEXCORE-606-RV
Closed

APEXCORE-606-RV: review only: optimise kryo output stream.#455
brightchen wants to merge 1 commit intoapache:masterfrom
brightchen:APEXCORE-606-RV

Conversation

@brightchen
Copy link

This is a prototype of optimize kryo output stream. The main focus is avoiding memory copy and garbage collection to increase the performance.

  • SerializationBuffer is the the class extends kryo Output which use the WindowedBlockStream to manage the memory.
  • WindowedBlockStream is the memory management class which support manage memory blocks based windows. The windowed related function can be ignored now
  • BlockStream is the super class of WindowedBlockStream which manage blocks
  • CodecPerformanceTest is the class which test the performance. Please change the CodecPerformanceTest.loop to a number bigger than 100 before really do the performance test. And test the use case one by one as initialize impact the performance.
  • PartitionSerde is the class serialize partition and object which can be used by BufferServerPublisher.
  • BufferServerPublisher.put_new(Object) is the implementation use new stream.

@brightchen
Copy link
Author

@vrozov @PramodSSImmaneni Please review

@brightchen brightchen closed this Jan 27, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant