/akka

New issue

OversizedPayloadException DeltaPropagation #23025

Closed
patriknw opened this Issue May 24, 2017 · 0 comments

Comments

Assignees

@patriknw patriknw

Labels
bug t:distributed-data
Projects
None yet
Milestone
  2.5.3
1 participant
@patriknw
@patriknw
Owner

patriknw commented May 24, 2017

This can be reproduced with VotingServiceSpec in akka-samples, akka/akka-samples#25

Payload size for [akka.cluster.ddata.Replicator$Internal$DeltaPropagation] is [173178] bytes

What I think is going on is that when doing many updates quickly the delta propagations are accumulated without bounds. By slowing down the voting in the test the message size is small.

Not sure if it's a specific problem with PNCounterMap or more general.

It's not so bad as it might sound because it's fine to drop delta propagations, but marking it as a bug anyway.

@patriknw patriknw added 1 - triaged bug t:distributed-data labels May 24, 2017

patriknw referenced this issue in akka/akka-samples May 24, 2017

Closed

OversizedPayloadException in VotingServiceSpec #25

patriknw self-assigned this May 30, 2017

@patriknw patriknw added 3 - in progress and removed 1 - triaged labels May 30, 2017

@patriknw patriknw added a commit that referenced this issue May 30, 2017

@patriknw patriknw discard large deltas, #23025 
* to avoid OversizedPayloadException
* some complex deltas grow for each update operation, e.g.
  when updating different keys in ORMap (PNCounterMap)
* such large deltas can safely be discarded and disseminated as full
  state instead
* added ReplicatedDeltaSize interface to be able to define the "size"
  and when that size exceeds configured threshold the delta is discarded
 df3e27e

@patriknw patriknw added a commit that referenced this issue May 30, 2017

@patriknw patriknw discard large deltas, #23025 
* to avoid OversizedPayloadException
* some complex deltas grow for each update operation, e.g.
  when updating different keys in ORMap (PNCounterMap)
* such large deltas can safely be discarded and disseminated as full
  state instead
* added ReplicatedDeltaSize interface to be able to define the "size"
  and when that size exceeds configured threshold the delta is discarded
 0771843

patriknw referenced this issue May 30, 2017

Merged

discard large deltas, #23025 #23068

@patriknw patriknw added a commit that referenced this issue Jun 16, 2017

@patriknw patriknw discard large deltas, #23025 
* to avoid OversizedPayloadException
* some complex deltas grow for each update operation, e.g.
  when updating different keys in ORMap (PNCounterMap)
* such large deltas can safely be discarded and disseminated as full
  state instead
* added ReplicatedDeltaSize interface to be able to define the "size"
  and when that size exceeds configured threshold the delta is discarded
 591a41a

@patriknw patriknw added a commit that referenced this issue Jun 16, 2017

@patriknw patriknw discard large deltas, #23025 
* to avoid OversizedPayloadException
* some complex deltas grow for each update operation, e.g.
  when updating different keys in ORMap (PNCounterMap)
* such large deltas can safely be discarded and disseminated as full
  state instead
* added ReplicatedDeltaSize interface to be able to define the "size"
  and when that size exceeds configured threshold the delta is discarded
 2970287

@patriknw patriknw added a commit that referenced this issue Jun 16, 2017

@patriknw patriknw Merge pull request #23068 from akka/wip-23025-large-delta-patriknw 
discard large deltas, #23025
 c190f14

patriknw removed the 3 - in progress label Jun 16, 2017

patriknw added this to the 2.5.3 milestone Jun 16, 2017

patriknw closed this Jun 16, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment