Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

R4R: Sunny/tombstone spec #3103

Merged
merged 27 commits into from
Jan 29, 2019
Merged
Show file tree
Hide file tree
Changes from 16 commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
1a26f32
in progress:
sunnya97 Dec 6, 2018
346bf9c
in progress
sunnya97 Dec 13, 2018
3fe1688
in progress
sunnya97 Dec 13, 2018
3bb6de9
in progress
sunnya97 Dec 17, 2018
96c074c
asdf
sunnya97 Dec 17, 2018
5b9aa01
Update docs/spec/slashing/tombstone.md
alexanderbez Dec 19, 2018
04c2e6e
fixed incorrect note
sunnya97 Dec 19, 2018
4faf5fb
comments
sunnya97 Jan 1, 2019
3864df3
asdf
sunnya97 Jan 2, 2019
55a5fbf
Rigel typos
sunnya97 Jan 6, 2019
1ecbca1
Update docs/spec/slashing/tombstone.md
alexanderbez Jan 6, 2019
368cfcb
Update docs/spec/slashing/tombstone.md
alexanderbez Jan 6, 2019
8a4499f
Update docs/spec/slashing/tombstone.md
alexanderbez Jan 6, 2019
d695766
tombstone is just jailed with infinite jail
sunnya97 Jan 6, 2019
c0a79c7
tombstone is just jailed with infinite jail
sunnya97 Jan 6, 2019
822c7ee
merge conflicts
sunnya97 Jan 6, 2019
e52f32a
Merge branch 'develop' into sunny/tombstone-spec
sunnya97 Jan 22, 2019
8a29ae2
in progress
sunnya97 Jan 22, 2019
25afcae
addressed comments
sunnya97 Jan 24, 2019
aa699dc
Merge branch 'develop' into sunny/tombstone-spec
sunnya97 Jan 24, 2019
a9f2c67
fix misspelling
sunnya97 Jan 28, 2019
ef1428b
Merge branch 'develop' into sunny/tombstone-spec
sunnya97 Jan 28, 2019
331d84a
removed devtools-stamp
sunnya97 Jan 28, 2019
fba6660
Apply @cwgoes suggestions from code review
cwgoes Jan 29, 2019
4fa183d
removed future improvements
sunnya97 Jan 29, 2019
153190c
Apply @cwgoes suggestions from code review
cwgoes Jan 29, 2019
78424da
typo fixes and minor markdown restructure
Jan 29, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Empty file added devtools-stamp
Empty file.
75 changes: 75 additions & 0 deletions docs/spec/slashing/tombstone.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,75 @@
# Staking Tombstone

## Abstract

In the current implementation of the `slashing` module, when the consensus engine informs the state machine of a validator's consensus fault, the validator is partially slashed, and put into a "jail period", a period of time in which they are not allowed to rejoin the validator set. However, because of the nature of consensus faults and ABCI, there can be a delay between an infraction occuring, and evidence of the infraction reaching the state machine (this is one of the primary reasons for the existence of the unbonding period).
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved

> Note: The tombstone concept, only applies to byzantine faults reported over ABCI. For slashable offenses tracked by the state machine (such as liveness faults), as there is not a delay between infraction and slashing, no slashing period tracking is needed. A validator is immediately put into jail period, and they cannot commit another liveness fault until they unjail.
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved

In the current system design, once a validator is put in the jail for a consensus fault, after the `JailPeriod` they are allowed to send a transaction to `unjail` themselves, and thus rejoin the validator set.

One of the "design desires" of the `slashing` module is that if multiple infractions occur before evidence is executed (and a validator is put in jail), they should only be punished for single worst infraction, but not cumulatively. For example, if the sequence of events is:
1. Validator A commits Infraction 1 (worth 30% slash)
2. Validator A commits Infraction 2 (worth 40% slash)
3. Validator A commits Infraction 3 (worth 35% slash)
4. Evidence for Infraction 1 reaches state machine (and validator is put in jail)
5. Evidence for Infraction 2 reaches state machine
6. Evidence for Infraction 3 reaches state machine

Only Infraction 2 should have its slash take effect, as it is the highest. This is done, so that in the case of the compromise of a validator's consensus key, they will only be punished once, even if the hacker double-signs many blocks. Because, the unjailing has to be done with the validator's operator key, they have a chance to re-secure their consensus key, and then signal that they are ready using their operator key. We call this period during which we track only the max infraction, the "slashing period".

Once, a validator rejoins by unjailing themselves, we begin a new slashing period; if they commit a new infraction after unjailing, it gets slashed cumulatively on top of the worst infraction from the previous slashing period.

However, while infractions are grouped based off of the slashing periods, because evidence can be submitted up to an `unbondingPeriod` after the infraction, we still have to allow for evidence to be submitted for previous slashing periods. For example, if the sequence of events is:
1. Validator A commits Infraction 1 (worth 30% slash)
2. Validator A commits Infraction 2 (worth 40% slash)
3. Evidence for Infraction 1 reaches state machine (and Validator A is put in jail)
4. Validator A unjails

We are now in a new slashing period, however we still have to keep the door open for the previous infraction, as the evidence for Infraction 2 may still come in. As the number of slashing periods increase, it creates more complexity as we have to keep track of the highest infraction amount for every single slashing period.

> Note: Currently, according to the `slashing` module spec, a new slashing period is created every time a validator is unbonded then rebonded. This should probably be changed to jailed/unjailed. See issue [#3205](https://github.com/cosmos/cosmos-sdk/issues/3205) for further details. For the remainder of this, I will assume that we only start a new slashing period when a validator gets unjailed.

The maximum number of slashing periods is the `len(UnbondingPeriod) / len(JailPeriod)`. The current defaults in Gaia for the `UnbondingPeriod` and `JailPeriod` are 3 weeks and 2 days, respectively. This means there could potentially be up to 11 slashing periods concurrently being tracked per validator. If we set the `JailPeriod >= UnbondingPeriod`, we only have to track 1 slashing period (i.e not have to track slashing periods).
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved
jackzampolin marked this conversation as resolved.
Show resolved Hide resolved

Currently, in the jail period implementation, once a validator unjails, all of their delegators who are delegated to them (haven't unbonded / redelegated away), stay with them. Given that consensus safety faults are so egregious (way more so than liveness faults), it is probably prudent to have delegators not "auto-rebond" to the validator. Thus, we propose setting the "jail time" for a validator who commits a consensus safety fault, to `infite` (i.e. a tombstone state). This essentially kicks the validator out of the validator set and does not allow them to re-enter the validator set. All of their delegators (including the operator themselves) have to either unbond or redelegate away. The validator operator can create a new validator if they would like, with a new operator key and consensus key, but they have to "re-earn" their delegations back. To put the validator in the tombstone state, we set `DoubleSignJailEndTime` to `time.Unix(253402300800)`, the MAX time supported by Amino.
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved

By implementing the tombstone system and getting rid of the slashing period tracking, will make the `slashing` module way simpler, especially because we can remove all of the hooks defined in the `slashing` module.
jackzampolin marked this conversation as resolved.
Show resolved Hide resolved

## Further improvements / Related proposals:

### Single slashing amount
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved

Another optimization that can be made is that if we assume that all ABCI faults for Tendermint consensus are slashed at the same level, we don't have to keep track of "max slash". Once an ABCI fault happens once, we don't have to worry about comparing potential future ones to find the max.
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved

I believe current planned Tendermint ABCI faults are primarily:
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved
- Unjustified precommits (double signs)
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved
- Signing a precommit when you're in unbonding phase (can be used to trick light clients)
cwgoes marked this conversation as resolved.
Show resolved Hide resolved

At the moment, the second one is not implemented, but needs to be implemented soon, in order to make light client bisection safe. Do we want to punish these two faults at different levels? If not, we can enact the above change. Note: This change may make sense for current Tendermint consensus, but maybe not for a different consensus algorithm or future versions of Tendermint that may want to punish at different levels (for example, partial slashing).

### Store infractions in state instead of iterating over unbonds/redelegations

Pending discussion on #3206.

<!-- Currently, every time evidence of a new fault comes in, we currently iterate over all of the unbonds/redelegations away from a validator to see if the slash affects them or not. If it does, we decrease the "balance" of the `ubd` or `red`. However, as the number of unbonds or redelegations can be very high, this might be very expensive. Instead, we can store evidences for all infractions that happened in the last `Unbonding Period` in state, and then whenever a ubd or red hits maturity, it can check if it needs to be slashed by checking it against the last infraction that happened before they started unbonding/redelegating away. Because we only need to store the infractions from the last unbon -->
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved




<!--
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved
First, part of the design of the `stake` module is that delegators should be slashed for the infractions that happened during blocks that they were delegated to the offending validator, however, they should not be slashed for infractions that their voting power did not contribute to.
sunnya97 marked this conversation as resolved.
Show resolved Hide resolved

Thus, if the sequence of events is:
1. Validator A commits Infraction 1
2. Delegator X delegates to Validator A
3. Evidence for Infraction 1 reaches state machine
Delegator X should not be slashed.

Similarly, if the sequence of events is:
1. Delegator X delegates to Validator A
2. Delegator X unbonds from Validator A and begins unbonding period
3. Validator A commits Infraction 1
4. Evidence for Infraction 1 reaches state machine
5. Delegator X finishes unbonding.
Delegator X should not be slashed. -->