switch to KangarooTwelve proof of work #108

stoffu · 2019-03-28T01:56:26Z

This implements my proposal in #103.

After doing some research (including asking the Keccak team for a comment) and discussing with @iamsmooth privately, it now seems that the most preferable choice among all possible Keccak variants for PoW is KangarooTwelve (or K12 for short) with the reasons being:

a semi-standardized design endorsed by the same team who designed SHA-3
- It feels safer than tweaking the Keccak parameters by ourselves.
a bit faster than SHA-3 with the round number reduced to 12 which is still believed to be secure enough
potentially useful for hashing all other things in the protocol, especially transactions which are often large, because K12's main strength is its ability to quickly process large chunks of data in parallel
- If we implement this in the future, we get another benefit that the PoW hash and the block hash become identical (as in Bitcoin), thus saving the current doubled computation of hashes for each block (one for the block ID and the other for PoW).

The testnet fork height is set to ~~111600~~ 112000, so for those who want to try please upgrade your testnet daemon .

Included upstream patches:

iamsmooth · 2019-03-28T02:01:44Z

It has a cool name

BigslimVdub · 2019-03-28T03:28:15Z

Great work guys! I like how this is set up with the future in mind for pow and tx cohesion availability. This just sounds like the best choice for Aeon in regards to a Keccak variant. Nice pick.

Informational paper on K12 POW: https://keccak.team/files/KangarooTwelve.pdf

From the conclusion:

"KangarooTwelve can be seen as a new member of the Keccak family. It inherits all the properties of the family such as suitability in hardware and resistance against side-channel attacks, but grew up with a strong focus on software performance and interoperability."
and
"KangarooTwelve benefits immediately from the new SHA-3 hardware support recently introduced in the ARMv8.2 instruction set". mobile mobile mobile

Also from page 17 regarding speed comparisons to other POW in Table 2:

"The speedup benefits to both low-end and high-end processors. "

Stoffu, let us know when you are able to port any miner for usage of this POW for testing purposes. I have noticed with our current version that the CLI miner does have close to average miners hash rates CPU wise of course.

iamsmooth · 2019-03-28T03:40:17Z

@BigslimVdub The built-in miner already supports it and will go live on testnet once the fork happens. Standalone miners will need to be upgraded. As I noted on reddit, I fully expect at least a small arms race and initial miners will likely not remain competitive for long.

stoffu · 2019-03-28T04:26:11Z

I've removed the testnet fork height and will bring it back once XKCP/XKCP#58 is addressed.

stoffu · 2019-03-28T06:05:29Z

Brought back the testnet fork height since XKCP/XKCP#58 was self-resolved.

iamsmooth · 2019-03-29T01:24:01Z

Testnet fork seemed to go fine.

BigslimVdub · 2019-03-29T03:58:46Z

Build success Ubuntu 18.04.2.
seems to be working ok on testnet and mining at 815kh on 2 threads

iamsmooth · 2019-03-29T23:47:31Z

@stuffu Nice work making the PRs for xmrig and the stratum proxy. Is something needed for pool code and/or that javascript hashing library that most of the JS pool implementations use?

camthegeek · 2019-03-30T02:22:51Z

@stuffu Nice work making the PRs for xmrig and the stratum proxy. Is something needed for pool code and/or that javascript hashing library that most of the JS pool implementations use?

I believe it needs to be added to multi-hashing as most pools call upon an algorithm defined in multi-hashing.

stoffu · 2019-03-31T07:49:51Z

Currently I’m trying to update the pool code but still struggling to get it working:

stoffu · 2019-04-01T06:31:34Z

Testnet pool working: http://162.210.173.150:8080/

BigslimVdub · 2019-04-08T02:39:25Z

Built on osx high sierra and seems to be working ok only basic testing with testnet.
7 threads on i7 cpu xmrig pr1004 getting 4.2Mh.

stoffu · 2019-04-08T11:31:55Z

The above fix is for visibility purposes and is meant to be squashed with the previous commit.

stoffu · 2019-04-08T11:37:56Z

Note that the nonce size change requires wiping the older v8 testnet chain. Please use aeon-blockchain-import from the commit before the nonce size change and roll back to 111000 before running the latest daemon.

stoffu · 2019-04-09T11:35:26Z

Monero's scaling solution based on the long term block weight (monero-project#5124) has now been taken as well. It includes some misc tweaks I've made along the way pending review/approval (monero-project#5414).

BigslimVdub · 2019-05-22T02:39:53Z

Approved

iamsmooth · 2019-06-16T01:38:22Z

Has a conflict now after #106 was merged.

stoffu · 2019-06-17T00:10:27Z

Resolved conflicts

stoffu · 2019-06-17T03:29:34Z

The last commit is pending upstream approval monero-project#5659

BigslimVdub · 2019-07-04T02:46:06Z

18.04.2 builds ok with the latest fetch and checkout of pr-108.
I am getting this error from daemon now running on testnet:

status

2019-07-04 02:36:20.363	    7f90bffff700	ERROR	default	contrib/epee/include/console_handler.h:388	Exception at [console_handler], what=boost::too_few_args: format-string referred to more arguments than were passed
version
Aeon 'Sophia' (v0.12.9.0-master-66c7dd91)

It seems that PR-119 was merged yesterday.

BigslimVdub · 2019-07-08T02:14:43Z

18.04.2 builds ok with the latest fetch and checkout of pr-108.
I am getting this error from daemon now running on testnet:
status

2019-07-04 02:36:20.363	    7f90bffff700	ERROR	default	contrib/epee/include/console_handler.h:388	Exception at [console_handler], what=boost::too_few_args: format-string referred to more arguments than were passed
version
Aeon 'Sophia' (v0.12.9.0-master-66c7dd91)
It seems that PR-119 was merged yesterday.

Build successful now on 18.04.2 and status command shows proper response.

Based on Boolberry work by: jahrsg <jahr@jahr.me> cr.zoidberg <crypto.zoidberg@gmail.com>

…nused-function

This curbs runaway growth while still allowing substantial spikes in block weight Original specification from ArticMine: here is the scaling proposal Define: LongTermBlockWeight Before fork: LongTermBlockWeight = BlockWeight At or after fork: LongTermBlockWeight = min(BlockWeight, 1.4*LongTermEffectiveMedianBlockWeight) Note: To avoid possible consensus issues over rounding the LongTermBlockWeight for a given block should be calculated to the nearest byte, and stored as a integer in the block itself. The stored LongTermBlockWeight is then used for future calculations of the LongTermEffectiveMedianBlockWeight and not recalculated each time. Define: LongTermEffectiveMedianBlockWeight LongTermEffectiveMedianBlockWeight = max(300000, MedianOverPrevious100000Blocks(LongTermBlockWeight)) Change Definition of EffectiveMedianBlockWeight From (current definition) EffectiveMedianBlockWeight = max(300000, MedianOverPrevious100Blocks(BlockWeight)) To (proposed definition) EffectiveMedianBlockWeight = min(max(300000, MedianOverPrevious100Blocks(BlockWeight)), 50*LongTermEffectiveMedianBlockWeight) Notes: 1) There are no other changes to the existing penalty formula, median calculation, fees etc. 2) There is the requirement to store the LongTermBlockWeight of a block unencrypted in the block itself. This is to avoid possible consensus issues over rounding and also to prevent the calculations from becoming unwieldy as we move away from the fork. 3) When the EffectiveMedianBlockWeight cap is reached it is still possible to mine blocks up to 2x the EffectiveMedianBlockWeight by paying the corresponding penalty. Note: the long term block weight is stored in the database, but not in the actual block itself, since it requires recalculating anyway for verification. AEON Notes: - The surge factor is reduced from x50 to x20. - The long term growth rate is reduced from 40% to 4%.

stoffu force-pushed the aeon-k12 branch from f8aefc1 to 9b03996 Compare March 28, 2019 03:13

stoffu mentioned this pull request Mar 28, 2019

Inconsistent results of K12 with test vectors? XKCP/XKCP#58

Closed

stoffu force-pushed the aeon-k12 branch from 9b03996 to 3a7d767 Compare March 28, 2019 04:24

stoffu force-pushed the aeon-k12 branch from 3a7d767 to e67b87d Compare March 28, 2019 04:51

stoffu force-pushed the aeon-k12 branch 3 times, most recently from 2639bf2 to 4bb9059 Compare March 28, 2019 07:21

stoffu mentioned this pull request Mar 29, 2019

support 128 bit difficulty type moneroexamples/onion-monero-blockchain-explorer#172

Closed

iamsmooth mentioned this pull request Mar 29, 2019

Aeon CryptonightR-light / What about? #72

Closed

This was referenced Mar 29, 2019

Aeon v8: PoW switch to KangarooTwelve sammy007/monero-stratum#102

Merged

Add support for KangarooTwelve (Aeon v8) xmrig/xmrig#1004

Closed

This was referenced Apr 1, 2019

[Request] Support for KangarooTwelve (Aeon v8) xmrig/xmrig-nvidia#261

Closed

[Request] Support for KangarooTwelve (Aeon v8) xmrig/xmrig-amd#250

Closed

stoffu force-pushed the aeon-k12 branch 2 times, most recently from ef86d6c to 368be95 Compare April 8, 2019 10:20

stoffu force-pushed the aeon-k12 branch from 368be95 to 6c2499a Compare April 9, 2019 11:32

stoffu force-pushed the aeon-k12 branch from 6c2499a to 21af3ed Compare April 24, 2019 05:40

stoffu force-pushed the aeon-k12 branch from 89193a2 to 8ef20a5 Compare June 17, 2019 00:10

stoffu force-pushed the aeon-k12 branch 2 times, most recently from 2d6a850 to 66c7dd9 Compare July 3, 2019 02:17

stoffu force-pushed the aeon-k12 branch from 66c7dd9 to d4e4e6b Compare July 4, 2019 04:27

moneromooo-monero and others added 11 commits July 15, 2019 22:09

rpc: add cumulative difficulty in block header data /monero#4373

ac94369

lmdb: fix gcc 7.3.0 'implicit-fallthrough' warning /monero#4872

3e9854b

Make difficulty 128 bit instead of 64 bit /monero#5239

1c12078

Based on Boolberry work by: jahrsg <jahr@jahr.me> cr.zoidberg <crypto.zoidberg@gmail.com>

switch to KangarooTwelve proof of work

f8b141c

k12: remove fromBytesToWords/fromWordsToBytes to circumvent -Werror=u…

af4678f

…nused-function

k12: add official test vectors

b540077

set testnet v8 fork height to 112000

ee73d47

Enlarge nonce space to 64 bit

99738cd

fix wide difficulty conversion with some versions of boost /monero#5510

a6a2223

daemon: print 128bit diff properly /monero#5659

f1f9de9

stoffu force-pushed the aeon-k12 branch from d4e4e6b to f1f9de9 Compare July 15, 2019 13:09

stoffu mentioned this pull request Jul 15, 2019

Reduce transaction sizes by adopting the Borromean signature scheme #123

Merged

aeonix merged commit 902e432 into aeonix:master Jul 17, 2019

stoffu mentioned this pull request Jul 17, 2019

Proposal to switch to SHA-3 proof of work #103

Closed

BigslimVdub mentioned this pull request Jul 25, 2019

Errors when opening wallet using aeon-wallet-rpc? Failed to parse transaction from blob #10

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

switch to KangarooTwelve proof of work #108

switch to KangarooTwelve proof of work #108

stoffu commented Mar 28, 2019 •

edited

Loading

iamsmooth commented Mar 28, 2019

BigslimVdub commented Mar 28, 2019

iamsmooth commented Mar 28, 2019

stoffu commented Mar 28, 2019

stoffu commented Mar 28, 2019

iamsmooth commented Mar 29, 2019

BigslimVdub commented Mar 29, 2019

iamsmooth commented Mar 29, 2019

camthegeek commented Mar 30, 2019

stoffu commented Mar 31, 2019

stoffu commented Apr 1, 2019

BigslimVdub commented Apr 8, 2019

stoffu commented Apr 8, 2019

stoffu commented Apr 8, 2019

stoffu commented Apr 9, 2019

BigslimVdub commented May 22, 2019

iamsmooth commented Jun 16, 2019

stoffu commented Jun 17, 2019

stoffu commented Jun 17, 2019

BigslimVdub commented Jul 4, 2019

BigslimVdub commented Jul 8, 2019

switch to KangarooTwelve proof of work #108

switch to KangarooTwelve proof of work #108

Conversation

stoffu commented Mar 28, 2019 • edited Loading

iamsmooth commented Mar 28, 2019

BigslimVdub commented Mar 28, 2019

From the conclusion:

Also from page 17 regarding speed comparisons to other POW in Table 2:

iamsmooth commented Mar 28, 2019

stoffu commented Mar 28, 2019

stoffu commented Mar 28, 2019

iamsmooth commented Mar 29, 2019

BigslimVdub commented Mar 29, 2019

iamsmooth commented Mar 29, 2019

camthegeek commented Mar 30, 2019

stoffu commented Mar 31, 2019

stoffu commented Apr 1, 2019

BigslimVdub commented Apr 8, 2019

stoffu commented Apr 8, 2019

stoffu commented Apr 8, 2019

stoffu commented Apr 9, 2019

BigslimVdub commented May 22, 2019

iamsmooth commented Jun 16, 2019

stoffu commented Jun 17, 2019

stoffu commented Jun 17, 2019

BigslimVdub commented Jul 4, 2019

BigslimVdub commented Jul 8, 2019

stoffu commented Mar 28, 2019 •

edited

Loading