Adding accounts transfer history query endpoint v2 #76

emmanueldenloye · 2022-03-07T20:02:19Z

No description provided.

…nuel/account-history

worker function for writing rows to transfers table

It is ok if there are only three values in this field (given the other conditions of course)

this is necessary because the actual query takes some non-trivial amount of time to execute and we need this map during backfills, listens, etc. These are processes which should not be unnecessarily sluggish.

there is a build error. I need to figure out how to make a function with this type "PrimaryKey BlockT Identity -> Text". using unDbHash and coerce doesn't seem to work.

we need this in case there are gaps in the new upcoming transfers table

filling an empty table

cabal.project

exec/Chainweb/Listen.hs

exec/Chainweb/Lookups.hs

lib/ChainwebDb/Types/Common.hs

exec/Chainweb/Worker.hs

exec/Chainweb/FillTransfers.hs

lib/ChainwebDb/Types/Transfer.hs

exec/Chainweb/FillTransfers.hs

…nuel/account-history

lib/ChainwebDb/Types/Transfer.hs

enobayram · 2022-09-06T20:29:50Z

Here's what remains here:

Address this comment: https://github.com/kadena-io/chainweb-data/pull/76/files#r964135523
Pin chainweb-api to the latest commit on master (both for nix and in cabal.project)
Perform the manual test steps here: Adding accounts transfer history query endpoint v2 #76 (review)

amount type :: Double -> Scientific

…nuel/account-history

* update chainweb-api types * Change numeric type of transfer amount type to Decimal * move back to using Scientific * specify correct HasColumnType instance for KDAScientific

…nuel/account-history

In this instance, I want to be able to run a migration that doesn't give any warnings about user made edits to the chainweb-data db schema.

emmanueldenloye · 2022-11-23T16:38:03Z

Here is a script to verify that the transfers table is filled correctly under all circumstances https://gist.github.com/emmanueldenloye/b814a07531afd06b9c6547bc66c5d902

Here is some command-line output showing that the accounts endpoint produces correct output https://gist.github.com/emmanueldenloye/cc7f6b14fa92606585f41ae71af45d46

enobayram

LGTM! Great work on this PR, glad it's finally getting merged.

emmanueldenloye added 19 commits March 7, 2022 11:03

point to appropriate commit in chainweb-api

3cc2819

Merge branch 'master' of github.com:kadena-io/chainweb-data into emma…

675ef17

…nuel/account-history

include accountHandler function

4a29b42

fix cabal.project

b8f43c8

create Transfer table

6ba1658

add module name to row in Transfer table

897c0dc

write function mkTransferRows

7ce25c0

worker function for writing rows to transfers table

write transfers to db

d8e1fad

checking the params field appopriately

963848c

It is ok if there are only three values in this field (given the other conditions of course)

hardcode the events activation height map

76899eb

this is necessary because the actual query takes some non-trivial amount of time to execute and we need this map during backfills, listens, etc. These are processes which should not be unnecessarily sluggish.

introduce AccountDetail type for account queries

461c1e9

there is a build error. I need to figure out how to make a function with this type "PrimaryKey BlockT Identity -> Text". using unDbHash and coerce doesn't seem to work.

fill hole in _acDetail_blockHash

31a88d0

update cabal.project

d731f8d

convert int pact object into a double

f42ec3a

include FillTransfers.hs module

b42d2b3

we need this in case there are gaps in the new upcoming transfers table

etch out basics for only filling transfers from an empty state

fbbe547

first draft of filltransfers

219154c

filling an empty table

fix mkTransferRows to include coinbase events

30d41d1

update writePayload function to account for events

2360bc9

mightybyte suggested changes Apr 26, 2022

View reviewed changes

emmanueldenloye and others added 10 commits April 26, 2022 14:32

point to chainweb-api master

c80deb1

only pass in version instead of entire env to insertNewHeader

054b964

makeEventsMinHeightMap -> eventsMinHeight

7a71905

use eventsMinHeight in fillEventsCut

9160f12

_tr_name -> _tr_modulename

51e094e

Merge branch 'master' into emmanuel/account-history

9399150

Merge branch 'master' of github.com:kadena-io/chainweb-data into emma…

c71db1f

…nuel/account-history

print raw value in mkTransferRows on error

15e44f6

put in better debugging info

319f26d

index into json array properly

eae3b68

enobayram assigned emmanueldenloye Sep 6, 2022

enobayram mentioned this pull request Sep 6, 2022

Refactor richlist generation #89

Merged

enobayram reviewed Sep 6, 2022

View reviewed changes

lib/ChainwebDb/Types/Transfer.hs Show resolved Hide resolved

emmanueldenloye added 19 commits September 7, 2022 09:55

update chainweb-api types

be16287

merge master from chainweb-api

acdfb0b

amount type :: Double -> Scientific

Merge branch 'master' of github.com:kadena-io/chainweb-data into emma…

71715e8

…nuel/account-history

Change numeric type of transfer amount type to Decimal (#94)

bfec7a5

* update chainweb-api types * Change numeric type of transfer amount type to Decimal * move back to using Scientific * specify correct HasColumnType instance for KDAScientific

Merge branch 'master' of github.com:kadena-io/chainweb-data into emma…

fe47d69

…nuel/account-history

show hashes in errors of payloadWithOutputsBatch

f76bbb9

show hash properly

0a96e24

bring in new commit from cw-api to fix chainid issue

e48f2b8

include ability to run "unsafe" migration

b5d48f6

In this instance, I want to be able to run a migration that doesn't give any warnings about user made edits to the chainweb-data db schema.

improve logging in writeBlocks function

37d252a

bump chainweb-api pin

62f2536

bugfix: create non-coinbase transfers correctly

62eb091

some cleanup

fc8485e

update endpoint definition (from chainweb-api)

f03656f

swap arguments

5c7f4c9

log account search origination

f1e6f1d

get printf correct

33e4298

include fromHeight logic

2e25b5f

print offset error message

668c204

update cabal.project file

acb93f6

enobayram approved these changes Nov 23, 2022

View reviewed changes

mightybyte approved these changes Nov 23, 2022

View reviewed changes

emmanueldenloye added 2 commits November 24, 2022 10:45

point to master branch on chainweb-api

9a0742c

update cabal.project again

6efe589

emmanueldenloye merged commit f0322dc into master Nov 24, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Adding accounts transfer history query endpoint v2 #76

Adding accounts transfer history query endpoint v2 #76

emmanueldenloye commented Mar 7, 2022

enobayram commented Sep 6, 2022 •

edited by emmanueldenloye

Loading

emmanueldenloye commented Nov 23, 2022

enobayram left a comment

Adding accounts transfer history query endpoint v2 #76

Adding accounts transfer history query endpoint v2 #76

Conversation

emmanueldenloye commented Mar 7, 2022

enobayram commented Sep 6, 2022 • edited by emmanueldenloye Loading

emmanueldenloye commented Nov 23, 2022

enobayram left a comment

Choose a reason for hiding this comment

enobayram commented Sep 6, 2022 •

edited by emmanueldenloye

Loading