Transaction actions indexer

[varasev]

Motivation

This is a part of #6289. The corresponding changes for the new UI are added in blockscout/frontend#434.

Changelog

This PR contains the following features and changes:

• an indexer for tx actions
• an extension of API v2 to handle requests from the new UI

This PR adds support of one protocol yet (Uniswap V3). Other protocols will be added in the next PRs.

Indexing of tx actions runs with realtime and catchup block fetchers (if DISABLE_INDEXER is not true and INDEXER_TX_ACTIONS_ENABLE is true).

There is also a separate transaction_action fetcher for historical blocks which only runs if INDEXER_TX_ACTIONS_ENABLE env variable is true and the block range is defined (see env variables description below). We need it for the case when we need to index tx actions for historical (already indexed) blocks of the chain or reindex tx actions for the defined block range (in case we found a bug in tx action indexer and need to reindex the actions for some blocks and/or protocols).

Also, the PR adds 5 new environment variables:

• INDEXER_TX_ACTIONS_ENABLE (defaults to false) - enables transaction actions indexer.
• INDEXER_TX_ACTIONS_MAX_TOKEN_CACHE_SIZE (defaults to 100000) - sets a maximum number of items in an internal cache of tx actions indexing process (to limit memory consumption).
• INDEXER_TX_ACTIONS_REINDEX_FIRST_BLOCK - defines the first block of a block range for historical indexing or reindexing of tx actions.
• INDEXER_TX_ACTIONS_REINDEX_LAST_BLOCK - defines the last block of a block range for historical indexing or reindexing of tx actions. Cannot exceed the last block of a chain.
• INDEXER_TX_ACTIONS_REINDEX_PROTOCOLS (defaults to empty string) - defines comma-separated names of protocols which should be indexed or reindexed on historical blocks defined by the range. Example: uniswap_v3,zkbob - only these protocols will be indexed or reindexed for the defined block range. If the value is empty string (or not defined), all supported protocols will be indexed/reindexed. This option is not applicable to realtime and catchup fetcher (it always indexes all supported protocols).

Checklist for your Pull Request (PR)

• I added an entry to CHANGELOG.md with this PR
• If I added new functionality, I added tests covering it.
• If I fixed a bug, I added a regression test to prevent the bug from silently reappearing again.
• I checked whether I should update the docs and did so by submitting a PR Add env variables and update sharelock.md for tx actions indexer docs#101
• If I added/changed/removed ENV var, I submitted a PR to https://github.com/blockscout/docs to update the list of env vars at https://github.com/blockscout/docs/blob/master/for-developers/information-and-settings/env-variables.md and I updated the version to master in the Version column. Changes will be reflected in this table: https://docs.blockscout.com/for-developers/information-and-settings/env-variables.
• If I add new indices into DB, I checked, that they are not redundant with PGHero or other tools

[varasev]

@nikitosing I finished working on the reviewers' comments. Now you can review as well. Thanks

[nikitosing]

@varasev Can you please fix failing tests?

[varasev]

@varasev Can you please fix failing tests?

Do you mean the following one?

Error:      test/indexer/block/realtime/fetcher_test.exs:45
     ** (FunctionClauseError) no function clause matching in anonymous fn/2 in Indexer.Block.Realtime.FetcherTest."test Indexer.Block.Fetcher.fetch_and_import_range/1 in range with internal transactions"/1

     The following arguments were given to anonymous fn/2 in Indexer.Block.Realtime.FetcherTest."test Indexer.Block.Fetcher.fetch_and_import_range/1 in range with internal transactions"/1:
     
         # 1
         %{id: 0, jsonrpc: "2.0", method: "net_version", params: []}

I can't reproduce it locally for some reason 🤔 Trying to run:

cd apps/indexer
export MIX_ENV=test
mix test --no-start --exclude no_nethermind

Am I missing something?

[vbaranov]

@varasev Can you please fix failing tests?

Do you mean the following one?

Error:      test/indexer/block/realtime/fetcher_test.exs:45
     ** (FunctionClauseError) no function clause matching in anonymous fn/2 in Indexer.Block.Realtime.FetcherTest."test Indexer.Block.Fetcher.fetch_and_import_range/1 in range with internal transactions"/1

     The following arguments were given to anonymous fn/2 in Indexer.Block.Realtime.FetcherTest."test Indexer.Block.Fetcher.fetch_and_import_range/1 in range with internal transactions"/1:
     
         # 1
         %{id: 0, jsonrpc: "2.0", method: "net_version", params: []}

I can't reproduce it locally for some reason 🤔 Trying to run:

cd apps/indexer
export MIX_ENV=test
mix test --no-start --exclude no_nethermind

Am I missing something?

All is good. There were blinking tests. All are green after a manual restart.

[varasev]

I added INDEXER_TX_ACTIONS_ENABLE env variable (defaults to false) in be99681.