From 0cd5b0d6ea51d32390e68cfcab1d9a603f333d63 Mon Sep 17 00:00:00 2001 From: shelleyolivia <108895606+shelleyolivia@users.noreply.github.com> Date: Thu, 27 Oct 2022 12:15:57 -0700 Subject: [PATCH 1/2] Update provider uri's Replacing the illustrative provider uri with a public Alchemy provider uri. In full transparency, I work at Alchemy and as our own developers were asking about ETLs, we created a public provider uri for all to use for free. --- README.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/README.md b/README.md index 4cf5d69ab..329ad9845 100644 --- a/README.md +++ b/README.md @@ -24,7 +24,7 @@ Export blocks and transactions ([Schema](docs/schema.md#blockscsv), [Reference]( ```bash > ethereumetl export_blocks_and_transactions --start-block 0 --end-block 500000 \ --blocks-output blocks.csv --transactions-output transactions.csv \ ---provider-uri https://mainnet.infura.io/v3/7aef3f0cd1f64408b163814b22cc643c +--provider-uri https://eth-mainnet.g.alchemy.com/v2/AvOXKWd4q-6_tMsGFMi2fLp2EM-HHTsK ``` Export ERC20 and ERC721 transfers ([Schema](docs/schema.md#token_transferscsv), [Reference](docs/commands.md##export_token_transfers)): @@ -48,7 +48,7 @@ Stream blocks, transactions, logs, token_transfers continually to console ([Refe ```bash > pip3 install ethereum-etl[streaming] > ethereumetl stream --start-block 500000 -e block,transaction,log,token_transfer --log-file log.txt \ ---provider-uri https://mainnet.infura.io/v3/7aef3f0cd1f64408b163814b22cc643c +--provider-uri https://eth-mainnet.g.alchemy.com/v2/AvOXKWd4q-6_tMsGFMi2fLp2EM-HHTsK ``` Find other commands [here](https://ethereum-etl.readthedocs.io/en/latest/commands/). @@ -78,7 +78,7 @@ For the latest version, check out the repo and call ```bash > pip3 install -e .[dev,streaming] > export ETHEREUM_ETL_RUN_SLOW_TESTS=True -> export PROVIDER_URL= +> export PROVIDER_URL= > pytest -vv ``` @@ -100,8 +100,8 @@ For the latest version, check out the repo and call 3. Run a container out of the image - > docker run -v $HOME/output:/ethereum-etl/output ethereum-etl:latest export_all -s 0 -e 5499999 -b 100000 -p https://mainnet.infura.io - > docker run -v $HOME/output:/ethereum-etl/output ethereum-etl:latest export_all -s 2018-01-01 -e 2018-01-01 -p https://mainnet.infura.io + > docker run -v $HOME/output:/ethereum-etl/output ethereum-etl:latest export_all -s 0 -e 5499999 -b 100000 -p https://eth-mainnet.g.alchemy.com/v2/ + > docker run -v $HOME/output:/ethereum-etl/output ethereum-etl:latest export_all -s 2018-01-01 -e 2018-01-01 -p https://eth-mainnet.g.alchemy.com/v2/ 4. Run streaming to console or Pub/Sub From eda13370c0ad890e1140c6e5038a7bb7a3a69a86 Mon Sep 17 00:00:00 2001 From: shelleyolivia <108895606+shelleyolivia@users.noreply.github.com> Date: Thu, 27 Oct 2022 12:41:48 -0700 Subject: [PATCH 2/2] Updated uri provider to a general api key The public api key would have been rate limited and would be only for small scale tests rather than for running large applications. Didn't want to confuse developers. --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 329ad9845..138cee7fe 100644 --- a/README.md +++ b/README.md @@ -24,7 +24,7 @@ Export blocks and transactions ([Schema](docs/schema.md#blockscsv), [Reference]( ```bash > ethereumetl export_blocks_and_transactions --start-block 0 --end-block 500000 \ --blocks-output blocks.csv --transactions-output transactions.csv \ ---provider-uri https://eth-mainnet.g.alchemy.com/v2/AvOXKWd4q-6_tMsGFMi2fLp2EM-HHTsK +--provider-uri https://eth-mainnet.g.alchemy.com/v2/alchemy_api_key ``` Export ERC20 and ERC721 transfers ([Schema](docs/schema.md#token_transferscsv), [Reference](docs/commands.md##export_token_transfers)): @@ -48,7 +48,7 @@ Stream blocks, transactions, logs, token_transfers continually to console ([Refe ```bash > pip3 install ethereum-etl[streaming] > ethereumetl stream --start-block 500000 -e block,transaction,log,token_transfer --log-file log.txt \ ---provider-uri https://eth-mainnet.g.alchemy.com/v2/AvOXKWd4q-6_tMsGFMi2fLp2EM-HHTsK +--provider-uri https://eth-mainnet.g.alchemy.com/v2/alchemy_api_key ``` Find other commands [here](https://ethereum-etl.readthedocs.io/en/latest/commands/).