feat: data provider bsc token & BABT token holder group

[0xmme]

As mentioned in the comments of #1483 here is a new data provider for BSC tokens and NFTs, powered by Ankr.
As their free version has a rate limit it takes a while to generate the group of around 700k BABT holders, but I couldn't find any other free provider that offers the information.

[MartinGbz]

left some comments 😉

[MartinGbz]

As mentioned in the comments of #1483 here is a new data provider for BSC tokens and NFTs, powered by Ankr. As their free version has a rate limit it takes a while to generate the group of around 700k BABT holders, but I couldn't find any other free provider that offers the information.

Yes I understand, maybe we can use other alternatives like bitquery for example (I saw that we can fetch 10 free call per minute, maybe it can do the job?)

But yes it will be surely complicated to find a way to do this without paying a bit

[0xmme]

I found out the one from Ankr can do up to 50req/min with 1000 addresses per request, that's the fastest I found. But I can have another deeper look.

[0xmme]

I checked and another provider could be Moralis, but they expect to use their SDK and require an API key. Do you want to add moralis as depency to the hub and store and API key in a .env ? Otherwise I think 50.000 addresses/min with Ankr is the best I could find. :)

[MartinGbz]

Hey @mme022 I tested the code with a premium version of ankr but the problem still the same.
We can't paralellise multiple requests (for example with a promise.all(), because for each request, it gave us in response a "nextPage" field in order to fetch the next results). So we can't fetch all in once, that's why it takes ~15min to fetch all the data and that's unfortunately too long...

[0xmme]

Wow still 15 mins with the timeout removed? That's sad to hear.

[MartinGbz]

Wow still 15 mins with the timeout removed? That's sad to hear.

May bad! totally forgot this set timeout (was thinking the API was very slow, I'm dumb) 😅😅
I'll merge this in the afternoon! 👍

[0xmme]

Wow still 15 mins with the timeout removed? That's sad to hear.

May bad! totally forgot this set timeout (was thinking the API was very slow, I'm dumb) 😅😅 I'll merge this in the afternoon! 👍

Ah I could've commented that here as well. ;) Nice! Great that it works then!