Read from a Farcaster Hub instead of the Warpcast API #15

gskril · 2023-03-11T18:09:18Z

Resources:

Farcaster Hub spec
Hubble (Typescript implementation of a Hub)

error creating a signer with `EthersEip712Signer`, patch coming tomorrow

src/lib/utils.ts

…to hubs

* signers * Add storage and registrations * Refactor code to use MAX_PAGE_SIZE constant * Refactor getOnChainEventsByFidInBatchesOf function * Update page size constant to use MAX_PAGE_SIZE * Minor cleanup * Remove unused import * Patches * Patch date logic * Fix fid registration time, delete unused table --------- Co-authored-by: Greg Skriloff <35093316+gskril@users.noreply.github.com>

Co-authored-by: Greg <35093316+gskril@users.noreply.github.com>

gskril added 5 commits March 11, 2023 01:44

start rewrite

4fb7354

progress

e5b7b09

Add more types

19f6dd6

Generate db types

0bf2b26

Rename function

adbf47c

gskril marked this pull request as draft March 11, 2023 18:10

gskril changed the title ~~Read from Farcaster Hub instead of Warpcast API~~ Read from a Farcaster Hub instead of the Warpcast API Mar 11, 2023

gskril added 23 commits March 11, 2023 16:55

Format data & hashes, improve types, conect db

ca9f810

Update readme

36c10ae

Update .env.example

1fb231a

Listen for verification add and remove messages

a756ea7

Abstract functions for modifying db

ed93a8b

Clean up, start profile API

7d9e933

Finish profile API

a560052

Create db migration for profiles

73e1aa9

Add dummy messages for testing

bc1eac6

Move watch()

eaaa15e

Add todo

027d5d4

Index reactions

7d8d6bc

Index signers

e7d601f

Make signer label optional

a5d8f61

Clean up dev env

a1f9370

Update default port

61df781

Update handler to listen for REVOKE_MESSAGE

f7bda21

Upgrade deps

6fb81a0

error creating a signer with `EthersEip712Signer`, patch coming tomorrow

Start seed functions

5bc7cc9

Update deps and fix dummy messages

387b7d7

Clean up dummy messages

d56ad20

Clean index file

02bbf38

Improve naming

9847fbc

gskril added 6 commits May 1, 2024 17:40

Update batch size

cbd7a42

Update readme

9e0b132

Keep track of progress within jobs

ef3df6c

Improve redis implementation

d2c9810

Fix job progress

cd859cc

Abstract redis

d9ad7dd

dawsbot reviewed May 2, 2024

View reviewed changes

src/lib/utils.ts Outdated Show resolved Hide resolved

zachterrell57 and others added 23 commits May 3, 2024 12:52

add hub data

613bb69

Run stream through bullmq, better use of Redis

ae24c44

Merge branch 'hubs' of https://github.com/gskril/farcaster-indexer in…

c9bde19

…to hubs

Wait to stream until backfill completes

1a5d135

Update concurrency logic

775bce8

Improve logic to save event ID before backfill

db444d5

Fix import

eedf7ed

Throw errors on inserts so the job gets flagged

00ed149

Clean dependencies

99f1e25

Clean migration

a3cce22

Paginate links on backfill

9d5e277

Add streamed events to queue in batches

5c65c81

Optimize events in the queue

85b1268

Resolve conflict

3fa3fc0

Update job progress during backfill

951eeab

Add Users View (#30)

9cb0fb5

Co-authored-by: Greg <35093316+gskril@users.noreply.github.com>

Add option to override worker concurrency

bf3931c

Add stats endpoint

e704aee

Add latestEventTimestamp to /stats API

31697b7

Insert links in chunks

8e612aa

Improve type safety, backfill tweak

dd5cf75

Use farcasterTimeToDate util where relevant

4ff59ed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Read from a Farcaster Hub instead of the Warpcast API #15

Read from a Farcaster Hub instead of the Warpcast API #15

gskril commented Mar 11, 2023

Read from a Farcaster Hub instead of the Warpcast API #15

Are you sure you want to change the base?

Read from a Farcaster Hub instead of the Warpcast API #15

Conversation

gskril commented Mar 11, 2023