Standardize events data

[lukaspetrasek]

DeRisk currently works with event data in a raw format where the relevant data (like the user, token, amount, etc.) is saved in a dictionary or list-like structure in one of the columns. To better extract information from the database, it would be helpful to have a unified data structure where all relevant pieces of information would be saved in a separate column. Thus, we could, e.g., easily query all events of the given type (deposit, withdrawal, liquidation) for the given user, lending protocol, etc.

The task is to take a sample of events (which will be provided on demand) and convert it to a standardized format that can be used to store information about any type of event and any lending protocol.

[fishonamos]

I will love to work on this @lukaspetrasek

[khayss]

I'll love to handle this issue

[lukaspetrasek]

Hi, can you guys please tell me something about you, what skills/experience do you have and how do you plan to tackle this issue? This task is not simple, so I have to learn more information before I assign anyone 🙏🏼

[godekina]

Hello I will love to work on this issue, @lukaspetrasek
I am a python developer with experience as a data scientist, I can create a function to organize the data in a csv file, then write code for retrieval

[lukaspetrasek]

Okay, assigning you @godekina 👍🏼

@godekina Let me know if everything is clear. If you have any questions, please ask here. What is you TG handler please? 🙏🏼

Consider joining our TG group.
See also our contributor guidelines.

[godekina]

Thanks @lukaspetrasek I'd like to have the sample data so I can work on writing code to standardize them.
my telegram handle is: @godekina
I have joined the Telegram group.

[lukaspetrasek]

Hi @godekina , you can find the sample e.g. for zkLend here: https://storage.googleapis.com/derisk-persistent-state/zklend_data/events_sample.parquet.

To obtain the sample for other protocols, just change the folder in the address, e.g. https://storage.googleapis.com/derisk-persistent-state/nostra_alpha_data/events_sample.parquet for Nostra Alpha.

[godekina]

@lukaspetrasek the pull request #123 for this feature is ready for review.

[lukaspetrasek]

Hi @godekina , 🔙