Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add another snapshot provider #355

Merged
merged 6 commits into from
Jan 19, 2024
Merged

Conversation

ynvv
Copy link
Contributor

@ynvv ynvv commented Dec 26, 2023

Description

Hello! I am Artem from fastnode.io
We are aware of the community's concerns about the lack of fresh op-geth snapshots - we already have an extensive number of internal snapshots, which we are ready to share with the OP community!

We are ready to update them every week so that community can raise nodes in a few hours, not in a few weeks.

Tests

Please describe any tests you've added. If you've added no tests, or left important behavior untested, please explain why not.

Additional context

Add any other context about the problem you're solving.

Metadata

  • Fixes #[Link to Issue]

Copy link

netlify bot commented Dec 26, 2023

Deploy Preview for docs-optimism ready!

Name Link
🔨 Latest commit 03f5340
🔍 Latest deploy log https://app.netlify.com/sites/docs-optimism/deploys/65aaf7edddf82400087313a2
😎 Deploy Preview https://deploy-preview-355--docs-optimism.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Copy link
Contributor

coderabbitai bot commented Dec 26, 2023

Warning

Rate Limit Exceeded

@sbvegan has exceeded the limit for the number of commits or files that can be reviewed per hour. Please wait 26 minutes and 1 seconds before requesting another review.

How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.
Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.
Please see our FAQ for further information.

Commits Files that changed from the base of the PR and between 6e473f2 and 03f5340.

Walkthrough

The documentation update includes a hyperlink to provide easy access to actual snapshots for the mainnet. This enhancement aims to assist node operators by providing a direct link to the necessary snapshots within the tutorial guide. Additionally, a warning about a third-party snapshot provider, FastNode, has been included along with a link to their service.

Changes

File Path Change Summary
pages/builders/node-operators/tutorials/mainnet.mdx Added a warning about FastNode being a 3rd party provider for OP mainnet snapshots, with a link to FastNode's website. Included a hyperlink for accessing mainnet snapshots in the tutorial.
pages/builders/node-operators/management/snapshots.mdx Added information about FastNode.io providing more recent full node snapshots for OP Mainnet, with a disclaimer about it being a 3rd party provider. Included a link to FastNode's website for accessing the snapshots.

Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

Share

Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>.
    • Generate unit-tests for this file.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai generate unit tests for this file.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai generate interesting stats about this repository from git and render them as a table.
    • @coderabbitai show all the console.log statements in this repository.
    • @coderabbitai read src/utils.ts and generate unit tests.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (invoked as PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger a review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai help to get help.

Additionally, you can add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.

CodeRabbit Configration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • The JSON schema for the configuration file is available here.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/coderabbit-overrides.v2.json

CodeRabbit Discord Community

Join our Discord Community to get help, request features, and share feedback.

@Chomtana
Copy link
Contributor

TLDR: Fastnode provided an alternative OP mainnet snapshot solution >> https://datapoint.fastnode.io/

Thank you for providing an OP mainnet snapshot. Would like to know if we can have an endpoint that dynamically fetch the latest snapshot file name.

@pires
Copy link

pires commented Jan 2, 2024

This would be helpful for Sepolia too. Do you run on said network? 🙏🏻

@sbvegan
Copy link
Collaborator

sbvegan commented Jan 3, 2024

This is awesome, thank you for providing this service. My only suggestion is around the wording and highlighting that this is a third party provided snapshot.

@Chomtana
Copy link
Contributor

Chomtana commented Jan 3, 2024

Look like this archive extract to a folder named op-dir with geth inside. It would be better to extract to only geth folder (no op-dir wrapper) as the official snapshot has this behavior.

@cpengilly
Copy link
Collaborator

@ynvv I have made the suggested changes as requested by @sbvegan but if you could please address the comment by @Chomtana I'd be grateful 🙏🏾 😄

@felipe-op
Copy link
Member

@Chomtana I'm having trouble downloading the full file - can you please share what the directory structure looks like?
i.e. tree -d in the decompressed directory

@smartcontracts
Copy link
Contributor

I'd also like to change this PR so that it changes the snapshots.mdx page instead. I'll modify the tutorial to point to that page. I'm going to make a PR to update the snapshots.mdx page with the correct format so you can add your link(s).

@Chomtana
Copy link
Contributor

Chomtana commented Jan 5, 2024

image

@felipe-op Like this it's wrapped in an op-dir folder while the correct one should extract directly to the geth folder

You should be able to use aria2c to download and use

tar --use-compress-program=lz4 -xf filename.tar.lz4

to extract file

Like this

@sbvegan
Copy link
Collaborator

sbvegan commented Jan 11, 2024

Hey @ynvv would you be able to update the directory structure to address the comment above?

Hey @cpengilly and @smartcontracts, what do you guys think about adding a callout for the correct directory structure so we can get this PR in now? I have folks asking for full node snapshots and I'm directing them to this PR instead of the docs.

@ynvv
Copy link
Contributor Author

ynvv commented Jan 12, 2024

Hello, guys!

We will upload a new snapshot soon, which will contain all the edits that were discussed here. There will also be a permanent link to the latest snapshot

@ottomakan
Copy link

@ynvv Does this snapshot include the activation? I see it is dated 12-16-2023 so just wondering? Thanks for doing this!

@Sleapy31
Copy link

Thank you that snapshot worked for me !
The snapshot from the documentation (who is outdated) was not working and I could not even launch op-geth because of 'block bodies error'

@ynvv
Copy link
Contributor Author

ynvv commented Jan 19, 2024

Hello, guys!
We're just uploaded new snapshot with latest block 115039006 (after network update - Jan-19-2024 03:06:29 PM +UTC) at our site datapoint.fastnode.io

We have changed the structure of the archive: now only the geth folder is inside the archive (without the op-volume folder)

We also added the ability to download the first up-to-date snapshot of all that we have (details on the website above) (@Chomtana for u)

@sbvegan
Copy link
Collaborator

sbvegan commented Jan 19, 2024

@Sleapy31 which snapshot didn't work for you?
Screenshot 2024-01-19 at 11 33 22 AM

@Sleapy31
Copy link

@Sleapy31 which snapshot didn't work for you? Screenshot 2024-01-19 at 11 33 22 AM

OP Mainnet (Full Node) despite the checksum being correct.

@sbvegan
Copy link
Collaborator

sbvegan commented Jan 19, 2024

@Sleapy31 okay thats weird, I imagine it was something else that caused the errors because that snapshot has worked for others spinning up OP Mainnet nodes. If you have questions like this in the future, you can direct them to our forum and we can help you answer them. https://github.com/ethereum-optimism/developers/discussions

@cpengilly cpengilly merged commit 24030b7 into ethereum-optimism:main Jan 19, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

9 participants