Skip to content

v2.0.0: Integrate official SPN2 API

Choose a tag to compare

View all tags
@agude agude released this 02 Sep 03:30
· 101 commits to main since this release
v2.0.0
cfacfee

Release Notes:

This release integrates the official Internet Archive Save Page Now 2 (SPN2) API, providing a more robust and reliable archiving experience.

What's New

The script can now use your Internet Archive API keys to run in an authenticated mode. This provides two major benefits:

  1. Confirmed Captures: Instead of "fire-and-forget," the script now waits for the capture to complete and reports the final status. On success, it prints the permanent Wayback Machine URL for the new snapshot.
  2. Increased Submission Limits: Using the authenticated API significantly raises the daily capture limits, making the tool much more effective for large sites.

The --jobs flag has been removed in favor of a more reliable sequential process that better respects the API's rate limits.

How to Use

1. Get your credentials:
First, get your S3-style API keys from your Internet Archive account:
https://archive.org/account/s3.php

2. Create a .env file:
Next, create a .env file where you run the archiver and add your keys:

INTERNET_ARCHIVE_ACCESS_KEY="YOUR_ACCESS_KEY_HERE"
INTERNET_ARCHIVE_SECRET_KEY="YOUR_SECRET_KEY_HERE"

The script will automatically detect this file and use the new authenticated mode. If no credentials are found, it will fall back to the previous unauthenticated behavior.

Assets 2
Loading