Skip to content

fix: stop Satoshi historical scan log OOM #604

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
macterra merged 2 commits into from
Jun 4, 2026
Merged

fix: stop Satoshi historical scan log OOM #604

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
916aa16
fix satoshi historical scan log oom
macterra Jun 4, 2026
b73766f
clarify satoshi pruned fallback diagnostics
macterra Jun 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 14 additions & 6 deletions services/mediators/satoshi/src/satoshi-mediator.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -54,6 +54,7 @@ const btcClient = new BtcClient({
const fallbackBtcClient = config.fallbackRpcUrl
? new BtcClient({ host: config.fallbackRpcUrl })
: undefined;
let primaryPruneHeight: number | undefined;

type ChainReadClient = Pick<BtcClient, 'getBlockHash' | 'getBlock' | 'getBlockHeader' | 'getBlockCount'>;

Expand Down Expand Up @@ -126,7 +127,15 @@ async function getChainBlockTxids(hash: string): Promise<Block> {
return withFallback(`block ${hash}`, async (client) => await client.getBlock(hash, BlockVerbosity.JSON) as Block);
}

async function getChainBlockHex(hash: string): Promise<string> {
async function getChainBlockHex(hash: string, height?: number): Promise<string> {
if (fallbackBtcClient && primaryPruneHeight !== undefined && height !== undefined && height <= primaryPruneHeight) {
try {
return await fallbackBtcClient.getBlock(hash, BlockVerbosity.HEX) as string;
} catch (error) {
throw new HistoricalBlockDataUnavailableError(`block ${hash}`, `primary RPC skipped because it is pruned through height ${primaryPruneHeight}`, error);
}
Comment thread
macterra marked this conversation as resolved.
}

return withFallback(`block ${hash}`, async (client) => await client.getBlock(hash, BlockVerbosity.HEX) as string);
}

Expand Down Expand Up @@ -664,16 +673,14 @@ async function fetchBlock(height: number, blockCount: number): Promise<void> {
try {
const blockHash = await getChainBlockHash(height);
const header = await getChainBlockHeader(blockHash);
const blockHex = await getChainBlockHex(blockHash);
const blockHex = await getChainBlockHex(blockHash, height);
const transactions = parseRawBlockTransactions(blockHex);
const blockTime = header.time ?? 0;
const timestamp = new Date(blockTime * 1000).toISOString();

for (let index = 0; index < transactions.length; index++) {
const tx = transactions[index];

console.log(height, String(index).padStart(4), tx.txid);

for (const opReturn of tx.opReturns) {
try {
const textString = Buffer.from(opReturn, 'hex').toString('utf8');
Expand Down Expand Up @@ -1127,8 +1134,9 @@ async function waitForChain() {
const blockchainInfo = await btcClient.getBlockchainInfo();
console.log("Blockchain Info:", JSON.stringify(blockchainInfo, null, 4));
const info = blockchainInfo as BlockchainInfo;
if (info.pruned && typeof info.pruneheight === 'number' && config.startBlock < info.pruneheight && !fallbackBtcClient) {
console.warn(`${config.chain} primary RPC is pruned at height ${info.pruneheight}, but start block is ${config.startBlock} and ARCHON_SAT_FALLBACK_RPC_URL is unset. Missing historical blocks will not be recoverable from this node.`);
primaryPruneHeight = info.pruned && typeof info.pruneheight === 'number' ? info.pruneheight : undefined;
if (primaryPruneHeight !== undefined && config.startBlock <= primaryPruneHeight && !fallbackBtcClient) {
console.warn(`${config.chain} primary RPC is pruned at height ${primaryPruneHeight}, but start block is ${config.startBlock} and ARCHON_SAT_FALLBACK_RPC_URL is unset. Missing historical blocks will not be recoverable from this node.`);
}
isReady = true;
} catch (error) {
Expand Down
Loading