feat: add evolution chain scraping - #1
Merged
Conversation
added 3 commits
April 17, 2026 16:47
Parse evolution chain from sprite detail pages, extracting each stage's name, id, evolves_from, level requirement, and special condition. Stored in JSON before skills field, and in CSV as semicolon-separated entries with format name(level/condition).
Use sprite no (numeric) instead of name as identifier in evolution_chain stages. Backfill is done post-scrape via name→no mapping.
Owner
|
Thank you for your contribution |
Owner
|
您好,星辰同学,
很高兴您对我的项目的认可,我也非常乐意见到您的加入。这是我的微信号:Li001502615,请您添加的时候备注一下,我这边看到了就会立刻通过。
实际上,目前我正在澳洲的UNSW继续硕士学业,因为学校的特殊制度,导致我目前正在忙于期末复习和下月初的考试,这段时间我也会比较忙碌可能无法按时推进进度,目前正在规划的下一步是通过
https://github.com/JhonTitor6/roco-kingdom-world-script.git
,这个闪耀大赛自爆开源项目实现新的PVP脚本模式,通过插入编辑好的脚本来实现自动闪耀大赛,后续可能会加入由战斗模拟器训练的AI联通脚本模式进行自动PVP
Xingchen Li ***@***.***> 于2026年4月22日周三 00:13写道:
… *bupt-lxc* left a comment (AofeiLi-code/rocom-data#1)
<#1?email_source=notifications&email_token=A3NYWCQOFPMEW7VXJTNUT2T4W56XJA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTIMRYHEZDCOJUHAZKM4TFMFZW63VMON2GC5DFL5RWQYLOM5S2KZLWMVXHJNLQOJPWG33NNVSW45C7N5YGK3S7MNWGSY3L#issuecomment-4289219482>
作者你好,你的项目很好,我是提pr的bupt-lxc,你项目中数据爬取的功能和图片识别的功能帮助了我开发项目。
我的项目目前正在开发(和对战的思路不同,但应该能互相辅助),如果能够应用,预计应该能获得至少100+star并产生一定影响力,目前我正值找工作面试期间,也非常忙,所以实际开发时间有限,进度比较慢,不知你是否感兴趣,如果感兴趣可以给我回您的微信,我们可以共同开发,我认为非常需要你的经验。如果暂时没空也没关系,就等之后再一起开发。
期待你的回复
李星辰
北京邮电大学/研博生/计算机学院(国家示范性软件学院)
北京
------------------ Original ------------------
From: ***@***.***>;
Date: Tue, Apr 21, 2026 04:43 PM
To: ***@***.***>;
Cc: "Xingchen ***@***.***>; ***@***.***>;
Subject: Re: [AofeiLi-code/rocom-data] feat: add evolution chain
scraping (PR #1)
Merged #1 into main.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID:
***@***.***>
—
Reply to this email directly, view it on GitHub
<#1?email_source=notifications&email_token=A3NYWCQOFPMEW7VXJTNUT2T4W56XJA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTIMRYHEZDCOJUHAZKM4TFMFZW63VMON2GC5DFL5RWQYLOM5S2KZLWMVXHJNLQOJPWG33NNVSW45C7N5YGK3S7MNWGSY3L#issuecomment-4289219482>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/A3NYWCTZQ2YGXXROITF7OU34W56XJAVCNFSM6AAAAACX4WKQZWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DEOBZGIYTSNBYGI>
.
You are receiving this because you modified the open/close state.Message
ID: ***@***.***>
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
parse_evolution_chain()to scrape evolution chain from each sprite's detail pagename,no(sprite number),evolves_from,level,conditionnois backfilled post-scrape via name→no mapping, supporting form variants (e.g.板板壳(蜕皮时的样子))evolution_chainfield is stored beforeskillsin JSON outputevolution_chaincolumn:name(level/condition);...Full Scrape Results
465 sprites scraped — 465 succeeded, 0 failed.
no = nullSample Data — JSON
3-stage chain (喵喵):
[ {"name": "喵喵", "no": 2, "evolves_from": null, "level": null, "condition": null}, {"name": "喵呜", "no": 3, "evolves_from": "喵喵", "level": "16", "condition": null}, {"name": "魔力猫", "no": 4, "evolves_from": "喵呜", "level": "32", "condition": null} ]Special condition + form variant (晶石蜗):
[ {"name": "矿晶虫", "no": 39, "evolves_from": null, "level": null, "condition": null}, {"name": "晶石蜗(西瓜碧玺的样子)", "no": 40, "evolves_from": "矿晶虫", "level": "40", "condition": "撞击三次蓝晶碧玺"} ]Sample Data — CSV
evolution_chaincolumn format:name(level/condition);...— empty fields left blank.喵喵(/);喵呜(16/);魔力猫(32/)矿晶虫(/);晶石蜗(西瓜碧玺的样子)(40/撞击三次蓝晶碧玺)Test Plan
no(e.g. 板板壳(蜕皮时的样子)→ no: 12)no=nullstagessim/battle engine