Update hashes for all systems #20
Comments
|
Finished GG, GB, GBC, GBA |
|
I found more GG games (24) I somehow missed from the thegamesdb - I've now added them to the website and this spreadsheet has the GameDB IDs for them https://dl.dropboxusercontent.com/u/48342677/NEW%20GameGear%20IDs.csv |
|
Thanks. I added them all to the dataset and found some duplicate issues in the dataset and corrected those. |
|
Thanks !! |
|
Updated NES. |
|
finished SNES |
|
Hi @sselph , a few Genesis games that are currently missing (based on the ROMs I scraped) https://dl.dropboxusercontent.com/u/48342677/Missing%20genesis.csv edit Also, If I can be a little bit picky, my Genesis 'Earthworm Jim (USA)' ROM links to ID 2894 , which is the Mega Drive version (they're identical except for the image), rather than the Genesis ID of 4353. |
|
My missing Master System ROMs https://dl.dropboxusercontent.com/u/48342677/Missing%20MasterSystem.csv |
|
Thanks, I've added your entries. |
|
Hey. These two games result in duplicate entries (ID 611) - one should be ID 611 (vs. Kingpin), one should be 2620 (animated series). |
|
Hi @sselph , here are all of the GBA games I had that were missing an entry in TGDB. There are now IDs for all of them: Can you let me know when your database has been updated? :) |
|
Sorry for the delay, I added your csv. |
|
I didn't realize there is a thread for that before I made mine. Support for Nintendo DS would be really appreciated. I have little knowledge in coding, but if it's a matter of time, I have time to spare. Thanks. |
|
Hi, I added this game to TGDB: http://thegamesdb.net/search/?string=Super+Soukoban&function=Search but the scraper can't find it. Of course, the game is in No-Intro set: http://datomatic.no-intro.org/?page=show_record&s=49&n=2865 |
|
@Pacolo I added this game. |
|
@sselph New GBA games to add to your list :) https://drive.google.com/file/d/0ByWwZdQX1FQmVEE2RGJsaUdxbTQ/view?usp=sharing Could you let me know when they're added so I can re-scrape? Many thanks! |
|
@robertybob Added. |
|
Hi @sselph , just 5 Turbografx games missing from your scraper https://www.dropbox.com/s/13lf004v2fiwiv5/Turbografx.csv?dl=0 |
|
Done |
|
Hi again @sselph . Thank you for adding those TG16 games. I've now started importing PS1 games into my Pi. I just scraped 63 games, 35 downloaded images and details entered into the gamelist, yet running your reporting tool gives a figure of just over 50. Not sure what's going on there. Either way, here's my hashes and TGDB IDs for inclusion onto your database :) https://www.dropbox.com/s/3pavet9jjc4vyrq/PS1%20Missing.csv?dl=0 Thanks again! 👍 |
|
The script checks the cue then the bins so it is possible the cues were correct since they are just a text file but the bin was slightly different. The reporter tool doesn't look at cue files so it isn't printing those. I can add these bin's in. |
|
Ah ok, that's where I'm going wrong- it's not finding the games because I haven't got any .cue files set up yet (?) Also, I've got a few .img files, these aren't supported by your scraper yet are they IIRC? |
|
So basically without .bin support within the reporting tool, there's no way for me to gain the hashes of the games definitely not being picked up by the Scraper? |
|
Do you take unlicensed games? |
|
This scraper uses data from thegamesdb.net - if a game is on that site then this scraper should pick it up. I should note, however, that unlicensed games and hacks are frowned upon on TGDB.net ..if you add that game it may well be deleted. |
The game I added already has an entry on thegamesdb: http://thegamesdb.net/game/26500 It looks like quite a few Unlicensed games already exist in the csv:
I didn't add, someone else added it. |
|
I don't care is it is unlicensed but since the system is NES the hash from just the regular shasum probably isn't correct. Do you mind using a version I just created that uses the same hashing algorithms that the scraper uses? https://storage.googleapis.com/stevenselph.appspot.com/shasum_linux_386.zip would be used similar to shasum |
Ah, I didn't realise that you used your own hash. Sorry about that. |
|
@sselph: I will talk to the TGDB Administrators about it and see what we can do to prevent deletions. It's an issue that we need to correct. I added another hash for Atari 2600. I have more on Atari 2600 to come. |
|
Hi @sselph and a few translation patched roms for SNES: |
|
@dvanthuyl I added the translated SNES roms but I don't think I support MSX. I don't see any other MSX hashes and don't have mx2 as an extension. |
|
@sselph Are you only using hashes for NES roms with headers? I have the latest No-Intro headerless set and I cannot find any matches. Edit: Answered the question myself. And the answer is yes you only have hashes for roms with headers. |
|
I parse the headers of .nes files to find the rom information and hash that. If the files have no headers it is likely the code is still trying to parse one and is getting invalid data for the position and length of all the data. I assume the headerless .nes is just a concatenation of the PRG and CHR data so if you shasum one you would get a hash that matches a No-Intro entry? If you want to get the sha1 hash of a common rom you can confirm my suspicion and I will add in some detection of the magic string in the header to know if it should be parsed. |
|
Not sure if this helps but here is a DirToDat including sha1. |
|
Thanks, those seem to match. I'll work on adding the checks and tests. |
|
@dd900 Fixed it |
|
@sselph - Hot Off the Press! Here is the completed set of all the .ctg files I could find for the TI-99/4A. There are more games which will be added in the future, but they are not yet converted to .ctg file type. Notes:
Here is the download for the TI-99/4A Game-Hashes: Please let me know if there is anything I can do. I am sure there will be a few errors I will need to correct. I should have the metadata done on TGDB soon to match up with the existing artwork which I previously have created. Thank you! |
|
@stevetb Thanks I've added these. |
|
Could you please add these too please? |
|
@stevetb Thanks I've added these. |
|
Could you add these as well, please? https://docs.google.com/spreadsheets/d/1sY7i_3wq8_zvbjUrwpJlKqzTb6HvzxFUUeo3pknLfqM |
|
Bare Knuckle III (Japan) [En by Twilight v1.0].md,hash not found,d1dc85abe0889ff8e880edcaf908a6b195b75952 english translation patched version for this one http://thegamesdb.net/game/25471/ |
|
de475924bae6cbe7cabdc84ac4cb8aeec58f076e F-Zero (Europe).sfc 4b82c70824922380a3193e282d7674a442bd6dd4 Firemen, The (Europe) (En,Fr,De).sfc |
|
ef726908b18a5ead67b8024ef664cc708cdf402e is in the hash dataset; however, it is unlabeled. It's Final Fight CD (Sega CD) (U).bin. |
|
Dear @sselph . Thanks for a great scraper. Went through a bunch of games: |
|
I created a separate discussion. Proposal to create an auto gathering option for the scraper. |
|
thanks everyone. I started adding all these but it is getting late and will continue tomorrow. |
|
@marcteale Thanks! @larsparsfromage Thanks! There were a couple of games that didn't seem to line up
The first the ID seems to be for a different game and the second the linked game seems to be slightly different than the one I have 2131. The hash is for the US version and I think the ID you gave is for an EU version. Also for neogeo it seemed like things were named in a non-standard way. I was lazy and just copied them in but you'll have to use There were also a couple of Mega Drive vs Genesis. I made the choice for Multi-region games that include Genesis and Mega Drive to use the Genesis version if available since Genesis sold more consoles based on the very quick search I did. I really didn't care but had to make some choice so that is what it ended up being. If you use the |
|
Thanks for the scraper tool.
|
|
Sorry to be that guy, but I found a handful of GBA titles that the scraper wouldn't find. Also, at the bottom of the list, one title that doesn't have a GBD ID, I suspect because it's a ROM rip from a GameCube disc that's been made playable on N64 (The Legend of Zelda: Ocarina of Time Master Quest). Not entirely sure what to do about that, so suggestions are welcome. https://drive.google.com/file/d/1g6ASmnkAMXmvHW1RN-veo4sizVpofpkL/view?usp=sharing |
|
How do you generate the hashes? Is it MD5 or something? i don't see docs anywhere |
|
Need help with the scraper in my Retropie. I saw on another link that I should run the scraper folder by folder and then open the csv file and post here the hash and the ID of my problematic games. But I'm having too many roms with issues on scraper. May I still post the csv file with the hash here or there's something else to try? The link I've found about the scraper problem is this https://github.com/sselph/scraper/wiki/Scraper-can%27t-find-a-game%3F |
|
Few missing hashes
` |
|
Some missing SNES hashes. |
|
THANKS
Em quarta-feira, 22 de janeiro de 2020 06:57:14 GMT+1, Michael Benavidez <notifications@github.com> escreveu:
Some missing SNES hashes.
https://www.dropbox.com/s/2eykaiahp6cdekm/file.csv?dl=0
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or unsubscribe.
|
|
Hey @sselph , Thank u for all of your great work, i hope u can help me with my issue , i have some psx roms with exction .PBP and i can scrap these roms using emulationstation scraper but when i using your script it always tells hash not found , Sorry for my bad English, and thanks for your great work . |
|
With the exception of Micro Mages, all of the games in this list are ROM hacks from romhacking.net. Thanks! |
|
Hello @sselph, I ran your scraper using the fastscraper.bat with screenscraper.fr as the source and had two missing hashes. Interestingly the file did not contain the hash until I downloaded and used your shasum.exe to get the hash and added it manually. The file can be found here. Thank you for the best scraper on the internet! Edit: Added some missing Atari Lynx ROMs here. Edit: Missing GameBoy ROM hashes: Edit: Missing GBA ROM hashes: Edit: Missing GameBoy Color ROM hashes: |
and others
Need to update the dataset with all the new games in the GDB.
The text was updated successfully, but these errors were encountered: