Implemented HTML Parsing with Regex Filters for FBI API JSON Extraction #3
Conversation
Introduces a set of regex filters to improve our HTML parsing capabilities when dealing with the FBI API. In certain cases, the API may unexpectedly return HTML content instead of the expected JSON format. With these regex filters in place, we can effectively extract the JSON data from the HTML response. By implementing these filters, we enhance the reliability and versatility of our data extraction process, ensuring that we can handle a wider range of API responses. This enhancement strengthens the overall stability and usability of our application when interacting with the FBI API. The new regex filters provide a robust solution for parsing HTML and extracting the required JSON data, allowing for seamless integration with our existing data processing workflows.
|
Thank you, SIR, for the opportunity to learn! I did not understand why you dissolved your FBI-Mostwanted tool into an API. You could have created it separately and kept the tool, as it is even used by the CSI Linux distro. I will try to create the tool again and will give you credit for the tool. |
Sure thing! Do whatever you want with it mate :) I decided to make it a library so that people can create better tools with it, instead of just using it as a single tool. In this case, you might be the one to create that better tool. Good luck, let me know if you need any help. |
|
You have already been a great help! |
Alright mate! :) |
Implemented regex filters to improve HTML parsing for the FBI API, handling unexpected HTML responses and extracting JSON data. These filters enhance data extraction reliability and versatility, ensuring our application interacts smoothly with the API. They seamlessly integrate with existing data processing workflows, providing a robust solution for parsing HTML and extracting JSON data.
I have left some regex as comments in case the API returns HTML data again, and I will update the filters accordingly if needed.
You can check the results below:
Now after applying HTML parsing, fbi-api can be able to fetch data from HTML page.
HTML data
https://api.fbi.gov/@wanted-person/b166d627e11149aa82c02d1533e3b650
This library supports both HTML and JSON
JSON data
https://api.fbi.gov/@wanted-person/b4db60d7ed14449cb73ba39564ef9e19