An extendable Search Scraper to list SEO rankings
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.
- Go to appsettings.json and ensure the ConnectionString to your database is correct
- Go to your Terminal (Make sure its current directory is matching the root of this repo) or VS Console then type:
dotnet tool install -g dotnet-ef
dotnet build
dotnet ef database update --project GoogleSearchScrape
To Run in Terminal:
dotnet run --project GoogleSearchScrape
- Optional Obtain syncfusion free license from https://syncfusion.com and add it to appsettings.json
-
Add a scrape request on the page with any specified strategy 'https://localhost:5001/requests'. The search term is what will be used when making the reqeust to the search engine, the max results will limit the results of this request. The target URL will determine the results saved by the application, if the URL returned by the search scraper CONTAINS the target URL (Target URL doesn't need to be a URL) then the application will save the result, if not it will be discarded. The repeat time will determine when a request is scraped again.
-
Go to the dashboard and wait for the graph to update 'https://localhost:5001/' The Y Axis denotes the rank on the search engine so the lower it is the better.
Please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.
We use SemVer for versioning. For the versions available, see the tags on this repository.
- JayArrowz - JayArrowz
See also the list of contributors who participated in this project.