Search feature

[mirceachira]

It would be awesome to have a search option for shub to look for jobs.

It's often the case that I have to find a broken job starting just from an url and I had to implement a script that cycles through all the jobs and through all the requests of each individual job in a project to find the one I'm looking for. The search could be configured in many way, see this example:

$ my_search_script.py --project_key="<project key>" --spider="amazon" --date_from="last week" --includes="<some url contet>"
> Bingo!  123456/12/123
> Bingo!  987654/32/1
> Done!

This could be extended so you could look for a job starting from part of an url, item field, argument etc. You could also search for jobs that have error or critical level logs which would help with debugging.

I thought this might be a good thing to have for shub and would be happy to add it here directly instead of maintaining an internal tool.

[mirceachira]

Hey @vshlapakov, I opened a pr for this #370
It has only the search by part of an url feature but I think it's a starting point. Let me know what you think :)