bug/feature request in opening the status of the crawler from web or somewhere?

[mezuqu]

hello,

i started a large crawl using the command, and
portiacrawl .. .... ... & > result.txt

however i see that the crawl is ended (i am not sure if it is terminated) , and i don't know if it is really stopped or not. How i can be sure that the crawl is ended or not?

is there a way of seeing the status of the bot from shell or web interface? I tried to see the scrapy's own web UI, however i dont see the status of the crawler there (6080 port)

thanks

[jimjonesGIT]

I would like to know the same.

[tpeng]

if you schedule spider with scrapyd, then you can see the status of the crawler from your scrapy web UI (by default it's http://localhost:6800)

[mavencode01]

Is there a way to expose this status in portia ?

portiacrawler <project_dir> status ?

Thanks