Update reconftw.sh

[pradeepch99]

sometimes url_extract_tmp.txt file contains external domains like Facebook, twitter, etc. The grep functions searches for the match anywhere in the gospider URLs. This also matches Facebook URLs contain target domain in the parameter value.

Example:

cat gospider.txt

http://test.domain.com/pathone
https://a.b.c.domain.com/pathtwo
https://testing123.domain.com/paththree
https://test.com/path1
https://facebook.com/path2?param1=domain.com
https://twitter.com/test?a=domain.com

cat gospider.txt | grep 'domain.com'

http://test.domain.com/pathone
https://a.b.c.domain.com/pathtwo
https://testing123.domain.com/paththree
https://facebook.com/path2?param1=domain.com
https://twitter.com/test?a=domain.com

cat gospider.txt | grep -E "^(http|https):[\/]{2}([a-zA-Z0-9\-\.]+\.domain.com)"

http://test.domain.com/pathone
https://a.b.c.domain.com/pathtwo
https://testing123.domain.com/paththree