auto define crawler
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
sample_page
README.md
__init__.py
diff_match_patch.py
func.py

README.md

It is tired to define crawler manually? You always extract the meta data by xpath?

Now you can easily to extract a list of meta data from a page.

See the example of func.py.

$ python func.py

是不是很觉得每个网站提取关键字很慢?是不是每个网站要找xpath提取关键字?

这个库可以动态提取关键字,只需要定义两个网页的关键字,就可以训练爬虫,然后去提取其他网页的关键字。

可以执行

$ python func.py