Skip to content

khorud/Skreep

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

74 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Skreep

PyPI version fury.io
It's fun data scraping with just a few lines of code. Basically Skreep is a function to make it easier to run selenium.

Installation

Python 3
python -m pip install -U skreep

Example

Us here :: Reference

from skreep.skreep import Skreep
from skreep.download import dl
from skreep.datasheet import sheet
from skreep.save import Save
from skreep.display import display

sk = Skreep()
sv = Save(name='output')
datasheet = sheet('datasheet')

for i in datasheet:
    sk.get(i, sc=5)
    title = sk.tag('h1')
    print(display(title))
    sv.save(display(title))
    
sk.quit()

Usage documentation

  • sheet(datasheet, ext=txt|csv) : Load datasheet
  • Skreep() : Main Class
  • Save(name=output, ext=csv|txt) : Save file
  • display(elm) : print
  • dl(url, set=default|list) : Download file
  • .quit() : end
  • .get(url, sc=0) : get url
  • .tag(args, set=default|in, sc=0) : tag element, set=in arguments required: object, tag default just use tag
  • .cls(args, set=default|in, sc=0) : class element
  • .id(args, set=default|in, sc=0) : id element
  • .path(args, set=default|in, sc=0) : xpath element
  • .paths(args, set=default|in, sc=0) : xpath elements, argument required plural path
  • .img(args, set=pa|pta|ota, sc=0) : Generally used to extract image urls. set:pa is default.
    set=pa arguments required : path, attribute
    set=pta arguments required : path, tag, attribute
    set=ota arguments required : object, tag, attribute

Dependency

selenium

Driver

Chrome https://chromedriver.chromium.org/downloads must be in the same project directory.

Donate

BTC 37rkr9cpVVcxg8vUpF65Cp9Mjgu1WrKD3d or Paypal Here

Releases

No releases published

Packages

No packages published

Languages