Skip to content
[not actively maintained] The C++ webkit-server from capybara-webkit with useful extensions and Python bindings
Branch: master
Clone or download
Latest commit c9e3a83 Aug 22, 2017
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
debian
src fix file name case Oct 17, 2014
.gitattributes
.gitconfig initial commit Dec 23, 2011
.gitignore
LICENSE
MANIFEST.in
README.md
build.sh
setup.py add py3 support, use buffering and other small fixes Jul 27, 2015
webkit_server.pro Adding qmake main file Dec 23, 2011
webkit_server.py Use communicate() to ensure standard file descriptors are closed May 11, 2017

README.md

NOTE: This package is not actively maintained. It uses QtWebkit, which is end-of-life and probably doesn't get security fixes backported. Consider using a similar package like Spynner instead.

Overview

Author: Niklas Baumstark

A standalone version of the Webkit server included in capybara-webkit. It includes a slim Python wrapper and the following improvements over the original version from thoughtbot:

  • Wait command to wait for the current page to load
  • SetAttribute command to configure certain QWebkit settings
  • SetHtml command to load custom HTML into the browser (e.g. to execute scripts on web pages scraped by a static scraper)
  • SetViewportSize command to set the viewport size of the in-memory browser

If you are interested in web scraping using this server, have a look at dryscrape.

Building and Installing

To install the Python binding (this also builds the server and places it into Python's site-package directory):

sudo python setup.py install

If you don't need the Python bindings, you can also use the supplied build.sh shellscript to build the server only.

A word about Qt 5.6

The 5.6 version of Qt removes the Qt WebKit module in favor of the new module Qt WebEngine. So far webkit-server has not been ported to WebEngine (and likely won't be in the near future), so Qt <= 5.5 is a requirement.

Contact, Bugs, Contributions

If you have any problems with this software, don't hesitate to open an issue on Github or open a pull request or write a mail to niklas baumstark at Gmail.

License

This software is based on capybara-webkit. capybara-webkit is Copyright (c) 2011 thoughtbot, inc. It is free software, and may be redistributed under the terms specified in the LICENSE file.

You can’t perform that action at this time.