web5design / spynner

Programmatic web browsing module with AJAX support for Python

Intro

Spynner is a stateful programmatic web browser module for Python. It is based upon PyQT and WebKit. It supports Javascript, AJAX, and every other technology that !WebKit is able to handle (Flash, SVG, ...). Spynner takes advantage of JQuery. a powerful Javascript library that makes the interaction with pages and event simulation really easy.

Using Spynner you would able to simulate a web browser with no GUI (though a browsing window can be opened for debugging purposes), so it may be used to implement crawlers or acceptance testing tools.

See usage on: https://github.com/makinacorpus/spynner/tree/master/src/spynner/tests/spynner.rst Or below if the section is preset

Credits

Companies

_

• Planet Makina Corpus
• Contact us

Authors

• Mathieu Le Marec - Pasquet <[email protected]>
• Arnau Sanchez <[email protected]>

Contributors

• Leo Lou <https://github.com/l4u>

Dependencies

• Python >=26
• PyQt > 443
• Libxml2 / Libxslt libraries and includes files for lxml
• autopy which in turns need xtst lib & headers on linux (aka Xtest)

Feedback

Open an Issue to report a bug or request a new feature. Other comments and suggestions can be directly emailed to the authors.

Install

• Throught regular easy_install / buildout:

  easy_install spynner

• The bleeding edge version is hosted on github:

  git clone https://github.com/makinacorpus/spynner.git
  cd spynner
  python setup.py install

Running Spynner without X11

• Spynner needs a X11 server to run. If you are running it in a server without X11. You must install the virtual Xvfb server. Debian users can use the small wrapper (xvfb-run). If you are not using Debian, you can download it here: http://www.mail-archive.com/[email protected]/msg69632/x-run :

  xvfb-run python myscript_using_spynner.py

• You can also use tightvnc, which is the solution of the actual maintainer [kiorky].