runt18 / urlnorm Goto Github PK

urlnorm.py
==========

Normalize a URL to a standard unicode representation

urlnorm normalizes a URL by:

  * lowercasing the scheme and hostname
  * converting the hostname to IDN format
  * taking out default port if present (e.g., http://www.foo.com:80/)
  * collapsing the path (./, ../, etc)
  * removing the last character in the hostname if it is '.'
  * unquoting any % escaped characters (where possible)

Installation
============

    pip install urlnorm


Example
=======

    >>> import urlnorm
    >>> urlnorm.norm("http://xn--q-bga.com./u/u/../%72/l/")
    u'http://q\xe9.com/u/r/l/'