optimalbits / crawlme Goto Github PK

Is there a way to update what port zombie uses? My site runs on 8080 so zombie always fails to connect to what it thinks it wants.

Take a look at some characters such as ñ in this pages:

http://clubcomidamundi.com/#!/

http://clubcomidamundi.com/?_escaped_fragment_=

According to this:

https://groups.google.com/forum/#!msg/zombie-js/qOS0W_cMCgQ/4iFcqLjVEPgJ

It seems like this code in crawlme.js cannot work because the callback doesn't get browser. Simply removing the browser argument from the callback seems to fix the issue.

browser.visit(url, {waitFor: options.waitFor},
  function(err, browser, status) {
    if(err) return cb(err);

    // links
    var links = browser.queryAll('a'); // browser is undefined
    links.forEach(function(link) {
      var href = link.getAttribute('href');
      var absoluteUrl = urlParser.resolve(url, href);
      link.setAttribute('href', absoluteUrl);
    });

In crawme.js (starting line 30) you have the following:

var protocol = req.protocol || options.protocol;
var url = options.protocol + '://' + req.headers.host;

that second options.protocol should just be protocol, otherwise the above line is useless :)