Comments (5)
Also:
$ rawler http://arbitragem.pt/
should work. But it does not.
from rawler.
Or maybe the 1st problem is that rawler doesn't properly process "../" -prefixed URLs in links?
from rawler.
Hi devtime, that's something I'll work on asap.
from rawler.
Hi, I've pushed this to master, it'll be included in the next release. Thanks and let me know if you find any other issue.
from rawler.
Thanks, Oscar! I'll test it as soon as the gem gets updated.
And what about the other (possible) problem:
that rawler doesn't properly process "../" -prefixed URLs in links?
Or this problem doesn't exist? ...If you publish the gem, I'll test it all, and let you know.
Thanks again!
from rawler.
Related Issues (19)
- rawler fails on some URL HOT 8
- Shouldn't say "ERROR -- : Invalid url" on "mailto:" links HOT 1
- Exception thrown when server doesn't answer HOT 2
- Include page being checked in rawler's output HOT 3
- "rawler http://geeks.aretotally.in/" - `initialize': the scheme http does not accept registry part HOT 2
- net/http.rb:1266:in `addr_port': undefined method `+' for nil:NilClass (NoMethodError) HOT 4
- http_proxy? HOT 3
- Returns 404 for anchor links HOT 2
- enable Travis HOT 1
- Base tag is not taken into consideration
- --ignore_fragments is not supported (but documented) HOT 5
- URLs with percent are parsed incorrectly
- The app can not rescue Errno::ETIMEDOUT exception HOT 2
- Authorization header is sent even without --username and --password
- warning: URI.escape is obsolete
- Returns 404 for links that contained chinese words HOT 4
- You should not have to specify http:// HOT 3
- Fails on JavaScript URLs HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rawler.