satrong / node-webcrawler Goto Github PK
View Code? Open in Web Editor NEW网页版nodejs爬虫工具
网页版nodejs爬虫工具
一级页面的url 抓取不到数据啊,怎么配置
1、首先在linux下测试,首页能显示。点爬取按钮后,没有任何反应。
之后修改了配置,把文件路径修改为linux下,也没有反应。
2、下载网盘文件,在windows下测试,点爬取按钮后,可以抓取到列表页面,并进行分析。
但是到下载图片的时候,显示“准备下载到本地中...”
之后没有反应。
请问应该是什么问题?
^
TypeError: Cannot read property '0' of null
at E:\host\node-webcrawler\lib\crawler.js:246:58
at iterate (E:\host\node-webcrawler\node_modules\async\lib\async.js:149:13)
at Object.async.eachSeries (E:\host\node-webcrawler\node_modules\async\lib\a
sync.js:165:9)
at Crawler.dlImage (E:\host\node-webcrawler\lib\crawler.js:245:11)
at E:\host\node-webcrawler\lib\crawler.js:220:22
at Request._callback (E:\host\node-webcrawler\lib\crawler.js:303:9)
at Request.self.callback (E:\host\node-webcrawler\node_modules\request\reque
st.js:344:22)
at Request.emit (events.js:110:17)
at Request. (E:\host\node-webcrawler\node_modules\request\request
.js:1239:14)
at Request.emit (events.js:129:20)
你好,我在你这个的博客使用这个方法代理没有生效。还是走的target配置的代理
jin tian shi le xia zhe ge pa cong zhong de li zi , qi zhong jing dong de li zi pao li hen chang shi jian ye mei fan ying , shi zhe ge jing dong de li zi bu neng yong le hai shi zhe ge pa cong yi jing bu neng yong le
--2018/10/29
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.