GithubHelp home page GithubHelp logo

lstmmnt / easyspider Goto Github PK

View Code? Open in Web Editor NEW

This project forked from naibowang/easyspider

0.0 0.0 0.0 122.48 MB

A visual no-code/code-free web crawler/spider一个可视化爬虫软件,可以无代码图形化设计和执行的爬虫任务

License: GNU General Public License v3.0

Shell 0.16% JavaScript 81.55% Python 2.70% TypeScript 0.21% CSS 0.48% HTML 12.79% Batchfile 0.15% Vue 1.96%

easyspider's Introduction

请您Star/Please Star

如果你觉得此工具不错,请轻轻点击此页面右上角Star按钮增加项目曝光度,谢谢!

If you think this tool is good, please gently click the Star button in the upper right corner at this page to increase the project exposure, thank you!

EasySpider: Visual Code-Free Web Crawler

一个可视化爬虫软件,可以使用图形化界面,无代码可视化的设计和执行爬虫任务。只需要在网页上选择自己想要爬的内容并根据提示框操作即可完成爬虫设计和执行。同时软件还可以单独以命令行的方式进行执行,从而可以很方便的嵌入到其他系统中。

A visual code-free/no-code web crawler/spider, just select the content you want to crawl on the web page and operate according to the prompt box to complete the design and execution of the crawler. At the same time, the software can be executed by command line alone, so it can be easily embedded into other systems.

animation_zh

animation_en

下载 EasySpider/Download EasySpider

进入 Releases Page 下载最新版本。如果下载速度慢,可以考虑从以下页面进入**境内下载地址:**境内下载地址

加QQ群从群文件下载也是一种方式,但使用软件的过程中发生了问题求助还是请从github提issue,因为群主不怎么看群,群号:682921940

Refer to the Releases Page to download the latest version of EasySpider.

视频教程/Video Tutorials

Bilibili/B站视频教程:

EasySpider介绍:**地震台网采集案例

如何无代码可视化的爬取需要登录才能爬的网站

如何爬需要输入验证码的网站

如何切换IP池和使用隧道IP - 打开详情页采集案

流程图执行逻辑解析 - 58同城房源描述采集案例

MacOS系统设计和执行eBay网站爬虫任务教程

Refer to Youtube Playlist to see the video tutorials of EasySpider.

文档/Documentation

请点此进入教程文档,如有英文可暂时翻译一下,或看作者的硕士毕业论文(主要看第三章和第五章)。

Documentation can be found from Github Wiki.

出版物/Publications

中文界面截图

软件界面示例

pic

块和子块及表单定义

pic

已选中和待选择示例

pic

京东商品块选择示例:

pic

京东商品标题自动匹配选择示例

pic

分块选择所有子元素示例

pic

同类型元素自动和手动匹配示例

pic

四种选择方式示例

pic

输入文字示例

pic

循环点击58同城房屋标题以进入详情页采集示例

pic

采集元素文本示例

pic

流程图界面介绍

pic

循环选项示例

pic

循环点击下一页示例

pic

条件分支示例

pic

完整采集流程图示例

pic

完整采集流程图转换为常规流程图示例

pic

服务信息示例

pic

服务调用示例

pic

58 同城房源信息采集服务部分采集结果展示

pic

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.