hahaha108 / meituanappspider Goto Github PK
View Code? Open in Web Editor NEW美团APP爬虫，可获取指定城市范围内所有美食店铺信息，包含店铺名称、类别、评分、所属片区、经纬度、详细地址、优惠套餐情况、营业时间、联系电话、累计售出份数、餐厅简介、特色菜......
meituanappspider's People
Contributors
Stargazers
Watchers
Forkers
yanliangsos ybxgood charosen caotianzi lixc rovertroy quincyc379 heaven2819 cemian tianbuaa killbus chinanet001 lifangzhen nicknown mopheiok xiaojingyi leiyugithub lengrui1988 flyforfreedom liangzai90 zhao-dapeng baronnd zhangyunfang laiba17 billlamian juezh wangzihuacool winghou liverofshannon michaelyin hhy5277 lcklozz13 kingking888 styleolder dizhu misscn haishen04 plutoyer danielislearning reference-project onlyinheaven abietainan yiranjing rockingvs byesoft webvul 2877206 zjz6b6 iluspan lincoln007 xiaomin0322 pangfd dot365 masdude mandytang360 yuanxing-syy jerryzhuochuxin gitqiubai frankatmech-github pengjinfu lxngoddess5321 guider llily6310 omoby peng5550 dd19372846 bestjex coldcaffe fangshi8080 scalaview fangyuchuan jamesumakob usa2046 mohuilin siukay-ng zakk-yang whitespur ww54510 teelj yuebins1984 chiuchiu951 chinasure kingfuzhu zsliving whygist cuid2488 yuyuyu125 lucky2sunshine zhonxv shihao918 seanhuang19860115 klmy10086 chenxi2015 wentongdeng heismart eric-seekas natehomles lionm zz-big tonnycaomeituanappspider's Issues
Api的速度是否有限制，查询过多会不会被BAN？
limit设置
limit=25的时候，offset=1000的时候data就为空了。最多只能爬取1000个商家
请问offset 和 limit 设置有什么关系？
MT_spider.run()商户计数
我发现请求一次api并不能获得到准确的100个商户信息，请求api时返回的商户个数会变化，所以使用100为偏移量offset来翻页会不会导致爬取时存在bug，导致run()中统计并打印的获取商户个数有误？我改成了一次请求返回limit=17，返回的商户个数能够准确在17个，用17为偏移量offset来翻页统计的商户个数应该是对的，不知道我理解的对不对。
请问一下城市的id是在哪里抓包的?
感谢楼主博主写的文章,不过请问下城市的id是从哪里获取的?
为什么我修改了那个city后面的id，没反应？还想问问如何查看那个id，比如西安？我感觉是42，但无论咋修改id最后都是给我返回广东的？
1.为什么我修改了那个city后面的id，没反应？还想问问如何查看那个id，比如西安？我感觉是42，但无论咋修改id最后都是给我返回广东的？
2.每次都要换一个ip？之后就要被403
爬到大概1.5w行时，会出现乱码，城市北京
乱码数据如下：
DQ(澶╁疂鍥簵) 276783 鍐版穱娣?Dairy Queen
寰℃懂鑻懧蜂含鍗楃涓€娑?涓板彴涓囪揪搴? 111075945 鑰佸寳浜伀閿?
涓€閿呴杩囨ˉ绫崇嚎 42885553 杩囨ˉ绫崇嚎
麻烦大神指点迷津。。。
同样的链接，请求的数据是不完整的，有时有数据，有时没数据
数据库密码在设置里清晰可见，建议作者把密码改掉
现在只能抓取1000个商家了，设置为1000以后data参数就为空了
失败了
接口没了，403无法访问了
我用fiddle抓不到美团数据，找不到城市id，请求帮助
感谢博主的分享，对我有很大帮助。能否再写一篇博客，讲述一下怎么抓到数据包的。这个问题困扰我很久了。
这个分类代码是在哪一块地方？
除了抓取美食，还有其他类别吗？
怎么查询子区域的数据
现在只能获取city的数据，但是限制了1000条数据；能否请求到每个areaId的数据？
api里面其他板块的英文字段是什么呀！
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.