Comments (11)
代码?
from jmcomic-crawler-python.
pip安装
jmcomic.download_album()方法获取含有多章节的album时,只能读到第一个,试了几个都是这样
from jmcomic-crawler-python.
你应该使用的不是 18comic.* 这样的域名吧?
from jmcomic-crawler-python.
我使用jmcomic.JmModuleConfig.get_jmcomic_url()获取到了这个域名
jm-comic2.cc
这个域名可以正常使用,使用18comic.vip无法访问,我开了全局代理并配置proxy: clash后得到403错误
from jmcomic-crawler-python.
这是我的配置文件
client:
domain: ["jm-comic2.cc"]
impl: html
postman:
meta_data:
cookies: null
proxies: clash
allow_redirects: true
headers:
accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7
accept-language: zh-CN,zh;q=0.9
authority: 18comic.vip
sec-ch-ua: '"Google Chrome";v="111", "Not(A:Brand";v="8", "Chromium";v="111"'
sec-ch-ua-mobile: ?0
sec-ch-ua-platform: '"Windows"'
sec-fetch-dest: document
sec-fetch-mode: navigate
sec-fetch-site: none
sec-fetch-user: ?1
upgrade-insecure-requests: '1'
user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML,
like Gecko) Chrome/111.0.0.0 Safari/537.36
impersonate: chrome110
type: cffi
retry_times: 20
debug: true
dir_rule:
base_dir: /Volumes/Media Library Private/comic
rule: Bd_Ptitle
download:
cache: true
image:
decode: true
suffix: null
threading:
batch_count: 30
version: '2.0'
from jmcomic-crawler-python.
目前只能获取第一章的原因是,正则表达式不适配jm-comic2.cc和jm-comic.org这两个域名,解析出的本子的章节为空。
当本子的章节为空,会默认只有一章,因此只下载了一章。
from jmcomic-crawler-python.
我刚刚适配了下上面两个域名,准备发布,你可以稍后再试下,需要用pip更新jmcomic
对了,关于18comic.vip,你的配置没有问题,只是最近网站限制相当严,用浏览器访问也会抛403.
我想最根本的解决方案还是要上移动端api😥
from jmcomic-crawler-python.
已发布,实测 jm-comic2.cc 是可以下载到全部章节的
from jmcomic-crawler-python.
在chrome可以正常访问的情况下,依旧出现403的情况
from jmcomic-crawler-python.
在chrome可以正常访问的情况下,依旧出现403的情况
我试了下确实。按以往经验大概率应该是headers的问题。你可以试下浏览器隐身模式f12抓包,然后在配置文件中配置你浏览器抓取的headers,应该就可以了。
from jmcomic-crawler-python.
实测应该只是加了 referer
字段校验
headers的配置里加上下面这行就行了。
referer: 'https://18comic.vip'
from jmcomic-crawler-python.
Related Issues (20)
- impersonate chrome is not supported HOT 3
- 希望能添加一个download_album_for_pdf函数直接下载pdf文件 HOT 2
- 发现个章节下载的小问题 HOT 1
- 手动调整Action下载包结构 下载完成的本子.zip/书名.zip
- 请问出现了如下状况怎么办啊 HOT 2
- 版本更新问题 HOT 1
- 有证书验证要怎么通过 HOT 1
- 下載多話的漫畫資料夾名稱問題 HOT 2
- 到最后一步下载不了,想请教下大佬 HOT 1
- 最新GitHub Actions 无法下载文件 HOT 7
- 功能需求:过滤重复图片 HOT 6
- 怎么使用jmcomic的搜索api HOT 8
- 你就是人类在漫漫黑夜中的一点星光
- 收藏夹爬取不全 HOT 2
- 下载过滤器使用不了 HOT 1
- 对于多章节漫画只能下载第一章 HOT 8
- 按照作者名搜索,搜索失败 HOT 1
- fork過來的項目可以隱藏嗎 HOT 3
- 请求重试全部失败 HOT 2
- [Help] 下载图片失败 HOT 23
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jmcomic-crawler-python.