bookstairs / bookhunter

A download tools for clawing the ebooks from internets.

What is BookStairs?

BookStairs is an open-source personal EPUB library which was highly inspired by talebook, calibre-web and BookBrowser.

It's designed to serve millions of books. Aims to provide high performance, readability compared with its competitors. And it's easy to be deployed on any Unix-like systems by docker.

• High performance

BookStairs didn't use metadata.db which was created by calibre directly. We would index all the books' metadata by bluge which can provide a better searching performance comparing to SQLite3. Although bluge isn't fast enough compared to elasticsearch, it's fast enough to serve the book indexing in memory mode.

• Better book organize

The books' category is defined by the Chinese Library Classification. Putting all the files into SeaweedFS for fast file access. This will make the S3 support out of box.

• Better book deduplication

We would deduplication the book by its CIP (Cataloging in Publication) in China and ISBN.

• Better chinese books metadata management

A lot of Chinese EPUBs don't have valid metadata. We would correct it by CIP database and a builtin Douban spider.

• Readability

We provide a built-in online reader which supports bookmarks, quotes, notes and highlights. Every user could have unlimited bookshelf for personal needs.

• Easy distribution

The bookstairs was designed to be distributed with only one file on all the platforms. You don't need any predefine configuration file. Just download the latest release file and execute it in a working directory. The bookstairs would auto create the database and application data files by your settings on a user-friendly web interface.

State of this project

The current master branch is unstable and is not recommended for production use. BookStairs 1.0.0 (what will be the first release version) is currently in the development stage.

Contributing

Contributions are welcomed and greatly appreciated. See CONTRIBUTING for details on submitting patches and the contribution workflow.

License

BookStairs is licensed under the AGPL-3.0. You are free to use this or modify project, but the only thing you need to do is to share your modifications.

See the LICENSE file for details.

bookhunter's Issues

Telegram's download progress save function does not take effect

• Store the download progress.
• Support setting proxy.
• Add ratelimit.
• Support private channel.

[Sanqiu] Filter the books from sanqiu.cc by extracting the files from archive file.

Filter the books from sanqiu.cc by extracting the files from the archive file.

Aliyun Drive add new `drive_id` argument for download request

See the PR in alist for detailed changes alist-org/alist#3437

Support download books from telegram private channel

We can only download books from the public Telegram channels. Can we download books from a private channel with an invite link?

[FATAL] stream error: stream ID 9; INTERNAL_ERROR; received from peer

• Version:
• Platform:

下载教材遇到错误，[FATAL] stream error: stream ID 9; INTERNAL_ERROR; received from peer。请问如何解决？可否根据教材文件名单独下载？

不支持windows 7？

• Version:0.14.0
• Platform:64-bit Windows 7

运行后出现如下错误提示：
Exception 0xc0000005 0x8 0x0 0x0
PC=0x0

runtime.asmstdcall()
/opt/hostedtoolcache/go/1.21.5/x64/src/runtime/sys_windows_amd64.s:65 +0
x75 fp=0x22fc70 sp=0x22fc50 pc=0x471235
rax 0x0
rbx 0x1e3f080
rcx 0x1e95180
rdi 0x7fffffde000
rsi 0x22fe78
rbp 0x22fdb0
rsp 0x22fc48
r8 0x0
r9 0x22feb8
r10 0x1
r11 0x0
r12 0x22fea0
r13 0x20
r14 0x1e3ea20
r15 0xfe80
rip 0x0
rflags 0x10293
cs 0x33
fs 0x53
gs 0x2b

[sanqiu] Support downloading books from aliyun drive

Sanqiu provides a variety of web addresses to download, the current 189cloud shared links are very slow to parse and download. Resolving aliyun drive is a viable solution.

bookhunter sanqiu -f epub --refreshToken xxxxxx

version subcommand can not show program version

How did i install bookhunter?

go install  github.com/bibliolater/bookhunter@latest

What is my computer platform?

Windows 10 

Which version of your golang compile?

go version go1.18 windows/amd64