sergiotapia / torrentinim Goto Github PK
View Code? Open in Web Editor NEWA very low memory-footprint, self hosted API-only torrent search engine. Sonarr + Radarr Compatible, native support for Linux, Mac and Windows.
License: MIT License
A very low memory-footprint, self hosted API-only torrent search engine. Sonarr + Radarr Compatible, native support for Linux, Mac and Windows.
License: MIT License
My environment: Windows 8.1 64
I tried to run it but the program asked for sqlite3_64.dll. I downloaded the latest sqlite version (64-bit DLL (x64) for SQLite 3.36.0), renamed the sqlite3.dll to sqlite3_64.dll and dropped it into torrentinim directory.
Now when I run the torrentinim
, I have an endless(?) "crawler error", like below:
c:\Apps\Torrentinim_windows
λ torrentinim
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
2021-08-10T08:46:18-03:00 [eztv] Crawler error, restarting...
2021-08-10T08:46:18-03:00 [eztv] Starting EZTV crawl
SIGINT: Interrupted by Ctrl-C.
c:\Apps\Torrentinim_windows
λ
Had a quick look at this and setup a version to trial, but having issues with the search as it seems to either pick up random results, or none at all.
e.g. In my database I have a few like;
When searching from the web I get random results returned (/search?query=surfing&page=1);
Possibly something I am missing? Although this seems to do it for most results I try and return. Any ideas what I could try?
There currently is no Docker container version of Torrentinim on the docker hub. Creating one, would greatly expand the reach of Torrentinim among users.
Get a token:
https://torrentapi.org/pubapi_v2.php?get_token=get_token&app_id=miamidogtest
Figure out how to get a list of latest N torrents from this API and periodically ask for latest.
https://github.com/serenader2014/rarbg-api/blob/master/src/utils.js
This.
If I have the time, later this week I'll try to write a plugin for qBitorrent
403 Forbidden
2024-02-08T13:46:21+00:00 [1337x] Crawler error, restarting...
2024-02-08T13:46:21+00:00 [1337x] Starting 1337x crawl
2024-02-08T13:46:21+00:00 [1337x] Download html: https://1337x.to/cat/Anime/1/
403 Forbidden
2024-02-08T13:46:22+00:00 [1337x] Crawler error, restarting...
2024-02-08T13:46:22+00:00 [1337x] Starting 1337x crawl
2024-02-08T13:46:22+00:00 [1337x] Download html: https://1337x.to/cat/Anime/1/
Maybe add flag/env to disable broken site?
could not load: sqlite3_64.dll
It's all i get from the output in terminal
This project related:
Nim related:
Currently, only builds for x86_64
are available.
Would be very helpful to compile for other architectures such as arm64
, armhf
, thanks.
Hello,
on Arch Linux, the package i have installed it like this: pamac build torrentinim-bin
$ man torrentinim
No manual entry for torrentinim
$ torrentinim -h
shows no help either, but launch the app which starts crawling some torrents without asking my permission
accidentaly i have found http://localhost:50123 in the output, but this site only notify me that the app is running, so i do not know how to manage the app - see no interface when i have lunched it via command line as shown above. And my Linux Arch based XFCE desktop environment menu does not find the torrentinim launch entry.
So maybe it can be improved to be less confusing to noob.
Ran ./torrentinim nuke_my_database as first time run on ubuntu 18.04 server.
./torrentinim nuke_my_database
[database] Initializing database
[eztv] Starting EZTV crawl
[1337x] Starting 1337x crawl
[1337x] Download html: https://1337x.to/cat/Anime/1/
[nyaa] Starting Nyaa crawl
[nyaa-pantsu] Starting NyaaPantsu crawl
[nyaa-sukebei] Starting Nyaa Sukebei crawl
[yts] Starting YTS crawl
[torrentdownloads] Starting TorrentDownloads.me crawl
[thepiratebay] Starting ThePirateBay crawl
[rarbg] Starting Rarbg crawl
INFO Jester is making jokes at http://0.0.0.0:50123
Starting 24 threads
Listening on port 50123
And it stops there. I let it run for 1 hour with no other output from the app. Checking the database, its size is 1.1MB. I ran it on another ubuntu 18.04 server box with the same results.
torrentinim-data.db.zip
MacOS version v0.5.0
The terminal shows nearly all "Insert not successful" messages, one for each item. No other error message or debugging info is displayed.
torrentinim-data.db
file is 3.2MB, plenty of disk space left on the computer.
Let me know if I can provide any further information.
Greetings! I'd like to use Torrentinim in conjunction with docker-compose
but I'd prefer to not build the image every time. If you're accepting PRs, I propose:
Dockerfile
for every tagged releaseghcr.io/sergiotapia/torrentinim
This could all be added to the existing release-asset.yaml
workflow.
Would it be possible to support a DHT crawler mode, a là BTDig (https://github.com/btdigg-org/dhtcrawler2)?
Would be nice to have even a lite version of that running locally.
I ran torrentinim with ./torrentinim on macos in the terminal. And it crawl all the torrent site endlessly
I thought it was a torrent search engine which request all the torrent site simultaneously and display the result.
Am i missing something? Why would anyone want to download the whole torrent websites when they can just request only the thing they want?
So I've been trying to set up torrentinim, and bumped into a problem: A bunch of tracker sites are banned around here and thus inaccessible. Of course, I have circumvention methods, but they're primarily a SOCKS proxy.
So I tried to run torrentinim through tsocks
. Getting tsocks to work at all took some time, but I'm definite it is working:
$ TSOCKS_CONF_FILE=/xxx/etc/tsocks.conf tsocks wget -qO - https://www.showmemyip.com/ | grep "<title>"
<title>Show Me My IP! - Your IP address is: xx.xx.xx.xx</title>
But when I try to run torrentinim under tsocks, this happens:
$ TSOCKS_CONF_FILE=/xxx/etc/tsocks.conf tsocks torrentinim
2021-08-12T18:28:00+03:00 [eztv] Starting EZTV crawl
2021-08-12T18:28:00+03:00 [1337x] Starting 1337x crawl
2021-08-12T18:28:00+03:00 [1337x] Download html: https://1337x.to/cat/Anime/1/
2021-08-12T18:28:00+03:00 [nyaa] Starting Nyaa crawl
2021-08-12T18:28:00+03:00 [nyaa-pantsu] Starting NyaaPantsu crawl
2021-08-12T18:28:00+03:00 [yts] Starting YTS crawl
2021-08-12T18:28:00+03:00 [torrentdownloads] Starting TorrentDownloads.me crawl
2021-08-12T18:28:00+03:00 [thepiratebay] Starting ThePirateBay crawl
2021-08-12T18:28:00+03:00 [rarbg] Starting Rarbg crawl
Torrentinim is running, bambino. http://localhost:50123
2021-08-12T18:28:00+03:00 [eztv] Crawler error, restarting...
2021-08-12T18:28:00+03:00 [eztv] Starting EZTV crawl
2021-08-12T18:28:00+03:00 [nyaa] Crawler error, restarting...
2021-08-12T18:28:00+03:00 [nyaa] Starting Nyaa crawl
2021-08-12T18:28:00+03:00 [nyaa-pantsu] Crawler error, restarting...
2021-08-12T18:28:00+03:00 [nyaa-pantsu] Starting NyaaPantsu crawl
2021-08-12T18:28:00+03:00 [yts] Crawler error, restarting...
2021-08-12T18:28:00+03:00 [yts] Starting YTS crawl
2021-08-12T18:28:00+03:00 [torrentdownloads] Crawler error, restarting...
2021-08-12T18:28:00+03:00 [torrentdownloads] Starting TorrentDownloads.me crawl
2021-08-12T18:28:00+03:00 [thepiratebay] Crawler error, restarting...
2021-08-12T18:28:00+03:00 [thepiratebay] Starting ThePirateBay crawl
2021-08-12T18:28:00+03:00 [rarbg] Crawler error, restarting...
2021-08-12T18:28:00+03:00 [rarbg] Starting Rarbg crawl
And it just loops infinitely.
Is there any hope of native proxy support? Failing that, any ideas why it's not working?
Hey,
I've cloned master branch and built sources with nimble build
(using nim 1.4.8 on MacOS). After successful build I am unable to initialize sqlite database as below:
NUKE_MY_DATABASE=true ./torrentinim
[system] Database nuke requested. Clearing all database tables and data.
/Users/slawek/src-oth/torrentinim/src/torrentinim.nim(23) torrentinim
/Users/slawek/src-oth/torrentinim/src/database.nim(18) initDatabase
/usr/local/Cellar/nim/1.4.8/nim/lib/impure/db_sqlite.nim(227) exec
/usr/local/Cellar/nim/1.4.8/nim/lib/impure/db_sqlite.nim(147) dbError
Error: unhandled exception: near "-": syntax error [DbError]
I believe the problem persist because of lack of quotes around utf-8
here.
Should unicode61 tokenizer be used?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.