evyatarmeged / humanoid

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

I do stuff with Kubernetes and Go. I also hack for the lolz.

humanoid's Issues

IUAM New Challenge

Hello sir @evyatarmeged your lib is already patched, do u will offer some new updated for new cf challenge?

Bypass pooky.js

Hi I was looking into this github and I was wondering if this could be used to bypass the anti bot detection script on the website:

https://www.supremenewyork.com/shop/all

They use a security system called Pooky.js

and Im not sure if it is a WAF.

(btw they only turn on this anti bot script every thursday at 11 am EST. Because that is when they release their items so they only turn it on at that time.

pooky.min.js.zip

That is the js file that I found in their html page

Example does not work

Installed. Trying to run your example with my own url:

#!/usr/bin/env nodejs

const Humanoid = require("humanoid-js");

let humanoid = new Humanoid();
humanoid.get("https://www.psacard.com/cert/47002793")
.then(res => {
console.log(res.body) // ...
console.log(res.isChallengeSolved);
humanoid.bypassJSChallenge(res);
})
.catch(err => {
console.error(err)
})

Response is the challenge page plus the text below. I do not get the protected page. Any ideas?

false
(node:13573) UnhandledPromiseRejectionWarning: Error: Could not solve or parse JavaScript challenge. Caused due to error:
TypeError: Cannot read property 'length' of null
at Function.solveChallenge (/home/ubuntu/node_modules/humanoid-js/src/solver.js:89:10)
at Humanoid.bypassJSChallenge (/home/ubuntu/node_modules/humanoid-js/index.js:71:30)
at /home/ubuntu/test.js:10:12
at processTicksAndRejections (internal/process/task_queues.js:97:5)
(node:13573) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag --unhandled-rejections=strict (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 1)
(node:13573) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.

Setting headers blows out default headers.

Humanoid/src/humanoidReqHandler.js

Line 74 in 196f543

headers = headers || this._getRequestHeaders(url);

This line blows out the default header values when passing any header which is probably not expected behavior and it causes humanoid to fail to the cloudflare check, at least in my case. It would be a simple fix to merge objects headers = {...this._getRequestHeaders(url), ...headers}. A temporary/hacky work around for this would be to merge in headers from humanoid._getRequestHeaders(url) before passing them to the request,

empty body

I'm receiving the empty body, CAPTCHA, I do not think there's a solution ..

Could this be used in an Electron project?

Hi,

I'm in dire need of a cloud-flare bypass library, and currently there aren't many out there. This seems to be a good candidate, but I would like to know if it would be possible to use it inside an Electron desktop application.

Thanks !

Bypass "Datadome" WAF

Hello @evyatarmeged ,

I'd like to use your package to bypass Datadome protection. Can your package do it?

Thank you!

Basic implementation does not work, cloudflare changed?

My code:

const Humanoid = require('humanoid-js');
const humanoid = new Humanoid();

const res = await humanoid.get(url);

Result is
isSessionChallenged: false,
isChallengeSolved: false,
statusCode: 503

Body contains a challenge which I won't paste here.

Can't retrieve HTML from some sites

Hi, I'm trying to get HTML from these links:

https://igds.info/
https://ilgeniodellostreaming.llc/?s=kung+fu+panda

Unfortunately these sites have different Cloudflare Protection and no program can get HTML from there.

NB:
These sites can only be accessed via Italian IP, but attached are the errors recovered (with HTML no bypassed).
ilgeniodellostreaming.txt
igds.txt

Thank you in advance and have a nice day : )

Error when installing with npm

Hi,
I get an error when running npm i humanoid-js.
npm cli error
and I also have a log file