mdpauley / ulixee-hero

The web browser built for scraping

Ulixee Hero

A few cool highlights about Hero:

• Built for scraping - it's the first modern headless browsers designed specifically for scraping instead of just automated testing.
• Designed for web developers - We've recreated a fully compliant DOM directly in NodeJS allowing you bypass the headaches of previous scraper tools.
• Powered by Chrome - The powerful Chrome engine sits under the hood, allowing for lightning fast rendering.
• Emulates any modern browser - Emulators make it easy to disguise your script as practically any browser.
• Avoids detection along the entire stack - Don't be blocked because of TLS fingerprints in your networking stack.

Check out our website for more details.

Installation

npm i --save @ulixee/hero-playground

or

yarn add @ulixee/hero-playground

Usage

Hero provides access to the W3C DOM specification without the need for Puppeteer's complicated evaluate callbacks and multi-context switching:

const Hero = require('@ulixee/hero-playground');

(async () => {
  const hero = new Hero();
  await hero.goto('https://example.org');
  const title = await hero.document.title;
  const intro = await hero.document.querySelector('p').textContent;
  await hero.close();
})();

Browse the full API docs.

Contributing

See How to Contribute for ways to get started.

This project has a Code of Conduct. By interacting with this repository, organization, or community you agree to abide by its terms.

We'd love your help in making Hero a better tool. Please don't hesitate to send a pull request.

License

MIT