GithubHelp home page GithubHelp logo

Comments (6)

lopuhin avatar lopuhin commented on June 9, 2024

@Schwankenson I didn't check the string yet but what might help is restricting the supported dialects by passing a custom syntaxes argument to extruct.extract, in case you can afford that. Depending on the data you deal with, you might find that some dialects are very rare but have large processing time, so it can make sense to disable them by default. For example, in one project we only use syntaxes=['microdata', 'opengraph', 'json-ld'] as they cover most kinds of semantic markup and are fast.

from extruct.

Schwankenson avatar Schwankenson commented on June 9, 2024

@lopuhin Great, thank you! Limiting it to json-ld and microdata shortens time to below one second!

from extruct.

lopuhin avatar lopuhin commented on June 9, 2024

Glad it helped, and thanks for checking 👍
I'd rather keep the issue open to see if we can fix this or update defaults or README

from extruct.

sitems avatar sitems commented on June 9, 2024

For one html string, I waited 10 hours. Finally found out that the problem is just in 'microformat'. After skipping that format, it takes just 1 second.

from extruct.

azcarraga avatar azcarraga commented on June 9, 2024

For one html string, I waited 10 hours. Finally found out that the problem is just in 'microformat'. After skipping that format, it takes just 1 second.

Super helpful thank you - this was the case for me too.

from extruct.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.