GithubHelp home page GithubHelp logo

Comments (4)

WWWonderer avatar WWWonderer commented on June 13, 2024

+1

Hi, I'm also mostly interested in how you used google API search to retrieve relevant results to the question. Please share the code it will really help! Thank you!

from prophetnet.

ZubinGou avatar ZubinGou commented on June 13, 2024

Hi, thanks for your interest!
To simplify, using text from the top result returned by the Google Search API is enough. Furthermore, due to budget constraints and the need for stable, reproducible results, we developed a Google and web page crawler with cache for our experiments (storing about 9GB of Google results from January-April 2023). This part of the code is complex, and we don't recommend trying it at the moment. We may consider organizing and open-sourcing the crawler separately in the future. Stay tuned for updates, and we appreciate your understanding!

from prophetnet.

zyg18181818 avatar zyg18181818 commented on June 13, 2024

from prophetnet.

WWWonderer avatar WWWonderer commented on June 13, 2024

All right thank you for your reply! Looking forward to the open-source of the crawler!

from prophetnet.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.