Comments (4)
+1
Hi, I'm also mostly interested in how you used google API search to retrieve relevant results to the question. Please share the code it will really help! Thank you!
from prophetnet.
Hi, thanks for your interest!
To simplify, using text from the top result returned by the Google Search API is enough. Furthermore, due to budget constraints and the need for stable, reproducible results, we developed a Google and web page crawler with cache for our experiments (storing about 9GB of Google results from January-April 2023). This part of the code is complex, and we don't recommend trying it at the moment. We may consider organizing and open-sourcing the crawler separately in the future. Stay tuned for updates, and we appreciate your understanding!
from prophetnet.
from prophetnet.
All right thank you for your reply! Looking forward to the open-source of the crawler!
from prophetnet.
Related Issues (20)
- Where can I get the evaluation script for English Dialog, including the AVG?
- 1. Post a typo. 2. Wander the time cost. 3. Error in inference HOT 2
- KeyError during inference with dialog-en model HOT 1
- Wrong Tokenization in SquadQG Evaluation Scripts
- About ProphetNet-Dialog-En in dialogue dataset
- Selecting additional scoring methods for fine-tuning
- How to pretrain the ProphetNet?
- Where to obtain the test.tgt for CNN/DM data HOT 5
- The reported scores of GENIE are not fair HOT 1
- GENIE: decoder_nll loss is always equal to 0 for training from scratch HOT 2
- Can use_fp16 be used?
- Why is the GENIE result in AR-diffusion very different from the original paper? Also, you come from a team. HOT 1
- Character level
- Can't Find Pretrained Checkpoint of Prophetnet: HOT 1
- Unable to load the GENIE model HOT 1
- The datasets have no dev set? HOT 1
- Options Employed for Training or Inference on the CNN/DM Dataset HOT 1
- Missing key documents for AR-Diffusion HOT 1
- where is "mbr_select.py" in AR-Diffusion HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from prophetnet.