rbjorklin
Hello! This project seems great from my limited use so far so thanks for putting it out there! Would you consider adding [tgrep](https://github.com/microsoft/tgrep) to the benchmark suite?
Would you consider adding tgrep to the benchmark section?
#274 · closed · 3 comments
Comments
Pringled
Hey @rbjorklin, we considered this when tgrep was released, but tgrep gives (almost) the exact same results as ripgrep which is already included in our benchmarks. The only difference is that it indexes a repo, but ripgrep is already so fast that we don't see this as a big benefit (e.g. see ripgrep on [our benchmarks](https://github.com/MinishLab/semble/blob/main/benchmarks/README.md#main-results), it's the fastest method there already). Like ripgrep, it scores very poorly on our benchmarks because it doesn't do semantic queries at all (I just ran it and it gives 0.1255 NDCG@10, compared to ripgreps 0.1259). We can add a small note to our benchmarks with this info though.
rbjorklin
Sounds good, thanks for the detailed response!
Pringled
No problem, added a note to our benchmarks as well!