Comments (4)
Hey @adjouama,
We currently don't have Solr integrated. However, as Haystack is completely modular, it would definitely be possible to do that.
What you would need to do:
-
Implement a
SolrDocumentStore
You could take the ElasticsearchDocumentStore as an example and adjust it to Solr.
This will be the major work, but you won't need all of the implemented functions there (e.g. query_by_embedding is not mandatory). The documentstore is needed for indexing docs, triggering queries and storing the mapping of fields from DB to haystackDocuments
-
Implement a
SolrRetriever
(or use the in-memoryTfidfRetriever
for smaller prototyping)
The retriever could be rather light-weight, e.g. consider the basic ElasticsearchRetriever which has only ~ 6 lines of code.
The other major components (Reader, Finder ...) are independent of this and will work out-of-the-box. We also plan to have some advanced Retrievers soon that are independent of the datastore.
Let us know if you want to tackle this in a PR. We are happy to support you along the way.
from haystack.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 14 days if no further activity occurs.
from haystack.
Hi @adjouama.
I also need to refactor the work haystack to it will work with Solr.
But, did you do it? And if you refactored haystack for Solr, can I use your code?
Thanks.
from haystack.
Hi @adjouama.
I also need to refactor the work haystack to it will work with Solr.
But, did you do it? And if you refactored haystack for Solr, can I use your code?
Thanks.
Hi @Always-prog , unfortunately I did not spend time on the Solr implementation. I moved all my data on Elasticsearch and I am very much satisfied about the result. I'd suggest that you migrate :)
from haystack.
Related Issues (20)
- Select 4 or 5 datasets
- Run evaluations on selected datasets to optimise basic RAG pipeline
- ModuleNotFoundError: No module named 'haystack.nodes' HOT 1
- `FileTypeRouter` should get mime type from `ByteStream` mime type attribute instead of `meta
- Use case Chat + tools
- Use case tools + plan
- Use case text-to-sql database explorer
- Allow Pipelines to be run/reused in "SuperPipelines" HOT 2
- ModuleNotFoundError: No module named 'haystack.nodes' HOT 2
- Installation issues on Databricks
- Use case RAG + one-shot query planning
- QA problem in using QdrantDocumentStore HOT 3
- Docs: SentenceTransformersDiversityRanker HOT 1
- (De-) Serialization is not properly working for HuggingFaceAPITextEmbedder HOT 1
- (De-) Serialization is not properly working for NamedEntityExtractor
- LLM-based evaluators not always returning a valid JSON
- Port Haystack v1 DocumentClassifier node to Haystack v2 HOT 3
- LLM-based evaluators shouldn't return `NaN`
- Better support for Tools HOT 2
- redundant logging statement causes KeyError due to name collision HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from haystack.