insert parameter id_hash_keys in Document about haystack

[julian-risch]

@nickprock In Haystack 2.0, you can just set the id of the document. So you could have a custom component in an indexing pipeline just before the DocumentWriter or you could create a wrapper around one of the other components, such as a FileConverter.

A component could look like the following

from copy import deepcopy
from typing import List
from haystack import Document, component

@component
class DocumentIDCreator:
    # This is a pass-through component that returns the same Documents but with different ids
    @component.output_types(documents=List[Document])
    def run(self, documents: List[Document]):
        updated_documents = []
        for doc in documents:
            id = calculate_id(doc, id_hash_keys) # using your code above
            updated_documents.append(Document(id=id, content=doc.content, meta=deepcopy(doc.meta), embedding=doc.embedding))

        return {"documents": updated_documents}

Please let us know whether that can solve your problem so that we can close the issue. 🙂

[nickprock]

Thanks @julian-risch