Progress bar to track how much time still require to complete the embeddings

[GauravPatel99]

I'm using 'HuggingFaceBgeEmbeddings' for data embedding. Due to the large size of the documents, the embedding process is time-consuming. I'm interested in monitoring the progress to ensure it's actively creating embeddings rather than being stuck. Is there a method to check the ongoing status of the embedding process?

[Shashankocean]

Even I am looking for the same solution
vector_store = Chroma.from_documents(documents, embedding=bge_embedding)

[blacksmithop]

I'm using 'HuggingFaceBgeEmbeddings' for data embedding. Due to the large size of the documents, the embedding process is time-consuming. I'm interested in monitoring the progress to ensure it's actively creating embeddings rather than being stuck. Is there a method to check the ongoing status of the embedding process?

Direct solution: Embed each document separately and use it to track progress
Example

Alternative: Subclass and define your own implementation of from_documents and the functions it uses that exposes progress
You could also look into using Callbacks