Does Langchain support the new OpenAI batch job API?

[BrandonStudio]

Can I use Langchain to generate batch job file or post-process batch result?

[skabbit]

bump this question, vote for the feature to have in langchain for reducing an evaluation price.

[emilmirzayev]

Bumping and commenting as well. That could potentially be one of the most valuable future features

[ZhengWonderingAround]

bro,,, I do feel like it's quite easy to write a wrapper ourselves. But I would second langchain making one

[Garand0o0]

Hi, does LangChain support OpenAI's Batch API? I couldn't find any relevant information in the documentation.

[ddlaws0n]

Agreed, running everything else via LangChain so would make sense to have some native support for this

[codeananda]

Bumping again. This would be super helpful.

[chriss1245]

Bumping again. I do not believe we don't have this implemented yet

[ankhbayarr]

Need this real quick!

[BrandonStudio]

It has been 7 months since I started this discussion.

[chriss1245]

Lets create an issue with a bug and try to bypass. I imagine there are a lot of ideas around. I agree that this is quite interesting. We can save a lot of money. Maybe rising an issue at least calls their attention. But still I don't think it would be an easy task to integrate this fully. The batch API does not tell you when the predictions are done. You need to keep constantly asking the API about your predictions.

[chriss1245]

Added an issue #28508

[ankhbayarr]

@chriss1245
Thank you, Chris! Hope it draws attention.