documents cross-pipelined

[xas]

Hi, I got some questions when trying to interact with a document stream from one pipeline to another

I have a PhotoPipeline, who process an image and create 2 documents:

• the full one
• a thumbnail version

return [
  input.Clone(path1, new MetadataItems { { "photo", photo }, { "type", "full" } }, input.GetContentStream()),
  input.Clone(path2, new MetadataItems { { "photo", photo }, { "type", "thumb" } }, memoryStream),
];

I have a second pipeline, with a dependency from the previous one.
I need at some point the stream of the thumbnail document.

Currently I do like this (in the second pipeline):

Config<List<IDocument>>> docs = Config.FromContext(context =>
{
  return context
    .Outputs
    .FromPipeline(nameof(PhotoPipeline))
    .Where(x => x.GetString("type") == "thumb");
});

And then in my Module.ExecuteAsync (declared in ProcessModules), I do

var thumbs = _docs.GetValueAsync(input, context);
foreach (var thumb in thumbs)
{
  thumb.GetContentStream();
  ...
}

1. First question: Is it a good way/pattern for what I try to achieve ?
2. If not can I easily get it from an internal module in the InputProcess (I doubt it if I read correctly the docs) ?
3. I know there is a more lazy way, putting this module in the PostProcessModules of the first pipeline, but I would like to keep it like this

The second question will be cool, as the `ExecuteAsync would be called for each document, instead of a personal loop in one call

Thanks in advance for your help