Find similarities ?

[delonleonard]

How do I find similarities between img_pipe and text_pipe

from towhee.dc2 import pipe, ops, DataCollection

img_pipe = (
    pipe.input('url')
    .map('url', 'img', ops.image_decode.cv2_rgb())
    .map('img', 'vec', ops.image_text_embedding.blip(model_name='blip_itm_base_coco', modality='image'))
    .output('img', 'vec')
)

text_pipe = (
    pipe.input('text')
    .map('text', 'vec', ops.image_text_embedding.blip(model_name='blip_itm_base_coco', modality='text'))
    .output('text', 'vec')
)

DataCollection(img_pipe('./teddy.jpg'))
DataCollection(text_pipe('A teddybear on a skateboard in Times Square.'))

[shiyu22]

@delonleonard You can use Milvus to load and search vectors, and more details you can refer to this tutorial.