App: Image Identification and Classification using Zero-shot

• An app to use zero-shot image classification models to analyze and describe an image and identify and classify animals in it.
• All these while creating custom AI Agent.

Demo

How to Use

• npm install
• npm run dev

Todo

• [Done] use zero-shot model, facebook-bart-large-mnli
• [Done] use state management like recoil for smoother state management
• Fix issue while calling classification and Summarize

Technologies used

• vision/image model: nlpconnect/vit-gpt2-image-captioning
• React
• Typescript
• Recoil
• Zero-shot classification model
• Custom AI Agent