Running OpenVino model

[HimanshuJanbandhu]

I'm able to run YOLO model using ultralytics api, but how do I run this YOLO model using OpenVino IR. Their documentation is not very helpful. Anyone having any insight?

[UltralyticsAssistant]

👋 Hello @HimanshuJanbandhu, thank you for your interest in Ultralytics 🚀! We recommend a visit to the Docs for new users where you can find many Python and CLI usage examples and where many of the most common questions may already be answered.

If this is a 🐛 Bug Report, please provide a minimum reproducible example to help us debug it.

If this is a custom training ❓ Question or an inquiry about deployment options like OpenVINO, please provide as much information as possible, including any specific steps you've tried and issues you've encountered. This information will be invaluable for our engineering team and community members trying to assist you!

Join the Ultralytics community where it suits you best. For real-time chat, head to Discord 🎧. Prefer in-depth discussions? Check out Discourse. Or dive into threads on our Subreddit to share knowledge with the community.

Upgrade

Upgrade to the latest ultralytics package including all requirements in a Python>=3.8 environment with PyTorch>=1.8 to verify your issue is not already resolved in the latest version:

pip install -U ultralytics

Environments

YOLO may be run in any of the following up-to-date verified environments (with all dependencies including CUDA/CUDNN, Python and PyTorch preinstalled):

• Notebooks with free GPU:
• Google Cloud Deep Learning VM. See GCP Quickstart Guide
• Amazon Deep Learning AMI. See AWS Quickstart Guide
• Docker Image. See Docker Quickstart Guide

Status

If this badge is green, all Ultralytics CI tests are currently passing. CI tests verify correct operation of all YOLO Modes and Tasks on macOS, Windows, and Ubuntu every 24 hours and on every commit.

This is an automated response; an Ultralytics engineer will assist you shortly.

[HimanshuJanbandhu]

Also, Is openvino inferecnce, implemented using C++ in Ultralytics?

[glenn-jocher]

@HimanshuJanbandhu to run a YOLO model using OpenVINO IR, you can use the OpenVINO Runtime API. Unfortunately, Ultralytics does not provide a C++ implementation for OpenVINO inference. For detailed guidance, please refer to the OpenVINO documentation.