Skip to content

A robot that can interpret sheet music, convert it to a midi, then play it through on the piano

License

Notifications You must be signed in to change notification settings

JustinScitech/Ludwig

Repository files navigation

Ludwig (Winner and Finalist of Hack The North 2024, Canada's biggest hackathon!)

Ludwig is a robotic piano player that can first read sheet music then convert it into MIDI data that can then be played on the piano using physical motors with fingers.

Developing THE BEST robot that can play music for you

Made by: Justin Lau, Jonathan Polina, Sanjay Ramesh, and Christian Aiello

Check out our demo

https://www.youtube.com/shorts/-XQeF0ca4Dk

Check out our DevPost

https://devpost.com/software/ludwig

We'll update more about this repo later, but here's the entire tech involved

Software: Python3 with OpenCV
Hardware: Raspberry Pi3 with a bunch of Servomotors and a servomotor module.

The basic concept behind the thing is that once we get the MIDI, we convert them into signals that then assign the fingerings based on where the leftmost finger is on the piano keyboard.

Optimized/Built on musical sheet recognition model SheetVision

About

A robot that can interpret sheet music, convert it to a midi, then play it through on the piano

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages