Ludwig is a robotic piano player that can first read sheet music then convert it into MIDI data that can then be played on the piano using physical motors with fingers.
Made by: Justin Lau, Jonathan Polina, Sanjay Ramesh, and Christian Aiello
https://www.youtube.com/shorts/-XQeF0ca4Dk
https://devpost.com/software/ludwig
Software: Python3 with OpenCV
Hardware: Raspberry Pi3 with a bunch of Servomotors and a servomotor module.
The basic concept behind the thing is that once we get the MIDI, we convert them into signals that then assign the fingerings based on where the leftmost finger is on the piano keyboard.
Optimized/Built on musical sheet recognition model SheetVision