MediaPipe Pose v0.7 beta

After quite some time of fixing and testing, MediaPipePose has finally been updated to properly work with VRChat OSC, even on standalone! Also including a simple WebUI, allowing you to access calibration parameters from any device on the local network. This means you can control parameters on your quest, while MPP is running on your pc!

Main changes:

• Changed which parameters fit under advanced and which under general settings
• Changed some default values to make default tracking smoother
• Added a parameter to allow switching between SteamVR and OSC backends
• Added an optional WebUI to allow for calibration from quest standalone
• Added linux support

NOTE: I dont actualy have a Quest 2 or a linux compatible headset, meaning that the changes relavant to those are not well tested. If you come across any issues, please open an issue on github or send a message on the ApriltagTrackers discord!

What's Changed

• Tiny grammar adjustments by @byronbytes in #15
• Make backend configurable by @yoyobuae in #26
• Linux support by @yoyobuae in #25
• Small fixes by @ju1ce in #27
• Enable a webui for calibration by @ju1ce in #34

Full Changelog: v0.6...v0.7-beta

MediaPipe Pose v0.6

Full release of the changes tested in the alpha builds, focusing on quality of life changes, ease of use, and bug fixes.

Added new settings, smoothing algorithms, and a runtime GUI so you can now change settings without restarting! Dont forget to reinstall the driver as well! (run uninstall_driver first, then install_driver).

Changelog:

• New GUI, which allows changing some settings while MediaPipePose is running
• You can now see the autocalibrated values, and adjust them if necessary
• Calibration data now saves between runs
• New, slower but less jittery smoother can now be set with Additional Smoothing
• Smoothing can now also be disabled. Make sure you uninstall, then install the provided driver!
• Ability to pause tracking
• Ability to set camera resolution and its parameters
• Added advanced mode to hide certain parameters for new users
• Added some mediapipe parameters, including model complexity
• Added option to mirror image

The MediaPipe parameters are described here: https://google.github.io/mediapipe/solutions/pose.html. The defaults should probably be the best, but you are free to experiment!

MediaPipe Pose v0.6.2 alpha

Fixes:

• Rotation calibration should now save correctly
• Added Max image size to advanced mode
• Added an option to mirror image

MediaPipe Pose v0.6.1 alpha

Some more additions and fixes since the last version:

• Added option to flip rotation calibration
• Added two profiles for smoothing values
• Autocalibration checkboxes now save
• Moved neck offset to inference gui
• Added some mediapipe parameters, including model complexity
• Fixed issue where feet were flipping direction if smoothing window was disabled

Known issues:

• Rotation calibration may not save correctly in some cases

The MediaPipe parameters are described here: https://google.github.io/mediapipe/solutions/pose.html

MediaPipe Pose v0.6 alpha

A quick test of some new feature. Full release with any bug fixes should be up in a week or so. If you do try it out, make sure to leave some feedback on the discord!

Changelog:

• New GUI, which allows changing some settings while MediaPipePose is running
• You can now see the autocalibrated values, and adjust them if necessary
• Calibration data now saves between runs
• New, slower but less jittery smoother can now be set with Additional Smoothing
• Smoothing can now also be disabled. Make sure you uninstall, then install the provided driver!
• Ability to pause tracking
• Ability to set camera resolution and its parameters

Known bugs:

• Feet rotation seems broken
• The exit button seems to crash the program instead of exiting

MediaPipe Pose v0.5

• Added option to disable hip tracker to use with owotrack
• Fixed hand tracking rotation to point in correct direction

MediaPipe Pose v0.4

A quality of life update.

• Rotation calibration is now also automatic, meaning all calibration can now be done with a single button
• Adden an option to (pretty terribly) track hands
• Renamed some parameters to reduce confusion

MediaPipe Pose v0.3

This release has some QOL changes and a bugfix

• Instead of calibrating on startup, a slider has been added to recalibrate anytime
• An option for automatic tilt and roll calibration has been added
• An option to set scale manualy instead of calibrating has been added
• Fixed a bug where feet would be switched in beatsaber

MediaPipe Pose v0.2

Due to popular demand, this version now includes smoothing settings and experimental foot rotation.

• Foot rotation! Doesnt work perfectly and not at all when you arent facing the camera, but may work well for some people
• Smoothing setting: how large is the window that is used for smoothing in seconds. Larger it is, the smoother movement is, but you get more delay and bounciness of trackers
• Camera latency setting: How much delay do frames have. Can be used to remove some delay of movement, but same drawbacks as smoothing.
• The X slider for tilting the skeleton now goes only up to 180 with 90 being the center, to make tilt calibration easier.

MediaPipe Pose v0.1.1

• Fixed a bug where program would crash if you used "Preview whole skeleton"
• On a crash, window no longer closes instantly so you can see what error caused it