New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fingerspelling #39

Open

4 of 7 tasks

AmitMY opened this issue Oct 7, 2024 · 0 comments

Collaborator

AmitMY commented Oct 7, 2024 •

edited

Loading

I would love to add fingerspelling to this repo.

Basic:

Collect fingerspelling data for various signed languages. One video per letter
- Upload, process, pose estimate etc.
Curate a fingerspelling list per language. For example, "SCH" is "one letter" in swiss-german
Implement a fallback strategy to combine the letters

Advanced

Combining letters naively is a little silly, as the transitions aren't necessarily "human".

For repeating letters, in supported languages (for example, no idea what they do in BSL), move the hand slightly, then, return to original position
Allow specifying letter transitions: annotated as "SCH-B" for example, is the transition between "SCH" and "B". "B-∅" is the transition between "B" and nothing.
Combine letters based on their transition (SCHULE = ∅-SCH + SCH-U + U-L + L-E + E-∅) - https://fingerspell.net/#/spell

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment