PoPo: Open-Source AI Tool to Animate MMD Characters with Natural Language

UncategorizedCommentsRead

PoPo: Open-Source AI Tool to Animate MMD Characters with Natural Language

PoPo is an open-source AI tool designed for MikuMikuDance (MMD) that allows users to control character poses and facial expressions using simple text descriptions. For example, typing “wave right hand and smile” generates structured MMD Pose Language (MPL) code that animates bones and morphs in real time.

PoPo: Open-Source AI Tool to Animate MMD Characters with Natural Language-Picture1文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

Key Features

  • Supports natural language input for full-body and facial animations
  • Generates consistent and readable MPL scripts
  • Optimized for Japanese-style rigs and physics constraints

Technical Stack

  • Frontend: Built with Next.js, TypeScript, and shadcn/ui
  • Rendering: Powered by Babylon.js and the babylon-mmd plugin
  • AI Engine: Uses a fine-tuned GPT-4o-mini model to translate text into MPL
  • Deployment: Hosted on Vercel

Why MPL?

MPL is a human-readable scripting format for MMD poses. It avoids complex quaternion math and makes results easier to tweak and debug, offering better consistency in output.文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

Training Example

{
  "messages": [
    {"role": "system", "content": "Generate MMD Pose Language (MPL) script from description."},
    {"role": "user", "content": "Description: arms down"},
    {"role": "assistant", "content": "arm_l bend forward 40; arm_r bend forward 40;"}
  ]
}

Project Background

PoPo evolved from the earlier MiKaPo project, which used MediaPipe to capture human poses. Now, PoPo directly generates MPL scripts from text, eliminating the need for pose sensors. The current dataset contains around 160 pose samples and welcomes community contributions for further improvements.文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

How to Use

Try the live demo at popo.love. Choose a sample character like “三相·梵天『无间玩伴』” and enter any pose description to generate instant animation. Full source code and contribution guidelines are available on GitHub under the GPL‑3.0 license.文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

PoPo: Open-Source AI Tool to Animate MMD Characters with Natural Language-Picture2文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

PoPo makes anime-style character animation easier than ever—just type and animate!文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

Official website: https://popo.love文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

GitHub repository: https://github.com/AmyangXYZ/PoPo文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html 文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

1. Please retain the original source link when reposting, thank you!
2. All resources and articles on this site are collected and organized from the internet, and we do not participate in their creation. The content may contain watermarks or promotional information, and users are advised to make their own judgments.
3. The resources are for research and educational purposes only. For commercial use, please purchase the official license; otherwise, the consequences will be borne by the user.
4. If the content infringes upon your legal rights, please contact us for removal.

Disclaimer: The resources provided on this site are for learning and research purposes only. Any unauthorized commercial use will result in legal consequences.
 
匿名

Comment

Anonymous
:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:
Decide

Slide puzzle verification.