PoPo: Open-Source AI Tool to Animate MMD Characters with Natural Language

Uncategorized评论阅读模式

PoPo: Open-Source AI Tool to Animate MMD Characters with Natural Language

PoPo is an open-source AI tool designed for MikuMikuDance (MMD) that allows users to control character poses and facial expressions using simple text descriptions. For example, typing “wave right hand and smile” generates structured MMD Pose Language (MPL) code that animates bones and morphs in real time.

PoPo: Open-Source AI Tool to Animate MMD Characters with Natural Language-图片1文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

Key Features

  • Supports natural language input for full-body and facial animations
  • Generates consistent and readable MPL scripts
  • Optimized for Japanese-style rigs and physics constraints

Technical Stack

  • Frontend: Built with Next.js, TypeScript, and shadcn/ui
  • Rendering: Powered by Babylon.js and the babylon-mmd plugin
  • AI Engine: Uses a fine-tuned GPT-4o-mini model to translate text into MPL
  • Deployment: Hosted on Vercel

Why MPL?

MPL is a human-readable scripting format for MMD poses. It avoids complex quaternion math and makes results easier to tweak and debug, offering better consistency in output.文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

Training Example

{
  "messages": [
    {"role": "system", "content": "Generate MMD Pose Language (MPL) script from description."},
    {"role": "user", "content": "Description: arms down"},
    {"role": "assistant", "content": "arm_l bend forward 40; arm_r bend forward 40;"}
  ]
}

Project Background

PoPo evolved from the earlier MiKaPo project, which used MediaPipe to capture human poses. Now, PoPo directly generates MPL scripts from text, eliminating the need for pose sensors. The current dataset contains around 160 pose samples and welcomes community contributions for further improvements.文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

How to Use

Try the live demo at popo.love. Choose a sample character like “三相·梵天『无间玩伴』” and enter any pose description to generate instant animation. Full source code and contribution guidelines are available on GitHub under the GPL‑3.0 license.文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

PoPo: Open-Source AI Tool to Animate MMD Characters with Natural Language-图片2文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

PoPo makes anime-style character animation easier than ever—just type and animate!文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

Official website: https://popo.love文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

GitHub repository: https://github.com/AmyangXYZ/PoPo文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html 文章源自resohive.com-https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html

文章末尾固定信息

 
alvinfc888@gmail.com
  • 本文由 alvinfc888@gmail.com 发表于 1 8 月, 2025 11:22:25
  • 转载请务必保留本文链接:https://resohive.com/popo-open-source-ai-tool-to-animate-mmd-characters-with-natural-language.html
匿名

发表评论

匿名网友
:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:
确定

拖动滑块以完成验证