Deepwalker
Join me on my journey towards physics-based 3D animation generation using neural networks!
***
10/1/2023 Update
This year I've been working on setting up an animating humanoid in the physics sim program Pybullet.
Today I got the animation data pipeline in place!
![](https://cdn.myportfolio.com/74356c9d094fb6fcdfc1bae6c2863374/57ac1c51-9cc7-4e1a-ad20-7df802583f95_rw_1200.gif?h=f3dd631ef7ec146cab24d7362c1282f3)
The reference animation
![](https://cdn.myportfolio.com/74356c9d094fb6fcdfc1bae6c2863374/5a9f6870-8356-4e3a-891e-69fe2c9dd655_rw_1200.gif?h=a8d60f400e3e02a82744ec551e1da303)
With physics on (no initial velocity)
![](https://cdn.myportfolio.com/74356c9d094fb6fcdfc1bae6c2863374/d7642f55-a013-468a-b3d5-1cd977bc9d1d_rw_1200.gif?h=7fa9d05699f0552d74f7c9ecdf7b4342)
Physics on, with initial velocity: : The starting point!
![](https://cdn.myportfolio.com/74356c9d094fb6fcdfc1bae6c2863374/0bf75234-b854-45f3-bf28-cb6d2619878d_rw_1920.gif?h=8b2d2ae9f9ea7e6bcb222702dd3311f8)
The source animation (from Mixamo)
Context:
The cool part is that a physics-capable robot in Pybullet is doing it.
Robotics programs don't really support animation out of the box - you gotta write your own way to do everything, from stepping time forward, to converting animation data and applying it to the robot's joints. (For me ~2500 lines of python)
Now that I have this framework, I can finally start running machine learning on top of it!
***