Summoner

Inspiration

As an anime fan, I am always obsessed with the fantasy world. I like the Summoning Technique in Naruto. When the Ninja uses specific hand signs with his blood, and the summon symbols, he can transport a particular animal from the different at his location. In Chinese Taoist culture, the Taoist priest also uses some hand gestures to draw some symbols on the paper to call something from the hell. Recently, I was exploring the TensorFlow.js. I found it would be cool that combined the hand gesture recognition with the summoning techniques to build a website for people to play with.

I want to build a website with a fantasy world that people use different hand gestures can summon different animals from the different world.

Techniques

The main interaction I want to build is the hand gesture recognition. I used to tried OpenCV and leap motion to detect the hand gesture. Since it is a web based technique, I founded the TensorFlow.js. It is my first time to use TensorFlow. I thought it has many possibilities for different projects. For this time, I used the posenet as my example. It can detect multiple people poses and the joint points of their body.

I had experience to build a interaction with leap motion and Openframeworks. To do the the gesture recognition, for example, like the drawing circle gesture. It has to store the last point and compare the direction and the distance of each point.

I firstly test with the example, and build some simple interaction with the the main point. Then I applied this Algorithm into javascript. And test with the drawing lines gesture detection.

Process

Prototype 01 - Code Link

For this prototype, my main focus is to build the interaction: drawing a triangle and then show a character on the screen.

© 2018 By Fanyun Peng. All rights reserved.