Category: Advance 3D with Serra_Term 3

Trough the most hardest design part, I finally created a personal performance with music beat with transform sphere and particle.

every part have meaning:

To kepping last week’s process, I try to out put my particle file into my hand tracking file, But when I Input it, suddently everything is automaticly connected and looks very massy and my computer cannot load it. also ,it cannot show the transform. But I realise I need add a pop into it and click “on”.

After every thing suttle down, this pink group particle will transform like:

This particle is not just particle, It’s means: Life like keep changing, so don’t be nervous, just hold the “play“ think into it. will have fun and find a good way.

Like a child, treat things with a playful mindset.

and also I add the sandstone into it, but particle:

create a particle form with a flat and rotate to like a paper shape. and change the “ramp” to colorful, also add” bloom” make it emission. looks like pretty sand!

Honestly, Those process are both really hard for me, expecially alway happen the unknow problem, very time I need find where is the reason, where it is stuck in.

I searched some tutorials online and leand how to made my geo to particle, and how to mix the music audio together.

To render in TouchDesigner I need to prepare a Geometry COMP, a Camera COMP, and a Render TOP, and then assign a material of a choice. And next is blend for “POP” of Morphing. Inside the process, There are so many

After I adjust the music beat aims to match it, which is about the particle form in rotation, and scale, I test lots of parameters like (rhythm in or kick in, even medium and high, so I decide to use rhythm and snare into transform to make it swim.

TD Process:

I already create a dundermental interactive things. And Create the left hand and right hand seperately, this process is aim to interactive with both hand and create specific geo graph, to visulize the action like hand grap or release the hold hand.

After fundermental handtracking’s learning, I start to leand how to create the particle shere. Actually this part is not easy, cause it has lots of parameters and POP transform between every panle, especially for lot’s of “null’ connectied with delete to delet the geomatry and transform into particle.

After create particle, I should use math to lock the X and Y, then delay the time and particle transform. Even I know the error place, But some time I don’t know how to fix it, so usually I will google or ask friend’s help.

For my concept present, I found a tutorial video, maybe better help: use hand reality capture to Control Particles, I think Visual element should not be one simple shape or not just one kind of animation.

Also, as serra’s recommodation. download off world Live Media production toolkit like a plugin. In my concept, I want to make a interecative game from TD create an

there are some example and reference for how to present the music and interactive game’s visual effect.

this week, I try to search some fun way to match my concept idea within my Touch Designer also some sort of skills.

I mean touchdesigner is really powerful software, and i can combine lots of interaction from camara and give some motion graph feedback if you design, like the video below:

So, I wanna mix the handgesture and songs beat, make it more fun, there also have a example which is made by UE5+ TD:

This is my project’s proposal

This project is related music and make it more visualization, interactive. The main aims to create a small interactive game with the music beat, but there is so many kind of material forms can combine together. And give the audience a special experience in music playing and have fun. Sometime people will follow the beat and dancing or sawed the air.

Background
This project concept came out from my daily life and my UE5 class. In my personal, I really like to listen to music, especially Kpop song, they have strong beat and those idol will dancing to presentation it in Music video. In this time, If we can dancing at the same time release pressure with body move, hand shape even kicking some where or facial expression.

To create an emotionally engaging interactive animation that encourages users to refresh the music live not only just listening but also doing some movement, recharge your energy, relieve fatigue. I try to use TouchDesigner and UE5( if yes) to create a game film use gesture to interact the songs beat or sentence.

• Experiment with motion and sound design
• Encourage audience participation
• Create an immersive emotional experience

Visual Style & Animation Approach
Maybe I will use 2D background mix 3D motion material combine together to become a film like 2-3 min.

this week we leaning a special skill that I really like it is 3D Screm. This skill always shows on the crowded places in big city like Wuhan, Shanghai…this kind of city in China. and How to made it?  introduce the setup for Virtual Production with for live link cameras and NDisplays

First: Know the 90 Screen and the principle of showing the 3D aniamtion:

• the inside screen: standard compositing like the whole room without 90 degree angle
• the outside: extend in front of frame edge should be match.
• animate must match both route simultaneously.
• horizon must be consistent inside the scene.

Actually, the real process and manupilating is not easy to be match as the real view. But it is still a good way to show and present obiesly.

Basically, this motion in 3D screen + NDisplays would be rendered twice, then people can see this animation in the reality world but like real 3D display. and for the details, just like the process below:

During this process, this is hard and need to adjust the screen in “nDisplayConfig” , which is a kind of blueprint.

This is how nDisplayConfig shows out.

Also it can add an IP address if you want to do a real-time update inside.

Once see the defalt screen, the rightside window you can find a “Projection policy” and choose the ” Mash”， and add our Right screen and left screen separately. So we have 2 screen should render out after finishing the Building layout.

After that, save it and go back to Level, starting the building process.

For me the hard thing is to match the screen and make 3D animate more bigger and show a more powerful visual impact.

This we we have introduction with Brif choose. I think may be I want to do some personal project and also have fun with. So I decide to do brif 1. Also it said: develop a project informed by my own research, interests, and position. considering not only what you create, but why it matters and how it operates in relation to the world.

I mean, Personal speaking, We are in a high pressure world, everything stransform very fast, developing just with time pass. and what people stress for?

when you very afraid of something or very concernd about something, which is like:

• cannnot dealing with this problem that you think is very harsh
• Things you are really worried about
• you are very eager to sth
• and so on

As time passes… suddenly people may realise, those things are just the sand of your lifetime, why can’t I enjoy everything happen?

So the Concept of project gradually comes out:

Everything like wind like sand , we can enjoy this way, this kind things and have fun. Also we can create a way with music, music is part of my life, I usually listen Kpop music, also when I feel stressful, I will listen and a little bit dance follow the totorial at my home, to release pressure.

This is what I usually listen: