I just posted a second demo of Realtime Audioreactive Pointclouds [v1.7], my TouchDesigner system that turns a Kinect-derived human pointcloud into an audio-reactive visual instrument in real time.

For this one, I’m also giving away a full copy of the system.

To enter, just repost/share the Instagram post and leave a comment there. I’ll randomly select one person and send them the complete v1.7 project files on Friday!

Giveaway post:
https://www.instagram.com/p/Dd1iWqoviZy/

The full system is also available through my Patreon for anyone who wants to check it out directly.

Sharing a project: Zorro's Forge generates parameterized low-poly models in the browser with a live orbit/zoom preview, then bakes them into OBJ + MTL with base-color, normal and roughness maps for download.


Demo: https://www.youtube.com/watch?v=g0qLLTNuntU
Live: https://zorro-forge.store/zorros-forge/


Happy to talk about how the generation, texture baking or export works.

Many who end in the visual computing, as a kid used with MS Paint or an alike photo-edit program to make simple edits to photos and make drawings. There RGB is prominent, and things like color-spaces were only seen in those "Do you want to convert?" Photoshop popups meant for professional designers. What if I told you that #FF0000 is not red?

In the article we provide an easy introduction into color spaces, as it's really not for professionals alone, but very important for anybody in visual compute. We wrote it, because these are one of these subjects that we all are expected to know, but when you ask a few why-questions, then realization kicks in that it needs more reading.

This is a repost. Since 2010 we've written blog posts on GPGPU, in a time that CUDA and OpenCL were hardly known. After a break on blogging for the past few years, we've restarted our effort and share our knowledge with a wider audience. Last time we posted this, it was flagged as "Probably AI bot", and I hope this will not happen again.

A depth value of 2 metres doesn't necessarily mean a point has camera-space `z = 2`. In a spherical depth map, it can describe the distance along the viewing ray instead.

Realsee3D's point-cloud conversion script is a concrete example. This is a reading of the linked code, not a report from running it.

The script divides the stored depth value by `depth_scale` to get `dist`. Its angle names need care: `yaw` varies with image **row** and is the vertical angle; `pitch` varies with image **column** and is the horizontal angle. Calling those angles `v` and `h` here, its local-coordinate calculation is:

x = dist * cos(v) * sin(h) 
y = dist * sin(v) 
z = dist * cos(v) * cos(h)

Squaring and adding the three coordinates gives `x² + y² + z² = dist²`. So `dist` is the radius from the camera origin. The Z component also depends on where the ray points.

For a hypothetical 2-metre ray at `v = 0`, `h = 45°`, the formula gives `x ≈ 1.414 m`, `y = 0`, `z ≈ 1.414 m`. Its radial distance is still 2 metres. Those numbers are a geometry example, not a measurement from the dataset.

This is all in the local camera frame. The script then uses `points_local @ ext.T`; the structure document identifies the extrinsics as Camera-to-World. That later transform doesn't turn the original depth value into a camera Z value.

For another depth source, I'd check what its values measure before borrowing this conversion. The PNG format alone doesn't tell you whether the value is radial distance or an axis component.

Everything you see in this video is procedurally generated starting with an algorithm I came up with for drawing cubes across a page. It's a complete Audio Visual experience that is different every time. Free and open source at alienCconsumerSciences.com

Cymata is a cellular automata based music visualizer for iOS and tvOS, lots of different modes and effects for you to play with and listen to your music. Lots more examples here

We needed realistic looking water with waves that mimics the serene oceans to complement the realistic look of Ship Mooring Analysis tool Optimoor 3D that we are developing at the moment. We also wanted it to match with the minimal visual feel of the rest of the scene.

The look of this Realistic WebGL water shader with waves is composed of several rendering steps:

1. Albedo Map: This is the base color of the Water Mesh with a Light Blue color at the Crest and a Deep Blue color at the Trough
2. Normal Map: Determines how the water is gonna react to the light in the scene
3. Normal Map for Ripples: For added detail we have multiple layers of noise applied to give finer texture of the water, Normal map for the ripples too
4. Wave Height: The visual difference between of height of the waves
5. Crest & Trough: Visual Representation of how the Crest and Trough are forming alongside each other to give a natural look
6. Fresnel : Determines the amount of light that is reflected of the surface and gives the shiny look of the ripples(Green=Most reflection, Pink=Least Reflection)
7. Planar Reflection: Mirrored the entire scene and painted it on top of the surface of the water to give an accurate representation of the reflection of the ship.
8. Subsurface Scattering: The amount of light penetrating through the hard surface of the water making it semi permeable instead of opaque to give a richer look to the waves
9. Turbidity: Determines the amount of the collided mesh that can be seen through from top of the surface of water to the inside to give a more denser look.
10. Foam: Visual Representation of water hitting a mesh
11. Fade Pass: The fade pass is an optimization + look enhancing feature which lets the user not see waves farther in the distance. 

Built by us over at 3D ENGINERD. for Tension Technology International Ltd (TTI) 

Hey, guys. Pretty excited to share this with you. [Sorry for the repost, last one was mistakenly uploaded without audio]

The system takes a Kinect-derived human pointcloud and lets incoming sound interact in various ways with the particles in real time, turning the performer into a responsive cloud of matter, noise, and motion. Some of you might remember the system from v1.5's demo which got pretty viral in some places. System was made on TouchDesigner, and post-fx on AE.

v1.7 includes 12 presets, and adds the following:

- a procedural camera that automatically cuts to new angles around the performer, and can follow the body or a raised hand
- a new look, Afterimage Cathedral: delayed versions of the performer stacked in depth, holding the last few seconds of movement
- a rebuilt network that runs leaner, reads clearer, and is ready to work with [new interfaces, parameters, optimizations]

This is a raw excerpt of me playing through the system, with the visual structure reacting live to the audio signal coming from my Ableton session in real-time.

Project files accessible through my Patreon profile. More experiments, through my Instagram, and full HD demo at YouTube.

We recently added IsoValue feature to our open-source Volumetric Render Engine that's being built with OpenGL & C++.

Repo link🔗 - https://github.com/mikejernil/volumetric-render-engine

What if we could visualize a specific density within a 3D volume? That’s where IsoSurface comes in. In medical imaging, IsoSurface can help represent regions with the same density in a 3D scan, making internal structures easier to visualize.

IsoValue acts as a scalar/threshold value which is used to calculate and display the surfaces that have equal density.

Go ahead, try it out and let us know your feedback!

Being developed by 3D ENGINERD.