These tools and metrics are designed to help AI actors develop and use trustworthy AI systems and applications that respect human rights and are fair, transparent, explainable, robust, secure and safe.
TDNeuron
Welcome to our repository. Here you will find material on how to use the TDNeuron system to implement machine learning within Derivative’s TouchDesigner.
Why use TDNeuron?
There are several deep-learning libraries and frameworks available today. Why yet another one, such as TDNeuron? Here are some of the reasons.
Education
TDNeuron was created initially out of our desire to self-learn the rudiments of machine learning. We believe that the best way to fully understand a concept is to build it from scratch. By making our code open-source and enriching it with comments, tutorials, and documentation, we are trying to open the world of machine learning for the novice ‘regular’ user, while still keeping the doors open to allow for those curious to dive deep into the mathematics and core concepts.
Visual modeling
The modeling interface of TDNeuron is completely TouchDesigner-based. It uses regular controls and the same patching mechanisms as those one uses when creating a regular network. In addition, the ‘nodes’ in the model show extended real-time information about the data flowing through the layer. This gives great insights into what the machine is actually learning at any given time or for bug-fixing. Since TouchDesigner is a visually oriented programming environment, there is no need to code a single letter with TDNeuron to build a deep learning model.
GPU powered
Most calculations of the deep learning layers can be done in parallel. TDNeuron uses GLSL (pixel and compute) shaders, to achieve the best possible performance.
Extended built-in layers
The following deep learning layers are currently implemented:
- Linear
- Activation (sigmoid, tanh, relu, lrelu, swish, softplus)
- Multiply, Add, Concat, Split
- Convolution (1d and 2d)
- Pool (maximum and average)
- Flatten
- Loss (MAE, MSE, Huber, CrossEntropy)
- Softmax
- Layer normalization
We have made sure that TDNeuron is as modular as possible, which makes it easy to implement new layers if needed.
TouchDesigner native
Since TDNeuron is fully built from scratch in TouchDesigner, with its own custom-made shaders and UI, everything is native to the program. There are no libraries to import and nothing new to learn outside the scope of TD. This allows you to quickly prototype models without leaving the comfort of your favorite software and to train them and share them with your colleagues, fit to function in your real-time projects.
Commercial licenses available
TDNeuron is released under a GNU Public License v3. If you want to use TDNeuron closed source in commercial projects, please contact tim@yfxlab.com, info@darienbrito.com for specific licenses.
Limitations and disclaimer
Here we list some importation limitations of TDNeuron:
- TDNeuron is Windows only (it uses compute shaders, which are not supported in MacOS
- The platform state is highly experimental and subjected to many major changes still
- TDNeuron is by no means state of the art (yet)
- There are limitations on the quantity of input data (when too big, TouchDesigner cannot load it at once)
- There are limitations on the length of input data (dependent on how big a texture your GPU can handle)
- As with every ML platform, the quality of input data quality is the responsibility of the user.
Final words
We assume that you are already proficient with TouchDesigner. To get you started with TDNeuron, we offer a help module that you may consult at any point. Along with it, we offer a gentle Introduction to machine learning that you may want to follow as well. In there, we built a simplified version of a neural network with CHOPs, with step-by-step explanations.
To use TDNeuron you do not necessarily need to know GLSL or shaders, although to make the most out of it you need to have a fair understanding of the basics.
We strongly believe that knowledge should be shared and hope that TDNeuron can help others in their first steps in machine learning. We look forward to learning from you and seeing how far we can take this platform together.
About the tool
You can click on the links to see the associated tools
Tool type(s):
Objective(s):
Type of approach:
Usage rights:
License:
Github stars:
- 158
Github forks:
- 13
Use Cases
Would you like to submit a use case for this tool?
If you have used this tool, we would love to know more about your experience.
Add use case




























