T-Dancer

Touch Designer

Product Development

A Motion-Capture powered experience to learn dance through active feedback.

Project Type: Product Development & Motion Tracking
Role: Creative Director & Developer
Tools: TouchDesigner, MediaPipe, Mximo
Duration: Q3 2024

Strategy

UI/UX

Prototyping

Research

Design systems

Overview

TDancer is an experience created to help users learn how to dance through motion tracking, which provides feedback on accuracy. While it doesn’t teach the dance itself, it facilitates an environment in which the user can learn through real-time feedback.

Problem and Solution

Problem

Solution

People want to learn dance

with freedom and privacy.

For those who want to learn dance, but prioritize privacy and the freedom to succeed or fail in their personal space, it can become difficult to do so without an instructor present.

"

Systems thinking

Developer-friendly

Clear process

Fast execution

Thoughtful feedback

Smooth handoff

Technology

Platforms and Tools

Upon evaluating potential tools to execute the experience,
I chose TouchDesigner and MediaPipe as the best tools to drive the experience.

Tech Ideation

Technology Affordances

Compared two technologies to determine
which would most effectively enhance user experience, performance,
and scalability — grounding the final choice in research and strategic alignment.

Technology Research Methods

Tech Learning Process & Methodology

Considering my lack of familiarity with TouchDesigner, I designed
a method by which I can further learn the tool within the given timeframe (1 month).

Project Plan & Task Breakdown

Planning & Execution

Upon learning the tool, I developed a plan by which I can execute the project -
A step by step guide to the technical elements required for the product to function as envisioned.

Challeneges

Roadblocks of the Initial Product

Upon beginning initial development, I evaluated what worked and didn't work.
What challenges I faced. What needed to be changed.

Navigating Roadblocks

In the same manner, I determined potential solutions
to overcome those challenges, targeting each of the above roadblocks.

Iteration Methods

User Testing

Upon improvements, in it's wireframe, low-fidelity stage, I tested the product on target users
to determine which elements they valued and were best to invest time to refine and improve.

How it works

User Flow

Based on feedback, I established the finalized user flow
which encompasses all of the values I observed from the target users.

Materials

Equipment List

Considering T-Dancer requires various tools and materials,
I created a document which encompasses the required equipment for ease of access.

Backend Flow

System Diagram & Operation Instructions

As a means to ensure the product can work anywhere,
I developed a system diagram in conjunction with operation instructions,
This way, the product can work as intended, even if others without familiarity load it.

Operation Instructions:

SetUp and Launch:

  1. Open TouchDesigner

  2. Load project file (T_Dancer8.93FINAL.toe)

Connecting Hardware:

  1. Plug in Kinect camera

  2. In TouchDesigner:

    1. Verify skeletal joints are being tracked (there are channels like /joints/SpineBase/x, /y, /z, etc.)

Tracking User Movements

  1. Confirm Kinect CHOP outputs live skeletal data

Operation Instructions:

SetUp and Launch:

  1. Open TouchDesigner

  2. Load project file (T_Dancer8.93FINAL.toe)

Connecting Hardware:

  1. Plug in Kinect camera

  2. In TouchDesigner:

    1. Verify skeletal joints are being tracked (there are channels like /joints/SpineBase/x, /y, /z, etc.)

Tracking User Movements

  1. Confirm Kinect CHOP outputs live skeletal data

See it in Action

High Fidelity Prototype

Lastly, I developed a high-fidelity prototype which encompasses each of the elements.

Due to Touch Designer allowing only editable links, I've provided documentation of the experience in action!

Anonymous Student

UT Austin IMS Student

I had so much fun! It feels low-stakes - I feel free when I do the dances. I can do this in private while still getting feedback on my performance - I really value that.

"

Matthew Eastin

Director of Moody College of Communications

I can see this as part of a dance or zumba class - you learn the moves beforehand and come in person perform. It's a great opportunity to learn with freedom and not worry about how others see you in the process.

"

Looking Ahead

Future Iterations

In recognizing areas which could be iterated on,
I examined all of the elements within T-Dancer and created a structured list of
specific points which might be of benefit.

See also

More Projects

Cur8

UI/UX

Fashion & Retail

Emotiscan

AI

Content

Want to chat?

Let's Connect

Feel free to contact me if you have any questions.
I'm available for work, new projects, or just for chatting!

Dagmawit Kifle

Want to chat?

Let's Connect

Feel free to contact me if you have any questions.
I'm available for work, new projects, or just for chatting!

Dagmawit Kifle

Want to chat?

Let's Connect

Feel free to contact me if you have any questions.
I'm available for work, new projects, or just for chatting!

Dagmawit Kifle