visitor@site:~$ cat ./projects/personal/.md
2019 · audio-visual

Fairytales and Televisions

a sonification and visualization of a Japanese fairytale audiobook, done in Unity.

unity3d generative
────────────────────────────────────────────────────────────

Concept

What remains when a text’s meaning and spoken pronunciation are obscured?

This piece explores light, shadow, word classification in text, and rhythm in spoken language. Each word in the audiobook is mapped to a television — different word classes (verbs, nouns, etc.) trigger televisions with distinct visual patterns falling from the sky. Each television type has its own sound bank. When sounds play via an aleatory statistical model, the corresponding television activates with visual patterns.

────────────────────────────────────────────────────────────