The Magic Flute
—  hardware/software instrument (C++, Arduino, Max/MSP)


Year: 2024
Duration: 6′30″
Presented: Selected, ICMC 2025 (International Computer Music Conference), Boston (Jun 2025)


The Magic Flute takes its title and its idea from Mozart's opera: a flute that makes sounds an ordinary flute cannot. The instrument is built in the form of the large xindi in G, a keyless Chinese transverse flute without the membrane of the dizi, and it is held and blown like one.

The body is a single kraft paper tube. Paper is light, it can be cut to any length, and sensors are easy to mount on it. The tube carries a microphone at the blow hole, four touch sensors under the fingers, a knob, and an accelerometer. An Arduino Uno sends the sensor data to Max/MSP.

The sound material is pre-recorded flute, four sounds from nature (wind, stone, thunder and rain) and electronic sounds. The player calls them up through the sensors: for example, blowing into the microphone brings thunder, touching the sensors brings drops of rain, and the knob brings in the sustained flute sound. The accelerometer follows the movement of the instrument in the player's hands.

The piece listens to nature from the flute's point of view. The performance is partly improvised and includes random elements.




The Lament of Plants
—  for Pipa,Cello and Max/MSP

Year: 2025
Duration: 8′30″
Awards:
First Prize, Acoustic/Electronic Category, 7th International Electronic Music Competition (IEMC) (Dec 2025)
Second Prize, Mixed Electronic Music, Macau Digital Intelligence Multimedia Music Creation Competition (MDIMC) (Nov 2025)

The piece began with a paper. In 2023, Khait et al. at Tel Aviv University reported in Cell that tomato and tobacco plants emit airborne ultrasonic clicks when they are short of water or have been cut. The sounds are too high for us to hear, and the likely mechanism is cavitation in the plant's vascular system.

After reading it, I wanted to mourn on the plants' behalf, and that is the lament in the title. The piece does not use recordings of plants and is not a sonification of the data. All of the sounds are composed for pipa, cello and electronics.

The two instruments are treated differently. A pipa note starts to fade as soon as it is plucked, while the cello can hold a tone. Both parts also use extended techniques, such as striking the body of the instrument and heavy bow pressure on the cello, and some passages are left free for the performers.

Both instruments are recorded and processed live in Max/MSP, together with material prepared in advance. Granular synthesis is the main process, because it breaks sound into very short grains, much like the clicks the plants emit. Delay, harmonizer and reverb are used alongside it.





Sonic Relief: Loong
— audiovisual, stereo (Processing, Max/MSP)

Year: 2026
Duration: 4′30″

The piece has two sources, one for the image and one for the sound. The image, made in Processing, comes from a circular nine-dragon relief, where the dragons coil around each other without leaving the surface. The sound comes from eight Chinese characters: 盤 庚 龍 百 怪 猙 獰 固. They are recorded as voice samples and then processed with various effects. The characters belong to the music only and are never shown on screen.

The first character, 盤, names a vessel, the coiling of a body around itself, and the first syllable of a king's name. The title keeps 龍 as “loong” rather than “dragon” because the two are not the same animal.

The sound is built in Max/MSP with sgran~, stgran~ and maraprob, which are ports of Mara Helmuth's RTcmix granular instruments. The material is handled as grains and densities rather than as notes.

YUE ZHANG
Composer  ·  Instrument Builder  ·  Computer Musician

z1805802838@gmail.com |  +86 195 5641 6384 | Portfolio: youtube.com/@Yue-j1f


R
ESEARCH INTERESTS

My work sits at the intersection of instrument design, real-time interaction, and computer-mediated performance. 

I build hardware and software systems that let performers shape electronic sound through physical gesture—from custom Arduino controllers to computer-vision pipelines that read sign language. 

A recurring question across my pieces is how the body's movement can serve as compositional material rather than merely a trigger: how a performer's breath, bow pressure, or hand shape can drive algorithmic processes that respond in real time, making the electronics an interpretive partner rather than a fixed accompaniment.

 I am especially interested in extending this inquiry to performers whose bodies have been underrepresented in instrument design, including disabled musicians and practitioners of non-Western instruments.

Selected Works


Fly with the Starlings — for violin and electronics

Year: 2022-2023
Duration: 4′30″
Awards:

Best Student Music Award, ICMC 2023, Shenzhen (Oct 2023)

Excellence Award, Electronic Music Category, 5th IEMC (Dec 2023)
First Prize, 9th New Voice Composition Competition, Wuhan Conservatory of Music (Jun 2023)



EDUCATION

Wuhan Conservatory of Music, Wuhan, China

Sep 2024 – Jun 2027 (expected)

Master of Arts, Computer Music Composition   ·   GPA 3.98/4.0

Composition studies with Associate Professor Feng Jian

University of Oregon, Eugene, Oregon, USA

Aug 2025

Summer Session, Computer Music, with Jeffrey Stolet

Wuhan Conservatory of Music, Wuhan, China

Sep 2020 – Jun 2024

Bachelor of Arts, Recording Arts (Music Sound Direction)   ·   GPA 3.69/4.0

Thesis: The Application of Real-Time Effects in Mixed Electronic Music: A Case Study of Fly with the Starlings (Outstanding Undergraduate Thesis Award)



PRESENTATIONS
 

NIME 2026 Student Consortium, London  —  Capture Uncapturable
(Jun 2026)
2nd National Academic Exchange Conference for Graduate Music Students, Zhejiang Conservatory of Music
(Dec 2025)

Selected paper: “Depicting Birds in Flight: The Creation Practice of Sound Description in Fly with the Starlings”



SCHOLARSHIPS


China National Scholarship, Ministry of Education of the People’s Republic of China
(Oct 2025)

Special Scholarship, Wuhan Conservatory of Music
(Oct 2025)

First-Class Scholarship, Wuhan Conservatory of Music
(Oct 2022, Oct 2025)

Practice Innovation Special Scholarship (Categories A2, A3), Wuhan Conservatory of Music
(Oct 2022)



TEACHING,SERVICE & LEADERSHIP


Guest Instructor, Electronic Music Composition (undergraduate lecture course), Wuhan Conservatory of Music
(Sep 2025 – Sep 2026)
Five sessions covering audio effects, DAW workflow (Cubase), real-time environments (AudioMulch), and introductory composition in acousmatic and mixed/interactive electronic music. Course led by Associate Professor Feng Jian.

Class President, Graduate Cohort, Composition Department
(Sep 2024 – Sep 2026)

Team Leader, Rural Community Arts Outreach Program (“Outstanding Team” Award)
                                                        (Jul 2025)



TECHNICAL SKILLS


Max/MSP  —  real-time performance systems, gesture-to-sound mapping, live processing of acoustic instruments

Python  —  real-time computer-vision gesture tracking with MediaPipe, mapped to Max/MSP

C++ / Arduino  —  firmware and sensor interfacing for custom hardware instruments

Processing  —  generative audiovisual systems sharing one algorithmic logic across image and sound

Notation  —  Sibelius

Audio  —  multichannel and spatial audio, Kyma, Cubase



LANGUAGES

Mandarin Chinese (native), English







Last Updated 26.10.05




Cybernetic Texture
— for robotic arm, suspended accelerometer, a box of seeds and Max/MSP

Year: 2026–2027 (in progress)

Cybernetic Texture is my master's thesis piece and is still in progress. The performer is a programmable robotic arm. Beside it, an accelerometer hangs on a long cord, and a plastic box holds a balloon and dried fruit stones and seed pods, including mango stones. A small microphone picks up the sound of the box, and everything is connected through Max/MSP.

The arm does two things. It plucks the hanging accelerometer, which then swings freely. The swing depends on the force of the pluck, the length of the cord and air resistance, so the data that reaches Max/MSP decays in a regular cycle but is always slightly disturbed. The arm also stirs, strikes and grabs the objects in the box, and they collide with one another in chains. Random modules in the Max patch are a third source of unpredictability.

I use “cybernetic” to mean feedback, not full control. The sensor data and the sound of the objects are captured, analyzed and processed in Max/MSP in real time, and then take part in the next round of sound generation. This closes a loop of action, feedback, processing and regeneration, in place of a one-way trigger and response.

At this stage the sound has three materials: the noise of the arm's joints as it moves, string-like timbres, and the collisions in the box. The idea draws on two pictures from physics, string theory and the motion of celestial bodies, and links the path of the swinging sensor to the sound design of the objects in the box.

The question I am working on is where the composer should keep control, and where the result should be left to the physical system.





Capture Uncapturable
 —  for sign language and MediaPipe
(Python, Max/MSP)



Year: 2025
Duration: 6′30″
Presented:
Accepted, Student Consortium, NIME 2026 (New Interfaces for Musical Expression), London (Jun 2026)
Selected, ICMC 2026 (International Computer Music Conference), Hamburg (May 2026)
Electronic Music Marathon Showcase, 3rd Summit on Music Intelligence (SOMI), Central Conservatory of Music (Apr 2026)

Sound cannot be seen, and sign language cannot be heard. In this piece each one supplies what the other lacks: the silent signing produces the sound, and the sound lets the signing be heard.

The central image is the sign for "strobe camera" in Chinese Sign Language. The hands become a camera that freezes what we cannot normally see: magma moving and rock breaking inside the earth, and water, forest and rain on its surface. The other signs in the piece are fire, sea, rain, landform and Danxia landform. All of them come from the National Common Sign Language vocabularies for physics and geography, and some are adapted for the piece.

I perform the signs myself. MediaPipe tracks the landmarks of my hands from a camera, and a Python bridge sends them over OSC into Max/MSP. There the data is tested against thresholds I set by hand: the distances between fingertips, how far the hand is open, the orientation of the palm, and the direction and speed of movement. These are close to the features that distinguish one sign from another in the language itself. When the data crosses a threshold it triggers a sound process, and the same data keeps shaping that process while it runs.

There is no trained classifier and no translation. The system responds to a small vocabulary of signs that I chose and defined, so the vocabulary is a compositional decision. The difficult part is onset: signing touches nothing, so there is no key or string to give an attack, and I have to decide for myself the moment a sign begins.

Sign language is not used here to illustrate or translate the music; the signing is what plays it. The aim is that everyone in the room, hearing or not, can listen to the gesture and see the sound.