Museum of Craft and Design® - Accessible Sonic Embroidery

Merging embroidery with interactive audio to redefine inclusive observation in art

Timeline: Nov 2023 to Nov 2023
Role: Individual Concept Project
Skills: Crafting, Programming, Interaction Design
Accessible Sonic Embroidery is an interactive design where sounds are triggered by touch on embroidered surfaces. Inspired by my previous project, Sound Map, this piece focuses on inclusive design, particularly for the visually impaired. It encourages artists to consider both visual and auditory dimensions in their work. By blending traditional embroidery with interactive sound, Sonic Embroidery offers an innovative and multisensory way to experience art, fostering greater accessibility and inclusivity for all audiences.
This project was exhibited at the Museum of Craft and Design, with a focus on engaging family groups. It encourages children to rethink and interact with artworks, showing them a vision of the future art world
[ CHALLENGES ]
Unlike typical industrial design projects that rely heavily on 3D modeling, I aimed to create a more hands-on and tactile experience. My challenge was to merge traditional crafting methods with modern technology, particularly by incorporating interactive elements like conductive threads and programming into the design. Balancing these two worlds—craftsmanship and technology—while maintaining the integrity of traditional embroidery techniques presented a unique challenge.
[ SOLUTION ]
To overcome this, I focused on crafting rather than conventional 3D modeling. I integrated conductive threads into the embroidery, allowing the design to have interactive properties. Through programming, I was able to give the piece a dynamic and functional dimension, blending traditional craftsmanship with technological innovation. This approach resulted in a design that not only honors the art of embroidery but also pushes the boundaries of what's possible in interactive and tactile design.
A hand touches an embroidered bird design connected to electronic components, creating an interactive, multi-sensory art experience.

Sonic Embroidery is an emerging experiment blending embroidery and technology. Each piece is stitched using grey conductive thread, which acts as a medium for connecting wires used in programming. The embroidery art is connected to positive and negative wires, powered by the Particle Photon 2 module.

Conductive thread is connected to a wire on the back of the embroidery, ensuring stability.(Lest Image)  Copper tape secures the wire to the fabric, reinforcing the connection for reliable interaction.(Right Image)

From the back of the embroidery art piece, you can see the conductive threads connected to wires. To reinforce the connection, I used copper tape to secure the conductive threads, ensuring stability and a stronger bond between the components. This approach ensures reliable data transmission during interaction with the artwork.

The video showcases an interactive, accessible sonic embroidery. A wooden board displays three embroidered designs: a bird, a mountain with flowers, and a pattern inspired by Taiwan’s indigenous culture. As the designer touches each embroidery from left to right, a unique melody plays, creating a sensory experience that blends touch and sound to make the artwork more inclusive.

A small embroidered art piece with flowers is shown on burlap fabric (Left Top Image). Two embroidered designs are connected to wires as part of an interactive setup (Left Down Image). A smiling girl holds her embroidered artwork connected to a system box, standing next to a display labeled Echoes of Inclusion, where her interactive embroidery is showcased (Right Image).
An embroidered design of a robot is shown connected by wires to a small wooden system box labeled Echoes of Inclusion.

I designed a small system box containing a Photon2 module. The box is connected to three pairs of wires and a computer, allowing children to link their embroidery artwork to the system. This setup enables their art pieces to become interactive, producing melodies when touched.

A child and an adult look at Sonic Embroidery installation (Left Image) A group of children eagerly interacting with another embroidery piece (Right Image)

I was grateful to collaborate with the Museum of Craft and Design in San Francisco for this event. I had the opportunity to engage with many families who were curious about Sonic Embroidery. Parents were especially interested in learning about the technical aspects, while children were fascinated by the way sound was produced through each embroidered artwork. It was rewarding to introduce a new form of interaction between art, artists, and audiences, bridging the gap between traditional crafts and modern technology.

In my future work, I am deeply committed to exploring the intersection of traditional craft and accessible technology. I believe art should be a universally immersive experience, open to all individuals, including those within the disability community. By combining hands-on, tactile craft with innovative, accessible tech, I hope to create art that bridges gaps and transcends barriers. My goal is to design experiences that invite everyone into the art world—regardless of physical ability—allowing for engagement, connection, and a sense of belonging through shared creative experiences.