Accessible Sonic Embroidery - Museum of Craft and Design®

Merging embroidery with interactive audio to redefine inclusive observation in art

Individual Project: Crafting, Prototyping, User Testing, Programming, Accessible Design
A hand touches an embroidered bird design connected to electronic components, creating an interactive, multi-sensory art experience.

The original idea for Sonic Embroidery was inspired by the Xbox Adaptive Controller and its motto, “When everybody plays, we all win.” In this project, I reimagined how people could interact with embroidery—and artwork in general—in a more accessible future. I wondered: could technology bridge the gap between art and accessibility? And how could we minimize the barriers between advanced technology and inclusive design?

Sonic Embroidery is an experimental fusion of embroidery and technology that responds to touch by producing melodies, making artwork more accessible and interactive. Each piece is stitched with conductive grey thread, which serves as a pathway for connecting wires essential to the programming. The embroidery is connected to positive and negative wires, powered by a Particle Photon 2 module, creating a tactile and auditory experience that invites people of all abilities to engage with art in a new, immersive way.

Conductive thread is connected to a wire on the back of the embroidery, ensuring stability.(Lest Image)  Copper tape secures the wire to the fabric, reinforcing the connection for reliable interaction.(Right Image)

From the back of the embroidery art piece, you can see the conductive threads connected to wires. To reinforce the connection, I used copper tape to secure the conductive threads, ensuring stability and a stronger bond between the components. This approach ensures reliable data transmission during interaction with the artwork.

The video showcases an interactive, accessible sonic embroidery. A wooden board displays three embroidered designs: a bird, a mountain with flowers, and a pattern inspired by Taiwan’s indigenous culture. As the designer touches each embroidery from left to right, a unique melody plays, creating a sensory experience that blends touch and sound to make the artwork more inclusive.

A small embroidered art piece with flowers is shown on burlap fabric (Left Top Image). Two embroidered designs are connected to wires as part of an interactive setup (Left Down Image). A smiling girl holds her embroidered artwork connected to a system box, standing next to a display labeled Echoes of Inclusion, where her interactive embroidery is showcased (Right Image).
An embroidered design of a robot is shown connected by wires to a small wooden system box labeled Echoes of Inclusion.

To further develop this project, I had the honor of exhibiting Sonic Embroidery at a Family Day event hosted by the Museum of Craft and Design. For the exhibition, I designed a small system box containing a Photon 2 module. The box connected to three pairs of wires and a computer, allowing children to link their embroidery artwork to the system. This setup enabled their art pieces to become interactive, producing melodies when touched, and creating an engaging, hands-on experience that brought accessibility and creativity together.

A child and an adult look at Sonic Embroidery installation (Left Image) A group of children eagerly interacting with another embroidery piece (Right Image)

I was grateful to collaborate with the Museum of Craft and Design in San Francisco for this event. I had the opportunity to engage with many families who were curious about Sonic Embroidery. Parents were especially interested in learning about the technical aspects, while children were fascinated by the way sound was produced through each embroidered artwork. It was rewarding to introduce a new form of interaction between art, artists, and audiences, bridging the gap between traditional crafts and modern technology.

In my future work, I am deeply committed to exploring the intersection of traditional craft and accessible technology. I believe art should be a universally immersive experience, open to all individuals, including those within the disability community. By combining hands-on, tactile craft with innovative, accessible tech, I hope to create art that bridges gaps and transcends barriers. My goal is to design experiences that invite everyone into the art world—regardless of physical ability—allowing for engagement, connection, and a sense of belonging through shared creative experiences.

↑ Back to Top
charlene.lu755@gmail.com  /  © charlene lu 2024