Skip to main content

SHIELD

Co-Design Is a Quality Control Mechanism

Safety infrastructure built for rather than with the people it is meant to serve reflects assumed users rather than actual ones. There is a consistent gap between the populations that safety systems are designed to protect and the populations that participate in designing them. The result is infrastructure calibrated to assumed users: an assumed relationship to technology, an assumed family structure, an assumed language, an assumed relationship to institutions and disclosure. Where those assumptions match reality, the infrastructure works reasonably well. Where they do not, the gap between the design and the actual situation is treated as a user failure rather than a design failure.

The Pattern of Exclusion

Frameworks built in one context are applied in others without modification. Young people are consulted rather than involved. Community-level practitioners are present as recipients of guidance rather than as sources of it. The knowledge required to design correctly is in the hands of the people least likely to be in the room.

The underrepresentation of Global Majority practitioners, youth, and community-level workers in the rooms where safety standards are set is not only an equity issue. It is a technical one that reduces the effectiveness of the output. The practitioners represented at the conference built frameworks and tools that addressed problems that more formally resourced processes had not reached, because they had access to information those processes did not.

Failure by Design

The design problem in co-design is not malicious. It is structural. When the people whose reality the system needs to account for are absent from the design process, the resulting assumptions are not wrong on purpose. They are wrong because no one in the room had the information to correct them. The gap between what the system was built for and what people actually need is then treated as a user failure: the person who does not fit the design is the problem, not the design that never accounted for them.

Infrastructure calibrated to assumed users does not fail by accident. It fails by design because the people whose reality the assumptions needed to reflect were never in the room to correct them.

The pattern of exclusion is self-reinforcing. The less a community is represented in the design process, the less the resulting system serves them, which reduces their trust in it, which in turn reduces their engagement with it.

The Core Finding

Co-design is not a participation practice. It is the mechanism by which designers gain access to information they cannot get any other way. Without it, the gaps in what they know become gaps in what they build.

This article is adapted from SHIELD’s 2026 Conference Reference Document from the SHIELD Global Online Safety Conference. The reference document synthesizes themes, insights, areas of agreement, tensions, and open questions that emerged during the event.

Download the full document here