Monash University

Evaluating the creative impact of a prototype workshop kit

Paper Giant worked with Monash University to help them evaluate the Portable Art Connections Toolkit (PACT). PACT is an artkit designed by Monash researchers for use in facilitated sessions with young people interested in creative activities.

The Pact Artkit featuring 3 face masks, string charcoal and a bright orange bag.
  • A theory of change that outlines Monash’s ultimate goal and the pathways that will lead to it

  • An evaluation framework with questions designed to measure progress against desired outcomes

  • A set of survey questions to be sent out to people who ordered the artkit


Defining and evaluating success

In collaboration with Monash researchers over a series of workshops and engagements, we developed a Theory of Change by identifying both the project’s ultimate goal and intermediate outcomes that would show it was on the right path.

Paper Giant helped the researchers develop an evaluation strategy for PACT. We developed a set of evaluation questions aligned with the project’s key desired outcomes, along with hypotheses about how the artkit can be used.

The evaluation framework includes details on both how the artkit will contribute to each key outcome, and how Monash can determine when that outcome has been reached.

The front page of the artkit instructions featuring a logo and illustrations showing what's in the kit and how to use it.
The back of the artkit instructions showing the theory of change and how to evaluate its effectiveness

A set of instructions for the kit that was created as part of the project


Collecting data

We worked with Monash to develop ways to test whether the prototype was effective. We identified supporting evidence and assumptions to test along the change pathways, then prioritised outcomes and hypotheses to include in the evaluation strategy. We used these to develop a survey for facilitators to use as the main evaluation method for the pilot.

The survey responses can be analysed and used to establish:

  • Types of artkit users
  • Barriers to use
  • Process and impacts of use

We included suggestions for data collection methods, and other useful data that could be collected apart from the survey.

Subscribe to Paper Giant

Each month, our team share their thoughts on design-related topics, reflect on current social issues and share what’s happening in and out of the studio. We'll also include an invitation to our monthly meet up, Office Hours. We'd love you to join us.

Three paper airplanes flying through the air into people's inboxes.
Paper Giant

Paper Giant acknowledges the Wurundjeri and Boonwurrung people of the Kulin nation, the Ngunnawal and Bundjalung people as the Traditional Owners of the lands on which our offices are located.

We acknowledge the Traditional Owners of Country on which we meet and work throughout Australia. We recognise that sovereignty over the land has never been ceded, and pay our respects to Elders past and present.

Aboriginal and Torres Strait Islander people are advised that this website may contain images and voices of deceased people.