Share an experience where you had to work with someone different from yourself.
Talk about a time when a person or organization tried to help someone or change something in your community.
In your community effort story, talk about an event that personally changed you in some way.
|Time Management||The extent that an individual makes optimum use of time.|
|Social Competence||The degree of personal confidence and self-perceived ability in social interactions.|
|Achievement Motivation||The extent to which the individual is motivated to achieve excellence and put the required effort into action to attain it.|
|Intellectual Flexibility||The extent to which the individual adapts his/her thinking and accommodates new information from changing conditions and different perspectives.|
|Task Leadership||The extent to which the individual leads other people effectively when a task needs to be done and productivity is the primary requirement.|
|Emotional Control||The extent to which the individual maintains emotional control when faced with potentially stressful situations.|
|Active Initiative||The extent to which the individual initiates action in new situations.|
|Self Confidence||The degree of confidence the individual has in his/her abilities and the success of his/her actions|
Talk about a childhood experience where you were able to do something you never thought you could have done.
They can use this with four different populations they serve: children, parents, donors (to build empathy), and volunteers/public/schools. This is an exciting aspect because unlike other evaluation frameworks, they gain a deeper understanding of what kind of difference they are making in the life of a disabled child through the many others that are effected by this child’s experience.
“Our impact is much more than mere ‘fun’,” the director said. “Providing the inspiration to achieve more is what our events are all about.”
To that end, they are excited that one of the benchmarking follow-up questions in our design is:
“What would have made a difference in this story?”
That allows them to learn how to expand and refine their programs in an open-ended way. Asking this question of four groups will refine their messaging and grant writing, as well as improve their programs and build relationships with the volunteer network they will need to sustain this listening project.
This organization will bring storytelling to the 30 schools where they do life skills training. They define success in much the same way Case #2 does. They want to use the open-ended storytelling question to look at how youth define the soft skills they receive, as well as build up an evidence base of the needs that these children have.
They expect it will be very difficult to get children to participate. I suggested that they engage teachers by offering to share the learning that emerges from stories with them. Teachers would probably like to know what their students think about, and this storytelling project offers them a lens into that. They may also explore a young-old mentoring program with the conversation mirroring approach.
This organization runs a network of business startup incubators around the world. And while they would like to eventually find a common framework for measuring the impact everywhere, they planned to start with the local hubs.
They plan to ask business leaders and aspiring entrepreneurs to share two stories. One will be about “any community effort” they know/care about, and the other is their own community effort:
Talk about your journey of trying to start a business.
This organization helps a half million volunteers find places to work. They too decided to pilot this storytelling with older volunteers. They use volunteering to improve life quality for the elderly and reduce social isolation. They added this context to the storytelling prompt:
Talk about an event that happened long ago and how that affects your life today.
By mining these narratives for emotion words they can quantify reduced social isolation. Isolated people use pronouns and articles differently than highly socialized people. By collecting stories monthly, they can plot the “journey” and look for trends across their volunteers, regardless of what else is talked about.
Topically, these stories will reveal life-transformation events that can be useful for designing future programs.
“And the requirement that we drop off and pick up story forms monthly will give our project managers an excuse to get out and visit these places,” the head person said happily.
They also have hundreds of narratives that they plan to import into our system and explore for more meaning.
One data system with many frameworks
I believe this is a real step forward in fixing our approach to impact evaluation. Instead of 6 organizations with 6 different ways to measure their “impact” we have 6 approaches that share a common back-end data collection system. Each of these organizations must collect as many open-ended narratives as they will of the more constrained questions outlined here.
They will have benchmarking. Even among the constrained questions, we see that there are some likely clusters for comparison:
That is the beginning of a storytelling context map. With just five organizations, we see that three will likely have some overlap with each other’s themes, and the remaining two have reasonable overlap with similar stories from our existing collection of 57,000.
As dozens of organizations try this out, we may find that evaluation frameworks emerge from the choices that individual organizations make as they take their specific objectives up to a higher level of abstraction. The essential trick is to flip the design by not asking for exactly what you want to know, but to ask communities to react thoughtfully to the core elements of what define our struggles to be more human to each other.
Already proven to work: From Gay Rights to Marriage Equality
Today I attended a talk at NTEN titled “How RED changed everything [for marriage equality]“. For a generation, the gay rights movement lost every ballot referendum that they poured money into fighting. After 30 straight losses, they decided that their messaging wasn’t working. (Yes, 0:30 seems obvious in retrospect, but the nonprofit/advocacy world is very afraid to admit failure). They hired a media company and started focus grouping with straight people who opposed gay marriage.
They eventually got to the heart of the matter:
Tell us why you got married?
Straight people described how they fell in love. But when these people talked about gay marriage, they perceived the issue to be exactly what decades of pro-gay messaging had told them: They thought gay people wanted to be married for the legal benefits, or for tax breaks, or to prove that their lifestyle was acceptable because the government condoned it.
The movement took a hard look at their own messages. They started featuring actual gay people in their ads (instead of judges and legal experts). They told stories. The focused on families and love. And they flipped the public from being 60% opposed to 60% in support in just 5 years. I’m going to take this approach to my local church, which is trying to do the same for voter suppression in North Carolina this year.
This is an example of the power of storytelling. When the prompting question is broad enough to allow surprises to emerge, an idea that begins as “gay rights” becomes a story of “marriage equality.” Reframing an idea starts by asking the people whose mindset and behavior you want to change to speak openly about it. As much as possible, our job is to is to listen.
Follow this thread: Examples of story analysis