Data Dictionary: the what, why and how

It is ideal to have a data dictionary whenever you have quantitative data that will be used and shared by multiple people or groups. Without precise definitions, it is very easy to arrive at different results while using the same dataset. In this article, we focus on how evaluators can (and should) clarify details about the data being used for evaluation. In other words, how and why build an evaluation-specific data dictionary.

Read More

Six lessons from practicing “true” developmental evaluation

I am now finally working on an evaluation that I believe to be true developmental evaluation. The initiative and evaluation is in its early days. Yet, I have already had a very different experience than previous DE (and so-called DE) experiences and learned a number of lessons I’d like to share. In this article, I outline six lessons from my DE experience, including why I think it is true DE.


Read More

Does my program need a dashboard?

When I hear “we need a dashboard,” what I hear is “we need relatively current information that we can quickly understand and trust, and we want it on one page.” But a dashboard may or may not be the best way to fulfill that need. Here, I’ll clarify what a dashboard is, and what it isn’t, then provide a checklist you can use to decide if your program or organization needs one.


Read More

What to Put in Your Evaluation Contract

Congratulations, evaluator, you’ve landed a client! Or maybe your organization has selected an evaluator to complete an exciting project. Either way, your next step is a contract for evaluation services. In this post, we list some components you should include, or at least consider, in your evaluation contract.

Read More

Why you shouldn’t rely on default survey platforms to give you all the answers

Don’t get us wrong, surveys are useful tools and we’re a fan of any survey platform that makes it easier to use the results. But what about when you want to scratch beneath the surface or present a legible graph that will convince the program director or funder that action needs to be taken? This is where the canned survey tools start to falter.

Read More

Dial Down Your Data

In the past, I have been guilty of putting any and all data I could into a report. I’m talking pages of charts to show ALL the results. If I’m being honest, in some instances, I didn’t know what the point was. I put in as much detail as I could to shift the burden of deciphering the meaning behind the data to my reader.

Read More

Social Network Analysis and Evaluation: Learnings From the Evaluator and the Client

This post explores how we at Three Hive Consulting worked with a community development initiative to evaluate their activities using social network analysis (SNA). This methodology was used to better understand the relationships and foster collaboration between different individuals, groups, and organizations connected to the initiative.


Read More

How to Present Your Evaluation Timelines: 4 Simple Ideas

Here at Eval Academy we are big fans of keeping evaluation simple and that includes how we present our evaluation timelines. These four simple ideas use basic software (Microsoft Word, Excel, and Powerpoint) to create clean and easy to understand timelines.

Read More

How We Evaluated: A Collaborative of Non-Profits Serving Immigrant and Refugee Youth

This post explores how we at Three Hive Consulting worked with REACH Edmonton Council and other agencies to evaluate a unique initiative called Bridging Together. You’ll see how they developed and carried out an evaluation plan that yielded actionable information.

Read More

Practice Proximity

Part 3 in this six-part series focuses on formatting your report by grouping and spacing elements in your report to enhance readability. Let’s dig a bit deeper into human perception and explore how simply arranging elements on a page can make all the difference when it comes to engaging your audience in your report.

Read More

Cleaning Messy Text Data is a Breeze with OpenRefine

We’ve all been there – you get some data from a client or a survey you’ve run, and you can’t wait to start answering your evaluation questions. But you find one of your data columns is a complete mess because it was an open-ended text field.

Cleaning this messy data can be a day-ruining task - but this doesn’t have to be! I’m going to show you how to use OpenRefine to make this task a million times easier.

Read More