Articles
Our latest articles are below, or you can filter by category using this dropdown:
Available Now: Evaluation Coaching
Sometimes online resources just aren’t enough. Some questions call for discussion, for a second opinion – a coach. That’s why Eval Academy is launching its new evaluation coaching service.
How To Transcribe Interviews Like a Pro
Evaluators have several options for transcribing audio from interviews, including voice-to-text software, outsourcing, and doing it ourselves. If you are taking the DIY approach, here are four tips to get you transcribing like a pro!
Improve Your Logic Model Using 3 Simple Design Principles
A recent study in the American Journal of Evaluation showed how three simple visual design principles could be applied to logic models to make them more effective and understandable. This article summarizes the findings of that study so you can improve your logic model.
Three Ways to Increase the Chances Your Evaluation Results Will Actually Get Used
Time and time again, we hear of people going through an evaluation only to be disappointed that the findings didn’t give them the answers they wanted. So I’m going to share three ways we help clients use the results from our evaluations.
9 Common Writing Mistakes in Evaluation
Evaluators need to write clearly for their work to be used. Although not preferable, the written evaluation report must stand on its own, clearly conveying the key findings and messages. The 9 mistakes below are ones that I’ve come across in my years of writing, editing, and reading evaluation reports.
Ethical Decision Making in Evaluation
Evaluations are inherently political, which means they are fraught with ethical choices and decisions along the way. There have been many instances throughout my career where I faced an ethical dilemma - here are some things that have helped me silence the devil on my left shoulder and figure out the right thing to do.
Common Issues When Entering Survey Data (and How to Solve Them)
Here, I share solutions to two challenges you are likely to come across while entering survey data: 1) coding complex question types and 2) dealing with unclear responses. Addressing these challenges will require some advanced coding that I did not cover in my first article.
Preventing Mistakes in Survey Data Entry
When entering survey data, it is important that it is accurate, easy to analyze, and fast. Use these tips to prevent mistakes from the beginning.
Three Steps for Painless Survey Data Entry
The most exciting part about conducting a survey is seeing the results – finally your hard work has come to fruition, and you get to hear what everybody had to say! But before you can get to that step, you need to transform the stack of paper surveys on your desk into useable data.
In this article, I share my three-step system for making survey data entry as easy and painless as possible, which comes from my experience designing, entering, and analyzing survey data.
How Writing an Evaluation Report is like Cooking
The process of writing an evaluation report is like cooking. It can be a joyful and meditative process for some and an annoying necessity for others. Both cooking and report writing take practice; the more you do them, the more you refine your processes and find your own groove. While there is no formula to create a perfect reporting process, there are some key steps that can set you up for success.
Evaluation in a Low-resource Setting: Strategies for Success
Program evaluations in a low resource setting can be challenging in that the program staff may not have the skills or capacity to see it through. However, agencies often require formal evaluation of their funded programs. As such, I offer strategies for success when evaluating within a LRS.
Applying the JCSEE Program Evaluation Standards to Real World Practice
Through developing and delivering evaluation training, we know the value of short guides for translating concepts to practice. That’s why we developed this free resource that helps evaluators reflect on whether and how they are applying the Program Evaluation Standards developed by the Joint Committee on Standards for Educational Evaluation.
Strategic Learning and Evaluation – What Boards Need to Know
Recently I was asked by a client about an “evaluation literacy course” for its board. The client’s board members had just attended a strategic planning day and through that discussion felt they needed some “education on evaluation and metrics.” On one hand I thought “bravo, they want to know more about evaluation!”; on the other hand I thought “shit…., I’ve totally failed them as their evaluator – what have I been missing?”
How to Write Good Evaluation Questions
Evaluation questions focus data collection. They are what our stakeholders need to answer. When they have the answer to these questions, they can tell their stories. But it can be challenging to write questions at just the right level, that will provide guidance for choosing methods and developing data collection tools, and will actually yield the information to satisfy stakeholders.
Arts-Based Data Collection Techniques
We share the most salient points from a recent CES webinar about using art as a data collection method, presented by Jennica Nichols and Maya Lefkowich (of AND Implementation). Also, we expand upon how we've used arts-based data collection techniques here at Eval Academy and Three Hive Consulting and how we could be using them in the future.
How to “Quantify” Qualitative Data
In qualitative approaches, we want to describe, to present details and nuances and interesting outliers. But as evaluators, we need to do more than just report what is—we need to comment on what it means. In familiar evaluation terms, moving from the “what” to “so what?”
This framework can help you to consistently “quantify” qualitative findings.
Reflexivity in Evaluation
Reflexivity often falls into that category of things we know we should be doing, but aren't really doing, or things we might be doing, but aren't so sure we're doing right. To try and ease your stress about reflexivity and to help guide your practice, we've compiled our best tips below.
Four Common Data Entry Mistakes (and How To Fix Them)
This article addresses four common mistakes made with data entry and offers suggestions to improve data entry to increase the overall productivity and, let us not forget, happiness of your colleagues, collaborators, and evaluators.