Articles
Our latest articles are below, or you can filter by category using this dropdown:
Common Issues When Entering Survey Data (and How to Solve Them)
Here, I share solutions to two challenges you are likely to come across while entering survey data: 1) coding complex question types and 2) dealing with unclear responses. Addressing these challenges will require some advanced coding that I did not cover in my first article.
Preventing Mistakes in Survey Data Entry
When entering survey data, it is important that it is accurate, easy to analyze, and fast. Use these tips to prevent mistakes from the beginning.
Three Steps for Painless Survey Data Entry
The most exciting part about conducting a survey is seeing the results – finally your hard work has come to fruition, and you get to hear what everybody had to say! But before you can get to that step, you need to transform the stack of paper surveys on your desk into useable data.
In this article, I share my three-step system for making survey data entry as easy and painless as possible, which comes from my experience designing, entering, and analyzing survey data.
How Writing an Evaluation Report is like Cooking
The process of writing an evaluation report is like cooking. It can be a joyful and meditative process for some and an annoying necessity for others. Both cooking and report writing take practice; the more you do them, the more you refine your processes and find your own groove. While there is no formula to create a perfect reporting process, there are some key steps that can set you up for success.
Strategic Learning and Evaluation – What Boards Need to Know
Recently I was asked by a client about an “evaluation literacy course” for its board. The client’s board members had just attended a strategic planning day and through that discussion felt they needed some “education on evaluation and metrics.” On one hand I thought “bravo, they want to know more about evaluation!”; on the other hand I thought “shit…., I’ve totally failed them as their evaluator – what have I been missing?”
How to Write Good Evaluation Questions
Evaluation questions focus data collection. They are what our stakeholders need to answer. When they have the answer to these questions, they can tell their stories. But it can be challenging to write questions at just the right level, that will provide guidance for choosing methods and developing data collection tools, and will actually yield the information to satisfy stakeholders.
Arts-Based Data Collection Techniques
We share the most salient points from a recent CES webinar about using art as a data collection method, presented by Jennica Nichols and Maya Lefkowich (of AND Implementation). Also, we expand upon how we've used arts-based data collection techniques here at Eval Academy and Three Hive Consulting and how we could be using them in the future.
How to “Quantify” Qualitative Data
In qualitative approaches, we want to describe, to present details and nuances and interesting outliers. But as evaluators, we need to do more than just report what is—we need to comment on what it means. In familiar evaluation terms, moving from the “what” to “so what?”
This framework can help you to consistently “quantify” qualitative findings.
Reflexivity in Evaluation
Reflexivity often falls into that category of things we know we should be doing, but aren't really doing, or things we might be doing, but aren't so sure we're doing right. To try and ease your stress about reflexivity and to help guide your practice, we've compiled our best tips below.
Four Common Data Entry Mistakes (and How To Fix Them)
This article addresses four common mistakes made with data entry and offers suggestions to improve data entry to increase the overall productivity and, let us not forget, happiness of your colleagues, collaborators, and evaluators.
Evaluation’s Yoda
Like Yoda, Michael Quinn Patton is revered for his wisdom and his power to inspire thinking differently about evaluation ideas. And while he isn’t a small, green humanoid alien there are striking similarities between the two (that go beyond the bald head and unique sweaters).
Being a Volunteer Evaluator
Have you ever been curious about what it is like to volunteer as an evaluator? Or are you considering a volunteer opportunity in the near future? This article aims to give you some insight into finding and engaging in a volunteer opportunity.
Hosting Great Virtual Sessions
Whether due to global pandemics, restricted travel budgets, or stakeholders flung across the world, evaluators should be prepared to facilitate virtual meetings or sessions. We've taken the guesswork out of how to facilitate a great virtual session and have rounded up our best tips and tricks.
Evaluating in the Developing World: A Canadian Evaluator’s Perspective
Up until one month ago my evaluation experience was firmly rooted in Canada. Like many young (ish) evaluators, I wanted to get international experience – more specifically I wanted to take on the challenge of doing evaluation work in a developing country. I would soon find out that I was incorrect in my optimism to copy and paste my evaluation perspective as well as my packing list.
How to Kick Off Your Evaluation Kick-Off Meeting
So you landed an evaluation contract and the first meeting date is set. Here are some pointers for kicking your evaluation off on the right foot.
Somehow I Manage: What Evaluation Consultants Need to Know About Business Management
People have done a lot of thinking about how to run a successful business, and there’s a lot independent evaluation consultants can learn from that body of knowledge. Part 2 in this series is about what evaluation consultants can learn from business management experts.
So You Think You Can Consult?
Being a great evaluator doesn’t necessarily make you a great evaluation consultant – you need to do all the things a professional evaluators does, while also operating a business, finding work, and marketing your brand.
This is an article about the skills and knowledge you need to succeed as an independent evaluation consultant.
The Components of an Evaluation Plan
Each evaluation is different. You have different stakeholders, different topics, different timelines and different end goals. Some evaluation plans will be simple, and others more complex. When developing your evaluation plan, you can take a mix and match approach to its composition.
Here are some common components of evaluation plans. Your plan might need just a few, or it may need all of them.
Visual Storytelling Through Videos
Unfortunately, I didn’t make it to AEA’s annual evaluation conference this year (I chose a Mai Tai on the beaches of Maui instead). However, one of the wonderful things about the Internet is that I was able to feel like I was part of the conference by following #eval19 on Twitter. So what was my one big takeaway through the Twitter lens? Of course, it came from the evaluation guru himself, Michael Quinn Patton (MQP) – “Evaluating transformation means transforming evaluation.”
How to Conduct Interviews
This step-by-step guide is focused on one-on-one 30 minute telephone interviews. However, many of the tips shared can be applied to in person or group interviews, and interviews of differing time lengths and research interests.