Goal-free evaluation

Goal-free evaluation (Often shortened to GFE) is any evaluation in which the evaluator conducts the evaluation without particular knowledge of or reference to stated or predetermined goals and objectives.[1][2] This external evaluation model typically consists of an independent evaluator who is intentionally screened from the program’s stated goals and objectives in hopes of reducing potential goal-related tunnel vision.[3][4] According to Scriven,[5] the logic behind avoiding stated goals and objectives has to do with "finding out what the program is actually doing without being cued as to what it is trying to do. If the program is achieving its stated goals and objectives, then these achievements should show up; if not, it is argued, they are irrelevant" . The goal-free evaluator attempts to observe and measure all actual outcomes, effects, or impacts, intended or unintended, all without being cued to the program’s intentions. As Popham [6] analogizes, “As you can learn from any baseball pitcher who has set out in the first inning to pitch a shutout, the game’s final score is the thing that counts, not good intentions.”

Youker and Ingraham [7][8] summarize GFE's benefits which are based on:

Goal-free evaluation is not a comprehensive stand-alone evaluation model; rather it is considered either a perspective or position concerning an evaluator’s goal orientation throughout an evaluation, or a technique or tool for evaluating without referencing goals. Scriven [9] claims GFE is methodologically neutral, which means that it can be used or adapted for use with several other evaluation approaches, models, and methods as long as the other approaches do not mandate goal orientation.

There are really only two methodological requirements of GFE. The first is that the goal-free evaluator be external from and independent of the program and its upstream stakeholders (program funders, designers, administrators, managers, staff, volunteers, vendors, etc.); the second is that someone be appointed as the goal screener. A screener is an impartial party (i.e., someone who is not assigned to GFE design or data collection), such as an administrative assistant, a third party, or even the evaluation client.[10] The screener intervenes between the evaluator and the program people to eliminate goal-oriented communications and documents before they reach the goal-free evaluator. The screener does not require extensive training; the screener should, however, have a basic understanding of GFE’s purpose and methodology and be relatively familiar with the organization and its program to be able to identify program goals and objectives.

In a recent attempt to further articulate general principles for guiding the goal-free evaluator, Youker [11] proposed the following principles:

  1. Identify relevant effects to examine without referencing goals and objectives.
  2. Identify what occurred without the prompting of goals and objectives.
  3. Determine if what occurred can logically be attributed to the program or intervention.
  4. Determine the degree to which the effects are positive, negative, or neutral.

Furthermore, Youker [12] introduced GFE dos and don'ts which are included below.

GFE Dos

GFE Don’ts

References

  1. Youker, Brandon. "Goal-Free Evaluation: A Potential Model for the Evaluation of Social Work Programs". Social Work Research.
  2. Scriven, Michael. Evaluation Thesaurus (4th ed.). SAGE Publications, Inc. ISBN 9780803943643.
  3. Scriven, Michael. Evaluation Thesaurus (4th ed.). SAGE Publications, Inc. ISBN 9780803943643.
  4. Youker, Brandon; Ingraham, Allyssa; Bayer, Nick (2014). "An assessment of goal-free evaluation: case studies of four goal-free evaluations.". Evaluation and Program Planning 46.
  5. Scriven, Michael. Evaluation Thesaurus (4th ed.). SAGE Publications, Inc. p. 180. ISBN 9780803943643.
  6. Popham, James (1974). Evaluation in Education. McCutchan Publishing Corporation. p. 58. ISBN 082111512X.
  7. Youker, Brandon; Ingraham, Allyssa (2013). "Goal-free evaluation: An orientation for foundations’ evaluations". The Foundation Review 5 (4).
  8. Youker, Brandon; Ingraham, Allyssa; Bayer, Nick (2014). "An assessment of goal-free evaluation: case studies of four goal-free evaluations.". Evaluation and Program Planning 46.
  9. Scriven, Michael. Evaluation Thesaurus (4th ed.). SAGE Publications, Inc. ISBN 9780803943643.
  10. Youker, Brandon (2005). "Ethnography and evaluation: Their relationship and three anthropological models of evaluation". Journal of MultiDisciplinary Evaluation 3: 113–132.
  11. Youker, Brandon. "Goal-Free Evaluation: A Potential Model for the Evaluation of Social Work Programs". Social Work Research. p. 434.
  12. Youker, Brandon. "Goal-Free Evaluation: A Potential Model for the Evaluation of Social Work Programs". Social Work Research.
This article is issued from Wikipedia - version of the Tuesday, December 15, 2015. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.