The Essentials of Coaching Program Evaluation: Formative, Summative and Four Ds
Rather than always focusing on specific program activities, it is often valuable to focus on a specific program participant. Pick a “typical” person who has received coaching services. In what coaching activities did she engage? What worked for her? What didn’t she like? Why? One might even want to create a hypothetical participant who represents “normal” involvement in the coaching program. A case history can be written that describes this hypothetical participant in the program. This case history can be much more interesting and in some sense more “real” than dry statistics, though the case needs to be supported by statistics to ensure that this typical person is, in fact, typical.
Documentation of Program
The most straightforward type of evaluation is documentation. When someone asks what has happened in a program or whether a program has been successful, the program staff can present the inquirer with evidence of program activity and accomplishment. Program evaluations that do not include some documentation run the risk of appearing sterile or contrived. One reads descriptions of a program and one even reviews tables of statistics concerning program outcomes but never sees “real” evidence of the program’s existence. An appreciative evaluation always provides this real evidence. It discovers the footprints left by a program unit and appreciates the meaning of these footprints.
Some program evaluators even suggest that we are eventually led in program documentation to a “goal-free” evaluation. The documents speak for themselves and there is little need for an often biasing and limiting set of goals by which and through which an evaluator observes a specific program. Program documents often reveal much more about a program than is identified in a set of goals. Through the documents, one sees how a program is actually “living,” and what emanates from the program that may or may not conform to its pre-specified goals.
Often after a program has been developed, someone will collect all the documents that have been accumulating during the course of the program. This may include minutes from major meetings, important emails and letters, reports, formal and informal communications about specific program activities or products, productions of the program, video recordings of specific program activities, and so forth. These documents are usually stored in some computer file (or in the Cloud) for some vaguely defined use in the future. Often one suspects that the documents are stored to avoid the arduous task of sifting through them and throwing away the old, useless ones. Unfortunately, archives frequently are not used at a later date. As a result, the collection and storage of documents is rarely a rewarding or justifiable procedure in program evaluation.
- Posted by Bill Bergquist
- On July 21, 2015
- 0 Comment
Leave Reply