Desired Outcome |
Improve measurement of success.
|
| Primary Indicators |
- # Service organizations with outcomes-based evaluation plans and reports.
- # Community priorities which have consensus on performance indicators or “measurement of success.”
|
| Related Indicators |
- # Federal grants coming to North Hawaii and Hawaii County in community selected priorities.
- # Grants which are renewed.
- # Communities and organizations using community health profile data for priority selection, obtaining resources and improvement planning.
|
| Story Behind the Baseline |
- Increasingly, funders (philanthropic and government) are requiring an outcomes evaluation plan and report to assure their dollars are achieving the desired impact.
- Knowledge and skill required to develop and implement outcomes-based evaluation lags behind demand for evaluation from funders.
- Many organizations require technical assistance to move from output-based evaluation to outcomes-based evaluation.
- Some organizations still see the expense of evaluation as taking resources from programs.
- Hawaii Island United Way is encouraging partner agencies to have an outcomes evaluation plan and report.
|
| Partners with a Role to Play |
Local:
North Hawaii Outcomes Project and The Kohala Center.
County:
Hawaii Island United Way and Hawaii County Resource Center.
State:
Kamehameha Schools, The Evaluation Hui, UH Social Science Research Institute, and Hawaii Community Foundation.
National:
American Evaluation Association, and Australasian Evaluation Society.
Academic:
Kamehameha Schools Policy Analysis and System Evaluation.
|
| What Works - Best Practices |
- Clear expectations from funders for outcomes evaluation.
- Adequate funding for evaluation.
- See W.K. Kellogg Foundation’s Logic Model Development Guide.
|
| What is Being Done |
- North Hawaii Outcomes Project facilitated two mini-training sessions on “Measuring Success” at community forums.
- North Hawaii Outcomes Project facilitated program evaluation training with Lois-Ellin Datta.
- Kohala Center and North Hawaii Outcomes Project co-sponsored Evaluation Program with Kamehameha Schools and Making Evaluation Pono.
- North Hawaii Outcomes Project and Kohala Center provided technical assistance to community groups on outcome measures.
- North Hawaii Outcomes Project provided technical assistance to United Way on promoting outcome evaluation.
|
| Suggested Strategies |
Increase Awareness:
- Recognize and disseminate local ideal models of program outcomes evaluation.
- Work with local funders, Hawaii Community Foundation and United Way to clarify requirements, models and resources for measuring success.
- Increase discussions between funder’s and recipients on requirements for outcomes evaluation.
Obtain Additional Data:
- Work with United Way to survey organizations on needs for technical assistance in measuring success.
- Work with national surveys including BRFSS, National House Use of Drugs, YRBS, PRIDE, DAWN, TEDS to increase sample size and analysis for Hawaii County and sub-county data to support program evaluation.
Inventory and Build Existing Resources:
- Identify models and resources for optimal outcomes evaluation inventory and share with other organizations.
- Work with United Way and Hawaii Community Foundation to identify sources of technical assistance for outcomes evaluation.
Increase Organizational Links:
- Link community organizations and programs with measuring success resources.
- Link with Hawaii Community College and University of Hawaii at Hilo to identify resources for teaching outcomes evaluation.
Identify and Address Barriers:
- Support development of skills in outcomes evaluation.
Promote Effective Practices:
- Increase training in outcomes evaluation.
- Increase training in community-based participatory research.
Promote Effective Policies:
- Funders requirements for funding.
|
| |
