Sally Newman, Emerita
University of Pittsburgh
Editor- Journal of
A thoughtful systematic review of a
program’s development and
- Informal or formal process to
help us understand how programs
work, if they are worthy & if so how
they can be maintained or
What are the purposes of your
What information is needed ?
How do you collect this information
When should you evaluate ?
Who is responsible for evaluation?
Where will the evaluation be used?
purposes of the evaluation
Determine program’s strengths and
Revise the program as needed
Increase public knowledge of program
Gain community program support
Determine if it should be replicated
Secure funding to maintain or expand
Gather feedback from participants
What should we evaluate?
information to be collected
How realistic are the program
goals and objectives ?
Current Status of the program ?
The impact on the participants’
learning, social interaction and
overall well being ?
The impact on the community?
Program categories to include in
Demographics- information on the
Program activities- what are
participants doing- when and how
Program impact- what are the
outcomes of the activities on the
Additional areas for evaluation
Criteria to measure professional
-Standards and guidelines
Criteria to measure overall
- Process indicators and outcome
Observation- informal, structured
Surveys – phone, written-formal
Self-report instruments- informal
Questionnaires- project specific
Focus groups – informal
Standardized tests- pre-post,
When to evaluate your program
Evaluation is an essential
component of your program &
should be included in the overall
program plan for it’s development
and upon it’s conclusion
Formative evaluation- an ongoing
scheduled assessment of the programs
development and its key functions
Summative evaluation- focuses on
program outcomes & conclusions-a
review of all program aspects
Who will evaluate your program
staff, participants, advisory board
funders( government, private, non-
Where to Use Evaluation
Reports for funders
Updates and revisions for staff,
families, advisors, board
Replication ,expansion for programmers
Summary for public education
Highlights for research
Supplement current evaluation
information for the field
Program Evaluation Outcomes
What can we learn?
Is the program viable
How can you improve the program
What are the options for moving