Loading...

Evaluation

//Evaluation
Evaluation 2020-06-25T23:26:24+00:00

AMSTAT’s Expertise

AMSTAT provides reliable credential evaluation services for numerous state and federal government entities, schools, hospitals, non-profit organizations, and business clients. Hundreds of thousands of successful clients cite these reasons for choosing to work with AMSTAT:

  • All of our principals have PhDs at leading universities, including Harvard, Stanford, and Columbia.
  • They include nationally renowned evaluation experts.
  • They have over 100 years of practical experience in evaluation.
  • They are experts in evaluation (e.g., process, formative, impact, outcome, and summative evaluation).
  • Our fees usually pale in comparison to the savings and additional profits that our work produces for our clients.
  • Over 90% of our clients request our assistance more than once, as our clients are almost universally happy with our different brands of evaluation.
  • We are more reasonably priced than most other companies offering evaluation consulting.
  • We offer personalized, comprehensive, and friendly support during and after your consultation with us.
  • We offer ultra-fast turnaround times.

Our Services

We are happy to provide the help you need at any or all of the following steps in earning the answers you request:

  • developing a detailed program evaluation management plan;
  • reviewing program documents and records;
  • conducting pre-program development (needs assessment) evaluation;
  • conducting process or formative evaluation;
  • conducting impact, outcome, or summative evaluation;
  • conducting site and classroom observations;
  • conducting focus group interviews;
  • conducting surveys;
  • leading site evaluation team meetings;
  • inputting, organizing, and cleaning the data;
  • implementing data analysis;
  • developing written evaluation reports;
  • presenting evaluation results to governing board

AMSTAT is dedicated to offering the following professional services:

  • Independent program evaluation services for grants
  • Performance measurement for corporations
  • Government contracting activities
  • Statistical and other types of quantitative analysis and support
  • Other types of administrative functions

Program evaluation is a tool with which to demonstrate accountability to an array of stakeholders who may include funding sources, policymakers, state, and local agencies implementing the program, and community leaders. AMSTAT can:

  • Engage stakeholders
  • Describe the program
  • Focus the evaluation
  • Gather credible evidence
  • Justify conclusions
  • Ensure the use of evaluation findings and share lessons learned

Evaluation

Evaluation encourages us to examine the operations of a program, including which activities take place, who conducts the activities, and who is reached as a result. In addition, evaluation will show how faithfully the program adheres to implementation protocols. AMSTAT can conduct several types of evaluations. Some of them include the following:

Process Evaluations

Process evaluations, also called implementation evaluations, are the most frequently used type of evaluation. They review how a program is implemented and focus on how a program actually operates.  Process evaluations can be beneficial throughout the life of a program, however, they are often used when a program is implemented to ensure compliance with statutory and regulatory requirements, program design requirements, professional standards, and customer expectations. Early program evaluations can identify processes that can be made more efficient and mitigate compliance issues at a later date. A process evaluation may also be appropriate during the latter stages of a program life cycle when there is a need to assess program efficiency or effectiveness in achieving output goals.

AMSTAT can:

  • Determine whether program activities have been implemented as intended.
  • Evaluate how well the program is working, the extent to which the program is being implemented as designed, and whether the program is accessible and acceptable to its target population.
  • Provide an early warning for any problems that may occur.
  • Allow programs to monitor how well their program plans and activities are working.
  • Measure the activities of the program, program quality, and who it is reaching.
  • Help answer questions about your program such as:
    • Has the project reached the target group?
    • Are all project activities reaching all parts of the target group?
    • Are participants and other key stakeholders satisfied with all aspects of the project?
    • Are all activities being implemented as intended? If not why?
    • What if any changes have been made to intended activities?
    • Are all materials, information, and presentations suitable for the target audience?
    • Is the program being delivered as intended to the targeted recipients?
    • Is the program implemented as intended?
    • Have any feasibility or management problems emerged?
    • What progress has been made in implementing changes or new provisions?
    • Are program resources being used efficiently?
    • Why is a program no longer obtaining the desired level of outcomes?
  • Track program information related to Who, What, When and Where questions:
    • To whom did you direct program efforts?
    • What has your program done?
    • When did your program activities take place?
    • Where did your program activities take place?
    • What are the barriers/facilitators to implementation of program activities?

Formative Evaluations

formative evaluation (sometimes referred to as internal) is a method for judging the worth of a program while the program activities are forming (in progress). This part of the evaluation focuses on the process. Thus, formative evaluations are basically done on the fly. They permit the designers, learners, instructors, and managers to monitor how well the instructional goals and objectives are being met. Its main purpose is to catch deficiencies ASAP so that the proper learning interventions can take place that allows the learners to master the required skills and knowledge.

AMSTAT can:

  • Ensure that a program or program activity is feasible, appropriate, and acceptable before it is fully implemented.
  • Conduct it when a new program or activity is being developed or when an existing one is being adapted or modified.
  • Examine whether the proposed program elements are likely to be needed, understood, and accepted by the population you want to reach.
  • Examine the extent to which an evaluation is possible, based on the goals and objectives.
  • Allow for modifications to be made to the plan before full implementation begins.
  • Maximize the likelihood that the program will succeed.

Summative Evaluations

summative evaluation (sometimes referred to as external) is a method of judging the worth of a program at the end of the program activities (summation). The focus is on the outcome. The various instruments used to collect the data are questionnaires, surveys, interviews, observations, and testing. The model or methodology used to gather the data should be a specified step-by-step procedure. It should be carefully designed and executed to ensure the data is accurate and valid. AMSTAT can measure and document quality indicators for decision-making purposes. At the completion of the program, it may also be valuable to conduct summative evaluation.

AMSTAT can:

  • Help answer questions such as:
    • Do you continue the program?
    • If so, do you continue it in its entirety?
    • Is it possible to implement the program in other settings?
    • How sustainable is the program?
    • What elements could have helped or hindered the program?
    • What recommendations have evolved out of the program?

Outcome Evaluations

Outcome evaluations, as the name implies, assess program outcomes. Outcomes can be immediate effects of a program or more distal. In general, the closer an outcome is to program outputs, the clearer the linkage between the two. That is, outcomes measured immediately after outputs are generated are less likely to be affected by outside factors that can cloud the relationship between outputs and outcomes.  In addition to intended outcomes, outcome evaluations should address unintended outcomes.

AMSTAT can:

  • Measure the program goal.
  • Measure how well the program goal has been achieved.
  • Measure the degree to which the program is having an effect on the target population’s behaviors.
  • Tell whether the program is being effective in meeting its objectives.
  • Help answer questions such as:
    • Has the overall program goal been achieved?
    • What, if any factors outside the program have contributed or hindered the desired change?
    • What, if any unintended change has occurred as a result of the program?
    • Are desired program outcomes obtained?
    • What, if any, unintended side effects did the program produce?
    • Do outcomes differ across program approaches, components, providers, or client subgroups?

Impact Evaluations

Impact evaluations are designed to measure the net effect of a program by comparing actual program results with counterfactual data. The most straightforward way to isolate program impact is to randomly assign subjects (individuals, counties, cities, etc.) to treatment and control groups, i.e., groups that receive and do not receive program services. Experimental design is critical and factors such as group size and composition must be carefully considered to ensure a valid statistical sample. Treatment and control groups must also be sufficiently isolated to prevent spillover effects.  An alternative to random assignment is to construct the control and treatment groups to be similar in ways that are considered important.

AMSTAT can:

  • Examine the degree to which the program meets its ultimate goal.
  • Provide evidence for use in policy and funding decisions.
  • Measure the immediate effect of the program.
  • Measure how well the program objectives (and sub-objectives) have been achieved.
  • Help answer questions such as:
    • How well has the project achieved its objectives (and sub-objectives)?
    • How well have the desired short term changes been achieved?
    • Did the program cause the desired impact?
    • Is one approach more effective than another in obtaining the desired outcomes?

Cost-Benefit Evaluations

Cost-benefit evaluations can be considered a special case of outcome evaluations.

AMSTAT can:

  • Compare program outputs and/or benefits to input costs to provide a ratio of cost to benefit.

Economic Evaluations

AMSTAT can:

  • Examine what resources are being used in a program and their costs (direct and indirect) compared to outcomes.
  • Provide program managers and funders a way to assess cost relative to effects. “How much bang for your buck.”

Health Evaluations

AMSTAT provides a variety of specialized evaluation services in health. They include:

  • Tobacco prevention, evidence-based medicine, clinical practice guidelines, children and family services, healthcare ethics, biostatistical studies, clinical trial design and methodology, medical education, biostatistical consulting, clinical program evaluation, performance measurementm, and process improvement
learn more about our PhD level experts

This list shows a sample of the past clients.

Explore more studies

Staff Proficiency

July 3rd, 2020|0 Comments

The purpose of the study was to conduct the evaluation of the effectiveness of the program. The research question was as follows: RQ1. Is there a significant difference in staff proficiency before and after [...]

SEEK Program

July 2nd, 2020|0 Comments

The purpose of the study was to measure the following: the difference in students’ attitudes and knowledge before, during and after SEEK Program and PCI programs, training, and mentor teaching; the impact of ’s [...]

Program Quality and Integrity

July 1st, 2020|0 Comments

The purpose of the study was to measure the difference in students’ and mentors’ perceptions of program quality and integrity before and after the change of CPE’s program. The research question was as follows: [...]

see the blog posts

AMSTAT is a global professional services firm committed to achieving sustainable results in partnership with its clients. They bring a wealth of experience in strategy, operations, advisory services, technology, and analysis to drive lasting and measurable results in the medical care, higher education, life sciences and business sectors. Through focus, passion, and collaboration, they provide guidance to support organizations as they face the change that is transforming their industries and businesses.

Amanda Jensen, 5-star Facebook Review

The assistance and technical advice are given by AMSTAT and team. They are first class in their attitude and ability. We give you 5 stars in every respect. Well done and thank you indeed.

William Miller, 5-star Facebook Review

Their enthusiasm, proactivity, and willingness to go beyond to excel are the highlights. It is good to work with AMSTAT. Other activities and frequent lunches in the team, the outdoor trips sponsored by the company are rejuvenating. It was really a very good experience to work with people of AMSTAT. I always get in touch with them for further services.

They have been doing a tremendous job on our requests. They are turning things around quickly, coming up with approaches and suggestions on their own and are truly patterning with me on different initiatives. I am deeply appreciative of all their effort and engagement.

They delivered outstanding service and we are thoroughly pleased with their work. Will be using AMSTAT again in the future!”

Call Us Now At (301) 800-0038

Join The 300,000+ Satisfied Customers Today

If You Want To Set Up A Specific Time To Discuss Your Project, Schedule A Free Consultation! 

Contact us now!
Schedule a Free Consultation