Program will also

We will also work to ensure that all potentially eligible borrowers are aware of the improvements to PSLF and tools available to them. We can and should make it easier for borrowers to apply for PSLF. In the coming year, FSA will make several improvements that will create a smoother application process. ED will also explore other improvements, like allowing employers to sign employment certification forms on behalf of their employees and automating PSLF certification for state, local, and tribal government employees.

In addition to the executive actions outlined here, ED plans to continue transforming PSLF through the negotiated rulemaking process. What Borrowers Need to Know. ED will roll out these improvements in groups over the coming months. For more information, please visit StudentAid. By creating an account, we can communicate with you directly in a personalized way about how this waiver and other matters might affect you.

If necessary, Federal Student Aid may contact you to ask you to certify additional months of employment. You should look out for an email from Federal Student Aid in the coming weeks to let you know how many additional payments we have preliminarily determined to be qualifying. If you know that you have qualifying employment that you have not yet certified with us, we recommend you certify that employment now by using the PSLF Help Tool at www.

You will need to submit a PSLF form so we can review your loans under the simplified rules and determine whether your current or past employers qualify for PSLF. Because we expect an influx of applicants due to this announcement, you may see some delays in having your application processed, but we will work as quickly as possible to assist you. You will need to submit your application by October 31, We will provide more information when this update is done.

To find out more about loan consolidation visit StudentAid. Please note that this waiver does not affect qualifying employer rules. Your employer still needs to be a governmental organization, a c 3 organization, or a not-for-profit organization that provides a designated public service to get PSLF under normal rules and the Limited PSLF Waiver.

You can see what loans you have by logging into your account on StudentAid. In the coming weeks, servicers will receive updated information from FSA to help you navigate these changes. If you encounter challenges working with your loan servicer, you should contact the FSA Ombudsman by visiting StudentAid. Toggle navigation U. Department of Education.

Student Loans Grants Laws Data. October 6, Contact: Press Office, , press ed. Target also offers coronavirus benefits and has taken steps to ensure Target remains a clean, safe place for team members and guests. Several benefits introduced during the pandemic have recently transitioned into ongoing benefits for all U. Additional company information can be found by visiting the corporate website and press center and by following TargetNews. We strive to return all of our media inquiries within one business day.

People and organizations also have cultural preferences that dictate acceptable ways of asking questions and collecting information, including who would be perceived as an appropriate person to ask the questions. For example, some participants may be unwilling to discuss their behavior with a stranger, whereas others are more at ease with someone they don't know.

Therefore, the techniques for gathering evidence in an evaluation must be in keeping with the cultural norms of the community. Data collection procedures should also ensure that confidentiality is protected.

The process of justifying conclusions recognizes that evidence in an evaluation does not necessarily speak for itself. Evidence must be carefully considered from a number of different stakeholders' perspectives to reach conclusions that are well -substantiated and justified. Conclusions become justified when they are linked to the evidence gathered and judged against agreed-upon values set by the stakeholders. Stakeholders must agree that conclusions are justified in order to use the evaluation results with confidence.

Standards reflect the values held by stakeholders about the program. They provide the basis to make program judgments. The use of explicit standards for judgment is fundamental to sound evaluation.

In practice, when stakeholders articulate and negotiate their values, these become the standards to judge whether a given program's performance will, for instance, be considered "successful," "adequate," or "unsuccessful. Analysis and synthesis are methods to discover and summarize an evaluation's findings. They are designed to detect patterns in evidence, either by isolating important findings analysis or by combining different sources of information to reach a larger understanding synthesis.

Mixed method evaluations require the separate analysis of each evidence element, as well as a synthesis of all sources to examine patterns that emerge. Deciphering facts from a given body of evidence involves deciding how to organize, classify, compare, and display information. These decisions are guided by the questions being asked, the types of data available, and especially by input from stakeholders and primary intended users.

Interpretation is the effort to figure out what the findings mean. Uncovering facts about a program's performance isn't enough to make conclusions. The facts must be interpreted to understand their practical significance. In short, interpretations draw on information and perspectives that stakeholders bring to the evaluation.

They can be strengthened through active participation or interaction with the data and preliminary explanations of what happened. Judgments are statements about the merit, worth, or significance of the program.

They are formed by comparing the findings and their interpretations against one or more selected standards. Because multiple standards can be applied to a given program, stakeholders may reach different or even conflicting judgments.

Community members, however, may feel that despite improvements, a minimum threshold of access to services has still not been reached. Their judgment, based on standards of social equity, would therefore be negative. Conflicting claims about a program's quality, value, or importance often indicate that stakeholders are using different standards or values in making judgments.

This type of disagreement can be a catalyst to clarify values and to negotiate the appropriate basis or bases on which the program should be judged.

Recommendations are actions to consider as a result of the evaluation. Forming recommendations requires information beyond just what is necessary to form judgments. For example, knowing that a program is able to increase the services available to battered women doesn't necessarily translate into a recommendation to continue the effort, particularly when there are competing priorities or other effective alternatives.

Thus, recommendations about what to do with a given intervention go beyond judgments about a specific program's effectiveness. If recommendations aren't supported by enough evidence, or if they aren't in keeping with stakeholders' values, they can really undermine an evaluation's credibility. By contrast, an evaluation can be strengthened by recommendations that anticipate and react to what users will want to know.

Justifying conclusions in an evaluation is a process that involves different possible steps. For instance, conclusions could be strengthened by searching for alternative explanations from the ones you have chosen, and then showing why they are unsupported by the evidence. When there are different but equally well supported conclusions, each could be presented with a summary of their strengths and weaknesses.

Techniques to analyze, synthesize, and interpret findings might be agreed upon before data collection begins. It is naive to assume that lessons learned in an evaluation will necessarily be used in decision making and subsequent action. Deliberate effort on the part of evaluators is needed to ensure that the evaluation findings will be used appropriately.

Preparing for their use involves strategic thinking and continued vigilance in looking for opportunities to communicate and influence. Both of these should begin in the earliest stages of the process and continue throughout the evaluation. Design refers to how the evaluation's questions, methods, and overall processes are constructed. As discussed in the third step of this framework focusing the evaluation design , the evaluation should be organized from the start to achieve specific agreed-upon uses.

Having a clear purpose that is focused on the use of what is learned helps those who will carry out the evaluation to know who will do what with the findings.

Furthermore, the process of creating a clear design will highlight ways that stakeholders, through their many contributions, can improve the evaluation and facilitate the use of the results. Preparation refers to the steps taken to get ready for the future uses of the evaluation findings. The ability to translate new knowledge into appropriate action is a skill that can be strengthened through practice.

In fact, building this skill can itself be a useful benefit of the evaluation. It is possible to prepare stakeholders for future use of the results by discussing how potential findings might affect decision making.

For example, primary intended users and other stakeholders could be given a set of hypothetical results and asked what decisions or actions they would make on the basis of this new knowledge. If they indicate that the evidence presented is incomplete or irrelevant and that no action would be taken, then this is an early warning sign that the planned evaluation should be modified.

Preparing for use also gives stakeholders more time to explore both positive and negative implications of potential results and to identify different options for program improvement. Feedback is the communication that occurs among everyone involved in the evaluation. Giving and receiving feedback creates an atmosphere of trust among stakeholders; it keeps an evaluation on track by keeping everyone informed about how the evaluation is proceeding.

Primary intended users and other stakeholders have a right to comment on evaluation decisions. From a standpoint of ensuring use, stakeholder feedback is a necessary part of every step in the evaluation.

Obtaining valuable feedback can be encouraged by holding discussions during each step of the evaluation and routinely sharing interim findings, provisional interpretations, and draft reports. Follow-up refers to the support that many users need during the evaluation and after they receive evaluation findings.

Because of the amount of effort required, reaching justified conclusions in an evaluation can seem like an end in itself. It is not. Active follow-up may be necessary to remind users of the intended uses of what has been learned.

Follow-up may also be required to stop lessons learned from becoming lost or ignored in the process of making complex or political decisions. To guard against such oversight, it may be helpful to have someone involved in the evaluation serve as an advocate for the evaluation's findings during the decision -making phase.

Facilitating the use of evaluation findings also carries with it the responsibility to prevent misuse. Evaluation results are always bounded by the context in which the evaluation was conducted. Some stakeholders, however, may be tempted to take results out of context or to use them for different purposes than what they were developed for.

For instance, over-generalizing the results from a single case study to make decisions that affect all sites in a national program is an example of misuse of a case study evaluation. Similarly, program opponents may misuse results by overemphasizing negative findings without giving proper credit for what has worked.

Active follow-up can help to prevent these and other forms of misuse by ensuring that evidence is only applied to the questions that were the central focus of the evaluation. Dissemination is the process of communicating the procedures or the lessons learned from an evaluation to relevant audiences in a timely, unbiased, and consistent fashion.

Like other elements of the evaluation, the reporting strategy should be discussed in advance with intended users and other stakeholders. Planning effective communications also requires considering the timing, style, tone, message source, vehicle, and format of information products.

Regardless of how communications are constructed, the goal for dissemination is to achieve full disclosure and impartial reporting. Along with the uses for evaluation findings, there are also uses that flow from the very process of evaluating. These "process uses" should be encouraged. The people who take part in an evaluation can experience profound changes in beliefs and behavior. For instance, an evaluation challenges staff members to act differently in what they are doing, and to question assumptions that connect program activities with intended effects.

Evaluation also prompts staff to clarify their understanding of the goals of the program. This greater clarity, in turn, helps staff members to better function as a team focused on a common end. In short, immersion in the logic, reasoning, and values of evaluation can have very positive effects, such as basing decisions on systematic judgments instead of on unfounded assumptions. There are standards to assess whether all of the parts of an evaluation are well -designed and working to their greatest potential.

These standards, designed to assess evaluations of educational programs, are also relevant for programs and interventions related to community health and development. The program evaluation standards make it practical to conduct sound and fair evaluations. They offer well-supported principles to follow when faced with having to make tradeoffs or compromises.

Attending to the standards can guard against an imbalanced evaluation, such as one that is accurate and feasible, but isn't very useful or sensitive to the context. Another example of an imbalanced evaluation is one that would be genuinely useful, but is impossible to carry out. The following standards can be applied while developing an evaluation design and throughout the course of its implementation.

Remember, the standards are written as guiding principles, not as rigid rules to be followed in all situations. The feasibility standards are to ensure that the evaluation makes sense - that the steps that are planned are both viable and pragmatic. The propriety standards ensure that the evaluation is an ethical one, conducted with regard for the rights and interests of those involved. The eight propriety standards follow. There is an ever-increasing agreement on the worth of evaluation; in fact, doing so is often required by funders and other constituents.

So, community health and development professionals can no longer question whether or not to evaluate their programs. Instead, the appropriate questions are:.

The framework for program evaluation helps answer these questions by guiding users to select evaluation strategies that are useful, feasible, proper, and accurate. To use this framework requires quite a bit of skill in program evaluation. In most cases there are multiple stakeholders to consider, the political context may be divisive, steps don't always follow a logical order, and limited resources may make it difficult to take a preferred course of action.

An evaluator's challenge is to devise an optimal strategy, given the conditions she is working under. An optimal strategy is one that accomplishes each step in the framework in a way that takes into account the program context and is able to meet or exceed the relevant standards.

This framework also makes it possible to respond to common concerns about program evaluation. For instance, many evaluations are not undertaken because they are seen as being too expensive.

The cost of an evaluation, however, is relative; it depends upon the question being asked and the level of certainty desired for the answer. A simple, low-cost evaluation can deliver information valuable for understanding and improvement. Rather than discounting evaluations as a time-consuming sideline, the framework encourages evaluations that are timed strategically to provide necessary feedback. This makes it possible to make evaluation closely linked with everyday practices.

Another concern centers on the perceived technical demands of designing and conducting an evaluation. However, the practical approach endorsed by this framework focuses on questions that can improve the program.

Finally, the prospect of evaluation troubles many staff members because they perceive evaluation methods as punishing "They just want to show what we're doing wrong. We're the ones who know what's going on. Evaluation is a powerful strategy for distinguishing programs and interventions that make a difference from those that don't. It is a driving force for developing and adapting sound strategies, improving existing programs, and demonstrating the results of investments in time and other resources.

It also helps determine if what is being done is worth the cost. This recommended framework for program evaluation is both a synthesis of existing best practices and a set of standards for further improvement.

It supports a practical approach to evaluation based on steps and standards that can be applied in almost any setting. Because the framework is purposefully general, it provides a stable guide to design and conduct a wide range of evaluation efforts in a variety of specific program areas. The framework can be used as a template to create useful evaluation plans to contribute to understanding and improvement.

The Magenta Book - Guidance for Evaluation provides additional information on requirements for good evaluation, and some straightforward steps to make a good evaluation of an intervention more feasible, read The Magenta Book - Guidance for Evaluation. Are You Ready to Evaluate your Coalition? The American Evaluation Association Guiding Principles for Evaluators helps guide evaluators in their professional practice. CDC Evaluation Resources provides a list of resources for evaluation, as well as links to professional associations and journals.

Chapter Community Interventions in the "Introduction to Community Psychology" explains professionally-led versus grassroots interventions, what it means for a community intervention to be effective, why a community needs to be ready for an intervention, and the steps to implementing community interventions.

The Comprehensive Cancer Control Branch Program Evaluation Toolkit is designed to help grantees plan and implement evaluations of their NCCCP-funded programs, this toolkit provides general guidance on evaluation principles and techniques, as well as practical templates and tools. In addition to information on designing an evaluation plan, this book also provides worksheets as a step-by-step guide.

Evaluating Your Community-Based Program is a handbook designed by the American Academy of Pediatrics covering a variety of topics related to evaluation. Government Accountability Office with copious information regarding program evaluations.

Practical Evaluation for Public Managers is a guide to evaluation written by the U. Department of Health and Human Services. Penn State Program Evaluation offers information on collecting different forms of data and how to measure different community markers. The Program Manager's Guide to Evaluation is a handbook provided by the Administration for Children and Families with detailed answers to nine big questions regarding program evaluation. Program Planning and Evaluation is a website created by the University of Arizona.

It provides links to information on several topics including methods, funding, types of evaluation, and reporting impacts.

This guide includes practical information on quantitative and qualitative methodologies in evaluations. Kellogg Foundation Evaluation Handbook provides a framework for thinking about evaluation as a relevant and useful program tool. It was originally written for program directors with direct responsibility for the ongoing evaluation of the W. Kellogg Foundation. Recommended framework for program evaluation in public health practice. Atlanta, GA: Author.

Gazing into the oracle: the delphi method and its application to social policy and community health and development. London: Jessica Kingsley Publishers. Barrett, F. Sunnycrest Press, This practical manual includes helpful tips to develop evaluations, tables illustrating evaluation approaches, evaluation planning and reporting templates, and resources if you want more information.

Basch, C. Avoiding type III errors in health education program evaluation: a case study. Health Education Quarterly. Handbook of applied social research methods.

Boruch, R. Randomized controlled experiments for evaluation and planning. In Handbook of applied social research methods, edited by Bickman L. Centers for Disease Control and Prevention. Guidelines for evaluating surveillance systems. Morbidity and Mortality Weekly Report ;37 S-5 Handbook for evaluating HIV education.

Cook, T. Qualitative and quantitative methods in evaluation research. Cousins, J. Framing participatory evaluation. In Understanding and practicing participatory evaluation , vol. The utilization of qualitative and quantitative data for health education program planning, implementation, and evaluation: a spiral approach.

Dyal, W. Ten organizational practices of community health and development: a historical perspective. American Journal of Preventive Medicine;11 6 Eddy, D. Performance measurement: problems and solutions.

Health Affairs;17 4 Harvard Family Research Project. Performance measurement. In The Evaluation Exchange, vol. Evaluation in a complex adaptive system. Planning a program evaluation. Fawcett, S. P, Berkley-Patton, J. Evaluating community initiatives for health and development.

Rootman, D. McQueen, et al. Fawcett , S. Evaluating community efforts to prevent cardiovascular diseases. Fetterman, D. Empowerment evaluation: knowledge and tools for self-assessment and accountability. Frechtling, J. User-friendly handbook for mixed method evaluations. Goodman, R. Identifying and defining the dimensions of community capacity to provide a basis for measurement. Health Education and Behavior;25 3 Greene, J. Qualitative program evaluation: practice and promise.

Haddix, A. Prevention effectiveness: a guide to decision analysis and economic evaluation. Hennessy, M. In Statistics in Community health and development , edited by Stroup. Henry, G. Graphing data. In Handbook of applied social research methods , edited by Bickman. Practical sampling. Institute of Medicine. Improving health in the community: a role for performance monitoring.

Sanders Chair. The program evaluation standards: how to assess evaluations of educational programs. Kaplan, R. The balanced scorecard: measures that drive performance. Harvard Business Review ;Jan-Feb Kar, S. Health promotion indicators and actions. Knauft, E. What independent sector learned from an evaluation of its own hard-to -measure programs. In A vision of evaluation, edited by ST Gray. Washington, DC: Independent Sector. Lipsy, M. Design sensitivity: statistical power for applied experimental research.

In Handbook of applied social research methods, edited by Bickman, L. Lipsey, M. Theory as method: small theories of treatments. New Directions for Program Evaluation; 57 What can you build with thousands of bricks?

Musings on the cumulation of knowledge in program evaluation. New Directions for Evaluation; 76 : Love, A. Internal evaluation: building organizations from within. Miles, M. Qualitative data analysis: a sourcebook of methods.

National Quality Program. National Quality Program , vol. National Institute of Standards and Technology. Health care criteria for performance excellence , vol.

National Quality Program, Newcomer, K. Using statistics appropriately.