Book's by Committee on Science, Engineering, and Public Policy (U.S.). Committee on Evaluating the Efficiency of Research and Development Programs at the U.S. Environmental Protection Agency
A new book from the National Research Council recommends changes in how the federal government evaluates the efficiency of research at EPA and other agencies. Assessing efficiency should be considered only one part of gauging a program's quality, relevance, and effectiveness. The efficiency of research processes and that of investments should be evaluated using different approaches. Investment efficiency should examine whether an agency's R&D portfolio, including the budget, is relevant, of high quality, matches the agency's strategic plan. These evaluations require panels of experts. In contrast, process efficiency should focus on "inputs" (the people, funds, and facilities dedicated to research) and "outputs" (the services, grants, publications, monitoring, and new techniques produced by research), as well as their timelines and should be evaluated using quantitative measures. The committee recommends that the efficiency of EPA's research programs be evaluated according to the same standards used at other agencies. To ensure this, OMB should train and oversee its budget examiners so that the PART questionnaire is implemented consistently and equitably across agencies.
A new book from the National Research Council recommends changes in how the federal government evaluates the efficiency of research at EPA and other agencies. Assessing efficiency should be considered only one part of gauging a program's quality, relevance, and effectiveness. The efficiency of research processes and that of investments should be evaluated using different approaches. Investment efficiency should examine whether an agency's R&D portfolio, including the budget, is relevant, of high quality, matches the agency's strategic plan. These evaluations require panels of experts. In contrast, process efficiency should focus on "inputs" (the people, funds, and facilities dedicated to research) and "outputs" (the services, grants, publications, monitoring, and new techniques produced by research), as well as their timelines and should be evaluated using quantitative measures. The committee recommends that the efficiency of EPA's research programs be evaluated according to the same standards used at other agencies. To ensure this, OMB should train and oversee its budget examiners so that the PART questionnaire is implemented consistently and equitably across agencies.
Reliable and valid forensic science analytic techniques are critical to a credible, fair, and evidence-based criminal justice system. There is widespread agreement that the scientific foundation of some currently available forensic science methods needs strengthening and that additional, more efficient techniques are urgently needed. These needs can only be met through sustained research programs explicitly designed to ensure and improve the reliability and validity of current methods and to foster the development and use of new and better techniques. This task is challenging due to the broad nature of the field. Concerns have been raised repeatedly about the ability of the criminal justice system to collect and analyze evidence efficiently and to be fair in its verdicts. Although significant progress has been made in some forensic science disciplines, the forensic science community still faces many challenges. Federal leadership, particularly in regard to research and the scientific validation of forensic science methods, is needed to help meet the pressing issues facing state and local jurisdictions. This report reviews the progress made by the National Institute of Justice (NIJ) to advance forensic science research since the 2009 report, Strengthening Forensic Science in the United States: A Path Forward and the 2010 report, Strengthening the National Institute of Justice. Support for Forensic Science Research examines the ways in which NIJ develops its forensic science research priorities and communicates those priorities as well as its findings to the scientific and forensic practitioner communities in order to determine the impact of NIJ forensic science research programs and how that impact can be enhanced.
Environmental research has driven landmark improvements that led to the protection of human and ecosystem health. Recognizing the value of knowledge generated by environmental research and the ingenuity within academic and nonprofit institutions, the US Environmental Protection Agency (EPA) created a program known as Science to Achieve Results, or STAR, in 1995. STAR is EPA's primary competitive extramural grants program. A Review of the Environmental Protection Agency's Science to Achieve Results Research Program assesses the program's scientific merit, public benefits, and overall contributions in the context of other relevant research and recommends ways to enhance those aspects of the program. This report also considers the conclusions and recommendations of a prior National Research Council review of the STAR program (2003), the STAR program's research priorities in light of the nation's environmental challenges, and the effects of recent STAR funding trends on obtaining scientific information needed to protect public health and the environment.
The National Institute of Justice (NIJ) is the nation's primary resource for advancing scientific research, development, and evaluation on crime and crime control and the administration of justice in the United States. Headed by a presidentially appointed director, it is one of the major units in the Office of Justice Programs (OJP) of the U.S. Department of Justice. Under its authorizing legislation, NIJ awards grants and contracts to a variety of public and private organizations and individuals. At the request of NIJ, Strengthening the National Institute of Justice assesses the operations and quality of the full range of its programs. These include social science research, science and technology research and development, capacity building, and technology assistance. The book concludes that a federal research institute such as NIJ is vital to the nation's continuing efforts to control crime and administer justice. No other federal, state, local, or private organization can do what NIJ was created to do. Forty years ago, Congress envisioned a science agency dedicated to building knowledge to support crime prevention and control by developing a wide range of techniques for dealing with individual offenders, identifying injustices and biases in the administration of justice, and supporting more basic and operational research on crime and the criminal justice system and the involvement of the community in crime control efforts. As the embodiment of that vision, NIJ has accomplished a great deal. It has succeeded in developing a body of knowledge on such important topics as hot spots policing, violence against women, the role of firearms and drugs in crime, drug courts, and forensic DNA analysis. It has helped build the crime and justice research infrastructure. It has also widely disseminated the results of its research programs to help guide practice and policy. But its efforts have been severely hampered by a lack of independence, authority, and discretionary resources to carry out its mission.
Introduction: The government performance and results act, the program assessment rating tool, and the Environmental Protection Agency -- Efficiency metrics used by the Environmental Protection Agency and other federal research and development programs -- Are the efficiency metrics used by the federal research and development programs sufficient and outcome-based? -- A model for evaluating research and development programs -- Findings, principles, and recommendations -- Appendices -- Boxes, figures and tables.
The Minerva Research Initiative is a Department of Defense (DoD) social science grant program that funds unclassified basic research relevant to national security. The goal of the program is to make use of the intellectual capital of university-based social scientists to inform understanding of issues important to DoD and the broader national security community. Evaluation of the Minerva Research Initiative discusses the program's successes and challenges over its first decade of operation, and highlights ways to strengthen the program's foundations and take advantage of opportunities for broadening its reach and usefulness.
In 2001, the National Research Council (NRC) completed a congressionally mandated assessment of the benefits and costs of DOE's fossil energy and energy efficiency R&D programs, Energy Research at DOE: Was It Worth It? The Congress followed this retrospective study by directing DOE to request the NRC to develop a methodology for assessing prospective benefits. The first phase of this projectâ€"development of the methodologyâ€"began in December 2003. Phase two will make the methodology more robust and explore related issues, and subsequent phases will apply the methodology to review the prospective benefits of different DOE fossil energy and energy efficiency R&D programs. In developing this project, three considerations were particularly important. First, the study should adapt the work of the retrospective study. Second, the project should develop a methodology that provides a rigorous calculation of benefits and risks, and a practical and consistent process for its application. Third, the methodology should be transparent, should not require extensive resources for implementation, and should produce easily understood results. This report presents the results of phase one. It focuses on adaptation of the retrospective methodology to a prospective context.
Since its inception in 1977 from an amalgam of federal authorities, the U.S. Department of Energy (DOE) has administered numerous programs aimed at developing applied energy technologies. In recent years, federal oversight of public expenditures has emphasized the integration of performance and budgeting. Notably, the Government Performance and Results Act (GPRA) was passed in 1993 in response to questions about the value and effectiveness of federal programs. GPRA and other mandates have led agencies to develop indicators of program performance and program outcomes. The development of indicators has been watched with keen interest by Congress, which has requested of the National Research Council (NRC) a series of reports using quantitative indicators to evaluate the effectiveness of applied energy research and development (R&D). The first such report took a retrospective view of the first 3 years of DOE R&D programs on fossil energy and energy efficiency. The report found that DOE-sponsored research had netted large commercial successes, such as advanced refrigerator compressors, electronic lighting ballasts, and emission control technology for flue gas desulfurization. However, some programs were judged to be costly failures in which large R&D expenditures did not result in a commercial energy technology. A follow-up NRC committee was assigned the task of adapting the methodology to the assessment of the future payoff of continuing programs. Evaluating the outcome of R&D expenditures requires an analysis of program costs and benefits. Doing so is not a trivial matter. First, the analysis of costs and benefits must reflect the full range of public benefits that are envisioned, accounting for environmental and energy security impacts as well as economic effects. Second, the analysis must consider how likely the research is to succeed and how valuable the research will be if successful. Finally, the analysis must consider what might happen if the government did not support the project: Would some non-DOE entity undertake it or an equivalent activity that would produce some or all of the benefits of government involvement? This second report continues to investigate the development and use of R&D outcome indicators and applies the benefits evaluation methodology to six DOE R&D activities. It provides further definition for the development of indicators for environmental and security benefits and refines the evaluation process based on its experience with the six DOE R&D case studies.
Global warming continues to gain importance on the international agenda and calls for action are heightening. Yet, there is still controversy over what must be done and what is needed to proceed. Policy Implications of Greenhouse Warming describes the information necessary to make decisions about global warming resulting from atmospheric releases of radiatively active trace gases. The conclusions and recommendations include some unexpected results. The distinguished authoring committee provides specific advice for U.S. policy and addresses the need for an international response to potential greenhouse warming. It offers a realistic view of gaps in the scientific understanding of greenhouse warming and how much effort and expense might be required to produce definitive answers. The book presents methods for assessing options to reduce emissions of greenhouse gases into the atmosphere, offset emissions, and assist humans and unmanaged systems of plants and animals to adjust to the consequences of global warming.
Aldo Leopold, father of the "land ethic," once said, "The time has come for science to busy itself with the earth itself. The first step is to reconstruct a sample of what we had to begin with." The concept he expressedâ€"restorationâ€"is defined in this comprehensive new volume that examines the prospects for repairing the damage society has done to the nation's aquatic resources: lakes, rivers and streams, and wetlands. Restoration of Aquatic Ecosystems outlines a national strategy for aquatic restoration, with practical recommendations, and features case studies of aquatic restoration activities around the country. The committee examines: Key concepts and techniques used in restoration. Common factors in successful restoration efforts. Threats to the health of the nation's aquatic ecosystems. Approaches to evaluation before, during, and after a restoration project. The emerging specialties of restoration and landscape ecology.
This report is the second edition of the 1992 COSEPUP report "Science and Technology Leadership in American Government: Ensuring the Best Presidential Appointments." As was the case with the original report, this report analyzes the federal government's capacity to recruit highly qualified individuals for the top science and technology (S&T)-related leadership positions in the executive branch and makes appropriate recommendations.
The nation has compelling reasons to reduce its consumption of oil and emissions of carbon dioxide. Plug-in hybrid electric vehicles (PHEVs) promise to contribute to both goals by allowing some miles to be driven on electricity drawn from the grid, with an internal combustion engine that kicks in when the batteries are discharged. However, while battery technology has made great strides in recent years, batteries are still very expensive. Transitions to Alternative Transportation Technologies-Plug-in Hybrid Electric Vehicles builds on a 2008 National Research Council report on hydrogen fuel cell vehicles. The present volume reviews the current and projected technology status of PHEVs; considers the factors that will affect how rapidly PHEVs could enter the marketplace, including the interface with the electric transmission and distribution system; determines a maximum practical penetration rate for PHEVs consistent with the time frame and factors considered in the 2008 Hydrogen report; and incorporates PHEVs into the models used in the hydrogen study to estimate the costs and impacts on petroleum consumption and carbon dioxide emissions.
The Government Performance and Results Act (GPRA), passed by Congress in 1993, requires that federal agencies write five-year strategic plans with annual performance goals and produce an annual report that demonstrates whether the goals have been met. The first performance reports are due in March 2000. Measuring the performance of basic research is particularly challenging because major breakthroughs can be unpredictable and difficult to assess in the short term. This book recommends that federal agencies use an "expert review" method to examine the quality of research they support, the relevance of that research to their mission, and whether the research is at the international forefront of scientific and technological knowledge. It also addresses the issues of matching evaluation measurements to the character of the research performed, improving coordination among agencies when research is in the same field, and including a human resource development component in GPRA strategic and performance plans.
The report favorably reviews the U.S. Environmental Protection Agency's competitive research grants program, finding that it has yielded significant new findings and knowledge critical for EPA's decision-making process. Established in 1995, the grants program was designed to enable the nation's best scientists and engineers to explore new ways to safeguard the environment and protect public health. The program awards about $100 million a year in grants and fellowships to independent investigators, multidisciplinary teams, and graduate students at universities and nonprofit institutions.
Thank you for visiting our website. Would you like to provide feedback on how we could improve your experience?
This site does not use any third party cookies with one exception — it uses cookies from Google to deliver its services and to analyze traffic.Learn More.