Abstract
Our subject is how the experience of Americans with a certain funding criterion, “broader impacts” (and some similar criteria) may help in efforts to turn the European concept of Responsible Research and Innovation (RRI) into a useful guide to funding Europe’s scientific and technical research. We believe this comparison may also be as enlightening for Americans concerned with revising research policy. We have organized our report around René Von Schomberg’s definition of RRI, since it seems both to cover what the European research group to which we belong is interested in and to be the only widely accepted definition of RRI. According to Von Schomberg, RRI: “… is a transparent, interactive process by which societal actors and innovators become mutually responsive to each other with a view to the (ethical) acceptability, sustainability and societal desirability of the innovation process and its marketable products (in order to allow a proper embedding of scientific and technological advances in our society).” While RRI seeks fundamental changes in the way research is conducted, Broader Impacts is more concerned with more peripheral aspects of research: widening participation of disadvantaged groups, recruiting the next generation of scientists, increasing the speed with which results are used, and so on. Nevertheless, an examination of the broadening of funding criteria over the last four decades suggests that National Science Foundation has been moving in the direction of RRI.
Similar content being viewed by others
Notes
The only published alternative to this definition seems to be:
Responsible Research and Innovation refers to ways of proceeding in Research and Innovation that allow those who initiate and are involved in the processes of research and innovation at an early stage (A) to obtain relevant knowledge on the consequences of the outcomes of their actions and on the range of options open to them and (B) to effectively evaluate both outcomes and options in terms of moral values (including, but not limited to wellbeing, justice, equality, privacy, autonomy, safety, security, sustainability, accountability, democracy and efficiency) and (C) to use these considerations (under A and B) as functional requirements for design and development of new research, products and services. (Directorate-General 2013, 55–56)
We think the Directorate-General definition differs little in substance from Von Schomberg’s shorter and simpler version (though it does avoid some of the problems we find in Von Schomberg’s).
Actually, this is not quite right—or is quite right only given a certain understanding of “science”. For example, NSF does not typically fund research in criminal justice science, library science (except digital libraries), or animal husbandry, but does fund work in philosophy and history of science.
This amount, though large, is small compared to the overall federal spending on research. NIH alone spends about $30 billion a year on medical research (NIH 2012).
The data appear in Appendix C of NSF (2011), a report of over 300 pages (providing many insights into the entire process of re-formulating the broader-impacts criterion).
The first version of the proposed revised merit criterion (NSF 2011, 264) provided the following information about “national goals”:
Collectively, NSF projects should help to advance a broad set of important national goals, including:
-
Increased economic competitiveness of the United States.
-
Development of a globally competitive STEM workforce.
-
Increased participation of women, persons with disabilities, and underrepresented minorities in STEM.
-
Increased partnerships between academia and industry.
-
Improved pre-K–12 STEM education and teacher development.
-
Improved undergraduate STEM education.
-
Increased public scientific literacy and public engagement with science and technology.
-
Increased national security.
-
Enhanced infrastructure for research and education, including facilities, instrumentation, networks and partnerships.
Note that even this long list is not exhaustive. The nation’s goals simply “include” these. Note too that NSF projects are to advance these goals “collectively”. There is no requirement that any particular project advance any of these goals. The list is much the same as the “goals” in the America COMPETES Reauthorization Act of 2010 (H.R. 5116), Sec. 526.
-
The substitution of “societal” for “national” seems to have been a way to provide more free-play in the choice of impacts to pursue (since there was no Congressional definition of “societal goals” as there was of “national goals”). For those with an ear for language, the question might arise: Why “societal” rather than the shorter and older “social”? There is no official answer. The best guess is that “societal” suggests “society” while “social” also suggests “socialize”, “sociable”, “socialism”, and other ideas slightly less appropriate.
Almost identical language appears in NSF (2013), Chapter II.C.2.d (the Guide to those proposing research). This is a definition only in the sense that it sets some limits on what counts as broader impact (contribution to societal goals by the research itself or some auxiliary activities).
http://www.nsf.gov/news/special_reports/i-corps/program.jsp (accessed May 1, 2013). This is one of many efforts to build on the Bayh–Dole Act of 1980 (a.k.a. Patent and Trademark Law Amendments Act). Codified as 35 U.S.C. § 200–212, and implemented by 37 C.F.R. 401, that legislation permits a university, small business, or non-profit institution to pursue ownership of a federally funded invention (rather than, as had been the practice, letting it fall into the public domain). The idea was that private ownership would speed the movement of scientific advance into practical application. http://en.wikipedia.org/wiki/Bayh%E2%80%93Dole_Act (accessed April 24, 2013).
The point here is not that EPRS could not have been a marketable product in a different environment—as Google Health was supposed to be—but that, even though it was in fact not developed as a marketable product (but as something the public health system would use), it served Von Schomberg well, allowing him to make all the points he wished concerning RRI. It did not have to be a markable produce to elucidate RRI.
Interestingly, NSF now uses “products” to include “publications, data sets, software, patents, and copyrights” [NSF 2013, B.2.i(c)]. Since “publications” generally appear in journals or as books that publishers market, even publications would seem to count as “marketable products” (for NSF). So (in the American context at least), not only does “marketable products” leave out products Von Schomberg should include in RRI (those that are useful but not marketable) but also to include some products he may not intend (those marketable products that simply consist in scientific publications). “Product” is another term in need of clarification if it is to be used more narrowly than NSF does.
We added “other” to Von Schomberg’s “societal actors” because researchers and innovators are, of course, societal actors too. Even “pure science” is a societal activity.
I am assuming that among the reasons to desire RRI is to avoid the harms scientific and technical advances might impose, such as the loss of privacy or the destruction of the environment. Of course, some research, especially military research, is meant to do harm (to some people). I ignore such research here because it does not seem to be within the bounds of RRI—just a military research is not within NSF’s mandate. RRI is, it seems, about certain research compartments, not all. There is a need for the Europeans to be much more explicit about what sorts of research and innovation is outside the bounds of RRI.
The NSB consists of the NSF director and twenty-four ordinary members appointed by the President of the United States and confirmed by the United States Senate. The NSB meets six times a year to establish NSF’s overall policies within the framework of applicable national policies set by the President and Congress. The Board also serves as an independent policy advisory body to the President and Congress on science and engineering research and education and has a statutory obligation to “render to the President and to the Congress reports on specific, individual policy matters related to science and engineering and education in science engineering, as the Board, the President, or the Congress determines the need for such reports,” and to “render to the President and the Congress no later than January 15 of each even numbered year, a report on indicators of the state of science and engineering in the United States.” [42 U.S.C. Section 1863, Sec.4.(j)(1–2)] The NSF’s director is also responsible for administration, planning, budgeting, and day-to-day operations of the foundation.
Indeed, having had more than three decades of experience with academic-industry partnerships, Americans have become cautious about allowing partnerships to be too close. See, for example, Davis (1991), Krimsky (2004), or Institutes (2009). NSF now requires academic institutions to have conflict of interest policies to keep university-industry relations from becoming too close (NSF 2013, 6–7). RRI seems to risk similar problems.
There was some sense of that possibility, however. Informal discussions with several of the participants specializing in “outreach” revealed that they often helped to shape the research being proposed as part of helping researchers develop a satisfactory statement of broader impacts. For example, a researcher who (upon the outreach specialist’s suggestion) included high school students among those collecting water samples for him could count the students’ increased interest in science as a potential broader impact of the proposed research.
One exception to this general separation of research and the public is what has come to be known as “citizen science”, that is, projects that recruit members of the public to help gather research data. So, for example, a recent NSF-funded project at Cornell University included volunteers living in areas affected by the Deepwater Horizon oil spill. The volunteers surveyed birds on beaches and in marshes along the Gulf coast. They shared what they learned through a website that automatically built interactive maps showing locations of reported birds in relation to current and forecast oil-slick locations, allowing for quick response when conservation was needed (NSF 2010).
Members of an advisory council are chosen by the respective institute or center and approved by the Department of Health and Human Services. For certain committees, members are appointed by the President of the United States.
For human subjects in research, the relevant laws are 45 CFR Part 46 (HHS) and 45 CFR Part 690 (NSF) Federal Policy for the Protection of Human Subjects; for animals, 7 USC. 2131 et seq., 9 CFR 1.1–4.11.
The terms “translative research” and “translational science” are (more or less) equivalent to “translational research”.
References
Anderson, I. (2011), “The Bill and Melinda Gates Foundation: Bureaucracy versus business in international development” discussion paper 2, Development Policy Center, Crawford School of Economics and Government, The Australian National University, Canberra.
Bill and Melinda Gates Foundation. (2012) Improving our work with grantees: A progress report. (September) http://www.gatesfoundation.org/~/media/GFO/Documents/How%20We%20Work/granteeprogressreport2012.pdf. Accessed May 6, 2013.
Bill and Melinda Gates Foundation. (2013) What we do: Agricultural development strategy overview. http://www.gatesfoundation.org/What-We-Do/Global-Development/Agricultural-Development. Accessed May 6, 2013.
Bruggen, W. W. (2009). Implementation of the national science foundation's ‘broader impacts’: Efficiency considerations and alternative approaches. Social Epistemology, 23(3–4), 234.
Butler, D. (2009). “Crossing the valley of death.” Nature, 453, 840–841.
Collaborative Institutional Training Initiative (CITI). https://www.citiprogram.org/rcrpage.asp. April 27, 2013.
Coller, B. S., & Califf, R. M. (2009). “Traversing the valley of death: A guide to assessing prospects for translational success.” Science Transitional Medicine, 1(10), 10.
Davis, M. (1991). University research and the wages of commerce. Journal of College and University Law, 18(Summer), 29–38.
Directorate-General for Research and Innovation Science in Society. (2013). Options for strengthening responsible research and innovation: Report of the expert group on the state of art in Europe on responsible research and innovation. Luxembourg: Publications Office of the European Union. http://ec.europa.eu/research/science-society/document_library/pdf_06/options-for-strengthening_en.pdf. Accessed May 28, 2013.
Editorial. (2009). What has the Gates foundation done for global health? The Lancet, 373(9675), 1577.
Hellström, T., & Jacob, M. (2012). Revisiting ‘Weinberg’s Choice’: Classic tensions in the concept of scientific merit. Minerva, 50, 381–396.
HHS.gov (2013). US Department of Health & Human Services. Search human research protections frequent questions. http://answers.hhs.gov/ohrp/questions/7180.
Holbrook, J. B. (2010). The use of societal impacts considerations in grant proposal peer review: A comparison of five models. Technology and Innovation, 12, 220.
Holbrook, J. B. (2012). Re-assessing the science—society relation: The case of the US National Science Foundation’s Broader Impacts merit review criterion (1997–2011). http://www.peerev.org/data/7cce53cf90577442771720a370c3c723/PE_doc_28403.pdf. Accessed June 2, 2013.
Institutes of Medicine. (2009). Conflict of interest in medical research, education, and practice. Washington, DC: National Academies Press.
Krimsky, S. (2004). Science in the private interest: Has the lure of profits corrupted biomedical research?. Lanham, MD: Rowman & Littlefield Publishers.
McCoy, D., Kembhavi, G., Patel, J., & Luintel, A. (2009). The Bill & Melinda Gates Foundation’s Grant-Making Program for global health. Lancet, 373, 1645–1653.
National Aeronautics and Space Administration. (2012a) Agency financial report FY2012. (November 15). http://www.nasa.gov/pdf/707292main_FY12_AFR_121412_FINALv508.pdf. Accessed May 15, 2013.
National Aeronautics and Space Administration. (2012b). Science mission directorate education and public outreach. http://smdepo.org/node/544. Accessed May 6, 2013.
National Institute on Mental Health. (2008). The National Institute of Mental Health Strategic Plan. http://www.nimh.nih.gov/about/strategic-planning-reports/index.shtml. Accessed April 30, 2013.
National Institutes of Health. (2011). About NIH. http://www.nih.gov/about/. Accessed May 12, 2013.
National Institutes of Health. (2012). Office of budget. http://www.nih.gov/about/budget.htm. Accessed May 10, 2013.
National Institutes of Health. (2013a). Peer review process. http://grants.nih.gov/Grants/peer_review_process.htm#Criteria. Accessed May 10, 2013.
National Institutes of Health. (2013b). Bench to bedside program. http://clinicalcenter.nih.gov/ccc/btb/. Accessed May 28, 2013.
National Institutes of Health. (2013c). Clinical and translational science awards web site. http://www.ncats.nih.gov/research/cts/ctsa/ctsa.html. Accessed May 29, 2013.
National Institutes of Health. (2013d). NIH public access policy. http://publicaccess.nih.gov/. Accessed April 30, 2013.
National Science Foundation. (1995). Grant proposal guide (NSF-95-27).
National Science Foundation. (2010). Award Abstract #1049363. RAPID: Gulf coast sill biodiversity tracker. A volunteer-based observation network to monitor the impact of oil on organisms along the gulf coast. http://www.nsf.gov/awardsearch/showAward?AWD_ID=1049363&HistoricalAwards=false. Accessed May 23, 2013.
National Science Foundation. (2011). National Science Foundation’s merit review criteria: Review and revisions (December 14). www.nsf.gov/nsb/publications/2011/meritreviewcriteria.pdf. Accessed April 20, 2013.
National Science Foundation. (2012). NSF at a glance. http://www.nsf.gov/about/glance.jsp. Accessed April 27, 2013.
National Science Foundation. (2013). Chapter II—Proposal preparation instructions. http://www.nsf.gov/pubs/policydocs/pappguide/nsf13001/gpg_2.jsp#IIC2d. Accessed April 20, 2013.
Owen, R., Macnaghten, P., & Stilgoe, J. (2012). Responsible research and innovation: From science in society to science for society, with society. Science and Public Policy, 39, 751–760.
Resnik, D. B. (2009). Playing politics with science: Balancing scientific independence and government oversight. New York: Oxford University Press.
Rothenberg, M. (2010). Making judgments about grant proposals: A brief history of the merit review criteria at the national science foundation. Technology and Innovation, 12, 189–195.
Singapore Statement on Research Integrity. (September 22, 2010). http://www.singaporestatement.org/. Accessed May 27, 2013.
Von Schomberg, R. (2013). A vision of responsible innovation. In: R. Owen, M. Heintz, & J. Bessant (Eds.), Responsible innovation. London: Wiley, forthcoming.
Acknowledgments
This article was written with support from the European Community’s Seventh Framework Programme grant number 321400. Thanks to Doris Schroeder and two of this journal’s reviewers for helpful comments on earlier drafts.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Davis, M., Laas, K. “Broader Impacts” or “Responsible Research and Innovation”? A Comparison of Two Criteria for Funding Research in Science and Engineering. Sci Eng Ethics 20, 963–983 (2014). https://doi.org/10.1007/s11948-013-9480-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11948-013-9480-1