Author Archives: Travis Dorsey

Travis Dorsey

About Travis Dorsey

Travis, an economist by training, was a program analyst in the NIGMS Office of Program Planning, Analysis, and Evaluation. He used statistical and other methods to study the Institute’s research portfolios, training programs and funding policies.

Revisiting the Dependence of Scientific Productivity and Impact on Funding Level

Travis Dorsey
Posted by , and on
Post a Comment | View Comments (13) ↓

A 2010 analysis by NIGMS and subsequent studies by others (Fortin and Currie, 2013; Gallo et al., 2014; Lauer et al., 2015; Doyle et al., 2015; Cook et al., 2015 Exit icon) have indicated that, on average, larger budgets and labs do not correspond to greater returns on our investment in fundamental science. We have discussed the topic here in A Shared Responsibility and in an iBiology talk Exit icon. In this updated analysis, we assessed measures of the recent productivity and scientific impact of NIGMS grantees as a function of their total NIH funding.

We identified the pool of principal investigators (PIs) who held at least one NIGMS P01 or R01-equivalent grant (R01, R23, R29, R37) in Fiscal Year 2010. We then determined each investigator’s total NIH funding from research project grants (RPGs) or center grants (P20, P30, P50, P60, PL1, U54) for Fiscal Years 2009 to 2011 and averaged it over this 3-year period. Because many center grants are not organized into discrete projects and cores, we associated the contact PI with the entire budget and all publications attributed to the grant. We applied the same methodology to P01s. Thus, all publications citing the support of the center or P01 grant were also attributed to the contact PI, preventing underrepresentation of their productivity relative to their funding levels. Figure 1 shows the distribution of PIs by funding level, with the number of PIs at each funding level shown above each bar.

Continue reading →

P01 Outcomes Analysis

Travis Dorsey
Posted by on
Post a Comment | View Comments (9) ↓

As part of our program assessment process, we have analyzed NIGMS program project (P01) grants to improve our understanding of how their outcomes compare with those of other mechanisms.

The most recent NIGMS funding opportunity announcement for P01s states that individual projects “must be clearly interrelated and synergistic so that the research ideas, efforts, and outcomes of the program as a whole will offer a distinct advantage over pursuing the individual projects separately.” From this perspective, we sought to address three major questions:

  • Do P01s achieve synergies above and beyond a collection of separate grants?
  • How do the results from P01s compare with those from R01s?
  • Do certain fields of science need P01s more than others?

To address these questions, we analyzed the outcomes of P01 grants using several different metrics and compared these outcomes to those of two comparator groups: single-principal investigator (PI) R01s and multiple-PI R01s. Since P01s could be considered as a collection of single-PI R01s and one or more cores, we chose single-PI R01s as a comparator group. Because a major facet of P01s is their focus on using collaborative approaches to science, we also wanted to compare their outcomes to another collaboration-focused research grant: multiple-PI R01s. While structurally different from P01s, multiple-PI R01s allow for a comparison between two competing models of funding team science within the NIGMS portfolio.

Continue reading →

Analysis of NIGMS Funding Rates for Early Stage Investigators and Non-Early Stage New Investigators

Travis Dorsey Sarah Wallen
Posted by and on
Post a Comment | View Comments (14) ↓

NIH and NIGMS have policies to promote the successful entry of junior investigators into independent biomedical research careers. NIH classifies investigators who have not previously had a major NIH grant into two categories: new investigators (NIs) and early stage investigators (ESIs), a subset of NIs who are within 10 years of completing their terminal research degree or medical residency. The goal of these policies is to support R01-equivalent awards to both of these categories of investigators at success rates (the percentage of new Type 1 R01 applications that were funded) similar to those of established investigators (EIs) who submit new R01 applications.

Given that the NI and ESI policies have been in effect for some time, we wanted to update and extend an analysis of success rates by investigator status performed in 2010 to see if NIGMS has been able to meet these objectives. While we found that the success rates for all NIs were comparable to or greater than that of EIs, our new analysis also revealed that the subset of NIs who completed their terminal research degree at least 10 years ago (non-ES NIs) had consistently lower success rates in obtaining R01s relative to both ESIs and EIs.

We focused our analysis on NIGMS Type 1 R01 applications for Fiscal Years 2011-2014. Figure 1a shows the success rates for EIs and NIs. During the time period analyzed, success rates for both EIs and NIs were comparable. However, when the NIs are separated into ESIs and non-ES NIs, the data show a more nuanced result (Figure 1b). ESIs consistently had higher success rates than either EIs or non-ES NIs when applying for new R01s.

Continue reading →