Posted on

Examining the First Competing Renewal Rates of New NIGMS Investigators

by
9 comments

The successful entry and retention of new investigators into biomedical research is a priority for us, and the renewal rate of this group’s first R01 research grants is an important indicator for this goal. Here are the results of an analysis I did of the first competing renewal rates for new and established investigators.

Figure 1 shows that the first competing renewal rate of new investigators’ first NIGMS R01 or R29 grants has declined over the past 10 years. This trend is similar to the one for overall NIGMS R01 application success rates.

Percent Funded by End of Project Period (approximate) 53% 2002, 53% 2003, 52% 2004, 45% 2005, 44% 2006, 43% 2007, 43% 2008, 38% 2009, 39% 2010, 35% 2011, 32% 2012
Figure 1. Percentage of new investigators’ R01 and R29 grants that were successfully renewed. The horizontal axis is the fiscal year in which the first project period ended. The vertical axis is the percentage of these projects that were successfully renewed at least once (regardless of whether the new or amended competing renewal application was funded) by the end of Fiscal Year 2014.

Figure 2 gives a more complete picture of the renewal history of new investigators’ NIGMS R01 and R29 projects. In addition to the renewal rate (also shown in Figure 1), it shows the percentage of projects for which at least one renewal application was submitted but was not successfully renewed as well as the percentage of projects for which no renewal application was submitted.

Renewal history at the end date of first project based on paid, not paid, and no application submitted (approximate). 2002 53% paid, 20% not paid, 27% no application. 2003 53% paid, 23% not paid, 24% no application. 2004 52% paid, 27% not paid, 21% no application. 2005 45% paid, 32% not paid, 23% no application. 2006 43% paid, 34% not paid, 23% no application. 2007 43% paid, 30% not paid, 27% no application. 2008 43% paid, 33% not paid, 24% no application. 2009 38% paid, 33% not paid, 29% no application. 2010 39% paid, 36% not paid, 25% no application. 2011 35% paid, 38% not paid, 27% no application. 2012 32% paid, 35% not paid, 33% no application.
Figure 2. Renewal history of new investigators’ R01 and R29 grants between Fiscal Years 2002-2012. The bottom section (green) shows successful renewals (paid), which are also shown in Figure 1; the middle section (red) shows grants for which renewal was attempted but was not successful (not paid); and the top section (blue) shows grants for which no renewal application was submitted (no app).

Figure 3 shows that success in renewing an NIGMS-funded R01 grant correlates positively with how long the grant has been active.

Percentage of Projects funded by grant years (approximate) 31% 1st renewals for grant years 4-6, 49% 2nd renewals for grant years 7-12, 54% for 3rd and greater renewals for grant years 12 or greater
Figure 3. Competing renewal rates for the first, second and third or more renewals of NIGMS R01 grants awarded between Fiscal Years 2004-2007 to new and established investigators.

Since first renewals have lower success rates than subsequent renewals, Figure 4 addresses whether new investigators seeking to renew their first R01 grants are competitive with established investigators who are renewing long-term and/or new projects. The figure shows that the renewal rate for all projects from established investigators, including new as well as long-term projects, is higher than the renewal rate of projects from new investigators (46 percent in the left column versus 36 percent in the right column). However, when focusing only on the first renewals of new projects (in the middle and right columns), new investigators are renewing at a higher rate than are established investigators (36 percent versus 30 percent).

Renewal history by percentage of projects FY2004-FY2007 by type of investigator (approximate). All renewals by established investigators 46% paid, 24% not paid, 30% no application. Renewals of new projects by established investigators 30% paid, 25% not paid, 45% no application. Renewals of new projects by new investigators, 36% paid, 35% not paid, 29% no application.
Figure 4. Renewal history of NIGMS R01 projects from new and established investigators that were initially funded by NIGMS between Fiscal Years 2004-2007.

Figure 5 shows the relative success of new and established investigators in renewing new projects as a function of the percentile score obtained on the initial award. As the “Paid” sections of the bars indicate, for each of the percentile groups, the overall renewal rate for new investigators’ new R01s was higher than that for established investigators’ new R01s.

Percentage of new and established investigators' projects renewed in relation to the percentile ranking of the original award (approximate). Percentile 0-9, new investigators 41% paid, 28% not paid, 31% no application. Percentile 0-9 established investigators, 34% paid, 22% not paid, 44% no application. Percentile 10-19, new investigators, 32% paid, 41% not paid, 27% no application. Percentile 10-19, established investigators 28% paid, 29% not paid, 43% no application. 20th percentile and greater, new investigators 41% funded, 36% not paid, 23% no application. 20th percentile and greater, established investigators 26% paid, 29% not paid, 45% no application.
Figure 5. Renewal history of NIGMS R01 projects from new and established investigators that were initially funded between Fiscal Years 2004-2007 in relation to the percentile ranking (0-9th, 10-19th, and 20th and higher percentiles) of the original award. The number of projects in each of the six categories analyzed from left (new investigators, 0-9th percentile) to right (established investigators, ≥20th percentile) are: 239, 328, 299, 347, 172 and 102.

Recognizing the importance of new investigators in sustaining the vitality of biomedical research, we give special consideration to applications from them, and in some cases, we fund these applications at percentiles beyond those for most established investigators. The data in Figure 5 supports this practice by showing that the renewal rates of new investigators whose original applications scored at or above the 20th percentile are about the same as, or higher than, those for new and established investigators whose original applications scored in the 0-9th percentile range.

More About This Analysis

This analysis includes Recovery Act projects and excludes withdrawn applications and multi-principal investigator grants.

Definitions
R01 projects: Research project grants.
R29 projects: First Independent Research Support and Transition (FIRST) awards, R01-type research project grants awarded to new investigators available from 1987 to 1998.
Renewal rate: Percentage of grants that were successfully renewed by the date of this analysis (end of Fiscal Year 2014), regardless of whether a new or amended competing renewal application was funded.
Grant year: Grant year in which the renewal R01 application was submitted.
New investigator: An individual who has not previously competed successfully as a program director/principal investigator for a substantial NIH independent research award (see http://grants.nih.gov/grants/glossary.htm#NewInvestigator).

9 Replies to “Examining the First Competing Renewal Rates of New NIGMS Investigators”

  1. I have a query, not a comment. What about the success rate for individuals above the age of 70? Do you have any information in this regard?

    Reply

  2. I would be interested in the data for Figure 5 if they were broken down by whether the grant in question were the only grant for the lab in question. It seems as if looking at new projects from established investigators, there may be bias in that group for second and third funded projects for “new”.

    Reply

  3. It would be very interesting to correlate these numbers with productivity; i.e. how many publications per year for each group – successful renewal, non-successful renewal, and did not re-compete. When I was at the Program analysis branch at NIEHS (1999-2008) we did such an analysis of new investigator and it was found in the two cohorts we examined only about 50% tried to re-compete, and those that were successful published 2-3 papers per year for the four years leading up to the competitive renewal. Those that were not successful had a lower overall productivity.

    Reply

    1. The number of publications is NOT the same as productivity.
      Some fields are more amenable to publishing zillions of dinky papers and mini-reviews with nearly the same title than others. I consider that litter, not productivity.

      Reply

  4. Are there data on how many of the new investigators were women and minorities and how that would overlay on Figure 1?

    Reply

  5. The analysis from Fig. 4 suggesting that new investigators are more successful at renewing grants, as compared to the renewal of new projects by established investigators, is misleading because a larger fraction of established investigators do not apply for a renewal. If we adjust for the no-shows, it becomes clear that experienced investigators are not only more successful at renewing long-term funded projects, but also new projects.

    Reply

  6. I disagree with the conclusion drawn from Fig 4; when focusing only on the first renewals of new projects (in the middle and right columns), new investigators are renewing at a higher rate than are established investigators (36 percent versus 30 percent). The suggestion being that new investigators are at least as competitive if not more so than established investigators.

    Both Fig 4 and 5 clearly illustrate that established investigators attempt to renew awards at a lower rate than new investigators, and have greater success in renewing these awards. new investigators are more likely to attempt a renewal, and are less successful in such attempts.

    The trend suggested by Figs 1 and 2 hold that new investigators are becoming progressively less successful. The suggestion being that new investigators are increasingly disadvantaged and/or established investigators are favored in the 10 year period that has also seen reduced paylines.

    Unclear in this analysis would be if the trend is produced by an increase in the number of new investigators, leading to greater competition for the limited resources, rather than a shift in the relative advantage of established investigators.

    Reply

  7. We recognize that the success rate for established investigators who submit renewal applications for new projects is higher than that for new investigators, and this is an issue that concerns us. Here, we were focusing on the overall renewal rate for new projects. A new project that is not renewed for any reason is less likely to have been successful than one that was renewed, and thus this information is important in thinking about how we can make the best investments of our funds. We are planning to analyze the output of new projects that were not submitted for renewal versus those that were, as suggested by several commenters, to attempt to understand what the higher fraction of established investigators not submitting new grants for renewal indicates.

    Reply

Submit a Comment

Please note: Comment moderation is enabled and may delay your comment. There is no need to resubmit your comment.