Dr. Stefan Maas

About Dr. Stefan Maas

Stefan, a molecular biologist, manages research grants in the areas of cell growth, differentiation, homeostasis and cell death. He also oversees SBIR/STTR small business grants in genetics and developmental biology and institutional training grants in systems and integrative biology.

Further Analysis of Renewal Rates for New and Established NIGMS Investigator Projects

In an earlier blog post, I presented data on the first competing renewal rates of R01 projects that NIGMS awarded to new and established investigators. The analysis showed that no renewal application was submitted for a substantial percentage of projects—30% of new projects from new investigators and 45% of new projects from established investigators. This raises questions, such as those suggested by Feedback Loop readers, including:

  • Do projects for which no renewal is submitted generally have less productivity or scientific impact?
  • Are new projects awarded to established investigators more likely to represent the second or third award to that investigator?

I’ve tried to explore these questions in a further analysis.

Continue reading

Examining the First Competing Renewal Rates of New NIGMS Investigators

The successful entry and retention of new investigators into biomedical research is a priority for us, and the renewal rate of this group’s first R01 research grants is an important indicator for this goal. Here are the results of an analysis I did of the first competing renewal rates for new and established investigators.

Figure 1 shows that the first competing renewal rate of new investigators’ first NIGMS R01 or R29 grants has declined over the past 10 years. This trend is similar to the one for overall NIGMS R01 application success rates.

Percent Funded by End of Project Period (approximate) 53% 2002, 53% 2003, 52% 2004, 45% 2005, 44% 2006, 43% 2007, 43% 2008, 38% 2009, 39% 2010, 35% 2011, 32% 2012
Figure 1. Percentage of new investigators’ R01 and R29 grants that were successfully renewed. The horizontal axis is the fiscal year in which the first project period ended. The vertical axis is the percentage of these projects that were successfully renewed at least once (regardless of whether the new or amended competing renewal application was funded) by the end of Fiscal Year 2014.

Figure 2 gives a more complete picture of the renewal history of new investigators’ NIGMS R01 and R29 projects. In addition to the renewal rate (also shown in Figure 1), it shows the percentage of projects for which at least one renewal application was submitted but was not successfully renewed as well as the percentage of projects for which no renewal application was submitted.

Renewal history at the end date of first project based on paid, not paid, and no application submitted (approximate). 2002 53% paid, 20% not paid, 27% no application. 2003 53% paid, 23% not paid, 24% no application. 2004 52% paid, 27% not paid, 21% no application. 2005 45% paid, 32% not paid, 23% no application. 2006 43% paid, 34% not paid, 23% no application. 2007 43% paid, 30% not paid, 27% no application. 2008 43% paid, 33% not paid, 24% no application. 2009 38% paid, 33% not paid, 29% no application. 2010 39% paid, 36% not paid, 25% no application. 2011 35% paid, 38% not paid, 27% no application. 2012 32% paid, 35% not paid, 33% no application.
Figure 2. Renewal history of new investigators’ R01 and R29 grants between Fiscal Years 2002-2012. The bottom section (green) shows successful renewals (paid), which are also shown in Figure 1; the middle section (red) shows grants for which renewal was attempted but was not successful (not paid); and the top section (blue) shows grants for which no renewal application was submitted (no app).

Figure 3 shows that success in renewing an NIGMS-funded R01 grant correlates positively with how long the grant has been active.

Percentage of Projects funded by grant years (approximate) 31% 1st renewals for grant years 4-6, 49% 2nd renewals for grant years 7-12, 54% for 3rd and greater renewals for grant years 12 or greater
Figure 3. Competing renewal rates for the first, second and third or more renewals of NIGMS R01 grants awarded between Fiscal Years 2004-2007 to new and established investigators.

Since first renewals have lower success rates than subsequent renewals, Figure 4 addresses whether new investigators seeking to renew their first R01 grants are competitive with established investigators who are renewing long-term and/or new projects. The figure shows that the renewal rate for all projects from established investigators, including new as well as long-term projects, is higher than the renewal rate of projects from new investigators (46 percent in the left column versus 36 percent in the right column). However, when focusing only on the first renewals of new projects (in the middle and right columns), new investigators are renewing at a higher rate than are established investigators (36 percent versus 30 percent).

Renewal history by percentage of projects FY2004-FY2007 by type of investigator (approximate). All renewals by established investigators 46% paid, 24% not paid, 30% no application. Renewals of new projects by established investigators 30% paid, 25% not paid, 45% no application. Renewals of new projects by new investigators, 36% paid, 35% not paid, 29% no application.
Figure 4. Renewal history of NIGMS R01 projects from new and established investigators that were initially funded by NIGMS between Fiscal Years 2004-2007.

Figure 5 shows the relative success of new and established investigators in renewing new projects as a function of the percentile score obtained on the initial award. As the “Paid” sections of the bars indicate, for each of the percentile groups, the overall renewal rate for new investigators’ new R01s was higher than that for established investigators’ new R01s.

Percentage of new and established investigators' projects renewed in relation to the percentile ranking of the original award (approximate). Percentile 0-9, new investigators 41% paid, 28% not paid, 31% no application. Percentile 0-9 established investigators, 34% paid, 22% not paid, 44% no application. Percentile 10-19, new investigators, 32% paid, 41% not paid, 27% no application. Percentile 10-19, established investigators 28% paid, 29% not paid, 43% no application. 20th percentile and greater, new investigators 41% funded, 36% not paid, 23% no application. 20th percentile and greater, established investigators 26% paid, 29% not paid, 45% no application.
Figure 5. Renewal history of NIGMS R01 projects from new and established investigators that were initially funded between Fiscal Years 2004-2007 in relation to the percentile ranking (0-9th, 10-19th, and 20th and higher percentiles) of the original award. The number of projects in each of the six categories analyzed from left (new investigators, 0-9th percentile) to right (established investigators, ≥20th percentile) are: 239, 328, 299, 347, 172 and 102.

Recognizing the importance of new investigators in sustaining the vitality of biomedical research, we give special consideration to applications from them, and in some cases, we fund these applications at percentiles beyond those for most established investigators. The data in Figure 5 supports this practice by showing that the renewal rates of new investigators whose original applications scored at or above the 20th percentile are about the same as, or higher than, those for new and established investigators whose original applications scored in the 0-9th percentile range.

More About This Analysis

This analysis includes Recovery Act projects and excludes withdrawn applications and multi-principal investigator grants.

Definitions
R01 projects: Research project grants.
R29 projects: First Independent Research Support and Transition (FIRST) awards, R01-type research project grants awarded to new investigators available from 1987 to 1998.
Renewal rate: Percentage of grants that were successfully renewed by the date of this analysis (end of Fiscal Year 2014), regardless of whether a new or amended competing renewal application was funded.
Grant year: Grant year in which the renewal R01 application was submitted.
New investigator: An individual who has not previously competed successfully as a program director/principal investigator for a substantial NIH independent research award (see http://grants.nih.gov/grants/glossary.htm#NewInvestigator).

Outsourcing Lab Procedures: Results from Request for Information

I previously described our effort to solicit feedback from investigators on their needs and ideas for outsourcing laboratory procedures. Now I’d like to share a summary of the overall results (no longer available) and some observations based on the 35 responses we received (mostly from academia):

Related News Articles*

An eBay for Science Exit icon, Nature

Online Marketplace Helps Professors Outsource Their Lab Research Exit icon, The Chronicle of Higher Education

Have You Heard of Assay Depot? It’s the Amazon.com of Medical Research Exit icon, The Atlantic

Science for Sale: Academic Meets Industry Exit icon, Cell

* This reference list is not meant as an endorsement of specific marketplaces or services.

  • Unexpectedly, almost all of the services mentioned by respondents constitute technologies or methodologies currently available for outsourcing. The most frequently identified ones—next-generation sequencing, bioinformatics/statistics and mass spectroscopy—are offered as services by numerous companies and core facilities.
  • Several marketplace-type platforms have recently been launched that facilitate bringing together researchers and providers of desired laboratory expertise, technology and research services. For a short list, see the news articles included in this post.
  • Evaluating the quality and cost of procedures available for outsourcing is not always straightforward. Similarly, assessing a laboratory’s actual costs for specific procedures, some of which could be outsourced, is difficult. Performing such economic analyses could reveal new needs for outsourcing laboratory procedures.

While we realize that the feedback we received may not be representative of the whole community, the results lead us to conclude that there does not appear to be a need for a special initiative to develop novel outsourcing capabilities.

Explaining the 4-Year Duration of Most Research Project Grants

NIGMS program directors are often asked why most of our grants are made for 4 years. We’ve just posted this brief explanation on our Web site:

NIH is required by Congressional mandate to keep the average research project grant (RPG) length to 4 years. Since NIGMS primarily uses the R01 mechanism for RPGs and participates in few short-term mechanisms (such as the R21), it limits most R01 awards to 4 years.

NIGMS does award some grants for 5 years, including research program projects and centers. The Institute also funds 5-year R01s to most new and early stage investigators to provide extra time for getting their projects under way.

The limitation on the average length of RPGs has been in effect at NIH for more than 10 years, and it helps ensure that funds are available to support new competing awards.

What does it mean for you? Keep applying for project periods that are adequate for the proposed work and are for a maximum of 5 years. But be aware that unless you fall under the exceptions mentioned above, your award will most likely be limited to 4 years of funding.

Outsourcing Lab Procedures: What Are Your Needs and Ideas?

Do you want to have more or easier access to state-of-the-art technologies and methodologies for your research? Are there specific types of non-clinical laboratory procedures that you wish were available through an outsourcing service?

If you answered “yes” to either of these questions, then please consider responding to our Request for Information (RFI): Priorities for Outsourcing of Laboratory Procedures. The RFI will help us identify research areas, such as assays, measurements and computational and data management tasks, that could be developed into outsourced services perhaps by small businesses and possibly supported through new funding opportunities.

Responses, which are voluntary and anonymous, should be submitted electronically (no longer available) by May 1, 2012.

UPDATE: The response deadline has been extended to May 15 (NOT-GM-12-110).