Strong Publication and Funding Outcomes
The evaluation compared 16 BIRCWH Scholars with 17 similarly qualified faculty members who applied but were not selected for the program. The results demonstrate clear advantages for program participants. BIRCWH Scholars produced 1,000 total publications—265 before and 736 after the program—compared with 653 publications from the comparison group. After adjusting for time, BIRCWH Scholars published significantly more articles and received more NIH grant funding, with 10 Scholars securing 20 grants totaling approximately $48 million compared to 6 comparison group members who received 10 grants worth roughly $10 million.
Network Growth and Collaboration Expansion
Beyond traditional metrics, the study employed bibliometric analysis to reveal deeper impacts. One Scholar’s collaboration network grew dramatically during their BIRCWH appointment, expanding from 19 collaborators on 11 publications to 197 collaborators on 122 publications. This expansion reflects how the program facilitates meaningful interdisciplinary connections that extend researchers’ capacity and reach.
Broadening Disciplinary and International Impact
Citation analysis showed that one Scholar’s work, which was initially cited by journals in 13 different disciplines before the program, was subsequently cited across 45 different disciplinary areas during and after BIRCWH involvement. Another Scholar’s research evolved from citations in 30 countries to citations in 54 countries, with the volume of international citations increasing from 263 citing researchers to 1,494 researchers worldwide.
Policy Influence and Public Engagement
The program’s impact extends into the policy and public spheres. One Scholar’s work has been referenced in 52 government and association documents from 41 different sources, including the Department of Health and Human Services and the World Health Organization, and cited in 134 news stories across major media outlets, including the New York Times, Washington Post, and Forbes. This demonstrates that BIRCWH Scholars’ research translates into real-world applications affecting public health policy and public awareness.
Implications for Research Career Development
The findings suggest that mentored research career development programs generate value far beyond what traditional metrics capture. The study demonstrates that BIRCWH Scholars establish broader networks, address problems across multiple disciplines, and achieve measurable impact on health policy and public discourse. The research supports using bibliometric evaluation alongside conventional measures to document program effectiveness and scholar success, particularly useful for institutional funding decisions, tenure reviews, and grant applications.
Source: Berge JM, et al. Bibliometric Approach to Evaluating the Impact of a Building Interdisciplinary Research Careers in Women’s Health K12 Research Career Development Program. J Womens Health. 2022;31(10):1422–1431.
