Metrics Rule Everything Around Me

In academia, metrics are omnipresent. They can dictate funding decisions, job prospects, and even the perceived value of one's research. So, you need to understand them. This blog is aimed at contextualising the common metrics that academics are measured on.

Setting the Scene

Metrics such as the H-index, impact factors, and citation counts are drilled into us from early in our academic careers. They are meant to measure our research's reach and impact. However, the very act of measuring these metrics can create perverse incentives. Academics might prioritize boosting their numbers over conducting genuinely innovative or important research. This metric-centric environment can make your head spin, but don't give up. Understanding these metrics and how to navigate them is crucial to surviving and thriving in academia.

Note Well: Metrics can be a double-edged sword: used positively, they can highlight significant contributions and guide progress; used negatively, they can foster competition, dishonesty, and a focus on quantity over quality.

The problem with metrics

Metrics, by their very definition, become a problem once we start measuring them. The system is inherently flawed, yet it's the system we operate within, so ignorance isn't a viable option.

Like it or not, you are being measured!!!!!

So, you have to understand how you are being judged if you hope to navigate the academic landscape effectively.

The Flaws in the System

The competitive nature of academia can drive even the best academic to engage in questionable practices to game the system. I've heard stories of academics publishing a paper every three days, engaging in gift authorship, resorting to excessive self-citations, and making dodgy deals. This behavior is fueled by the desire to excel in the metrics that dominate our professional lives. It's a reminder that while metrics are important, they should never come at the cost of integrity.

However, this doesn't mean you should aim for such practices. The focus should be on producing quality work. Yet, without 'good enough' metrics, surviving in academia can be incredibly challenging. It's a double-edged sword that requires careful navigation.

Important Metrics and How to Maximize Them

A note: this is not an exhaustive list; simply the main ones that I can think of. There are likely more, and the powers that be are likely making new metrics that we will soon be slaves to.

1. H-Index

What it Means: The H-index measures both the productivity and citation impact of a scholar's publications. An index of h means the researcher has published h papers, each of which has been cited at least h times.

How it's Calculated: It's calculated based on the set of the researcher's most cited papers and the number of citations they have received in other publications.

How it's Used: Institutions and funding bodies use the H-index to gauge the influence and contribution of a researcher.

Maximizing It: Focus on producing high-quality, impactful research that is likely to be cited. Collaborate with other researchers and aim to publish in high-impact journals.

2. Impact Factor

What it Means: The impact factor of a journal is the average number of citations received in a particular year by papers published in the journal during the two preceding years.

How it's Calculated: It is calculated by dividing the number of citations in the current year by the total number of articles published in the two previous years.

How it's Used: Used to assess the importance of a journal within its field.

Maximizing It: Aim to publish in journals with high impact factors. This often means targeting prestigious journals with rigorous peer-review processes.

3. Citations

What it Means: Citations are a measure of how often your work is referenced by other researchers.

How it's Calculated: Simply the number of times your publications are cited in other works.

How it's Used: Used to measure the impact and reach of your research.

Maximizing It: Write clear, influential papers that address key questions in your field. Engage in networking and present your work at conferences to increase visibility.

4. Journal Rankings

What it Means: These rankings are often based on metrics like the impact factor and the reputation of the journal.

How it's Calculated: Different organizations use various methodologies, but most consider citation data and expert opinion.

How it's Used: Researchers aim to publish in high-ranking journals to boost their credibility and career prospects.

Maximizing It: Stay informed about which journals are highly regarded in your field and aim to meet their publication standards.

5. Grant Success Rate

What it Means: The ratio of successful grant applications to the total number of applications submitted.

How it's Calculated: Calculated by dividing the number of grants awarded by the number of applications submitted.

How it's Used: Indicates a researcher's ability to secure funding.

Maximizing It: Write strong, persuasive grant proposals. Network with funding bodies and understand their priorities and criteria.

6. Competitive Grant Income Total

What it Means: The total amount of funding secured through competitive grants.

How it's Calculated: Sum of all competitive grant funding received.

How it's Used: Reflects the researcher's ability to attract significant funding and indicates the competitiveness and appeal of their research.

Maximizing It: Apply for various grants, including those outside your immediate area of expertise. Tailor each proposal to the specific funding body's interests and requirements to improve your chances.

7. Field-Weighted Citation Impact (FWCI)

What it Means: FWCI compares the actual number of citations received by an article to the expected number of citations for articles of the same type, year, and field.

How it's Calculated: It's calculated by dividing the actual citation count by the expected citation count.

How it's Used: Used to assess the relative impact of a researcher's publications within their specific field.

Maximizing It: Publish in high-impact journals and ensure your research addresses key, current topics in your field to increase visibility and citations.

8. Altmetrics

What it Means: Altmetrics measure the attention an article receives on social media, news outlets, policy documents, and other platforms.

How it's Calculated: It aggregates mentions, shares, and discussions about research across various online platforms.

How it's Used: Provides a broader view of the impact and reach of research beyond traditional citations.

Maximizing It: Actively promote your research on social media, engage with the public and other researchers online, and make your work accessible to a broader audience.

9. Student Graduations

What it Means: The number of students who successfully complete their degrees under a researcher's supervision.

How it's Calculated: It's a straightforward count of graduates.

How it's Used: Reflects the mentorship and guidance provided by a researcher.

Maximizing It: Provide strong mentorship, support your students' research endeavors, and ensure they have the resources they need to succeed.

10. Industry Income

What it Means: The amount of funding a researcher secures from industry partnerships.

How it's Calculated: Total financial contributions from industry collaborations.

How it's Used: Indicates the practical application and value of a researcher's work to industry.

Maximizing It: Build relationships with industry partners, focus on applied research, and demonstrate the commercial potential of your work.

11. Impact Metrics

What it Means: Various metrics that measure the broader societal, economic, and cultural impact of research.

How it's Calculated: Includes measures like policy influence, public engagement, and real-world applications.

How it's Used: Shows the significance and relevance of research beyond academia.

Maximizing It: Engage with policymakers, participate in public outreach, and focus on research that addresses societal challenges.

12. In-Kind Grant Income

What it Means: The value of in-kind contributions such as infrastructure and national facility use (e.g., synchrotron time, computing resources, nuclear facilities).

How it's Calculated: Estimated value of the resources provided.

How it's Used: Demonstrates the level of support and resources a researcher can attract.

Maximizing It: Apply for access to national facilities and leverage these resources in your research. Highlight these contributions in your grant applications and publications.

Balancing Metrics and Quality

It's crucial to strike a balance between achieving good metrics and maintaining the quality and integrity of your work. Aim for impactful, high-quality research while being mindful of the metrics that matter in your field. Remember, metrics are just one part of your academic journey. They should guide, not dictate, your path.

Call to Action: Start keeping detailed records of these achievements and their dollar values in your CV. Documenting your successes comprehensively will help you present a robust case for your work's value and impact.

Navigating the world of academic metrics is challenging, but with the right focus and integrity, you can achieve success without compromising your values. Go forth, conquer!