A university can count how many papers its researchers publish. It can count citations, calculate h-indices and identify highly cited academics. What is considerably harder is answering a more important question: what changed because the research existed?
That distinction matters for universities across Asia. Research is expected not only to contribute new knowledge but, depending on the institution and discipline, to influence industry, public policy, professional practice, technology, communities, the environment or future research.
Citations remain valuable evidence. They show that other scholars have discovered and referenced a piece of work. But scholarly attention is only one layer of research impact. A study can receive relatively few citations yet significantly influence professional practice. Another can become highly cited without producing an identifiable change outside academia.
Universities therefore need a broader approach to research impact measurement—one that combines quantitative indicators with evidence of how knowledge is actually used.
Research Output and Research Impact Are Not the Same Thing
The first mistake is treating everything that can be counted as an impact.
A paper is an output. A patent is an output. A conference presentation is an output. A dataset, software tool or policy briefing is also an output.
These outputs matter because impact cannot occur without something being created, communicated or applied. But producing something does not automatically mean it changed anything.
| Stage | Question | Possible Evidence |
|---|---|---|
| Output | What did the research produce? | Articles, datasets, software, patents, prototypes, guidelines |
| Attention | Who noticed it? | Citations, downloads, media coverage, invitations, references |
| Engagement | Who interacted with the research? | Industry collaborations, policy discussions, practitioner workshops |
| Adoption | Who actually used it? | Policy adoption, licences, clinical or professional use, organisational implementation |
| Outcome | What changed after adoption? | Improved processes, costs, access, performance, environmental or social outcomes |
This five-stage ladder is useful because universities frequently report evidence from one level as though it proved another.
Media coverage demonstrates attention. It does not prove adoption. A memorandum of understanding demonstrates an institutional relationship. It does not prove that research changed industry practice. A patent demonstrates protected intellectual property. It does not prove commercial use.
Why Citation Counts Still Matter
The answer is not to abandon bibliometrics.
Citations can help universities understand whether research is influencing subsequent scholarship. Publication and citation patterns can identify emerging research strengths, collaboration networks and areas attracting academic attention.
The problem appears when a single metric is asked to answer questions it was not designed to answer.
Different disciplines also produce and cite research differently. A citation profile that appears exceptional in one field may be ordinary in another. Research with immediate practical applications may create visible external outcomes quickly, while fundamental research can take many years before its significance becomes clear.
Responsible research impact measurement therefore begins by matching the indicator to the question.
If the question is “Is other research building on this work?”, citations may be useful. If the question is “Did this research change professional practice?”, the university needs completely different evidence.
The TRACE Framework for University Research Impact
Universities can make impact assessment more manageable by using a five-part test: Target, Reach, Adoption, Contribution and Evidence—TRACE.
1. Target: What Change Was the Research Intended to Influence?
Impact measurement becomes difficult when institutions wait until a project is finished before deciding what impact means.
A research team should identify potential pathways early. Depending on the project, the intended change might involve government policy, manufacturing efficiency, agricultural productivity, teaching practice, public behaviour, environmental management, healthcare delivery or technological capability.
This does not mean researchers should promise an outcome before the research is completed. It means identifying the stakeholders and possible changes that are relevant enough to monitor.
2. Reach: Did the Research Reach the People Who Could Use It?
Research cannot influence an organisation that never encounters it.
Useful reach indicators may include practitioner downloads, policy briefings, professional workshops, industry demonstrations, standards-committee participation or engagement with community organisations.
Reach should not be mistaken for impact, but it helps establish the pathway between research and subsequent use.
3. Adoption: Was Anything Actually Used?
This is where evidence becomes substantially stronger.
An industry partner incorporating a research method into operations is stronger impact evidence than attending a seminar about it. A government agency referring to research when developing guidance is stronger than a researcher simply sending the agency a report.
Possible evidence includes implementation records, licences, institutional procedures, technical specifications, policy documents, professional guidelines or written confirmation from external users.
4. Contribution: How Much of the Change Can Reasonably Be Connected to the Research?
Real-world outcomes rarely have one cause.
Suppose a city introduces a transport policy after several university studies, government consultations, public campaigns and technological changes. Claiming that one research project “caused” the improvement would probably overstate the evidence.
A better impact statement describes contribution.
The research might have provided the modelling used to compare policy options, supplied evidence supporting a particular intervention or developed the technology ultimately implemented.
Careful language makes an impact claim stronger, not weaker.
5. Evidence: Could Someone Outside the Research Team Verify the Story?
A credible impact narrative should not depend entirely on the researcher’s own description.
External documents, implementation records, independent datasets, government publications, customer records, professional guidelines, licensing agreements and testimony from users can help substantiate the pathway.
The strongest cases combine quantitative evidence with contextual evidence explaining what changed and why the university’s research mattered.
Build the Evidence Trail Before You Need the Impact Report
Universities frequently lose good research-impact stories because evidence is collected too late.
By the time an institutional assessment, funding application or annual report asks for impact examples, emails have disappeared, project staff have moved and partners no longer remember exactly when an intervention was introduced.
A simple impact register can prevent this.
For significant projects, research offices can periodically capture:
- the original problem and intended users;
- major research outputs;
- external organisations engaged;
- documents showing adoption or implementation;
- relevant baseline information;
- measurable changes observed later;
- independent confirmation from beneficiaries or users;
- limitations affecting what can reasonably be claimed.
This does not require every academic project to become an administrative reporting exercise. Evidence collection should be proportionate to the expected significance and purpose of the research.
Five Research Impact Claims Universities Should Treat Carefully
“Our research reached millions of people.”
Potential audience is not the same as demonstrated reach, and reach is not the same as impact. Universities should identify how the number was calculated and what interaction actually occurred.
“Our research transformed industry practice.”
Which organisations changed their practice? What changed? When? What evidence connects the change to the research?
“Our study influenced government policy.”
A policy released after a study is not automatically evidence of influence. Stronger evidence may include citations in official documents, consultation records or confirmation from policymakers.
“This patent demonstrates research impact.”
A patent demonstrates an invention and a legal right. Commercialisation, licensing or implementation provides different evidence.
“Our researchers published in high-impact journals.”
This can be a useful academic signal, but the reputation of a journal should not automatically be presented as proof of the societal impact or quality of every article it publishes.
Research Impact Should Be Compared With the Right Benchmark
Universities should also resist turning impact measurement into another league table.
A theoretical mathematician, an education researcher, a biomedical laboratory and an architecture research centre can produce very different forms of value. Applying one universal impact score risks rewarding whatever is easiest to count rather than whatever is most significant.
Instead, institutions can establish evidence expectations by research purpose and discipline.
A policy project might prioritise documented policy influence. Applied engineering research might track implementation or commercialisation. Community-based research might examine changes experienced by a defined population. Fundamental research may appropriately place greater weight on academic contribution while recognising that wider impact could emerge much later.
Research Impact and Record Recognition Answer Different Questions
Universities should also distinguish research-impact assessment from awards, rankings, accreditation and record recognition.
Research impact asks whether knowledge produced by research contributed to meaningful change.
Record recognition asks whether a precisely defined achievement reached an exceptional and independently verifiable level.
A university might, for example, develop research that changes industry practice. That is an impact question. Separately, an institution might achieve an exceptional measurable milestone involving research participation, technology development, institutional scale or another precisely defined accomplishment.
Where a milestone is objectively measurable, universities can review Asia Record’s published verification criteria. Those criteria include measurability and verifiability, among other requirements.
An Asia record certification should therefore be understood as documentation of a specific qualifying achievement, not as evidence that an entire research portfolio is superior or that every research project produced societal impact. Keeping those categories separate makes both research-impact reporting and record recognition in Asia more credible.
A Practical Research Impact Checklist
Before publishing a major research-impact claim, university leaders and research offices can ask:
- Outcome: What changed outside the research project?
- Beneficiary: Who experienced or used that change?
- Baseline: What was happening before the research was applied?
- Pathway: How did the research reach the organisation or community concerned?
- Adoption: What evidence shows that somebody actually used the research?
- Contribution: How much of the outcome can reasonably be attributed or connected to the research?
- Verification: Is there independent evidence supporting the claim?
- Duration: Was the change temporary or sustained?
- Context: Would the same indicator make sense in this discipline?
- Limits: Has the institution clearly explained what the evidence does not prove?
Measure the Change, Not Just the Research Activity
Universities will continue to count publications and citations because both provide useful information. The mistake is assuming that the easiest indicators to collect are automatically the most important ones.
Strong research impact measurement follows the path from knowledge to use.
It asks what was produced, who encountered it, who adopted it, what changed afterwards and how confidently the institution can connect that change to the original research.
For Asian universities seeking stronger relationships with governments, communities, industry partners, funders and prospective researchers, that evidence can become one of the most credible demonstrations of institutional contribution.
The aim is not to turn every research project into a success story. It is to identify where research genuinely made a difference—and document that difference well enough that somebody outside the university can understand and verify it.