Sharechat Logo

Measuring public science by dollar value alone 'stupid', says top science adviser

Tuesday 26th April 2016

Text too small?

Measuring taxpayer-funded investment in science using a simple dollar value approach is "stupid", says Motu economist Adam Jaffe, who is welcoming a new government big data project to allow richer measurements in the future.

The Ministry of Business, Innovation & Employment was embarking on a process to create a "government-wide data infrastructure" which would make it easier to track the public science effort Jaffe said at the Future for Scientists in New Zealand conference at Wellington's Te Papa this morning. Jaffe, a globally recognised expert on innovation policy, is a director at Motu and sits on MBIE's science board. 

"The idea is the government is going to track, across all government-funded agencies for research, all research proposals, the people involved with them, and basic data about each of those research investments," Jaffe said. "They're going to create the fundamental baseline of data, which means that over time researchers can come along and say how would we measure the impact of that project?"

There were multiple ways of measuring the impacts of such projects, varying from direct measures such as revenue to proxy measures such as investment in the same product from private firms, he said. However, as a researcher, Jaffe said if he was looking to track a programme's impact years later he would need to be able to find the people involved and MBIE's proposed infrastructure would enable this. 

Impact shouldn't be reduced to a simple dollar value, Jaffe said. 

"The goal should not be to say that the government's rate of return on the $1.5 billion dollars they spent last year was 4.6 percent - or some other number, I've made that up. That's a stupid way to think about assessing the impact of research, because what we're trying to do is inherently and intrinsically multi-dimensional," he said.

"The only way to keep track of intrinsically multi-dimensional impacts is to recognise there are multiple impacts. You're not going to be able to add them together, you're not going to be able to say we did this much improvement of public policy and this much enhancement of capability," Jaffe said. "That shouldn't be the goal, and the fact you can't do that doesn't mean you can't evaluate the impact."

Earlier in the day, Minister of Science and Innovation Steven Joyce said the government was developing "more easily accessible information" on science, including the people, institutions and funding involved.

"This is will enable us all to make more intelligent investments, continually raise the bar on performance, and make the best use of public money," Joyce said in notes for his speech.

  General Finance Advertising    

Comments from our readers

No comments yet

Add your comment:
Your name:
Your email:
Not displayed to the public
Comments to Sharechat go through an approval process. Comments which are defamatory, abusive or in some way deemed inappropriate will not be approved. It is allowable to use some form of non-de-plume for your name, however we recommend real email addresses are used. Comments from free email addresses such as Gmail, Yahoo, Hotmail, etc may not be approved.

Related News:

House price inflation ticks higher as sales volumes recover
Fletcher in $31 mln dispute with ministry over Greymouth hospital
NZ dollar eases as markets fret about US-China trade talks
15th October 2019 Morning Report
CTU pressures govt for Fair Pay Agreements
NZ Rugby not ready for a seat at Sky board table
MARKET CLOSE: NZ shares gain; Sky soars on NZ Rugby deal
NZ dollar falls ahead of inflation data
F&P Healthcare shares hit record on improved guidance
Bounce in international guest nights some reprieve for slowing tourism sector

IRG See IRG research reports