A whole of government Indigenous Evaluation Strategy

Speech

Commissioner Romlie Mokak delivered a speech for a NAIDOC event at the Institute of Public Administration Australia in Canberra on 2 July 2019.

Download the speech

Read the speech

Introduction

Today, I stand here on the lands of the Ngunnawal and Ngambri people. I am deeply grateful for the warmth and the generosity in allowing this country to be home for my family over the past 20 years. I honour your ancestors, your Elders and your young ones yet to come. I honour your sacred places and the wisdom and teachings held and shared in these places.

I aim to speak to two things today – NAIDOC and the Indigenous Evaluation Strategy.

NAIDOC theme — Voice, Treaty, Truth

This year’s NAIDOC brings into focus the theme of Voice, Treaty, Truth: let’s work together for a shared future. The NAIDOC theme, by definition, seeks for all Australians to work together to build our nation’s future. Voice, Treaty, Truth puts forward a proposition – to the Australian people – about a shared future.

These three elements from the Uluru Statement from the Heart speak to the call by Aboriginal and Torres Strait Islander people to have a greater say in their lives.

I quote:

When we have power over our destiny our children will flourish.

They will walk in two worlds and their culture will be a gift to their country.

We call for the establishment of a First Nations Voice enshrined in the Constitution….we seek a Makarrata Commission to supervise a process of agreement-making between governments and First Nations and truth-telling about our history.

In 1967 we were counted, in 2017 we seek to be heard.

NAIDOC week is a time to commemorate, as well as a time to celebrate. It is a time to remember and honour those who have come before.  To honour those who have worked tirelessly and endlessly for our benefit. NAIDOC week is a time to place our - Indigenous - knowledges, our cultures, our science, our strength, our achievements - at the centre.

NAIDOC invites you into this space – beyond raising flags, beyond exhibiting art, beyond consuming native foods. NAIDOC is not just about NAIDOC week. In fact the spirit of NAIDOC really is about what we do during those remaining weeks of the year.

25 years in policy

This week begins my 12th week at the Productivity Commission – it is still very much early days for me.

My road to the Commission has been traveled via community, state, Commonwealth and Indigenous organisations. From beginnings in the NSW public service 25 years ago as a junior policy officer in ageing and disability. To the Commonwealth Department of Health - working in Indigenous policy and program areas such as health inequality, substance use and financing.

For the past 14 years heading up national black organisations:

  • nine as CEO of the Australian Indigenous Doctors Association
  • the last five as head of the Lowitja Institute (Australia’s National Institute for Aboriginal & Torres Strait Islander Health Research).

The learning over these years - that those who are most invested and most impacted must not be assigned to policy render. They must also be designers, architects, builders and evaluators for impact and change.

Indigenous Evaluation Strategy

The Productivity Commission has been asked to develop a whole-of-government evaluation strategy to be used by all Australian Government agencies, for policies and programs affecting Aboriginal and Torres Strait Islander people.

The project will have three main components. The commission has been asked to:

  • establish a principles-based framework for the evaluation of policies and programs
  • identify priorities for evaluation
  • set out its approach for reviewing agencies’ conduct of evaluations against the strategy.

The commission has a broad remit to recommend changes to improve the use and conduct of evaluation in Australian Government agencies. This goes beyond guiding stakeholders during the commissioning and conduct of evaluations.

The evaluation strategy should also make recommendations on how evaluation and evidence-based decision making can be embedded into policy development and program delivery. The problems with existing evaluation practice that have motivated this project are not just that evaluations have been rarely or poorly conducted, but stem from the lack of influence of evaluation practice and results on policymaking.

It is clear that the value of evaluation will be limited in the absence of strong and sustainable mechanisms to feed evaluation findings, and Aboriginal and Torres Strait Islander knowledges, perspectives and priorities, into the policymaking process.

The evaluation strategy must cover both mainstream and Indigenous-specific policies and programs if it is to properly examine those that have most impact on, or potential benefit for, Aboriginal and Torres Strait Islander people.

We will make recommendations on how evaluation efforts should be prioritised, both within agencies and across the Australian Government.

Aboriginal and Torres Strait Islander peoples perspectives on what policies and outcomes matter most will be vital when identifying priorities for evaluation.

Early insights

Our project is in its early stages:

  • we will deliver a draft report in February next year
  • and a final report to government in around 12 months from now.

However early discussions around the country have provided insights into the challenges we may face when developing the strategy, and the areas where the strategy can add the most value. The dearth of evaluation of policies and programs affecting Aboriginal and Torres Strait Islander people has been well-documented. It is clear that evaluation practice in Australian Government agencies varies considerably.

Existing evaluation efforts are often narrowly focused rather than systematic, and many agencies do not publish evaluation reports in a timely manner (if at all). Aboriginal and Torres Strait Islander people and voices have been largely absent from evaluation design and conduct. Even where there has been leadership and considerable resources devoted, experience shows that changing the evaluation culture in government agencies is hard.

The then Department of the Prime Minister and Cabinet (now National Indigenous Australian agency) and the Department of Health are two agencies that have made inroads into better incorporating Aboriginal and Torres Strait Islander perspectives and priorities into their evaluation efforts.

Implementation matters, and considering likely implementation road blocks – such as capability and culture in agencies and service delivery organisations, data availability, and knowledge translation – will be a key considerations for the strategy.

We are also encountering many positive examples from outside government of how evaluation can be used to improve decision making and program implementation. We have much to learn from Aboriginal and Torres Strait Islander organisations – such as the Institute for Urban Indigenous Health (IUIH) in South East Queensland.

IUIH has been active in commissioning and conducting research and evaluation to build the evidence base on what works, and demonstrate its impact to the community and government.

Last week, we published an issues paper, which outlines some of the key questions we’d like your help to answer.

These include:

  • How can Aboriginal and Torres Strait Islander knowledges, priorities and values be better integrated into policy and program evaluation?
  • What principles should guide Australian Government agencies’ evaluation efforts?
  • What should be the priority policy areas for future Australian Government evaluation efforts?
  • How can evaluation results be better used in policy and program design and implementation?
  • What ongoing role should the Productivity Commission have in monitoring agencies’ implementation of the strategy, and in evaluating policies and programs affecting Aboriginal and Torres Strait Islander people more generally?

Further engagement

We are seeking submissions from interested parties between now and 23 August.

You can send us a written submission, make an oral submission or leave a brief comment on our website: www.pc.gov.au/indigenous-evaluation

In the second half of the year we will be engaging widely across Australia to inform the development of the strategy. We will travel to urban, regional and remote areas, to hear from individuals, groups and organisations.

We hope to hold a series of roundtable discussions on topics related to the evaluation strategy. This will be to draw on the experience and expertise of people and organisations who have been involved in evaluation or have insights into how policy making and program implementation can be improved.

In closing

As NAIDOC’s impact must surely go well beyond a single week in July.

So to a future Indigenous Evaluation Strategy must have value in a lasting way.

I invite each and every one of you to be an active part of the discussion, debate and design to make this a reality.

Speech

Chair Danielle Wood presented to the National Conference on University Governance.

Download the speech

Read the speech

Thank you everyone for the opportunity to speak tonight. I am honoured to stand on the land of the Wurundjeri people of the Kulin Nation and I pay my respect their elders past and present. I extend that respect to any Aboriginal and Torres Strait Islander people in the audience today.

I’m sure it’s something of a cruel and unusual punishment making you sit through a speech on productivity before you get your dessert. I hope I can convince you that productivity is its own treat, and a substantial one at that. As the Nobel Prize winning economist Robert Lucas said: ‘Once one starts to think about [economic growth], it is hard to think about anything else.’ 1

But beyond (hopefully) convincing you that productivity matters, I want to focus on the unique role of universities as engines of productivity. And I will issue a challenge: for universities to step up their own productivity performance so as to deliver more of the research and quality teaching Australia needs for us to thrive in coming decades.

Productivity – why do we care?

Productivity is about improving our living standards. If we can produce more goods and services using the same or fewer resources than before, that’s productivity growth.

And the effects of that growth over time are enormous.

In 1901 in Australia, it took 18 minutes of the average worker’s time to afford a standard loaf of bread. Today, it is just 4 minutes.’ 2

The productivity of our bread makers means that we can all consume a lot more bread – or for the carb conscious – spend that extra bread money elsewhere.

But it’s not just bread production that’s been revolutionised.

A theatre ticket cost an average worker 321 minutes of work in 1901. Today it’s 62. A bicycle? 473 hours in 1901 down to just 6 hours today.

And to put even today’s very real concerns about rental costs into perspective: the typical Australian worked 9 hours a week to afford a rental in 2019 but 20 hours in 1901.

Wherever you look, productivity progress has improved our capacity to deliver the goods and services that we value.

That productivity growth has seen real per person incomes improve by more than 700% since Federation, while giving us an extra 13 hours a week to ourselves.’ 3

Australians are better off due to rising productivity

But here let me engage with a common argument dismissing the importance of productivity. According to the doubters, this economic growth might deliver more ‘stuff’ but does not deliver better lives or improved wellbeing.

I would mostly disagree. It is certainly true that economic growth won’t tuck your kids into bed at night, but it has delivered at lot more than just extra bread or bicycles.

Growth is correlated with so many of the things we care about: longer, healthier lives, better education, more and more varied leisure time, and better and more stable political institutions.

Many of these things are supported by growth but they also support growth themselves. As I’ll explain shortly, this is very much the case with education.’ 4

That’s why it’s not surprising that richer countries tend to have higher average life satisfaction’ 5 and that those countries that experience sustained economic growth tend to see their average levels of satisfaction increase over time.’ 6

That said, economists recognise that growth is not a measure of everything we care about. Some things are hard to measure well, like the quality of care services. And important determinants of wellbeing like community involvement and quality of relationships are missed all together.

But no one can or should deny that growth matters.

Houston, we have a (productivity) problem

I don’t need to tell this audience that Australia’s recent productivity performance hasn’t been much cause for celebration.

Productivity went on a roller coaster ride during COVID.

We’ve been on a wild ride lately. Labour productivity (index, 2021 = 100) between December 2003 and December 2023

In the first two years of the pandemic, productivity rose strongly. This counterintuitive result was primarily because social distancing restrictions reduced hours worked the most in the lower-productivity services sectors.

But this productivity ‘bubble’ was in no way sustainable. After the end of restrictions in 2022, working hours expanded again in these sectors and pushed productivity in the opposite direction. The bubble burst.

The strong performance of the labour market through much of 2022 and 2023 has also put downward pressure on productivity during this period.

Now let me be totally clear: strong labour markets are great. But the surge in hours worked in the COVID recovery (coming from increased participation, lower unemployment and the re-opening of borders) was both quick and large. The capital stock has not kept up. The historical decline in the amount of capital per worker, has dragged on productivity because each worker has less capital – fewer or less efficient tools and resources – to help them do their jobs.’ 7

In some ways, the economy is like the cobra swallowing the ‘rat’ of the COVID shock. It will digest it, but it will take some time.

But this begs the question: what is the economy recovering to?

Even before our COVID rollercoaster, all was not well.

In the decade sandwiched between the GFC and COVID, Australia’s annual productivity growth averaged just 1.1% – the lowest of the last 6 decades and well below its 60-year average.

Australia’s productivity growth pre-COVID was slowest in 60 years. Average labour productivity by 10- and 60-year periods

This slowdown in productivity growth is not just an Australian phenomenon.

This is not just an Australian phenomenon. Labour productivity growth in OECD countries

Almost every OECD country experienced a substantial decline in labour productivity in the 15 years prior to COVID, compared to the previous 15. Across the OECD, labour productivity growth halved in this period.

A range of credible explanations have been put forward to explain why: growth in the lower productivity services sector, declining gains from education, a smaller contribution from technological change, reduced economic dynamism, and increased risk aversion by business and capital owners.

But what I want to focus on here are two that are most relevant to our universities: declining gains from education and declining contribution from innovation. And then I want to address how the people in this room can help turn them around.

Universities are a powerful engine for productivity

Universities contribute a huge amount to our intellectual, social and cultural lives. But you’ve an invited an economist tonight so I’m naturally going to talk about the ways in which universities contribute to our long-term productivity performance.

There are, I think, three major channels:

  • through building the skills and capacity of our future workforce – the so called ‘human capital’ of our population
  • by generating and disseminating the research and ideas that lead to better processes and new and improved goods and services, and
  • through building ties, understanding and goodwill with people from other nations, which contributes to ongoing integration – whether through trade, investment or the flow of ideas.

Tonight, I’m going to focus on the first two.

Boosting human capital

Let me start with the fundamental role that universities play in educating the population.

In the past 30 years, education levels across the Australian population have soared.

Our high - and growing - education rates are a source of strength. Higher education attainment rate for ages 25-34, bachelor degree or higher, 1982 to 2022

In the early 1980s, about one in ten 25–34-year-olds had a held a university qualification. Today, it’s 45%.’ 8

Part of this increase has been driven by a strong migration program that has encouraged skilled migrants to settle on our shores.’ 9 But it points as well to a large and sustained expansion in the number of Australians going to university.

Annual domestic student course completions have more than doubled since 1989, with nearly 140,000 students finishing a bachelor’s degree in 2021 and 87,000 finishing post-graduate study.’ 10

The resultant improvement in ‘labour quality’ has played an important role in productivity growth – particularly as other contributors have stalled.

Human capital is important for productivity growth. Factors accounting for labour productivity growth since 1994-95

University degrees are associated with better employment outcomes and higher earnings over people’s lifetimes – even after adjusting for individuals’ characteristics.’ 11

Although the graduate premium is in decline,’ 12 it is still significant across the lifetime.

Educated workers tend to work and get paid more. Employment outcomes (LHS), and average expected hourly wage (RHS), by education

Higher levels of education in our working population improves wages and productivity through a few channels.

Most obviously, it improves the skills and abilities of our future workforce.

People who hold a tertiary qualification have higher cognitive performance than others their own age, even when you control for the fact that clever people tend to go on to study at higher levels. 13

Perhaps just as importantly, people with a higher education are more likely to do on-the-job training when they’re in the workforce – they’ve learned how to learn. 14 And there’s evidence going to university improves your non-cognitive skills, like sociability and your ability to cooperate or work in a team. 15

Education also improves people’s capacity to innovate. Increases in the supply of educated workers and managers leads to greater direct innovation by firms. Those educated workers are also more likely to adopt new innovations from elsewhere. 16

This link between education and an innovation mindset is critical if we are to supercharge the productivity upside from education, a point I will return to.

There are still gains to be eked out from expanding Australians’ access to higher education, despite the huge expansion over recent decades.

As the Productivity Commission noted in our 2023 Productivity inquiry, there is no evidence that we have reached the point where the cost of education for marginal workers outweighs the benefit received by them and by society. 17

According to Jobs and Skills Australia, more than 9 out of 10 new jobs will require a post-school qualification over the next decade, and around 50% will require a bachelor's degree. 18

Almost all new jobs need a tertiary qualification. Employment projections over five years to November 2026

The recent Universities Accord argued governments should continue to promote participation in university and vocational education and set ambitious targets for governments to boost attainment rates by 2050.

The benefits of higher education are why the PC has supported a return to a system of uncapped demand driven funding. 19

But even with this potential upside, the huge ramp up in the education levels of the population will not be repeated. This means the contribution of gains from the quantity of education in the productivity numbers is likely to be more subdued in coming decades than in the previous ones.

This brings the quality of education into even sharper focus.

Education quality: levelling up

Improving education quality means improving outcomes for students for a given level of investment.

Which begs the question: how are we currently faring?

As already mentioned, university graduates have good labour market outcomes over the medium term compared with those who acquire skills via VET or school alone, even after adjusting for student characteristics.

Australian universities also perform well overall on student-assessed measures of quality. Indeed, the average university brings home a 76% – just scraping through with a distinction – on overall experience for undergraduate students. 20 On assessed teaching quality, it’s 80% – a solid mark. 21

Student Experience Survey (QILT), 2021

Further, on measures of employer satisfaction, overall satisfaction with graduates sits just below 84% and has remained strong over time. 22

But there are reasons to be vigilant.

Despite the relatively strong average student-assessed quality scores, there is a fair degree of variation across institutions.

There is also stickiness in the outcomes data, suggesting a lack of course correction. Measured over a 4-year period, the universities that start with the highest share of students nominating their quality as ‘excellent’ tend to stay excellent, while those with the lowest shares also tend to stay at the bottom.

The good stay good, the mediocre stay mediocre. Universities with the highest and lowest shares of students saying overall quality is ‘excellent’, 2017 to 2021

Employer satisfaction scores, while high overall, are stronger for foundational and technical skills than broader job skills like collaboration and adaptation. 23

And employers report much lower levels of satisfaction with the collaboration skills of graduates who study entirely remotely. 24 This matters because these ‘social skills’ are increasingly demanded by employers as a complement to technical skills. 25

More generally we need to consider the impact of online course delivery for student learning. The shift to online adds convenience and flexibility for students, but it comes with risk to quality.

Measures of learning engagement dropped when the pandemic hit our shores, and have not recovered since. 26

We may have jumped many of the initial hurdles to hybrid learning during those chaotic months of shutdowns, but not everyone has yet nailed the challenge of how to do online delivery well. A sea of blank Zoom screens is not ideal for either students or teachers.

More broadly, the Productivity Commission has noted the lack of direct incentive for teachers and universities to improve teacher quality.

We’re used to looking at star ratings when we book a hotel or a restaurant, but prospective students often don’t have good data when choosing between courses. 27

This lack of visibility combines with other factors – a general sense that teaching hold less prestige than research, government funding settings that fail to reward quality, and a lack of external oversight – to weaken the incentives for delivering the best teaching. 28

Of course, there are non-pecuniary incentives for individuals and institutions to teach well. And indeed, intrinsic motivations for excellence continue to steward high quality and innovative teaching practices at our universities.

But that is not enough to ensure that every teacher is delivering at a high standard.

The PC has put forward a range of recommendations for change. An important one is making lecture and course materials publicly available. Letting the public see behind your high walls would sharpen the incentives for quality teaching, allow students to make better decisions around what courses might match their interests and assist in lifetime learning – giving those not looking for an accreditation access to an endless supply of learning opportunities. 29

We need to ensure that teaching excellence is at the heart of our universities if we are going sustain the big improvements in quality needed for future productivity gains.

Promoting innovation

I want to turn now to another critical way in which universities impact our prosperity – in their role as vectors for innovation.

It is technological change that drives most productivity improvements over time. 30 And it is ideas that make technological change possible.

Economics Professor Daniel Susskind has argued that asking ‘how do we generate more growth?’ is essentially the same as asking ‘how do we generate more ideas?’.

And what are universities if not factories for ideas? 31

It is worth remembering that when we talk about ideas we are not just talking about the novel, frontier research that some of your researchers might be engaged in. ‘New to the world innovation’ is only around 1-2% of Australia’s innovation story. Diffusion – the application of existing knowledge to different businesses and contexts – is a crucial part of the innovation puzzle. 32

‘Innovation for the 98%’ must also be a focus of research efforts and graduate skills sets.

Universities spend more than they used to on research activity. Total university research expenditure has increased five-fold since the early 1990s – although growth has slowed somewhat in recent years.

Spending on research is up since the 90s, but growth slowed in the past decade. Total higher education research expenditure, 1992 to 2022, $billions, 2022 dollars

This ramp up in spending over the past three decades is repeated across much of the developed world. But it has not generated the ideas boom we might have hoped.

For example, if we turn to the US, we can see the number of people employed in research roles has grown 23-fold since the 1930s – a huge expansion in research effort. 33

But measured by the economic outputs of this research – the expansion in total factor productivity across the economy – the productivity of that research has declined 41-fold – or a growth rate of minus 5.1% per year on average. 34

Are ideas getting harder to find?

This tale of more and more effort and for less and less return has played out across a range of innovation areas.

Take Moore’s Law: the tendency for the number of transistors fitted onto an integrated circuit to double every two years. It is, on the face of it, a remarkable testament to our capacity for innovation. But the number of researchers required to bring about this result has grown to be 18 times higher than it was in 1971. 35

Agricultural crop yields are improving at a relatively constant or slightly declining rate, but the number of agricultural researchers required to achieve this has doubled. 36

In drug discovery, the number of new drugs approved per billion on R&D halves every nine years or so, in a phenomenon that has been dubbed ‘Eroom’s Law’: Moore’s law spelled backwards. 37

At the heart of the slowdown in research productivity is that researchers inevitably solve the easier problems first – making gains harder once the lowest hanging fruit has been picked. Indeed, being ‘Better than the Beatles’ is a challenge that confounds across so many research areas. 38

But even noting this difficulty, there is still scope to improve the productivity of the research process in ways that could help generate and diffuse new ideas.

Australia is unusual in that university-led research makes up a relatively large percentage of our R&D expenditure. 39

As a share of GDP, our universities chip in more for research and development than universities in the US and Korea, and we’re well above the OECD average. 40

The good news is that our university research is top notch on academic metrics.

Despite our small population, we have the fifth highest number of highly citied researchers in the world. 41 And 84% of our research is rated at or above world standard. 42

We punch above our weight on research citations. Countries’ world share of ‘highly cited researchers’, 2023

Australian researchers also are more likely than those in the US or the EU to collaborate with international scholars, allowing us to ‘hoover up’ good ideas from overseas and apply them at home. 43

But there’s more we need to do.

There is a widely held view that Australian business collaboration with universities is poor. The perception is backed up in the numbers: data from the ABS suggests less than 10% of innovating firms got their ideas from universities between 2019 and 2021. 44

As much as policy makers say they want universities and business to ‘talk more’, clearly the incentives aren’t there to bring everyone to the table.

The Accord recognised the importance of nationally-relevant research in its recommendation for a new ‘Solving Australian Challenges Fund’ which would reward universities that apply their research capabilities to meeting Australia’s ‘big national challenges’. 45

Even where research turns up potentially useful ideas for Australian businesses or policy makers, we could do more to put them into practice.

Governments have long grappled with reducing barriers to research commercialisation – such as IP licencing and academic-spin offs or joint ventures – only partially successfully.

But the PC’s found we should be doing more to encourage knowledge transfers by encouraging labour mobility between industry and academia, and even by promoting joint conferences and networking events.

We can also help businesses tap into the experience and knowledge of academic researchers by reducing barriers to academic consulting, which is too often held up by administrative roadblocks. 46

There is also more to do on the productivity of the ideas generation process itself.

Long and expensive processes for grants can reduce ‘bang for buck’ and slow the research process.

US research on the peer-reviewed grant-making process concluded that the ‘tax’ of application processes may be up to 45% of researcher time. Further, these processes can skew or bias research efforts in a number of ways: towards more incremental research with a higher likelihood of surviving review than riskier or novel research; against interdisciplinary research; and towards researchers with a history of successful applications. 47

Certainly it does not take long for a conversation with Australian academics to degenerate into a similar set of complaints.

The recent Accord process suggested universities be paid for the indirect costs of applying for nationally competitive research grants, 48 and the Australian Research Council recently took the positive step of introducing an Expression of Interest round to its Discovery grant applications. 49

Future work may be necessary to explore alternative models like ‘science lotteries’ to continue tackling these challenges. 50

Where to from here?

I realise tonight I am speaking to a sector working through significant upheaval.

The COVID shock – the rollercoaster ride of closing and then reopening international borders with flow on effects for international student numbers – was obviously hugely challenging. Universities are on the frontline of a major technological change with the shift to online teaching and the growing adoption of generative AI in both learning and research.

Those challenges have been amplified by big and disruptive policy changes over a short period: first with the Jobs Ready Graduates package, then a suite of regulatory reforms to student migration settings, 51 and now the proposal for international student caps.

The Universities Accord process, a generally more constructive policy exercise, is also starting to flow through to policy. But it has raised fundamental questions about the university business model and the extent to which we can continue to rely on international student revenue to ‘cross subsidise’ research activity.

I am here tonight to say the payoff from getting the policy settings and the internal culture right are high. Universities hold in their hands two crucially important ingredients for national productivity: the skills of our labour force and the generation and diffusion of ideas.

Gains in both of these areas are becoming harder to come by. That might naturally push you to look for more resources. But I’m here to encourage you to also look for improvements via productivity at home.

Promoting teaching excellence, widely sharing learning, supporting research with Australian impacts and empowering students with an innovation mindset are just some of the ways in which Australia’s universities can shape a more productive future for Australia.

Footnotes

  1. Lucas RE Jr 1988, On the mechanics of economic development, Journal of Monetary Economics, Vol. 22, Issue 1, p.5. Return to text
  2. Productivity Commission 2023, 5-year Productivity Inquiry: Keys to growth, Vol. 2, Inquiry Report no. 100, Canberra, p. 6. Return to text
  3. Ibid., p.17. Return to text
  4. Susskind D 2024, Growth: A Reckoning, Penguin Books, United Kingdom. Return to text
  5. Sacks, D, Stevenson, B & Wolfers, J 2010, Subjective Well-being, Income, Economic Development and Growth, NBER Working Paper, No. 16441, October. See also Ortiz-Ospina, E. & Roser, M. 2013, Happiness and Life Satisfaction, Our World in Data, https://ourworldindata.org/happiness-and-life-satisfaction, (updated February 2024; accessed October 2024). Return to text
  6. Ortiz-Ospina, E & Roser, M 2013, Happiness and Life Satisfaction, Our World in Data, https://ourworldindata.org/happiness-and-life-satisfaction, (updated February 2024; accessed October 2024). Return to text
  7. Productivity Commission 2024, Quarterly Productivity Bulletin – June 2024, 27 June, Canberra. Return to text
  8. ABS 2023, Education and Work Australia, Table 35. Return to text
  9. See Norton, A 2023, Mapping Australian Higher Education 2023, ANU Centre for Social Research and Methods, for a discussion. Return to text
  10. Ibid., p.52. Return to text
  11. See Productivity Commission 2023, 5-year Productivity Inquiry: From Learning to Growth , Vol. 8, Inquiry Report No. 100, Canberra, pp.4-6, for a discussion of literature and controlling for cofounders. Return to text
  12. Brennan, M 2022, Productivity, Migration and Skills , ‘Rebuilding Australia’s Future’, Universities Australia Conference, delivered 7 July. Return to text
  13. Productivity Commission 2023, 5-year Productivity Inquiry: From Learning to Growth , Vol. 8, Inquiry Report No. 100, Canberra, pp.4-6. Return to text
  14. Ibid. Return to text
  15. Ibid. Return to text
  16. Ibid. Return to text
  17. Ibid, p. 3. Return to text
  18. Jobs and Skills Australia 2023, Towards a National Jobs and Skills Roadmap: Annual Jobs and Skills Report 2023 , Australian Government, October, p.18. Return to text
  19. Productivity Commission 2023, 5-year Productivity Inquiry: From Learning to Growth , Vol. 8, Inquiry Report No. 100, Canberra, Recommendation 8.4, p. 64. Return to text
  20. Quality Indicators for Learning and Teaching (QILT) 2023, 2022 Student Experience Survey , Department of Education, Table 1. Return to text
  21. Quality Indicators for Learning and Teaching (QILT) 2023, 2022 Student Experience Survey , Department of Education, Figure 1. Return to text
  22. Quality Indicators for Learning and Teaching (QILT) 2024, 2023 Employer Satisfaction Survey , Department of Education, Figure 1. Return to text
  23. Ibid., Table 3. Return to text
  24. Ibid. Return to text
  25. Brennan, M. 2022, Productivity, Migration and Skills , ‘Rebuilding Australia’s Future’, Universities Australia Conference, delivered 7 July. Return to text
  26. Quality Indicators for Learning and Teaching (QILT) 2023, 2022 Student Experience Survey , Department of Education, Figure 1. Return to text
  27. The PC recommended QILT data be refined and made more salient for prospective students. Productivity Commission 2023, 5-year Productivity Inquiry: From Learning to Growth , Vol. 8, Inquiry Report no. 100, Canberra, Recommendation 8.9, p. 111. Return to text
  28. Ibid., pp. 97-101. Return to text
  29. Ibid., Recommendation 8.9, p. 111. Return to text
  30. Williamson et al. 2015, Technology and Australia’s Future: New Technologies and their Role in Australia’s Security, Cultural, Democratic, Social and Economic Systems , Australian Council of Learned Academies. Return to text
  31. Susskind D 2024, Growth: A Reckoning , Penguin Books, United Kingdom, p.177. Return to text
  32. Productivity Commission 2023, 5-Year Productivity Inquiry: Innovation for the 98% , Vol. 5, Inquiry Report no. 100, Canberra. Return to text
  33. Bloom et al. 2020, Are Ideas Getting Harder to Find? , American Economic Review, Vol. 110, No. 4, pp. 1104-1144. Return to text
  34. Ibid. Return to text
  35. Ibid. Return to text
  36. Ibid. Return to text
  37. Scannell et al. 2012, Diagnosing the Decline in Pharmaceutical R&D Efficiency , Nature Reviews Drug Discovery, Vol. 11, No. 3, pp. 191-200. Return to text
  38. Ibid. Return to text
  39. O’Kane, M. et al. 2024, Universities Accord: Final Report, Australian Government, Figures 30 and 31. Return to text
  40. Ibid. Return to text
  41. Ibid, p.192. Return to text
  42. Ibid. Return to text
  43. Ibid. Return to text
  44. Productivity Commission 2023, 5-year Productivity Inquiry: From Learning to Growth , Vol. 8, Inquiry Report no. 100, p.49. Return to text
  45. O’Kane, M. et al. 2024, Universities Accord: Final Report, Australian Government, p. 299 Return to text
  46. Productivity Commission 2023, 5-Year Productivity Inquiry: Innovation for the 98% , Vol. 5, Inquiry Report no. 100, Canberra, Recommendation 5.4, pp. 50-52. Return to text
  47. See Sharma, I. et al. 2022, Piloting and Evaluating NSF Science Lottery Grants: A Roadmap to Improving Research Funding Efficiencies and Proposal Diversity , Institute for Progress, 2 February, for a summary. Return to text
  48. O’Kane, M et al. 2024, Universities Accord: Final Report, Australian Government, p. 216-217. Return to text
  49. Australian Research Council 2023, Discovery Projects Scheme: Two-stage Application Process , 30 October, https://www.arc.gov.au/news-publications/media/feature-articles/discovery-projects-scheme-two-stage-application-process (accessed October 2024). Return to text
  50. Sharma, I et al. 2022, Piloting and Evaluating NSF Science Lottery Grants: A Roadmap to Improving Research Funding Efficiencies and Proposal Diversity , Institute for Progress, 2 February. Return to text
  51. Norton, A. 2024, Australia made 9 changes to student migration rules over the past year. We don’t need international student caps as well , The Conversation, August 5. Return to text