Data availability and use
Inquiry report
Released 08 / 05 / 2017
This report offers guidance on where the benefits of greater data use may be most evident, and ways that governments might engage with the public to generate community understanding of the costs, risks, and benefits associated with data sharing and use.
This report was sent to Government on 31 March 2017 and publicly released on 8 May 2017.
Download the overview
Download the report
In the interest of focusing on matters essential to the outcomes favoured by the Report, some information from the Draft Report is not repeated in full in this Report. It nevertheless remains of relevance unless corrected or withdrawn in this Report. Read the draft report
- Key points
- Contents
- Extraordinary growth in data generation and usability has enabled a kaleidoscope of new business models, products and insights. Data frameworks and protections developed prior to sweeping digitisation need reform. This is a global phenomenon and Australia, to its detriment, is not yet participating.
- Improved data access and use can enable new products and services that transform everyday life, drive efficiency and safety, create productivity gains and allow better decision making.
- The substantive argument for making data more available is that opportunities to use it are largely unknown until the data sources themselves are better known, and until data users have been able to undertake discovery of data.
- Lack of trust by both data custodians and users in existing data access processes and protections and numerous hurdles to sharing and releasing data are choking the use and value of Australia's data. In fact, improving trust community-wide is a key objective.
- Marginal changes to existing structures and legislation will not suffice. Recommended reforms are aimed at moving from a system based on risk aversion and avoidance, to one based on transparency and confidence in data processes, treating data as an asset and not a threat. Significant change is needed for Australia's open government agenda and the rights of consumers to data to catch up with achievements in competing economies.
- At the centre of recommended reforms is a new Data Sharing and Release Act, and a National Data Custodian to guide and monitor new access and use arrangements, including proactively managing risks and broader ethical considerations around data use
- A new Comprehensive Right for consumers would give individuals and small/medium businesses opportunities for active use of their own data and represent fundamental reform to Australia's competition policy in a digital world. This right would create for consumers:
- powers comparable to those in the Privacy Act to view, request edits or corrections, and be advised of the trade to third parties of consumer information held on them
- a new right to have a machine-readable copy of their consumer data provided either to them or directly to a nominated third party, such as a new service provider.
- A key facet of the recommended reforms is the creation of a data sharing and release structure that indicates to all data custodians a strong and clear cultural shift towards better data use that can be dialled up for the sharing or release of higher-risk datasets.
- For datasets designated as national interest, all restrictions to access and use contained in a variety of national and state legislation, and other program-specific policies, would be replaced by new arrangements under the Data Sharing and Release Act. National Interest Datasets would be resourced by the Commonwealth as national assets.
- A suite of Accredited Release Authorities would be sectoral hubs of expertise and enable the ongoing maintenance of, and streamlined access to, National Interest Datasets as well as to other datasets to be linked and shared or released.
- A streamlining of ethics committee approval processes would provide more timely access to identifiable data for research and policy development purposes.
- Incremental costs of more open data access and use — including those associated with better risk management and alterations to business data systems — will exist but should be substantially outweighed by the opportunities presented.
- Governments that ignore potential gains through consumer data rights will make the task of garnering social licence needed for other data reforms more difficult. Decoupling elements of this Framework runs the risk of limiting benefits to, and support from, the wider public.
- Preliminaries - Cover, Copyright and publication detail, Letter of transmittal, Terms of reference, Disclosure of interests, Contents, Acknowledgments and Abbreviations
- Overview - including key points
- Findings and recommendations
- Chapter 1 Australia's data landscape
- 1.1 About the Inquiry
- 1.2 Why data matters
- 1.3 Stakeholders in data management and access
- 1.4 What is the current landscape for data sharing and release in the public sector?
- 1.5 What private sector data is collected, and to what extent is it made available?
- 1.6 The challenges for governments and society
- Chapter 2 Opportunities enabled by data
- 2.1 Opportunities for individuals
- 2.2 Opportunities for business
- 2.3 Benefits for society
- 2.4 Estimates of the value of data
- 2.5 The sum of opportunities
- Chapter 3 What holds us back?
- 3.1 Fragile community understanding and trust
- 3.2 Legislative complexity
- 3.3 Risk aversion and lack of leadership
- 3.4 Data breaches and re identification
- 3.5 Poor usability of data
- 3.6 There is scope for more effective use of business and consumer data
- Chapter 4 A way forward: what we must aim at
- 4.1 The world is changing, and Australia must adapt
- 4.2 A Framework
- 4.3 What outcomes is this Framework designed to achieve?
- Chapter 5 New competition policy — a right to use your data
- 5.1 Why give consumers new rights?
- 5.2 A Comprehensive Right for consumers
- 5.3 Actioning the right to transfer data
- 5.4 Institutional arrangements to support consumers in using their data
- 5.5 Comprehensive credit reporting
- Chapter 6 Sharing and releasing data for community benefits
- 6.1 A structure for future data release and widespread use
- 6.2 A National Data Custodian
- 6.3 Accredited Release Authorities
- 6.4 Trusted user models
- 6.5 Changes to data practices affecting researchers
- Chapter 7 Getting value from Australia's national interest datasets
- 7.1 High value datasets
- 7.2 Access to datasets of national interest
- Chapter 8 A modernised regulatory framework
- 8.1 The Data Sharing and Release Act
- 8.2 Actioning a scalable, risk based approach
- 8.3 Achieving a consistent approach
- 8.4 Implementing the Comprehensive Right
- 8.5 Streamlining regulatory responsibilities
- Chapter 9 Transformation and pricing decisions
- 9.1 Transformation and sale of private sector data
- 9.2 Transformation and sale of public sector data
- 9.3 Pricing of public sector data
- 9.4 Funding support for public sector data release
- Chapter 10 Implementing the new data Framework
- 10.1 Working with the community to maintain and enhance social licence
- 10.2 A collaborative effort: working with States and Territories
- 10.3 Implementation timeline
- 10.4 Ongoing priorities for governments
- 10.5 Finally, a word on leadership
- Appendix A Inquiry conduct and participants
- Appendix B What the Commission's framework can achieve
- Appendix C Australia's public sector data infrastructure
- Appendix D Australia's legislative and policy frameworks
- Appendix E Case Study: Health data
- Appendix F Case Study: Financial data
- Appendix G Case Study: Data from your Internet activities and intelligent devices
- References