CSIRO adopts a number of mechanisms to monitor overall progress against its strategy, including reporting against ten Enterprise Strategy Measures (ESMs).
These measures are designed to provide evidence of our performance across four dimensions that are critical to the success of the CSIRO Strategy 2011–15:
- Impact: Delivering results with relevance and impact across areas of importance for Australia.
- Science: Performing high-quality science.
- People: Building and maintaining strong relationships with customers, partners, staff and other stakeholders.
- Resources: Effective resourcing of CSIRO’s activities.
A summary of actions taken and progress achieved against our ESMs is provided below.
Enterprise Strategy Measures results
ESM 1: Develop measures in 2011–12 for delivery of triple-bottom-line1 impact through evaluating realised benefits. Be recognised as one of the top three global applied science organisations by 2014–15 for impact delivery as measured against our 20 global peers2.
When compared against relevant impact related performance dimensions, CSIRO is within the top ten applied research organisations in the world.
Analysis of the use or impact of scientific knowledge in terms of citations, intellectual property and triple-bottom-line, suggests that CSIRO is on track to being in the top three applied science organisations globally by 2014–15 (see Figure 2.1).
In terms of impact of our science and scientific knowledge, the analysis suggests CSIRO is performing equal to or better than most of its global peers (Top three)3.
Normalised citation impact indicates that CSIRO is ranked second in the group of 20 nominated global peers4.
Our delivery of scientific solutions that contribute to significant economic, environmental and social impact for Australia in terms of scale and reach also places us in the top three when compared to global peers.
Analysis of the patent filings registered in the World Intellectual Property Database (WIPO) indicates that CSIRO has not yet reached the top three, but is ranked within the top ten due to it being Australia’s largest patent holder in 2012 (3,454 patents, 718 inventions and 281 trademarks) and 33 per cent of our patent families being the product of collaborative activity with external parties5.
Evidence of CSIRO's impact is demonstrated in the achievements in Program 1 – National Research Flagships, see Program 1.
ESM 2: Develop future impact pipelines for at least 80 per cent of the Flagships Portfolio by June 2012. Evaluate potential triple-bottom-line value for at least 50 per cent of the Flagship future pipeline by June 2013 and 80 per cent by June 2014. Deliver Flagships’ goals at a rate meeting or exceeding initial time-to-goal expectations.
Last year 89 per cent (8 of 9) of Flagships had articulated future impact pipeline including an evaluation of triple-bottom-line value.
This year this increased to 91 per cent (10 of 11 Flagships) (see Figure 2.2). The impact statements for these Flagships provide the basis for assessing future progress towards impact to ensure time-to-goal expectations are being refined and or achieved.
For more information about CSIRO’s impact project see Strategy progress.
Flagship future impact pipelines spanning financial years from 2011-12 through to estimated impact in 2014-15.
Data charted for the following financial years include:
- 2011-12: 89 per cent
- 2012-13: 91 per cent with evaluated potential triple bottom line impact target of 50 per cent
- 2013-14: impact pipeline including evaluated potential triple bottom line impact target of 80per cent
- 2014-15: impact pipeline target 100 per cent.
The chart also notes the total number of Flagships increased from 9 to 11 in 2012-13 financial year.
ESM 3: Baseline clients’ willingness to recommend in 2011–12 and improve our performance year-on-year over the strategy.
In a client satisfaction survey undertaken from 1 June 2012 – 31 May 2013, CSIRO was rated on average 8.5 out of 10 on ‘willingness to recommend’, indicating that the majority of clients are satisfied.
This year is the first year results have been reported for this measure. A baseline has now been set to assess performance for each remaining year of the strategy.
This strong result indicates CSIRO’s clients are willing to return to CSIRO in the future and similarly encourage their networks to do the same.
For more information on CSIRO’s client satisfaction survey under Program 1.
ESM 4: Increase community awareness of impact derived from CSIRO activities from the established baseline of 50 per cent in 2010–11 to 75 per cent by 2014–15.
In 2011, 40 per cent of Australians questioned in an online survey were able to name at least one contribution they believed CSIRO had made to their life.
In 2013, 38 per cent were able to name a positive contribution that they believed CSIRO had made to their lives6.
Responses by different segments of the community can be attributed to their different levels of receptiveness to science information (see Figure 2.3).
Using this segmentation analysis, CSIRO is able to undertake more targeted communication activities to reach the different segments with messages that most appeal to their values and preferred media channels.
Community awareness of impact derived from CSIRO activities displayed across six different categories, with an average of 38 per cent for the 2012-13 financial year and an average of 40 per cent for the 2011-12 financial year.
Community awareness data recorded is summarised in the following categories:
- Active interest in science: 59 per cent
- Interested but confused by science: 48 per cent
- Passive interest in science: 41 per cent
- Not interested in science and feel they know enough already: 38 per cent
- Not really interested in science: 25 per cent
- Not really interested in science and don't trust it 19 per cent
CSIRO's target for Community awareness for 2014-15 is 75 per cent.
ESM 5: Science quality is maintained or improved in Environment-Ecology, Agricultural Sciences, Plant and Animal Sciences, and Geosciences as measured through benchmarking against global peers (science productivity, citations per paper, collaboration). CSIRO maintains breadth in at least 14 fields in the top one per cent globally based on ISI/Thomson Reuters total citation data.
CSIRO is ranked in the top 0.1 per cent of global institutions in Plant and Animal Sciences; Agricultural Sciences; Environment and Ecology; and Geosciences (based on total citations).
In addition, CSIRO ranks in the top one per cent globally in a further 11 research fields. The total number of fields in which CSIRO is ranked within the top one per cent has increased from 14 last year to 15 this year, with the addition of Physics.
CSIRO also maintained its publication quality with its citation impact being 56 per cent better than the global average for the period 2008–12. CSIRO produced 5.9 per cent of Australia’s research publications, with Australia representing 3.6 per cent of global research publications, while maintaining a relatively high citation impact over this period.
CSIRO is also a major contributor to Australian publications, producing 21 per cent of Australian publication output in Agricultural Sciences; 18 per cent in Space Sciences; 17 per cent in both Environment/Ecology and in Geosciences; and 14 per cent in Plant and Animal Sciences.
For more information on CSIRO’s publication output and citation impact see Program 2.
ESM 6: Progress towards establishing precincts of global standing in the Plant and Agricultural Sciences, Resource Sciences, Environmental Sciences, Materials and Manufacturing Sciences and Human Life Sciences meets Precinct Development Plans by 2014–15.
Momentum continued to build across the National Innovation System for the establishment of precincts of global scale and standing.
The announcement of Industry Innovation Precincts by the Department of Industry, Innovation, Climate Change, Science, Research and Tertiary Education was a significant milestone as it included the Australian Manufacturing and Materials Innovation Precinct headquarters located at the CSIRO and Monash University-led Precinct in Clayton, Melbourne.
CSIRO will be a major partner in the Industry Innovation Precincts as they complement CSIRO’s Precincts and enable CSIRO to better engage with researchers, industry, government and the community.
For more information on CSIRO’s Precinct Program see Strategy-progress.
ESM 7: No fatalities or major injuries of CSIRO people. Lost time injury frequency rate (LTIFR)7 and medical treatment injury frequency rate (MTIFR)8 improves year-on-year and is in the top quartile of like organisations by 2014–15.
The LTIFR for 2012–13 was 4.9, in line with the 2011–12 performance. A nine per cent reduction in the incidence of physical injuries during the year was offset by a corresponding increase in reporting of mental stress and anxiety-related illnesses.
The increase in mental stress and anxiety related illness could be attributed to increased awareness among staff to report mental health illnesses that may have a work related component.
The MTIFR for 2012–13 was 7.8, higher than 2011–12. This marginally higher MTI frequency rate compared to the previous period was in part due to an increase in early intervention treatments for muscular skeletal injuries.
This early intervention approach is being actively encouraged to resolve and prevent muscular skeletal injuries from developing to a more disabling level (see Figure 2.4).
For more information see section on CSIRO’s Health and Safety program.
CSIRO's lost time and medical treatment frequency rates is graphed for each financial year by the number of incidents per million hours worked.
Lost time injury frequency rate (LTIFR) and medical treatment injury frequency rate (MTIFR) is shown to improve year-on-year and is summarised as follows.
| 2010-11 Baseline
ESM 8: Awareness of CSIRO’s Values increases year-on-year from the established baseline of 73 per cent in 2010–11 to 95 per cent in 2014–15.
Values awareness was not measured in 2012–13. However, during the year CSIRO continued to review responses to questions from the 2010–11 and 2011–12 survey to improve the application of our values in the Organisation (see Figure 2.5).
A survey will be undertaken in 2014 against which performance will be assessed.
Awareness of CSIRO Values is shown to increase from the baseline level of 73 per cent in 2010-11 to just over 80 per cent in 2012-13.
No assessment was undertaken in 2012-13, but a project target of 95 per cent has been graphed leading up to the 2014-15 financial year.
ESM 9: CSIRO’s financial, operating and capital management performance meets approved annual budget.
CSIRO’s financial, operating and capital management performance was within the approved annual budget.
CSIRO did not fully spend its capital budget due principally to a re-phasing of our major projects (the Marine Research Vessel, the Pawsey Centre, the Sustainable Energy for the Square Kilometre Array, the Australian Square Kilometre Array Pathfinder and the National Geosequestration Laboratory) which was approved by the Department of Finance and Deregulation resulting in a $39 million reduction in the capital expenditure envelope to $177.2 million.
ESM 10: Direct investment of CSIRO resources towards major national challenges and opportunities through the National Research Flagships increases to 65 per cent by 2014–15.
Indicative figures suggest that direct investment is above 48.6 per cent for the 2012–13 Financial Year (see Figure 2.6).
Direct investment of CSIRO resources in the National Research Flagships, actual and projected.
|Financial year||Actual (%)||Projected (%)|
- The triple-bottom-line refers to economic, social and environmental impacts.
- Refer to the glossary on page 196 for a table of the 20 global peers used in this comparison.
- Refer to the glossary on page 196 for a table of the 20 global peers used in this comparison.
- This analysis involves a combination of normalised citation measures from Thomson Reuters InCites, Scimago’s Institution Ranking and calculations based on Web of Science data and using the new Crown Indicator methodology. See glossary page 193 for more information.
- Patent co-operation treaty (PCT) applications data was only available from WIPO database for calendar year 2011 and 15 of the 20 peers. See glossary page 193 for more information.
- The segments that have identified an interest in science (i.e. segments 1: passive interest in science; 2: actively interested in science; and 3: interested but confused by scientific information) represent those community members who are more engaged in science and consequently more likely to be able to respond with knowledge of a positive contribution by CSIRO to their lives. Whereas the segments identified as not really interested (i.e. segments 4: not really interested in science; 5: not interested at all in science and do not much trust it; and 6: not interested in science and feel they know enough already, represent those members of the community that are less interested in science and consequently less likely to be able to respond with any knowledge of impact derived by a CSIRO activity to their lives.
- LTIFR is the number of incidents involving lost time from work greater than or equal to one full day or shift per million hours worked.
- MTIFR is the number of incidents requiring medical treatment (beyond first aid) per million hours worked.