The telerobotic rockbreaker controlled with a mixed reality user interface.
Controlling mines from a distance
CSIRO is developing remote operation systems for industry, such as a telerobotic rockbreaker for the mining industry.
- 31 May 2010 | Updated 14 October 2011
Within the next decade, integrated real-time knowledge will transform mining decision making and automation processes.
This will open the way to the mine of the future which will deliver significant benefits in productivity, safety and environmental factors.
Current activities
CSIRO is developing intelligent machines and systems that can be operated remotely – from a few metres away to anywhere in the world.
We are developing a common language framework and generic user interface so any machine or system can be run with the same user interface.
We are working on a 3-D immersive environment that feeds visual, audio and tactile information to the operators as if they were operating the machine on site in the conventional way. At the moment, remote operators have to deliberately look at many screens to gather this information.
The operator sees live video and a virtual world driven by real data.
In the virtual world colour can be used to convey information. For example, a load bearing column might change colour as the pressure on it increases, the operator only has to ‘select’ the column to get a numerical display.
Being a virtual world, operators can also position themselves anywhere. For example, they could float in mid-air and look back at the machine they’re operating.
Telerobotic rock breaking
Rock breaking traditionally involves on site operators spotting oversize rocks in ore bins with the naked eye and directing the hammer head to smash them.
Previous remotely operated rockbreakers used live video feeds from the site.
CSIRO has integrated augmented reality and virtual reality technologies with these video feeds to give greatly improved situational awareness creating a telerobotic rockbreaker.
Operators see additional information including virtual representations of the rocks and the ore bins. This information is displayed together with the video feed.
Sensors were fitted to the rockbreaker arm to determine its position. Cameras fitted to poles on either side of the ore bins deliver a three-dimensional image that allows operators to inspect the rock from different angles and determine the best position to strike the rock.
Outcomes
CSIRO’s remote operation technology aims to help achieve:
- increased safety
- improved productivity
- more efficient use of water and energy
- better prediction of the need for maintenance and repairs.
Partners
CSIRO is working on automation and remote operation technology with mining company Rio Tinto.
As reported in the March-April 2009 edition of earthmatters, Rio Tinto’s Head of Innovation, John McGagh, says Rio Tinto’s goal is to have a fully automated remotely controlled mine.
‘Our vision ... is deliverable but will take years, substantial R&D investment and a broad collaborative network involving original equipment manufacturers and leaders in automation,’ McGagh says.
‘CSIRO is an important contributor to our vision.’
Read more about how CSIRO is Delivering services through augmented reality.
