View all news

Humanoid robot that sees and maps

Roboray

Roboray Samsung Advanced Institute of Technology

Press release issued: 1 July 2013

Computer vision algorithms that enable Samsung’s latest humanoid robot, Roboray, to build real-time 3D visual maps to move around more efficiently have been developed by researchers from the University of Bristol.

By using cameras, the robot builds a map reference relative to its surroundings and is able to “remember” where it has been before. The ability to build visual maps quickly and anywhere is essential for autonomous robot navigation, in particular when the robot gets into places that have no global positioning system (GPS) signals or other references.

Roboray is one of the most advanced humanoid robots in the world, with a height of 140 cm and a weight of 50 kg. It has a stereo camera on its head and 53 different actuators including six for each leg and 12 for each hand.

The robot features a range of novel technologies.  In particular it walks in a more human-like manner by using what is known as dynamic walking.  This means that the robot is falling at every step, using gravity to carry it forward without much energy use. This is the way humans walk and is in contrast to most other humanoid robots that “bend their knees to keep the centre of mass low and stable”. This way of walking is also more challenging for the computer vision algorithms as objects in images move more quickly.

The Bristol team, who have been collaborating with Samsung Electronics in South Korea since 2009, was in charge of the computer vision aspects of 3D SLAM (simultaneous localisation and mapping). 

Dr Walterio Mayol-Cuevas, Deputy Director of the Bristol Robotics Lab, Reader in the Department of Computer Science at the University of Bristol and leader of the team, said: “A humanoid robot has an ideal shape to use the same tools and spaces designed for people, as well as a good test bed to develop machine intelligence designed for human interaction.

“Robots that close the gap with human behaviours, such as by featuring dynamic walking, will not only allow more energy efficiency but be better accepted by people as they move in a more natural manner.”

Dr Sukjune Yoon from the Samsung Advanced Institute of Technology (SAIT), speaking about the collaboration with the University of Bristol, said: “Bristol’s visual SLAM and their other real-time visual technologies have been very beneficial for Samsung Electronics’ humanoid robot project.

“Mapping in real-time for a biped humanoid is much harder than for wheeled vehicles not only because there is less constant contact with the ground.  In the near future, it is expected that humanoid robotic technologies will be able to provide a valuable service to society with robots working alongside people.”

The technology of rapid 3D visual mapping, developed at Bristol, is internationally renowned because of its ability to robustly track and recover from rapid motions and occlusions, which is essential for when the humanoid moves and turns at normal walking speeds. This Bristol work has been used for a number of applications outside robotics too, from augmented reality to commercial applications in the analysis of wearable Gaze data.

A paper describing some aspects of this collaboration with Samsung is published in the journal Advanced Robotics

Paper: Real-time 3D simultaneous localization and map-building for a dynamic walking humanoid robot, Yoon, Sukjune, Seungyong Hyung, Minhyung Lee, Kyung Shik Roh, SungHwan Ahn, Andrew Gee, Pished Bunnun, Andrew Calway, and Waterio W. Mayol-Cuevas, Advanced Robotics, published online ahead-of-print, Volume 27, Issue 10, 2013.

 

Further information

The University of Bristol team who have worked on the project include Drs Pished Bunnun, Andrew Gee, Jose Martinez-Carranza and Andrew Calway, and leader of the project, Dr Walterio Mayol-Cuevas, Deputy Director of the Bristol Robotics Lab and Reader in Robotics, Computer Vision and Mobile Systems in the Department of Computer Science at the University of Bristol.

About the Bristol Robotics Lab (BRL)

The BRL is a collaborative research partnership between the University of Bristol and UWE Bristol (the University of the West of England). It carries out cutting edge research programmes focused on the development of autonomous robot systems. The BRL’s vision is to transform robotics by pioneering advances in autonomous robot systems through the elucidation of the underpinning mechanisms required to create robot systems, which behave intelligently without human supervision.