New Protocols Enable Robots to Cooperate with One Another on Complex Jobs Using Body Language

Sometimes all it takes to get help from someone is to wave at them, or point. Now the same is true for robots. Researchers at KTH Royal Institute of Technology in Sweden have completed work on an EU project aimed at enabling robots to cooperate with one another on complex jobs, by using body language.

Dimos Dimarogonas, an associate professor at KTH and project coordinator for RECONFIG, says the research project has developed protocols that enable robots to ask for help from each other and to recognize when other robots need assistance — and change their plans accordingly.


"Robots can stop what they're doing and go over to assist another robot which has asked for help," Dimarogonas says. "This will mean flexible and dynamic robots that act much more like humans — robots capable of constantly facing new choices and that are competent enough to make decisions."

As autonomous machines take on more responsibilities, they are bound to encounter tasks that are too big for a single robot. Shared work could include lending an extra hand to lift and carry something, or holding an object in place, but Dimarogonas says the concept can be scaled up to include any number of functions in a home, a factory or other kinds of workplaces.

In a series of filmed presentations, the researchers demonstrate the newfound abilities of several off-the-shelf autonomous machines, including NAO robots. One video shows a robot pointing out an object to another robot, conveying the message that it needs the robot to lift the item.

Dimarogonas says that common perception among the robots is one key to this collaborative work.

"The visual feedback that the robots receive is translated into the same symbol for the same object," he says. "With updated vision technology they can understand that one object is the same from different angles. That is translated to the same symbol one layer up to the decision-making — that it is a thing of interest that we need to transport or not. In other words, they have perceptual agreement."

In another demonstration two robots carry an object together. One leads the other, which senses what the lead robot wants by the force it exerts on the object, he says.

"It's just like if you and I were carrying a table and I knew where it had to go," he says. "You would sense which direction I wanted to go by the way I turn and push, or pull."

The important point is that all of these actions take place without human interaction or help, he says.

"This is done in real time, autonomously," he says. The project also uses a novel communication protocol that sets it apart from other collaborative robot concepts. "We minimize communication. There is a symbolic communication protocol, but it's not continuous. When help is needed, a call for help is broadcast and a helper robot brings the message to another robot. But it's a single shot."

Featured Product

3D Vision: Ensenso B now also available as a mono version!

3D Vision: Ensenso B now also available as a mono version!

This compact 3D camera series combines a very short working distance, a large field of view and a high depth of field - perfect for bin picking applications. With its ability to capture multiple objects over a large area, it can help robots empty containers more efficiently. Now available from IDS Imaging Development Systems. In the color version of the Ensenso B, the stereo system is equipped with two RGB image sensors. This saves additional sensors and reduces installation space and hardware costs. Now, you can also choose your model to be equipped with two 5 MP mono sensors, achieving impressively high spatial precision. With enhanced sharpness and accuracy, you can tackle applications where absolute precision is essential. The great strength of the Ensenso B lies in the very precise detection of objects at close range. It offers a wide field of view and an impressively high depth of field. This means that the area in which an object is in focus is unusually large. At a distance of 30 centimetres between the camera and the object, the Z-accuracy is approx. 0.1 millimetres. The maximum working distance is 2 meters. This 3D camera series complies with protection class IP65/67 and is ideal for use in industrial environments.