Using 3D printers to print self-learning robots
When the robots of the future are sent to extract minerals from other planets, they will need to be both self-learning and self-repairing. Researchers at Oslo University have already succeeded in producing self-instructing robots on 3D printers. Read More
On the third floor of the Department of Informatics, there is a robotics laboratory which looks like a playroom. This is where researchers are exploring how their robots can learn to figure out how to move past barriers and other obstacles.
“In the future, robots will have to be able to solve tasks in deep mines on distant planets, in radioactive disaster areas, in hazardous landslip areas, and on the seabed beneath the Antarctic. These environments are so extreme that no human being can survive them. Everything needs to be automatically controlled.
Imagine that the robot enters the wreckage of a nuclear power plant. It finds a staircase that no-one considered. The robot takes a picture. The picture is analysed. The arm of one of the robots is outfitted with a printer. This produces a new robot, or a new part for an existing robot, which enables it to negotiate the stairs.” These are the hopes of Associate Professor Kyrre Glette, who is part of the Robotics and Intelligent Systems research team at Oslo University’s Department of Informatics.
Even if Glette’s ideas remain visions of the future, the robotics team in the Informatics Building has already developed three generations of self-learning robots. Professor Mats Høvin was the man behind the first model, a chicken-robot named “Henriette” that received a lot of media coverage when it was launched ten years ago. Henriette had to teach itself how to walk and jump over obstacles. And if it lost a leg, it had to learn, unaided, how to hop on the other leg.
A few years later, Master’s student Tønnes Nygaard launched the second generation robot. At the same time, the Informatics team developed a simulation program that was able to calculate what the body should look like. Just as with Henriette, the number of legs was pre-determined, but the computer program was at liberty to design the length of the legs and the distance between them.
The third generation of robots brings even greater flexibility. The simulation program takes care of the complete design and suggests the optimal number of legs and joints.
“We tell the simulation program what we would like the robot to do, how fast it should walk, its size and energy consumption. For instance, we may want the robot to be able to turn around and change directions, climb over boulders, and walk on rugged ground,” says Kyrre Glette.
In response, the simulation program suggests the optimal solution, including the shape of the body and the number of legs. It simulates thousands of possibilities and produces the best models by means of artificial evolution. In other words, the computer program comes up with a set of proposals for different robots designed for optimal functionality. “None of them is intrinsically better than the others. The only difference is their strategies for solving the tasks,” says research fellow Eivind Samuelsen.
Unfortunately, it is difficult to arrive at the perfect solution by way of simulation, because our wish list of what we want the robots to do is becoming increasingly complicated.
Simulation is not enough. In order to test the functionality of the robots, they need to undergo trials in the real world. The robots are produced as printouts from a 3D printer. “Once the robots have been printed, their real-world functionalities quite often prove to be different from those of the simulated versions. We are talking about a reality gap. There will always be differences. Perhaps the floor is more slippery in reality, meaning that the friction coefficient has to be changed. We are therefore studying how the robots worsen from the simulation to the laboratory stage,” says Mats Høvin.
The robots are frequently only half as good in real life.
“Practice enables the robots’ performance to be improved by 20 to 40 per cent. We hope that we will gradually be able to double their performance ratings so that they end up being just as good as, or perhaps even better than, their simulated counterparts.”
The researchers are looking at the robots’ ability to learn and practice even at the simulation program stage. “We then proceed to check whether the robots are able to learn in a real-world setting. One of the tests is to see how the robots react to obstacles,” says Samuelsen.
From three to six legs
The robotics team is currently comparing the performance of five robots that should be equally good in theory. Three of the five robots have four legs, one has three, the last has six. Fewer legs consume less energy. One of the robots is fitted with single-joint legs. The others have legs with two joints.
“It may well be that the best solution would be to use three joints, but this would mean that the energy consumption would be far too high.”
Just like in the natural world, the researchers have therefore opted to restrict the number of joints to two. “Single-jointed legs enable the robot to walk forward efficiently, but it will find it difficult to turn around,” Glette points out.
To test the robots, the researchers set up an obstacle course to enable the robots to teach themselves how to overcome the hurdles. The researchers hope that in future, the robots will be able to give automatic feedback to the simulation program about how well they work, so that the computer will be in a position to design an even better robot the next time around.
“Once we have further perfected the robots, we will also test how they work if printed out of a softer material.”
3D printers make it possible to create sophisticated robots and other objects.
“This is because a 3D printer will construct whatever you want it to, layer by layer. This means that you don’t have to bother with moulds, and you can produce seemingly impossibly complicated structures as a single piece. You can replicate perfect shapes and structures which are otherwise beyond the realm of possibility. Our imagination is the only limit.”
A 3D printer can also print objects with large cavities, such as a ship in a bottle.
“The 3D printout is based on a mathematical model, described as polygons, of whatever it is you want to print,” says Mats Høvin, who is currently testing out the technical production limits, like how thin or thick the legs of the robot can be.
There are a number of different types of 3D printers.
“Some produce printouts in steel, titanium and plastic. Others print fabrics. Organ printing has become very popular. Before the surgeons perform an operation, they can print out a copy of the patient to practice on. Oslo University Hospital Rikshospitalet is already employing this technology to design skeletal parts for hip replacement patients.”
The printers at the University of Oslo cost between 400,000 and three million NOK. The more expensive, the better the detail.
“NATO wants to use the printers to create spare parts for replacing damaged ones during field operations. This would require same-day fabrication. Some pastry chefs are already using 3D printers to bake sophisticated cakes. There are even printers that build houses. This means that the building contractor can set up an enormous crane that prints the entire building, including the cement, the insulation and everything else. Clever! And you won’t have to bother getting workmen in,” says Mats Høvin.
Not all 3D printers produce their output layer by layer. Some 3D printers mill the superfluous material off blocks. The latest printers can combine milling and layering techniques in the same operation. “This ensures a higher level of precision.” One of the main benefits for the robotics team at Blindern is the short route from the ideas stage to the robot-testing stage.
“Nevertheless, there are many practical challenges ahead before our robots can be exploited commercially. Our greatest challenge is to develop robust algorithms and a system that can make use of imprecise simulations,” says Kyrre Glette.
First published in Apollon Research Magazine
Robots in action