Robots Learn to Adapt and Scoot on Foreign Terrain

Category Machine Learning

tldr #

Researchers in the Departments of Aerospace Engineering and Computer Science at the University of Illinois Urbana-Champaign developed a novel learning-based method, so robots on extraterrestrial bodies can make decisions on their own about where and how to scoop up terrain samples. The robot has to learn that there are several possible ways to scoop the material, depending on the surface, and this method could be applied to landers on Earth as well.


content #

Mars rovers have teams of human experts on Earth telling them what to do. But robots on lander missions to moons orbiting Saturn or Jupiter are too far away to receive timely commands from Earth.Researchers in the Departments of Aerospace Engineering and Computer Science at the University of Illinois Urbana-Champaign developed a novel learning-based method so robots on extraterrestrial bodies can make decisions on their own about where and how to scoop up terrain samples.

This method of learning has applications beyond extraterrestrial bodies and can easily be applied to developing robots for lander missions on Earth.

"Rather than simulating how to scoop every possible type of rock or granular material, we created a new way for autonomous landers to learn how to learn to scoop quickly on a new material it encounters," said Pranay Thangeda, a Ph.D. student in the Department of Aerospace Engineering.

"It also learns how to adapt to changing landscapes and their properties, such as the topology and the composition of the materials," he said.

The two departments at University of Illinois collaborated to develop the learning-based method, as Aerospace Engineering provides the physical environment while Computer Science provides the algorithms.

Using this method, Thangeda said a robot can learn how to scoop a new material with very few attempts. "If it makes several bad attempts, it learns it shouldn't scoop in that area and it will try somewhere else." .

One of the challenges for this research is the lack of knowledge about ocean worlds like Europa.

"Before we sent the recent rovers to Mars, orbiters gave us pretty good information about the terrain features," Thangeda said. "But the best image we have of Europa has a resolution of 256 to 340 meters per pixel, which is not clear enough to ascertain features." .

The robot they used in their experiments was equipped with a 6-DOF arm and Jetson TX2 computer.

Thangeda's adviser Melkior Ornik said, "All we know is that Europa's surface is ice, but it could be big blocks of ice or much finer like snow. We also don't know what's underneath the ice." .

For some trials, the team hid material under a layer of something else. The robot only sees the top material and thinks it might be good to scoop. "When it actually scoops and hits the bottom layer, it learns it is unscoopable and moves to a different area," Thangeda said.

From the simulations they carried out there was 37% success rate on scooping up samples

NASA wants to send battery-powered rovers rather than nuclear to Europa because, among other mission-specific considerations, it is critical to minimize the risk of contaminating ocean worlds with potentially hazardous materials.

"Although nuclear power supplies have a lifespan of months, batteries have about a 20-day lifespan. We can't afford to waste a few hours a day to send messages back and forth. This provides another reason why the robot's autonomy to make decisions on its own is vital," Thangeda said.

The data collected from the robots was used to train a neural network to generate the best scooping policy for any new environment

This method of learning to learn is also unique because it allows the robot to use vision and very little on-line experience to achieve high-quality scooping actions on unfamiliar terrains—significantly outperforming non-adaptive methods and other state-of-the-art meta-learning methods.

The team used a robot in the Department of Computer Science at Illinois. It is modeled after the arm of a lander with sensors to collect scooping data on a variety of materials, from 1-millimeter grains of sand to 8-centimeter rocks, as well as different volume materials such as shredded cardboard and packing peanuts. The resulting database in the simulation contains 100 points of knowledge for each of 67 different types of materials.

The success of scooping can also depend on the material the robot encounters

The robot has to learn that there are several possible ways to scoop the material, depending on the surface. It can try to scoop a bigger or smaller sample, or it can use different heights. "It’s like teaching a child to scoop a spoonful of peanut butter from a jar, only here the robot is learning from hundreds of attempts on different materials," Thangeda said.

The method could also save battery life, because the robot knows not to try scooping the same material in the same spot over and over again.

This research has potential applications on Earth, too.

"We could apply similar autonomous learning techniques to landers landing on Earth," Thangeda said. "The physics are similar, so as soon as we get more accurate models, we can start doing simulations on Earth." .

This research was supported by the National Science Foundation, the NASA Probabilistically Typed Cyclone System Foundation, and the National Aeronautics and Space Administration Flight Opportunities Program.


hashtags #
worddensity #

Share