AI Improves Robotic Performance in DARPA’s Machine Common Sense Program


Date:2022-06-25 Source:DefenceTalk By:Technology News Viewed:

by DefenceTalk  June 23, 2022 in Technology News
Researchers with DARPA’s Machine Common Sense (MCS) program demonstrated a series of improvements to robotic system performance over the course of multiple experiments. Just as infants must learn from experience, MCS seeks to construct computational models that mimic the core domains of child cognition for objects (intuitive physics), agents (intentional actors), and places (spatial navigation).
Using only simulated training, recent MCS experiments demonstrated advancements in systems’ abilities – ranging from understanding how to grasp objects and adapting to obstacles, to changing speed/gait for various goals.
“These experiments are important milestones that get us closer to building and fielding robust robotic systems with generalized movement capabilities,” said Dr. Howard Shrobe, MCS program manager in DARPA’s Information Innovation Office. “The prototype systems don’t need large sensor suites to deal with unexpected situations likely to occur in the real world.”
DARPA信息创新办公室MCS项目经理霍华德·肖伯(Howard Shrobe)博士说:“这些实验是重要的里程碑,使我们更接近于构建和部署具有通用运动能力的强大机器人系统。” “原型系统不需要大型传感器套件来处理现实世界中可能发生的意外情况。”
Rapidly Adapting to Changing Terrain
In one experiment, researchers at the University of California, Berkeley developed a rapid motor adaption (RMA) algorithm that allows quadruped robots to adapt rapidly to changing terrain. Using the RMA algorithm and proprioceptive feedback (the sense of self-movement and body position), the robots successfully navigated through a range of both real-world and simulated terrain.
The algorithm is trained completely in simulation without using any domain knowledge-like reference trajectories or predefined foot trajectory generators and is deployed without any fine-tuning. Real-time terrain adaption is essential for quadruped robots to help military units with load carrying and sensing.
Carrying Dynamic Loads
Oregon State researchers demonstrated the ability for a bipedal robot to learn how to carry dynamic loads with only proprioceptive feedback. The robot, known as Cassie, learned commonsense behaviors in a simulated-to-real learning environment. Cassie adapted its gait to account for changes in load dynamics, such as sloshing liquids or balancing weights. After training in simulation, Cassie was able to walk on a treadmill for several minutes with four different types of dynamic loads. In contrast, before the learned commonsense training, Cassie fell immediately.
Understanding How to Grasp Objects
In natural environments, humans encounter a vast variety of possible tools, tool variations, and objects. This variety presents a challenge for robots. They must foresee all possibilities to function, which is why it’s important that they’re equipped with a general grasping capability rather than a specialized capability, for a predefined set of objects.
University of Utah researchers as part of the Oregon State University MCS team developed an active, grasp-learning algorithm that allows robots with multi-fingered hands to dexterously grasp previously unseen objects when trained entirely in simulation.
The new approach enabled the robot to grasp with higher than 93% real-world success on novel objects compared to 78% of existing passive learning approaches.
Additional Research
Another technical area within MCS seeks to develop computational tools that learn from reading the web, like a research librarian, to construct a commonsense knowledge repository capable of answering natural language and image-based questions about commonsense phenomena.
MCS researchers from the University of Washington and two teams from the University of Southern California, Information Sciences Institute are currently using a variety of approaches, including hyperbolic learning. This technique learns the commonsense structure of human behavior and physics from large collections of videos to forecast human actions up to 30 seconds in the future.
The researchers are also building a scalable, machine-authored, symbolic knowledge base that will provide a higher quality, larger, and more diverse representation of the world.
“By focusing on commonsense, we are creating the possibility for systems to have the flexibility of human learning and the breadth of human knowledge,” Shrobe said. “Fusing this knowledge with advanced robotics could result in highly capable, mission-critical systems that humans will want to have as partners.”
“通过关注常识,我们正在为系统创造具有人类学习灵活性和人类知识广度的可能性,”肖伯说。 “将这些知识与先进的机器人技术相结合,可能会产生人类希望拥有的功能强大、关键任务系统作为合作伙伴。”

    pre[上一篇]:Antennas:The hard physics challenge for Space Force ‘hybrid’ SATCOM plan   next[下一篇]:‘Bullet made out of light’: Army to field first Stryker-mounted combat laser in next 45 days