Skip to main content

All Publications

New challenges in oxygen reduction catalysis: a consortium retrospective to inform future research
Energy & Materials | July 13, 2022

In this perspective, we highlight results of a research consortium devoted to advancing understanding of oxygen reduction reaction (ORR) catalysis as a means to inform fuel cell science. We demonstrate how targeted collaborations between different institutions from academic, national lab, and industry backgrounds and different scientific disciplines like theory, experiment, and characterization can yield unique insights into fuel cell catalysts. We comment on such insights into material designs for platinum-group-metal alloys, transition metal oxides, and non-traditional materials including metal-organic frameworks; systems that have served as the foundational building blocks for our consortium. We also motivate a renewed focus on catalyst durability in light of emerging technological requirements and paths forward in understanding in situ and operando electrochemical stability. Finally, we describe new frontiers ORR research can take and how emerging artificial intelligence tools can assist researchers in capturing data, selecting new experiments, and guiding characterization to accelerate the design and discovery of fuel cell catalysts. A main goal of sharing this perspective is to discuss the rationale for our future research plans based on our consortium work. However, we also hope to illustrate both the potential impact of a collaborative strategy with the hopes of inspiring a higher degree of Industry-Academia-National Laboratory collaboration and encourage other centers and consortiums to distill and share their findings in a similar perspective-type article. Together we hope to enable the fuel cell research community to engage in a discussion of strategies for research and accelerated development of catalysts with improved activity and stability. READ MORE

Image
Oxygen reduction catalysis article image
Human-Centric Intelligent Driving: Collaborating with the Driver to Improve Safety
Human Interactive Driving | July 10, 2022

Despite the benefits of autonomous vehicles, their many challenges have made their wide scale deployment and adoption slower than hoped for. In order to help spread the potential benefits of autonomy sooner, as well as to cater to people who will continue to prefer to drive themselves while improving safety, there is a need for intelligent interaction and collaboration between increasingly automated vehicles and humans. At Toyota Research Institute, we call this Human-Centric Intelligent Driving (HCID). HCID has many technical challenges, some of which are shared with fully autonomous driving. Due to the collaborative nature between humans and machines in HCID, some of these challenges are particularly important and potentially different from fully autonomous driving. This chapter focuses on Toyota Research Institute’s (TRI) approach to addressing some of these core challenges. READ MORE

Image
Human-Centric Intelligent Driving article image
An Unconstrained Convex Formulation of Compliant Contact
Robotics | June 23, 2022

We present a convex formulation of compliant frictional contact and a robust, performant method to solve it in practice. By analytically eliminating contact constraints, we obtain an unconstrained convex problem. Our solver has proven global convergence and warm-starts effectively, enabling simulation at interactive rates. We develop compact analytical expressions of contact forces allowing us to describe our model in clear physical terms and to rigorously characterize our approximations. Moreover, this enables us not only to model point contact, but also to incorporate sophisticated models of compliant contact patches. Our time stepping scheme includes the midpoint rule, which we demonstrate achieves second order accuracy even with frictional contact. We introduce a number of accuracy metrics and show our method outperforms existing commercial and open source alternatives without sacrificing accuracy. Finally, we demonstrate robust simulation of robotic manipulation tasks at interactive rates, with accurately resolved stiction and contact transitions, as required for meaningful sim-to-real transfer. Our method is implemented in the open source robotics toolkit Drake. READ MORE

Image
Dual arm manipulation task image
Novel inorganic crystal structures predicted using autonomous simulation agents
Energy & Materials | June 14, 2022

We report a dataset of 96640 crystal structures discovered and computed using our previously published autonomous, density functional theory (DFT) based, active-learning workflow named CAMD (Computational Autonomy for Materials Discovery). Of these, 894 are within 1 meV/atom of the convex hull and 26826 are within 200 meV/atom of the convex hull. The dataset contains DFT-optimized pymatgen crystal structure objects, DFT-computed formation energies and phase stability calculations from the convex hull. It contains a variety of spacegroups and symmetries derived from crystal prototypes derived from known experimental compounds, and was generated from active learning campaigns of various chemical systems. This dataset can be used to benchmark future active-learning or generative efforts for structure prediction, to seed new efforts of experimental crystal structure discovery, or to construct new models of structure-property relationships. READ MORE

Image
Novel inorganic image
Object Permanence Emerges in a Random Walk along Memory
Robotics | June 13, 2022

This paper proposes a self-supervised objective for learning representations that localize objects under occlusion - a property known as object permanence. A central question is the choice of learning signal in cases of total occlusion. Rather than directly supervising the locations of invisible objects, we propose a self-supervised objective that requires neither human annotation, nor assumptions about object dynamics. We show that object permanence can emerge by optimizing for temporal coherence of memory: we fit a Markov walk along a space-time graph of memories, where the states in each time step are non-Markovian features from a sequence encoder. This leads to a memory representation that stores occluded objects and predicts their motion, to better localize them. The resulting model outperforms existing approaches on several datasets of increasing complexity and realism, despite requiring minimal supervision, and hence being broadly applicable. READ MORE

Image
Object permanence image
Velocity Level Approximation of Pressure Field Contact Patches
Robotics | June 9, 2022

Pressure Field Contact (PFC) was recently introduced as a method for detailed modeling of contact interface regions at rates much faster than elasticity-theory models, while at the same time predicting essential trends and capturing rich contact behavior. The PFC model was designed to work in conjunction with error-controlled integration at the acceleration level. Therefore a vast majority of existent multibody codes using solvers at the velocity level cannot incorporate PFC in its original form. In this work we introduce a discrete in time approximation of PFC making it suitable for use with existent velocity-level time steppers and enabling execution at real-time rates. We evaluate the accuracy and performance gains of our approach and demonstrate its effectiveness in simulating relevant manipulation tasks. The method is available in open source as part of Drake’s Hydroelastic Contact model. READ MORE

Image
soft bubble gripper image
Implicit Multiagent Coordination at Uncontrolled Intersections via Topological Braids
Human Interactive Driving | June 1, 2022

We focus on decentralized navigation among multiple noncommunicating agents at uncontrolled street intersections. Avoiding collisions under such settings demands nuanced implicit coordination. This is challenging to accomplish; the high dimensionality of the space of possible behavior and the lack of explicit communication among agents complicate prediction and planning. However, the structure of these domains often collapses the space of possible collective behavior into a finite set of modes. Our key insight is that enabling agents to reason about modes may enable them to coordinate implicitly via intent signals encoded in their actions. In this paper, we represent modes as low-dimensional multiagent motion primitives in a compact and interpretable fashion using the formalism of topological braids. Based on this representation, we derive a probabilistic model that maps past behavior of multiple agents to a future mode. Using this model, we design a decentralized control algorithm that treats navigation as uncertainty minimization over the space of modes. This algorithm enables agents to collectively reject unsafe intersection crossing strategies in a distributed fashion. We demonstrate our approach in a simulated four-way uncontrolled intersection. Our model is shown to reduce the frequency of collisions by over 65% against baselines explicitly reasoning in the space of trajectories, while maintaining comparable time efficiency in challenging scenarios. READ MORE

Image
Multi-agent coordination image
HMIway-Env: A Framework for Simulating Behaviors and Preferences To Support Human-AI Teaming in Driving
Human-Centered AI, Human Interactive Driving | June 1, 2022

We introduce a lightweight simulation and modeling framework, HMIway-env, for studying human-machine teaming in the context of driving. The goal of the framework is to accelerate the development of adaptive AI systems which can respond to individual driver states, traits, and preferences, by serving as a data-generation engine and training environment for learning personalized human-AI teaming policies. We extend highway-env, an OpenAI Gym-based simulator environment, to enable specification of human driver behavior, and design of vehicle-driver interactions and outcomes. We describe one instance of our framework incorporating models for distracted and cautious driving, which we validate through crowd-sourced feedback, and show early experimental results toward the training of better intervention policies. READ MORE

Image
HMI-env image
Unsupervised Multi-View Gaze Representation Learning
Human Interactive Driving | June 1, 2022

We present a method for unsupervised gaze representation learning from multiple synchronized views of a person's face. The key assumption is that images of the same eye captured from different viewpoints differ in certain respects while remaining similar in others. Specifically, the absolute gaze and absolute head pose of the same subject should be different from different viewpoints, while appearance characteristics and gaze angle relative to the head coordinate frame should remain constant. To leverage this, we adopt a cross-encoder learning framework, in which our encoding space consists of head pose, relative eye gaze, eye appearance and other common features. Image pairs which are assumed to have matching subsets of features should be able to swap those subsets among themselves without any loss of information, computed by decoding the mixed features back into images and measuring reconstruction loss. We show that by applying these assumptions to an unlabelled multi-view video dataset, we can generate more powerful representations than a standard gaze cross-encoder for few-shot gaze estimation. Furthermore, we introduce a new feature-mixing method which results in higher performance, faster training, improved testing flexibility with multiple views, and added interpretability with learned confidence. READ MORE

Image
Unsupervised Multi-View Gaze image
Teaching machine learning to materials scientists: Lessons from hosting tutorials and competitions
Energy & Materials | June 1, 2022

The growing field of data-driven materials research poses a challenge to educators: teaching machine learning to materials scientists. We share our recent experiences and lessons learnt from organizing educational sessions at the fall 2021 meeting of the Materials Research Society. READ MORE

Image
Teaching Machine Learning image