Biography
Kyle Hollins Wray leads the creation of autonomous robots that can plan, make decisions, navigate, and coordinate in the real world. He also researches theoretical models and practical algorithms for decision-making under uncertainty in real robots. Previously, Kyle was a Director of Engineering at Robust AI where he lead the fleet intelligence team, program managed six teams, designed product workflows, and presented to venture capitalists to successfully raise a $20 million Series A-1 funding round. He was also a Principal Researcher at the Nissan Advanced Technology Center - Silicon Valley where he led the creation of autonomous vehicle decision-making systems and hybrid electric vehicle energy management systems, managed multi-million-dollar projects, and presented to stakeholders including the CEO of Nissan. He was also a Visiting Scholar at Stanford University working with Mykel Kochenderfer where he co-authored a textbook entitled Algorithms for Decision Making that was published by MIT Press.
He earned his doctorate in computer science from the University of Massachusetts Amherst, advised by Shlomo Zilberstein, specializing in artificial intelligence and autonomous robots. Kyle earned his bachelor's and master's degrees in computer science, engineering, and mathematics from the University of Massachusetts Amherst and The Pennsylvania State University.
He is the recipient of the ICAPS Best Dissertation Award (2020), the runner-up Victor Lesser Distinguished Dissertation Award (2020), the Nissan Patent Research Award (2020 and 2018), and the Outstanding Graduate Research Award (2016).
He serves as an Associate Editor for IEEE Robotics and Automation Letters (RA-L) and an Area Chair for AAAI Conference on Artificial Intelligence (AAAI).
Please see his curriculum vitae (CV) for more details.
Academic Research Interests
Kyle’s research interests include decision-making, modeling, planning, and learning in the fields of both artificial intelligence and robotics. His work spans the design and analysis of theoretical models, the creation of efficient algorithms, and the practical applications of these decision-making approaches.
In artificial intelligence, he is particularly interested in the theoretical foundations of decision-making models based on MDPs, SSPs, POMDPs, and Dec-POMDP. In particular, he designs novel multi-objective and hierarchical models that unify prior models, and proposes scalable algorithms that solve them.
In robotics, he is particularly interested the goal of true long-term autonomy. In particular, he designs novel MDPs, SSPs, POMDPs, and Dec-POMDPs, with efficient algorithms to solve them online, that enable scalability, are robust, and provide safety guarantees.
His models and algorithms are deployed on Robust AI’s collaborative mobile robots and Nissan’s autonomous vehicles.
News
2024
September
- Two journal papers were accepted to the Journal of Aerospace Information Systems and the Air Medical Journal, both of which use multi-agent MDP-based models to coordinate black hawk helicoptors and other vehicles to safely fight wildfires and effecitvely perform medical evacuations!
March
- After 12 months and 9 quarter-long courses, I have completed the Stanford LEAD Executive Education Program!
March
- The ACM Journal on Autonomous Transportation Systems special issue on Cooperative Decision Making has released its Call for Papers, for which I'm serving as a guest editor.
February
February
- Our ICRA 2024 paper on a highly performant Constrained POMDP (CPOMDP) online solver!
February
- Another six U.S. patents were granted.
2023
June
- Two papers related to POMDPs were accepted IEEE IV 2023 and IEEE ECC 2023!
June
- In the past ten months, fourteen new patents were granted (nine U.S. and five international)!
April
- Our company Robust AI raised $20 million USD in Series A-1! Check out TechCrunch, The Robot Report, and Business Wire!
March
- Our journal paper on Competence-Aware Systems (CAS) was accepted to Artificial Intelligence Journal (AIJ)!
2022
August
- I am now a Director of Engineering at Robust AI leading the teams within Planning and Optimization.
June
- Our paper on computing multi-objective policy gradients in Topological MDPs (TMDPs), and a resulting extension to PPO, has been accepted to IROS 2022.
May
- Our paper on an improved Lexicographic SSP (LSSP) algorithm has been accepted to SoCS 2022.
April
- Four more U.S. patents on autonomous vehicle decision-making were granted!
January
- Our ICRA 2022 paper on an CPOMDP fast-converging gradient ascent algorithm that uses an approximate constraint projection was accepted!
January
- Our IEEE Robotics and Automation Letters (RA-L) paper on competence-aware path planning via introspective perception was accepted!
2021
November
- I am now a principal researcher at Nissan!
September
- I am now also a visiting scholar at Stanford!
September
- Eight more patents have been granted for autonomous vehicles!
June
- Our paper on improved competence via state space refinement was accepted to IROS 2021!
April
- Our paper on a new series hybrid vehicle intelligent engine activation algorithm, which is based on multi-objective SSPs, was accepted to IEEE's top intelligent vehicles/transportation conference IEEE IV 2021!
March
- Two more patents have been granted for autonomous vehicles.
February
- Our paper on a novel scalable class of finite state controllers, called circulant controllers, was accepted to ICRA 2021!
January
- Two more patents have been granted for autonomous vehicles.
January
- Our paper on the MODIA autonomous vehicle architecture was accepted to IEEE ISR 2021!
2020
November
- Both a U.S. and an E.U. patent were granted for autonomous vehicles.
August
- I am the primary inventor on ten more international patent applications for autonomous vehicles.
July
- Workshops papers covering various topics related to multi-objective, robust, and introspective autonomy were presented at RSS (Interaction and Decision-Making in Autonomous Driving and Robust Autonomy) and ECAI (AREA).
June
- My dissertation won the ICAPS Best Dissertation Award!
May
- Two U.S. patents were granted for autonomous vehicles!
April
- I am now a senior researcher at Nissan.
March
- My dissertation was runner-up for the Victor Lesser Distinguished Dissertation Award!
January
- Our conference paper on learning competence in semi-autonomous systems was accepted to AAMAS 2020!
2019
November
- I am the primary inventor on seven more international patent applications for autonomous vehicles.
June
- I started working at Nissan’s Alliance Innovation Lab Silicon Valley full-time!
June
- Two IROS 2019 papers were accepted on autonomous vehicle introspection and goal uncertainty in stochastic shortest path problems!
May
- I have officially graduated with my doctorate in computer science!
March
- I have successfully defended my dissertation: Abstractions in Reasoning for Long-Term Autonomy!
January
- Our paper on generalized controllers for POMDPs was accepted to ICRA 2019! It generalizes popular approximate POMDP policy forms used in point-based, FSC, and compression algorithms under one unified controller family form.
January
- Our AAMAS 2019 paper on policy networks was accepted as an extended abstract. It generalizes many popular models of hierarchies and multiple objectives, such as CMDPs and the options framework, as well as unifying much of my research. For an extensive presentation of policy networks, please read my dissertation later this year!
2018
October
- Our AAAI fall symposium on long-term autonomy that I chaired was held in Arlington, VA! Thank you to all those who participated and made the symposium a success!
June
- I have been awarded Nissan's Patent Research Award for my work at the Nissan Research Center!
April
- Our IJCAI 2018 paper on meta-reasoning for determining the optimal stopping point in anytime algorithms. It has another video of the 'epic' library for path planning from our IROS 2016 paper!
January
- I am the primary inventor on another six international patent applications for autonomous vehicles.
2017
November
- Our paper on integrating cooperation and competition (Dec-POMDP and POSG) was accepted to AAAI 2018! It has a multi-robot video using a hybrid Dec-POMDP and POSG with stochastic FSC policies!
July
- A paper on a simple belief point compression technique called a σ-approximation was accepted to IROS 2017. It has an accompanying video of a robot using a POMDP!
May
- I am going to Nissan Research Center in Silicon Valley again to continue to develop decision-making algorithms for their autonomous vehicles!
April
- Our conference paper on MODIA, which is a method for online scalable decision-making with applications to autonomous vehicles, was accepted to IJCAI 2017!
April
- A paper on a simple belief point compression technique was accepted the ICAPS 2017 Planning and Robotics (PlanRob) workshop.
February
- I am the primary inventor on four international patent applications for autonomous vehicles!
2016
November
- I am a co-organizer for the Multi-Objective Decision Making (MODeM) workshop at AAMAS 2017!
November
- Our AAAI 2017 paper on a short-sighted labeling algorithm for quickly solving SSPs entitled FLARES was accepted.
July
- News articles regarding our IJCAI semi-autonomous systems paper has appeared in Phys.org, EurekaAlert!, Science Codex, Science Daily, UMass News, and Daily Hampshire Gazette.
July
- Our IROS 2016 paper on robot path planning using harmonic functions and GPUs was accepted. This includes the 'epic' library for path planning in ROS.
May
- This summer I am at the Nissan Research Center in Silicon Valley working on their autonomous vehicles!
April
- Our IJCAI 2016 paper on semi-autonomous systems (namely vehicles) was accepted! Also, our IJCAI Goal Reasoning Workshop paper on a new SSP algorithm was accepted.
January
- Our AAMAS 2016 paper was accepted as an extended abstract.
2015
December
- I have passed my qualifying exam with distinction! Now I am a Ph.D. candidate!
November
- Our AAAI 2016 paper on proactive learning POMDPs has been accepted.
August
- Both a GPU-based POMDP algorithm paper and a relaxed LMDP paper have been accepted to the SDMIA as part of the AAAI Fall Symposium 2015 Series. The POMDP short paper presents our 'nova' library for planning.
April
- Our IJCAI 2015 paper on Lexicographic POMDPs has been accepted.
February
- News articles published on our semi-autonomous driving work: NSF.gov, Phys.org, and Slashdot.org.
2014
November
- Our AAAI 2015 paper on Lexicographic MDPs has been accepted.
May
March
- I have received the Outstanding Teaching Assistant Award!