Autonomous Solutions, Inc. (ASI) receives SBIR funding for Deep Learning architecture to support multiple sensors in GPS-denied environments

ASI receives SBIR Phase I grant from the U.S. Army to develop a Deep Learning (DL) architecture that will support sensor fusion in environments with limited, or no, GPS.

Autonomous Solutions, Inc. (ASI) has been awarded a SBIR Phase I grant from the U.S. Army Combat Capabilities Development Command Ground Vehicles Systems Center (formerly TARDEC) to develop a Deep Learning (DL) architecture that will support sensor fusion in environments with limited, or no, GPS.


"Environmental sensing today typically includes cameras, LiDAR and radar," said Jeff Ferrin, CTO of ASI. "Each of these devices has a specific purpose, but not all of them work well in every situation. For example, cameras are great at collecting high-resolution color information, but do not provide much useful information in the dark."

In addition to the challenges faced by cameras in poorly lit or degraded visual environments, LiDAR and radar sensors also have limitations. LiDAR performs well in most light conditions but may yield false positives in heavy rain, fog, snow or dust, due to its use of light spectrum wavelengths. Radar usually penetrates these degraded visual environments, but often lacks spatial resolution.

"ASI's goal is to design a deep learning architecture that fuses information from LiDAR, radar and cameras," said Ferrin. "We plan to build upon machine learning techniques we have already developed for LiDAR data."

Deep learning is a branch of artificial intelligence and machine learning that allows valuable information to be extracted from large volumes of data. Cameras are often used in deep learning models because of their high output of information in regularly sampled data structures.

The case is different for LiDAR and radar. Naturally, these two sensor types do not provide regularly sampled data, making it difficult to formulate problems using current deep learning frameworks. This gap in current research efforts - deep learning for LiDAR and radar - is the focus of this grant.

Improved utilization of data from multiple devices can paint a more accurate picture of a vehicle's surroundings, keeping it safer and making it more efficient. The details of the grant solicitation state, "It is anticipated that harnessing a wide variety of sensors altogether will benefit the autonomous vehicles by providing a more general and robust self-driving system, especially for navigating in different types of challenging weather, environments, road conditions and traffic."

"In the last few years, we have seen a growing need in the world of robotics to advance industry capabilities in machine learning, deep learning, and other artificial intelligence algorithms to improve performance in these challenging environments," said Ferrin.

ASI is required to demonstrate the feasibility of the deep learning architecture in a simulation environment, including a road following system that controls an autonomous vehicle, on a course with obstacles and a degraded visual environment.

About ASI
Autonomous Solutions, Inc. (ASI) is a world leader in industrial vehicle automation. ASI serves clients across the world in the mining, agriculture, automotive, government, and manufacturing industries with remote control, teleoperation, and fully automated solutions from its headquarters and 100-acre proving ground in northern Utah.

Featured Product

Knight Optical - Unlocking Precision for the Robotics and Automation Revolution

Knight Optical - Unlocking Precision for the Robotics and Automation Revolution

In the era of Industry 4.0, automation and machine learning drive the future. Knight Optical stands at the forefront, collaborating globally to supply precision optical components that power the robotics and automation sector. From UAVs, drones, and robotics to machine vision, LiDAR-driven car sensors, and renewable energy, our optics empower innovation. Optical components play an important role within the industry, including: Optical windows and domes safeguard systems in unmanned vehicles while preserving the field of view for cameras. Infrared lenses with aspheric surfaces elevate thermal imaging. Optical filters excel in machine vision, with colour glass, interference, and dichroic filters in our stock. Knight Optical provides stock components and custom solutions made to your exact specs. With every component undergoing rigorous metrology and QA checks before shipment, you are sure to experience true precision, innovation, and assurance.