Optimizing Construction Vehicle Interaction with Machine Learning

Photo by Ranulfo Bezerra

In the realm of earthmoving work, the interaction between autonomous dump trucks and human-operated backhoes is critical for efficient and safe operations. Recent studies have focused on leveraging machine learning techniques, particularly the Beta-Process Hidden Markov Model (BP-HMM), to intelligently predict backhoe loading times. One study developed a BP-HMM-based prediction method that automatically identifies the transition of several primitive motions from time-series data, achieving a remarkable 100% accuracy rate. This algorithm enhances the robustness of prediction models across different operator-backhoe combinations and sensor layouts. Another study used 6-axis IMU sensors to collect time-series data from backhoes, and employed BP-HMM to model specific operator behaviors. The model was able to predict the loading instant with up to 100% probability, significantly reducing idle time and risk for dump trucks. These advancements contribute significantly to the automation and safety of construction vehicles, enabling seamless cooperation between autonomous and human-operated machinery.

Ranulfo Bezerra
Ranulfo Bezerra
Assistant Professor

My research interests include multi-robot systems, robotic perception, knowledge acquisition.