Integration of simultaneous tactile sensing and reflectance visible and near-infrared spectroscopy in a robot gripper for mango quality assessment

Abstract

Development of non-destructive tools for determining mango ripeness would improve the quality of industrial production of the postharvest processes. This study addresses the creation of a new sensor that combines the capability of obtaining simultaneously both mechanical and optical properties of the fruit. It has been integrated in a robot gripper that can handle the fruit obtaining non-destructive measurements of firmness, incorporating two spectrometer probes to simultaneously obtain reflectance properties of the visible and near-infrared, and two accelerometers attached to the rear side of two fingers. Partial least square regression was applied to different combinations of the spectra data obtained from the different sensors to determine the combination that provides the best results. Best prediction of ripening index was achieved using both spectral measurements and two finger accelerometers signals, with R2p = 0.832 and RMSEP of 0.520. These results demonstrate that simultaneous measurement and analysis of the data fusion set improve the robot gripper features, allowing to assess the quality of the mangoes during pick and place processes.