Details

Autor(en) / Beteiligte

• Fan, Yuhe
• Zhang, Lixun
• Zheng, Canxing
• Zu, Yunqin
• Wang, Xingyuan
• Zhu, Jinghui

Titel

Real-time and accurate meal detection for meal-assisting robots

Ist Teil von

• Journal of food engineering, 2024-06, Vol.371, p.111996, Article 111996

Ort / Verlag

Elsevier Ltd

Erscheinungsjahr

2024

Quelle

Alma/SFX Local Collection

Beschreibungen/Notizen

• Meal detection is an important technology to ensure success rate of meal-assisting robotics. However, due to the strong interclass similarity and intraclass variability presented by appearance, gesture, and complex traits of meals in different scenarios, it is more challenging to real-time and accurate detect meals. To address the above problems, a novel method based on deformable convolution and CloFormer (CF) transformer to optimize the YOLOv8s was proposed to achieve efficient and accurate detection for meal. The YOLOv8s model architecture was enhanced by introducing deformable convolution to capture finer-grained spatial information, and the CloFormer module was introduced to capture high-frequency local and low-frequency global information through shared weights and context-aware weights, we notated it as DCF-YOLOv8s. The proposed method was evaluated on meal datasets, which were evaluated separately with baseline model and several state-of-the-art (SOTA) detection models, and results show that the proposed method achieves better performance. Specifically, the proposed method can achieve 88.5% mean average accuracy (mAP) at 43.6 frames per second (FPS), validating its efficiency and accuracy in meal detection for meal-assisting robotics. The effectiveness of introducing deformable convolution and CloFormer modules was verified by ablation experiments, and validating the importance of adopting data augmentation methods. The method proposed in this paper can improve success rate of meal fetching by intelligent meal-assisting robots and also contribute to the development of the field of food engineering to monitor the quality of meals and food management. •A novel method of meal detection for meal-assisted robots was proposed.•The proposed method was compared with baseline and several SOTA models.•Ablation experiments were performed to verify effectiveness of each improvement.•The proposed method can achieve real-time, high accuracy, and strong robustness.•The proposed method can provide a guiding theoretical basis for meal detection.