Peach ripeness classification based on a new one-stage instance segmentation model

Zhao, Ziang ORCID: https://orcid.org/0009-0004-6600-5581, Hicks, Yulia ORCID: https://orcid.org/0000-0002-7179-4587, Sun, Xianfang and Luo, Chaoxi 2023. Peach ripeness classification based on a new one-stage instance segmentation model. Computers and Electronics in Agriculture 214 , 108369. 10.1016/j.compag.2023.108369

PDF - Published Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (15MB)

Abstract

Peach instance segmentation is a crucial part to locate peaches and classify their ripeness stages to build an automatic peach harvesting or monitoring machine. This paper proposes a large and high-quality peach dataset called NinePeach, and a new one-stage instance segmentation model. The NinePeach dataset aims to reproduce real-world field conditions, encompassing various factors that can significantly influence the accuracy of peach detection, such as varying natural light intensity, instances of multiple fruit adhesion, and occlusion caused by stems and leaves. This is the largest and the most varied peach dataset among publicly available peach datasets to our best knowledge. Our proposed one-stage segmentation model does not require Region Proposal Network (RPN) to generate bounding box proposals, it directly identifies object instances by their centre locations and sizes and predict their category at the same time. The proposed model incorporates channel attention and spatial attention mechanisms to enhance object detection capabilities in crucial channels and spatial locations. Experimental results show that the state-of-the-art Mask RCNN performs 69.91% average precision (AP) with Swin-T backbone, our model surpasses it with the same backbone, achieving the highest 72.12% AP, and delivering more precise mask and boundary predictions. Specifically, our model is capable of accurately detect peaches under various conditions, such as peaches partially obscured by leaves, peaches partially exposed or overlapped. These advancements present promising prospects for the application of this technology to other fruits or crops.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Engineering
Publisher:	Elsevier
ISSN:	0168-1699
Funders:	CSC
Date of First Compliant Deposit:	10 November 2023
Date of Acceptance:	25 October 2023
Last Modified:	13 Nov 2023 12:45
URI:	https://orca.cardiff.ac.uk/id/eprint/163809

Actions (repository staff only)

Edit Item