[1]杨奕铭,陈凤,蔡婷,等.基于视频分析的振荡果实轨迹跟踪方法[J].江苏农业科学,2020,48(14):261-267.
 Yang Yiming,et al.Tracking method of oscillating apple based on video analysis[J].Jiangsu Agricultural Sciences,2020,48(14):261-267.
点击复制

基于视频分析的振荡果实轨迹跟踪方法()

《江苏农业科学》[ISSN:1002-1302/CN:32-1214/S]

卷:
第48卷
期数:
2020年第14期
页码:
261-267
栏目:
农业工程与信息技术
出版日期:
2020-07-20

文章信息/Info

Title:
Tracking method of oscillating apple based on video analysis
作者:
杨奕铭 陈凤 蔡婷 宋怀波
西北农林科技大学机械与电子工程学院/农业农村部农业物联网重点实验室/陕西省农业信息感知与智能服务重点实验室,陕西杨凌 712100
Author(s):
Yang Yiminget al
关键词:
苹果振荡Meanshift运动曲线果实目标自动识别果实轨迹跟踪
Keywords:
-
分类号:
TP391.4
DOI:
-
文献标志码:
A
摘要:
受采摘作业及风力等因素影响,果实目标多处于振荡状态,实现振荡影响下果实目标的自动识别与快速跟踪是提升果实采摘机器人采摘效率、果实表型最佳监测帧选取的关键。为了实现振荡影响下果实目标的准确识别与跟踪,提出了一种基于YCbCr颜色空间的果实目标自动识别方法;在此基础上,利用Meanshift算法实现了振荡果实轨迹跟踪;最后,通过对振荡果实运动轨迹跟踪结果得到果实的运动速度及加速度曲线,可为采摘机器人判定最佳采摘时机、最佳果实表型监测帧筛选奠定基础。结果表明,Meanshift跟踪方法适合于振荡果实目标的自动跟踪,可为提高振荡果实采摘效率和果实的生长状态无损监测提供借鉴。
Abstract:
-

参考文献/References:

[1]Zhang L B,Yang Q H,Bao G J,et al. Overview of research on agricultural robots in China[J]. International Journal of Agricultural and Biological Engineering,2008,1(1):12-21.
[2]Kondo N,Ting K C. Robotics for bioproduction systems[M]. New York:ASAE Publication,1998:231-251.
[3]Baeten J,Donné K,Boedrij S,et al. Autonomous fruit picking machine:a robotic apple harvester[C]//Field and service robotics.Berlin,Heildelberg:Springer,2008:531-539.
[4]Zhao D A,Lv J D,Ji W,et al. Design and control of an apple harvesting robot[J]. Biosystems Engineering,2011,110(2):112-122.
[5]Larry S D. A survey of edge detection techniques[J]. Computer Graphics and Image Processing,1975,4(3):248-270.
[6]Adams R,Bischof L. Seeded region growing[J]. IEEE Trans on Pattern Analysis and Machine Intelligence,1994,16(6):641-647.
[7]Meyer F. Skeletons and watershed lines in digital spaces[C]//Proceedings of SPIE.Society of Photo-optical Instrumentation Engineers,1990:85-102.
[8]Otsu N. A threshold selection method from gray-level histograms[J]. IEEE Transactions on Systems,Man,and Cybernetics,1979,9(1):62-66.
[9]Vapnik V N,Vapnik V. Statistical learning theory[M]. New York:Wiley,1998.
[10]田有文,李天来,李成华,等. 基于支持向量机的葡萄病害图像识别方法[J]. 农业工程学报,2007,23(6):175-180.
[11]Atsumi M . Saliency-based scene recognition based on growing competitive neural network[C]//Systems,man and cybernetics IEEE Xplore,2003.
[12]Mcdonald T,Chen Y R. Application of morphological image processing in agriculture[J]. Transactions of the ASAE,1990,33(4):1346-1352.
[13]Franz E,Gebhardt M R,Unklesbay K B. Shape description of completely visible and partially occluded leaves for identifying plants in digital images[J]. Transactions of the ASAE,1991,34(2):673-681.
[14]Nandi C S,Tudu B,Koley C. A machine vision technique for grading of harvested mangoes based on maturity and quality[J]. IEEE Sensors Journal,2016,16(16):6387-6396.
[15]Humphries S,Simonton W. Identification of plant parts using color and geometric image data[J]. Transactions of the ASAE,1993,36(5):1493-1500.
[16]Rakun J,Stajnko D,Zazula D. Detecting fruits in natural scenes by using spatial-frequency based texture analysis and multiview geometry[J]. Computers and Electronics in Agriculture,2011,76(1):80-88.
[17]王帆,吕继东,申根荣,等. 基于CLAHE和开闭运算的绿色苹果图像分割[J]. 计算机测量与控制,2017,25(2):141-145.
[18]Bulanon D M,Kataoka T,Ota Y,et al. AE-automation and emerging technologies:a segmentation algorithm for the automatic recognition of Fuji apples at harvest[J]. Biosystems Engineering,2002,83(4):405-412.
[19]Lucas B D,Kanade T. An iterative image registration technique with an application to stereo vision[C]//Proc. of international joint conference on artificial intelligence. San Francisco:Morgan Kaufmann Publishers Inc,1981:285-289.
[20]Linker R,Cohen O,Naor A. Determination of the number of green apples in RGB images recorded in orchards[J]. Computers and Electronics in Agriculture,2012,81:45-57.
[21]He Z L,Xiong J T,Rui L,et al. A method of green litchi recognition in natural environment based on improved LDA classifier[J]. Computers and Electronics in Agriculture,2017,140:159-167.
[22]Yilmaz A,Javed O,Shah M. Object tracking:a survey[J]. ACM Computing Surveys,2006,38(4):1-45.
[23]Jepson A D,Fleet D J,El-Maraghi T F. Robust online appearance models for visual tracking[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2003,25(10):1296-1311.
[24]Lowe D G. Distinctive image features from scale-invariant key points[J]. International Journal of Computer Vision,2004,60(2):91-110.
[25]Zhu G P,Zeng Q S,Wang C H. Efficient edge-based object tracking[J]. Pattern Recognition,2006,39(11):2223-2226.
[26]Kass M,Witkin A,Terzopoulos D. Snakes:active contour models[J]. International Journal of Computer Vision,1988,1(4):321-331.
[27]Paragios N,Deriche R. Geodesic active contours and level sets for the detection and tracking of moving objects[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2000,22(3):266-280.
[28]Kwon J,Lee K M. Visual tracking decomposition[C]//IEEE computer society conference on computer vision and pattern recognition.San Francisco:Institude of Electrical and Electronics Engineers,2010:1269-1276.
[29]吴俊杭,曾窕俊,马本学,等. 基于历史帧路径搜索的红枣动态图像采集[J]. 江苏农业科学,2019,47(10):219-223.
[30]李国利,姬长英,顾宝兴. 基于单目视觉与超声波检测的振荡果实采摘识别与定位[J]. 农业机械学报,2015,46(11):1-8.
[31]吕继东,赵德安,姬伟,等. 苹果采摘机器人对振荡果实的快速定位采摘方法[J]. 农业工程学报,2012,28(13):48-53,293.
[32]王辉,毛文华,刘刚,等. 基于视觉组合的苹果作业机器人识别与定位[J]. 农业机械学报,2012,43(12):165-170.
[33]Jiménez A R,Ceres R,Pons J L. A vision system based on a laser range-finder applied to robotic fruit harvesting[J]. Machine Vision and Applications,2000,11(6):321-329.
[34]Tanigaki K,Fujiura T,Akira A,et al. Cherry-harvesting robot[J]. Computers and Electronics in Agriculture,2008,63(1):65-72.
[35]Hsia C,Liou Y,Chiang J. Directional prediction CamShift algorithm based on adaptive search pattern for moving object tracking[J]. Journal of Real - Time Image Processing,2016,12(1):183-195.
[36]Shaik K B,Ganesan P,Kalist V,et al. Comparative study of skin color detection and segmentation in HSV and YCbCr color space[J]. Procedia Computer Science,2015,57:41-48.
[37]Fukunaga K,Hostetler L. The estimation of the gradient of a density function,with applications in pattern recognition[J]. IEEE Transactions on Information Theory,1975,21(1):32-40.
[38]Bao H Y,De X Z,Kui F,et al. Video tracking of human with occlusion based on MeanShift and Kalman filter[J]. Applied Mechanics and Materials,2013,380-384:3672-3677.

相似文献/References:

[1]贾永华,李晓龙,牛锐敏,等.叶面喷锌对苹果叶片生长及产量品质的影响[J].江苏农业科学,2014,42(12):218.
 Jia Yonghua,et al.Effects of spraying zinc on leaves on leaf growth , yield and quality of apple[J].Jiangsu Agricultural Sciences,2014,42(14):218.
[2]里程辉,刘志,王宏,等.不同化学疏花剂对岳帅苹果疏花疏果及果实品质的影响[J].江苏农业科学,2014,42(11):180.
 Li Chenghui,et al(80).Effects of different chemical flower thinners on flower thinning and fruit quality of apple “Yueshuai”[J].Jiangsu Agricultural Sciences,2014,42(14):180.
[3]王贵平,王金政.苹果抗逆性研究进展与鉴定方法[J].江苏农业科学,2013,41(07):151.
 Wang Guiping,et al.Research progress and identification method of stress resistance of apple trees[J].Jiangsu Agricultural Sciences,2013,41(14):151.
[4]李敏,厉恩茂,李壮,等.氨基酸钙叶面微肥对苹果缺素症的矫正及果实品质的影响[J].江苏农业科学,2013,41(11):180.
 Li Min,et al.Effects of calcium amino acid foliar fertilizer on apple element deficiency disease and fruit quality[J].Jiangsu Agricultural Sciences,2013,41(14):180.
[5]王贵平,王金政,薛晓敏,等.晚秋叶施高浓度尿素对苹果落叶及贮藏氮素的影响[J].江苏农业科学,2014,42(01):140.
 Wang Guiping,et al.Effects of high concentrations of foliar applied urea on defoliation and nitrogen storage of apple in late autumn[J].Jiangsu Agricultural Sciences,2014,42(14):140.
[6]宋哲,王宏,于年文,等.间伐、控冠处理对乔化凉香苹果树光合速率和果实产质量的影响[J].江苏农业科学,2016,44(05):290.
 Song Zhe,et al.Effects of thinning and crown control on photosynthesis and fruit yield and quality of Liangxiang apple trees[J].Jiangsu Agricultural Sciences,2016,44(14):290.
[7]黄金凤,王冬梅,闫忠业,等.苹果遗传图谱的构建与QTL定位研究进展[J].江苏农业科学,2016,44(02):4.
 Huang Jinfeng,et al.Construction of genetic map of apple and research progress of QTL localization[J].Jiangsu Agricultural Sciences,2016,44(14):4.
[8]苏律,宋俊霞,胡同乐,等.铁肥不同施用方式对苹果缺铁黄化病的矫正效果[J].江苏农业科学,2016,44(01):188.
 Su Lü,et al.Corrective effect of iron fertilizer with different fertilization methods on iron chlorosis of apple tree[J].Jiangsu Agricultural Sciences,2016,44(14):188.
[9]李静,宋飞虎,浦宏杰,等.苹果控制排湿压力微波干燥模型研究[J].江苏农业科学,2015,43(11):529.
 Li Jing,et al.Study on mathematical modeling of apple microwave drying under different moisture pressures[J].Jiangsu Agricultural Sciences,2015,43(14):529.
[10]廖春丽,王衡,李亚平,等.L-半胱氨酸及金属离子对马铃薯、苹果、甘薯多酚氧化酶活性的影响[J].江苏农业科学,2015,43(11):375.
 Liao Chunli,et al.Effects of L-cysteine and metal ions on activity of polyphenol oxidase from potato,apple and sweet potato[J].Jiangsu Agricultural Sciences,2015,43(14):375.

备注/Memo

备注/Memo:
收稿日期:2019-11-07
基金项目:国家重点研发计划(编号:2019YFD100072);国家高技术研究发展计划(863计划)(编号:2013AA10230402);陕西省农业科技创新与攻关项目(编号:2016NY-157);中央高校基本科研业务费项目(编号:2452016077)。
作者简介:杨奕铭(1999—),男,广东惠州人,主要从事数字图像处理研究。E-mail:y352184741@163.com。
通信作者:宋怀波,博士,副教授,博士生导师,主要从事数字图像处理研究。E-mail:songyangfeifei@163.com。
更新日期/Last Update: 2020-07-20