{"id":567,"date":"2024-11-14T13:26:25","date_gmt":"2024-11-14T18:26:25","guid":{"rendered":"https:\/\/labs.ri.cmu.edu\/kantorlab\/?p=567"},"modified":"2024-11-18T10:43:08","modified_gmt":"2024-11-18T15:43:08","slug":"pepper-harvesting","status":"publish","type":"post","link":"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/","title":{"rendered":"Pepper Harvesting"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Home<\/a><\/span><\/span><\/p>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t

\n\t\t\t\t\n\t\t\t\t\t\n\t\t\t\tPepper Harvesting\t\t\t<\/span>\n\t\t\t\t\t\n\t\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t<\/span>\n\t\t\t\t<\/h2>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Enhancing Crop Harvesting with Automated Robotics<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\tRead below...<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t
<\/div>\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t
<\/div>\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Enhancing Crop Harvesting with Automated Robotics\n<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Project Overview<\/strong><\/span><\/p>

This project explores the use of robotics for precision agriculture, specifically in automating pepper harvesting. Combining human demonstrations and advanced machine learning techniques, the goal is to deploy an autonomous harvesting system that can efficiently navigate real-world challenges in crop fields.<\/p>

Our Approach<\/strong><\/span><\/p>

At the core of this project is imitation learning, where robots learn by observing human actions. Through hundreds of carefully curated human demonstrations, the system is trained using a diffusion policy, enabling it to recognize key features of the harvesting task, such as identifying the pepper, estimating its position, and executing the necessary movements to harvest it autonomously.<\/p>

\u00a0Field Testing<\/strong><\/span><\/p>

The system was deployed in real-world field conditions, undergoing rigorous testing across various environmental challenges. These trials involved harvesting peppers in different lighting conditions, accounting for occlusion by leaves, and dealing with a range of pepper orientations and shapes. The tests demonstrated the system’s ability to generalize to new, unseen environments, handling natural variations in crop layouts.<\/p>

Challenges We Face<\/strong><\/span><\/p>

Pepper Occlusion by Leaves: One of the most difficult obstacles is when leaves or stems block the view of the pepper, which can mislead the robot’s policy.<\/p>

Peduncle Orientation: The orientation and shape of the pepper’s stem (peduncle) greatly influence how effectively the robot can cut and retrieve the pepper. Complex shapes and angles often pose significant difficulties.<\/p>

Looking Forward<\/strong><\/span><\/p>

To further enhance the system, we are exploring ways to improve the robot’s ability to handle occlusion, optimize cutting tools, and extend its capabilities to other crops. These advancements will make the technology more adaptable to diverse agricultural environments, paving the way for smarter and more efficient farming practices.<\/p>

\u00a0<\/div>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

Pepper Harvesting Enhancing Crop Harvesting with Automated Robotics Read below… https:\/\/youtu.be\/3scL8XWwmDEhttps:\/\/youtu.be\/ksXUIrUxjqY Enhancing Crop Harvesting with Automated Robotics Project Overview This project explores the use of robotics for precision agriculture, specifically in automating pepper harvesting. Combining human demonstrations and advanced machine learning techniques, the goal is to deploy an autonomous harvesting system that can efficiently navigate real-world … Continued<\/a><\/p>\n","protected":false},"author":22,"featured_media":569,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[],"class_list":["post-567","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-projects"],"yoast_head":"\nPepper Harvesting - Kantor Lab<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Pepper Harvesting - Kantor Lab\" \/>\n<meta property=\"og:description\" content=\"Pepper Harvesting Enhancing Crop Harvesting with Automated Robotics Read below… https:\/\/youtu.be\/3scL8XWwmDEhttps:\/\/youtu.be\/ksXUIrUxjqY Enhancing Crop Harvesting with Automated Robotics Project Overview This project explores the use of robotics for precision agriculture, specifically in automating pepper harvesting. Combining human demonstrations and advanced machine learning techniques, the goal is to deploy an autonomous harvesting system that can efficiently navigate real-world … Continued\" \/>\n<meta property=\"og:url\" content=\"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/\" \/>\n<meta property=\"og:site_name\" content=\"Kantor Lab\" \/>\n<meta property=\"article:published_time\" content=\"2024-11-14T18:26:25+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-11-18T15:43:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2024\/10\/pepper_harvesting_robot-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"2240\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"cemig\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"cemig\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/\",\"url\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/\",\"name\":\"Pepper Harvesting - Kantor Lab\",\"isPartOf\":{\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2024\/10\/pepper_harvesting_robot-scaled.jpg\",\"datePublished\":\"2024-11-14T18:26:25+00:00\",\"dateModified\":\"2024-11-18T15:43:08+00:00\",\"author\":{\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/0a88677439ed129c4b00b1e00e522f21\"},\"breadcrumb\":{\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/#primaryimage\",\"url\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2024\/10\/pepper_harvesting_robot-scaled.jpg\",\"contentUrl\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2024\/10\/pepper_harvesting_robot-scaled.jpg\",\"width\":2560,\"height\":2240},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Pepper Harvesting\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/#website\",\"url\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/\",\"name\":\"Kantor Lab\",\"description\":\"Robotics for Agriculture, Forestry and More\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/0a88677439ed129c4b00b1e00e522f21\",\"name\":\"cemig\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/8a0db42a98193a9b9b430c41d20d20a01b139f5f8af15772e1070d012e45e1df?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/8a0db42a98193a9b9b430c41d20d20a01b139f5f8af15772e1070d012e45e1df?s=96&d=mm&r=g\",\"caption\":\"cemig\"},\"url\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/author\/cemig\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Pepper Harvesting - Kantor Lab","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/","og_locale":"en_US","og_type":"article","og_title":"Pepper Harvesting - Kantor Lab","og_description":"Pepper Harvesting Enhancing Crop Harvesting with Automated Robotics Read below… https:\/\/youtu.be\/3scL8XWwmDEhttps:\/\/youtu.be\/ksXUIrUxjqY Enhancing Crop Harvesting with Automated Robotics Project Overview This project explores the use of robotics for precision agriculture, specifically in automating pepper harvesting. Combining human demonstrations and advanced machine learning techniques, the goal is to deploy an autonomous harvesting system that can efficiently navigate real-world … Continued","og_url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/","og_site_name":"Kantor Lab","article_published_time":"2024-11-14T18:26:25+00:00","article_modified_time":"2024-11-18T15:43:08+00:00","og_image":[{"width":2560,"height":2240,"url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2024\/10\/pepper_harvesting_robot-scaled.jpg","type":"image\/jpeg"}],"author":"cemig","twitter_card":"summary_large_image","twitter_misc":{"Written by":"cemig","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/","url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/","name":"Pepper Harvesting - Kantor Lab","isPartOf":{"@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/#website"},"primaryImageOfPage":{"@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/#primaryimage"},"image":{"@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/#primaryimage"},"thumbnailUrl":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2024\/10\/pepper_harvesting_robot-scaled.jpg","datePublished":"2024-11-14T18:26:25+00:00","dateModified":"2024-11-18T15:43:08+00:00","author":{"@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/0a88677439ed129c4b00b1e00e522f21"},"breadcrumb":{"@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/#primaryimage","url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2024\/10\/pepper_harvesting_robot-scaled.jpg","contentUrl":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2024\/10\/pepper_harvesting_robot-scaled.jpg","width":2560,"height":2240},{"@type":"BreadcrumbList","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/pepper-harvesting\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/labs.ri.cmu.edu\/kantorlab\/"},{"@type":"ListItem","position":2,"name":"Pepper Harvesting"}]},{"@type":"WebSite","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/#website","url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/","name":"Kantor Lab","description":"Robotics for Agriculture, Forestry and More","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/labs.ri.cmu.edu\/kantorlab\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/0a88677439ed129c4b00b1e00e522f21","name":"cemig","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/8a0db42a98193a9b9b430c41d20d20a01b139f5f8af15772e1070d012e45e1df?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8a0db42a98193a9b9b430c41d20d20a01b139f5f8af15772e1070d012e45e1df?s=96&d=mm&r=g","caption":"cemig"},"url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/author\/cemig\/"}]}},"_links":{"self":[{"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/posts\/567","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/comments?post=567"}],"version-history":[{"count":21,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/posts\/567\/revisions"}],"predecessor-version":[{"id":612,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/posts\/567\/revisions\/612"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/media\/569"}],"wp:attachment":[{"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/media?parent=567"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/categories?post=567"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/tags?post=567"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}