{"id":215,"date":"2022-12-15T21:01:14","date_gmt":"2022-12-15T21:01:14","guid":{"rendered":"https:\/\/labs.ri.cmu.edu\/kantorlab\/?p=215"},"modified":"2023-02-16T10:17:34","modified_gmt":"2023-02-16T15:17:34","slug":"vine-pruning","status":"publish","type":"post","link":"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/","title":{"rendered":"Vine Pruning"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t

\n\t\t\t\t\n\t\t\t\t\t\n\t\t\t\tVine Pruning\t\t\t<\/span>\n\t\t\t\t\t\n\t\t\t\tGoogle\t\t\t<\/span>\n\t\t\t\t\t\n\t\t\t\tMineral\t\t\t<\/span>\n\t\t\t\t\t\n\t\t\t\tX\t\t\t<\/span>\n\t\t\t\t\t\n\t\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t<\/span>\n\t\t\t\t<\/h2>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
Training of a RL agent for viewpoint optimization and reaching pruning points in dormant vine trees<\/span><\/div>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\tRead below...<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t
<\/div>\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t
<\/div>\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\n\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\n\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\n\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\n\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\n\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Training of a RL agent for viewpoint optimization and reaching pruning points in dormant vine trees<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

The work is composed in three parts:<\/p>

  1. i) Simulation and modeling of fruit trees: I used a point cloud to create a 3d model of the fruit tree and simulate its dynamics. The tree is described as a series of links and joints using the URDF format.<\/li>
  2. ii) Reaching pruning points: I used the open implementation of several RL algorithms available in Stable Baselines 3<\/a>to train 7 DOF robot (ur5 + linear slider) to reach pruning points in vines with simple structures. The algorithm we used is PPO, which performed similarly to the classical approach (RRT planner in Moveit). The experimental tests were performed in simulation and the real robot. An ICRA paper<\/a> was published as a consequence.<\/li><\/ol>

    iii) Viewpoint optimization: I studied several methods of inverse reinforcement learning (IRL) using the implementations provided in the imitation repo<\/a>. After several months of testing different algorithms, no one showed great success and we finally used PPO This alternative provided better results, especially when using the learned policy only for fixing the camera. The initial approach was done by a classical method<\/p>

    Status:<\/strong><\/p>

    At the date (Sept 2022 ) the project is in a 3rd phase, where we are looking forward to evaluate the fixation policy in the real robot.<\/p>

    The work is planned to continue by using a learning approach to start manipulating the canopy, pushing away branches that can make very difficult to reach the objective point.\u00a0 This is a collaboration with David Held\u2019s group.<\/p>

    Sponsors\/Partners:<\/strong><\/p>

    Google, Mineral, X<\/a><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

    Training of a reinforcement learning agent for viewpoint optimization and reaching pruning points in dormant vine trees\u200b.<\/p>\n","protected":false},"author":2,"featured_media":216,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[],"class_list":["post-215","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-projects"],"yoast_head":"\nVine Pruning - Kantor Lab<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Vine Pruning - Kantor Lab\" \/>\n<meta property=\"og:description\" content=\"Training of a reinforcement learning agent for viewpoint optimization and reaching pruning points in dormant vine trees\u200b.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/\" \/>\n<meta property=\"og:site_name\" content=\"Kantor Lab\" \/>\n<meta property=\"article:published_time\" content=\"2022-12-15T21:01:14+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-02-16T15:17:34+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2022\/12\/classical_tree.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1303\" \/>\n\t<meta property=\"og:image:height\" content=\"863\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"bstaszel\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"bstaszel\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/\",\"url\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/\",\"name\":\"Vine Pruning - Kantor Lab\",\"isPartOf\":{\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2022\/12\/classical_tree.png\",\"datePublished\":\"2022-12-15T21:01:14+00:00\",\"dateModified\":\"2023-02-16T15:17:34+00:00\",\"author\":{\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/927370540dbdb2168a8dafc93bc20ebc\"},\"breadcrumb\":{\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/#primaryimage\",\"url\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2022\/12\/classical_tree.png\",\"contentUrl\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2022\/12\/classical_tree.png\",\"width\":1303,\"height\":863},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Vine Pruning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/#website\",\"url\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/\",\"name\":\"Kantor Lab\",\"description\":\"Robotics for Agriculture, Forestry and More\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/927370540dbdb2168a8dafc93bc20ebc\",\"name\":\"bstaszel\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/0a9fc29c17295070428deafe3fa0e66079e169a016a129ead208403ff166aeca?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/0a9fc29c17295070428deafe3fa0e66079e169a016a129ead208403ff166aeca?s=96&d=mm&r=g\",\"caption\":\"bstaszel\"},\"url\":\"https:\/\/labs.ri.cmu.edu\/kantorlab\/author\/bstaszel\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Vine Pruning - Kantor Lab","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/","og_locale":"en_US","og_type":"article","og_title":"Vine Pruning - Kantor Lab","og_description":"Training of a reinforcement learning agent for viewpoint optimization and reaching pruning points in dormant vine trees\u200b.","og_url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/","og_site_name":"Kantor Lab","article_published_time":"2022-12-15T21:01:14+00:00","article_modified_time":"2023-02-16T15:17:34+00:00","og_image":[{"width":1303,"height":863,"url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2022\/12\/classical_tree.png","type":"image\/png"}],"author":"bstaszel","twitter_card":"summary_large_image","twitter_misc":{"Written by":"bstaszel","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/","url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/","name":"Vine Pruning - Kantor Lab","isPartOf":{"@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/#website"},"primaryImageOfPage":{"@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/#primaryimage"},"image":{"@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/#primaryimage"},"thumbnailUrl":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2022\/12\/classical_tree.png","datePublished":"2022-12-15T21:01:14+00:00","dateModified":"2023-02-16T15:17:34+00:00","author":{"@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/927370540dbdb2168a8dafc93bc20ebc"},"breadcrumb":{"@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/#primaryimage","url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2022\/12\/classical_tree.png","contentUrl":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-content\/uploads\/sites\/29\/2022\/12\/classical_tree.png","width":1303,"height":863},{"@type":"BreadcrumbList","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/vine-pruning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/labs.ri.cmu.edu\/kantorlab\/"},{"@type":"ListItem","position":2,"name":"Vine Pruning"}]},{"@type":"WebSite","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/#website","url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/","name":"Kantor Lab","description":"Robotics for Agriculture, Forestry and More","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/labs.ri.cmu.edu\/kantorlab\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/927370540dbdb2168a8dafc93bc20ebc","name":"bstaszel","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/labs.ri.cmu.edu\/kantorlab\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/0a9fc29c17295070428deafe3fa0e66079e169a016a129ead208403ff166aeca?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0a9fc29c17295070428deafe3fa0e66079e169a016a129ead208403ff166aeca?s=96&d=mm&r=g","caption":"bstaszel"},"url":"https:\/\/labs.ri.cmu.edu\/kantorlab\/author\/bstaszel\/"}]}},"_links":{"self":[{"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/posts\/215","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/comments?post=215"}],"version-history":[{"count":14,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/posts\/215\/revisions"}],"predecessor-version":[{"id":373,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/posts\/215\/revisions\/373"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/media\/216"}],"wp:attachment":[{"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/media?parent=215"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/categories?post=215"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/labs.ri.cmu.edu\/kantorlab\/wp-json\/wp\/v2\/tags?post=215"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}