{"id":182255,"date":"2025-07-23T15:21:54","date_gmt":"2025-07-23T13:21:54","guid":{"rendered":"https:\/\/eurecat.org\/?post_type=avada_portfolio&p=182255"},"modified":"2025-07-25T09:21:02","modified_gmt":"2025-07-25T07:21:02","slug":"umi-lingo","status":"publish","type":"avada_portfolio","link":"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/","title":{"rendered":"UMI-LINGO"},"content":{"rendered":"

\"\"<\/p>\n<\/div>

<\/div>
<\/div>
<\/div>

<\/h3><\/span>
<\/div><\/div><\/div>

Open access to a modular, multi-tool handheld gripper and a multimodal dataset for natural language-guided robot manipulation.<\/strong><\/p>\n

UMI-LINGO<\/strong> democratises robot learning by providing an open-source handheld gripper<\/strong> and a multimodal dataset<\/strong> from human demonstrations.<\/p>\n

By integrating natural language instructions, visual inputs, and<\/strong> tactile\/auditory sensing<\/strong>, the project enables cost-effective data collection and model training<\/strong>, accelerating automation adoption across sectors, particularly for SMEs.<\/p>\n

Building upon the Universal Manipulation Interface (UMI), UMI-LINGO introduces a novel approach: task demonstrations are generated from natural-language descriptions<\/strong>. In this setup, one user describes a task based on before\/after images, and another executes it from the spoken instruction. This method captures the diversity of human communication and execution strategies, enhancing the richness and generalisation capability of datasets used to train AI-powered robots.<\/p>\n

UMI-LINGO is an initiative selected by the 3rd<\/sup> Open Call \u201cCreation of manipulation tasks dataset with vision and language instructions on tech exchange and collaborative projects on robotics and AI\u201d<\/a>, boosted by the euROBIN project<\/strong><\/a>.<\/p>\n

In this sense, UMI-LINGO complements the euROBIN LLM-planner<\/strong> by offering automatic skills implementation, eliminating manual programming and enhancing workflow autonomy. Beyond euROBIN, this initiative benefits the entire EU industry by promoting dataset reusability, lowering R&D barriers, and enhancing collaboration<\/strong>.<\/p>\n

To maximise accessibility, the project provides video tutorials<\/strong> on gripper assembly, data capture and model training, empowering SMEs and non-expert users to deploy robotic solutions independently and affordably.<\/p>\n

UMI-LINGO is executed by Eurecat\u2019s Robotics and Automation<\/a> Unit, with mentoring from Inria<\/a>, and it be validated across multiple domains: flexible manufacturing, domestic assistance, and outdoor robotics.<\/p>\n<\/div>

<\/div><\/div><\/div>
<\/span><\/div><\/div>

General data<\/h3><\/span>
<\/div><\/div><\/div>

Project<\/strong><\/p>\n

UMI-LINGO \u2013 Universal Manipulation Interface Leveraging Language for Guided Operations<\/p>\n

\n
<\/div>\n<\/div>\n<\/div>
<\/div>
<\/div><\/div>
<\/div>

Programme and call<\/strong><\/p>\n

Project funded by the 3rd<\/sup> Open Call on Tech exchange and collaborative projects on Robotics and AI, boosted by the euROBIN project<\/p>\n

\n
<\/div>\n<\/div>\n<\/div>
<\/div>
<\/div><\/div>
<\/div>

Related SDGs<\/strong><\/p>\n

\n
<\/div>\n<\/div>\n<\/div>

8. Decent work and economic growth<\/p>\n

9. Industry, innovation and infrastructure<\/p>\n<\/div>

<\/div>
<\/div><\/div>
<\/div>
<\/div>
<\/div>
<\/div>
<\/span><\/div><\/div>

Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or European Commission. Neither the European Union nor the granting authority can be held responsible for them<\/em><\/p>\n<\/div>

<\/div><\/div><\/div><\/div><\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":39,"featured_media":182246,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","format":"standard","meta":{"footnotes":""},"portfolio_category":[1413,1532],"portfolio_skills":[2969],"portfolio_tags":[],"class_list":["post-182255","avada_portfolio","type-avada_portfolio","status-publish","format-standard","has-post-thumbnail","hentry","portfolio_category-european-projects","portfolio_category-robotics-and-automation","portfolio_skills-ue-en"],"yoast_head":"\nUMI-LINGO - Eurecat<\/title>\n<meta name=\"description\" content=\"UMI-LINGO democratises robot learning by providing an open-source handheld gripper and a multimodal dataset from human demonstrations.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"UMI-LINGO - Eurecat\" \/>\n<meta property=\"og:description\" content=\"UMI-LINGO democratises robot learning by providing an open-source handheld gripper and a multimodal dataset from human demonstrations.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/\" \/>\n<meta property=\"og:site_name\" content=\"Eurecat\" \/>\n<meta property=\"article:modified_time\" content=\"2025-07-25T07:21:02+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/eurecat.org\/wp-content\/uploads\/2025\/07\/UMI-Lingo_520x272.png\" \/>\n\t<meta property=\"og:image:width\" content=\"520\" \/>\n\t<meta property=\"og:image:height\" content=\"272\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"9 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/eurecat.org\\\/en\\\/portfolio-items\\\/umi-lingo\\\/\",\"url\":\"https:\\\/\\\/eurecat.org\\\/en\\\/portfolio-items\\\/umi-lingo\\\/\",\"name\":\"UMI-LINGO - Eurecat\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/eurecat.org\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/eurecat.org\\\/en\\\/portfolio-items\\\/umi-lingo\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/eurecat.org\\\/en\\\/portfolio-items\\\/umi-lingo\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/eurecat.org\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/UMI-Lingo_520x272.png\",\"datePublished\":\"2025-07-23T13:21:54+00:00\",\"dateModified\":\"2025-07-25T07:21:02+00:00\",\"description\":\"UMI-LINGO democratises robot learning by providing an open-source handheld gripper and a multimodal dataset from human demonstrations.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/eurecat.org\\\/en\\\/portfolio-items\\\/umi-lingo\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/eurecat.org\\\/en\\\/portfolio-items\\\/umi-lingo\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/eurecat.org\\\/en\\\/portfolio-items\\\/umi-lingo\\\/#primaryimage\",\"url\":\"https:\\\/\\\/eurecat.org\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/UMI-Lingo_520x272.png\",\"contentUrl\":\"https:\\\/\\\/eurecat.org\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/UMI-Lingo_520x272.png\",\"width\":520,\"height\":272},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/eurecat.org\\\/en\\\/portfolio-items\\\/umi-lingo\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Inici\",\"item\":\"https:\\\/\\\/eurecat.org\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Portfolio\",\"item\":\"https:\\\/\\\/eurecat.org\\\/en\\\/portfolio-items\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"UMI-LINGO\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/eurecat.org\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/eurecat.org\\\/en\\\/\",\"name\":\"Eurecat\",\"description\":\"Otro sitio realizado con WordPress\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/eurecat.org\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"UMI-LINGO - Eurecat","description":"UMI-LINGO democratises robot learning by providing an open-source handheld gripper and a multimodal dataset from human demonstrations.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/","og_locale":"en_US","og_type":"article","og_title":"UMI-LINGO - Eurecat","og_description":"UMI-LINGO democratises robot learning by providing an open-source handheld gripper and a multimodal dataset from human demonstrations.","og_url":"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/","og_site_name":"Eurecat","article_modified_time":"2025-07-25T07:21:02+00:00","og_image":[{"width":520,"height":272,"url":"https:\/\/eurecat.org\/wp-content\/uploads\/2025\/07\/UMI-Lingo_520x272.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"9 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/","url":"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/","name":"UMI-LINGO - Eurecat","isPartOf":{"@id":"https:\/\/eurecat.org\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/#primaryimage"},"image":{"@id":"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/#primaryimage"},"thumbnailUrl":"https:\/\/eurecat.org\/wp-content\/uploads\/2025\/07\/UMI-Lingo_520x272.png","datePublished":"2025-07-23T13:21:54+00:00","dateModified":"2025-07-25T07:21:02+00:00","description":"UMI-LINGO democratises robot learning by providing an open-source handheld gripper and a multimodal dataset from human demonstrations.","breadcrumb":{"@id":"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/#primaryimage","url":"https:\/\/eurecat.org\/wp-content\/uploads\/2025\/07\/UMI-Lingo_520x272.png","contentUrl":"https:\/\/eurecat.org\/wp-content\/uploads\/2025\/07\/UMI-Lingo_520x272.png","width":520,"height":272},{"@type":"BreadcrumbList","@id":"https:\/\/eurecat.org\/en\/portfolio-items\/umi-lingo\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Inici","item":"https:\/\/eurecat.org\/en\/"},{"@type":"ListItem","position":2,"name":"Portfolio","item":"https:\/\/eurecat.org\/en\/portfolio-items\/"},{"@type":"ListItem","position":3,"name":"UMI-LINGO"}]},{"@type":"WebSite","@id":"https:\/\/eurecat.org\/en\/#website","url":"https:\/\/eurecat.org\/en\/","name":"Eurecat","description":"Otro sitio realizado con WordPress","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/eurecat.org\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/avada_portfolio\/182255","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/avada_portfolio"}],"about":[{"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/types\/avada_portfolio"}],"author":[{"embeddable":true,"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/users\/39"}],"replies":[{"embeddable":true,"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/comments?post=182255"}],"version-history":[{"count":1,"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/avada_portfolio\/182255\/revisions"}],"predecessor-version":[{"id":182365,"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/avada_portfolio\/182255\/revisions\/182365"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/media\/182246"}],"wp:attachment":[{"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/media?parent=182255"}],"wp:term":[{"taxonomy":"portfolio_category","embeddable":true,"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/portfolio_category?post=182255"},{"taxonomy":"portfolio_skills","embeddable":true,"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/portfolio_skills?post=182255"},{"taxonomy":"portfolio_tags","embeddable":true,"href":"https:\/\/eurecat.org\/en\/wp-json\/wp\/v2\/portfolio_tags?post=182255"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}