{"id":191250,"date":"2025-11-26T09:26:34","date_gmt":"2025-11-26T08:26:34","guid":{"rendered":"https:\/\/lineact.cesi.fr\/?post_type=projets&p=191250"},"modified":"2025-12-15T09:48:55","modified_gmt":"2025-12-15T08:48:55","slug":"rojunaco-robotics-and-augmented-digital-twin-for-construction","status":"publish","type":"projets","link":"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/","title":{"rendered":"Rojunaco \u2013 robotics and augmented digital twin for construction"},"content":{"rendered":"\n
\n
\"\"<\/figure>\n<\/div>\n\n\n\n
\n
\n
\n
\n
<\/div>\n\n\n\n
\n
\"\"<\/figure>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n
    \n
  • Project leader:<\/strong> CESI LINEACT<\/li>\n\n\n\n
  • Call for projects:<\/strong> M\u00e9tropole Rouen Normandie \u2013 Research Program<\/li>\n\n\n\n
  • Total project budget:<\/strong> \u20ac77k<\/li>\n\n\n\n
  • CESI budget for the project:<\/strong> \u20ac77k<\/li>\n\n\n\n
  • Project launch date:<\/strong> October 1, 2023<\/li>\n\n\n\n
  • Project duration: <\/strong>24 months<\/li>\n<\/ul>\n\n\n\n

    <\/p>\n\n\n\n

    The ROJUNACO<\/strong> project is part of Construction 4.0 and focuses on research into data recalibration, semantic information retrieval, and the implementation of a proof of concept for automated inspection missions based on digital twins, BIM, robotics, and augmented reality.<\/p>\n\n\n\n

    Achievements as of March 31, 2025:<\/strong>
    During this period, we continued our work on creating synthetic datasets from digital twins and evaluation using the YOLOV5-6D approach for the detection and estimation of 6D object positioning. Several building elements were targeted: doors, windows, and fire extinguishers.
    <\/p>\n\n\n\n

    We then turned our attention to creating real self-labeled datasets in the flexible production workshop of the Industry of the Future platform at the CESI campus in Rouen. We focused on one object in particular: the laboratory doors. To build this dataset, we used a camera to which MOCAP (MOtion CAPture) markers were attached to capture the camera’s position in the laboratory’s global reference frame. The positions of the doors were also marked in this same reference frame. Located behind the MOCAP cameras, we created a 2.5-meter aluminum pole equipped with markers to report the position of a few characteristic points of the door in the MOCAP reference frame. Finally, a calibration phase using a checkerboard was necessary to determine the position of the camera’s optical center in the MOCAP reference frame. The entire experimental setup is shown in Figure 1.<\/p>\n\n\n\n

    \n\n\n\n
    \n
    \"\"<\/figure>\n<\/figure>\n\n\n\n

    Experimental setup for creating real self-labeled datasets<\/p>\n\n\n\n

    \n\n\n\n

    We also questioned the contribution of synthetic data in the training set with regard to model performance. To do this, we want to gradually inject real data into the dataset and evaluate the model’s performance according to three metrics:<\/p>\n\n\n\n

      \n
    • Accuracy of the distance between 3D center points: percentage of translation errors less than 10% of the object’s diameter relative to the centroid of the 3D bounding boxes (ground truth).<\/li>\n\n\n\n
    • Accuracy of the 2D projection at 5 pixels: Percentage of pixel errors less than 5 pixels relative to the corner of the eighth bounding box of the ground truth of the 3D bounding boxes.<\/li>\n\n\n\n
    • Accuracy at 25 centimeters\/25 degrees: Percentage of translation errors less than 25 cm and rotation errors less than 25 degrees relative to the centroid of the 3D bounding boxes.<\/li>\n<\/ul>\n\n\n\n

      This work is ongoing. We plan to showcase it in a scientific paper to be submitted to the IEEE IECON 2025 conference (submission deadline April 30). Acceptance notifications will be sent out on June 30. The conference will take place in Madrid in October.
      <\/p>\n\n\n\n

      <\/p>\n\n\n\n

      <\/p>\n<\/div>\n<\/div>\n\n\n\n

      <\/p>\n","protected":false},"excerpt":{"rendered":"

      The ROJUNACO project, rooted in Construction 4.0, explores data realignment and semantic information retrieval, and is developing a proof of concept for automated inspections integrating digital twins, BIM, robotics, and augmented reality, with the aim of improving the efficiency and accuracy of operations.<\/p>\n","protected":false},"featured_media":193908,"menu_order":0,"template":"","categories":[528],"tags":[],"class_list":["post-191250","projets","type-projets","status-publish","has-post-thumbnail","hentry","category-en"],"acf":[],"yoast_head":"\nRojunaco \u2013 robotics and digital twins enhance construction - CESI LINEACT<\/title>\n<meta name=\"description\" content=\"ROJUNACO develops automated inspections in Construction 4.0 using digital twins, BIM, robotics, and augmented reality for greater efficiency.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Rojunaco \u2013 robotics and digital twins enhance construction - CESI LINEACT\" \/>\n<meta property=\"og:description\" content=\"ROJUNACO develops automated inspections in Construction 4.0 using digital twins, BIM, robotics, and augmented reality for greater efficiency.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/\" \/>\n<meta property=\"og:site_name\" content=\"CESI LINEACT\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-15T08:48:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/lineact.cesi.fr\/wp-content\/uploads\/2025\/11\/Gemini_Generated_Image_aeu76eaeu76eaeu7.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/projets\\\/rojunaco-robotics-and-augmented-digital-twin-for-construction\\\/\",\"url\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/projets\\\/rojunaco-robotics-and-augmented-digital-twin-for-construction\\\/\",\"name\":\"Rojunaco \u2013 robotics and digital twins enhance construction - CESI LINEACT\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/projets\\\/rojunaco-robotics-and-augmented-digital-twin-for-construction\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/projets\\\/rojunaco-robotics-and-augmented-digital-twin-for-construction\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/lineact.cesi.fr\\\/wp-content\\\/uploads\\\/2025\\\/11\\\/Gemini_Generated_Image_aeu76eaeu76eaeu7.png\",\"datePublished\":\"2025-11-26T08:26:34+00:00\",\"dateModified\":\"2025-12-15T08:48:55+00:00\",\"description\":\"ROJUNACO develops automated inspections in Construction 4.0 using digital twins, BIM, robotics, and augmented reality for greater efficiency.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/projets\\\/rojunaco-robotics-and-augmented-digital-twin-for-construction\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/projets\\\/rojunaco-robotics-and-augmented-digital-twin-for-construction\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/projets\\\/rojunaco-robotics-and-augmented-digital-twin-for-construction\\\/#primaryimage\",\"url\":\"https:\\\/\\\/lineact.cesi.fr\\\/wp-content\\\/uploads\\\/2025\\\/11\\\/Gemini_Generated_Image_aeu76eaeu76eaeu7.png\",\"contentUrl\":\"https:\\\/\\\/lineact.cesi.fr\\\/wp-content\\\/uploads\\\/2025\\\/11\\\/Gemini_Generated_Image_aeu76eaeu76eaeu7.png\",\"width\":1024,\"height\":1024},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/projets\\\/rojunaco-robotics-and-augmented-digital-twin-for-construction\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Projets\",\"item\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/projets\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Rojunaco \u2013 robotics and augmented digital twin for construction\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/\",\"name\":\"CESI LINEACT\",\"description\":\"Laboratoire de recherche et d'innovation\",\"publisher\":{\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/#organization\",\"name\":\"CESI LINEACT\",\"url\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/lineact.cesi.fr\\\/wp-content\\\/uploads\\\/2022\\\/11\\\/cropped-LOGOTYPE_CESI_QUADRI_RVB_2.png\",\"contentUrl\":\"https:\\\/\\\/lineact.cesi.fr\\\/wp-content\\\/uploads\\\/2022\\\/11\\\/cropped-LOGOTYPE_CESI_QUADRI_RVB_2.png\",\"width\":862,\"height\":112,\"caption\":\"CESI LINEACT\"},\"image\":{\"@id\":\"https:\\\/\\\/lineact.cesi.fr\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Rojunaco \u2013 robotics and digital twins enhance construction - CESI LINEACT","description":"ROJUNACO develops automated inspections in Construction 4.0 using digital twins, BIM, robotics, and augmented reality for greater efficiency.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/","og_locale":"en_US","og_type":"article","og_title":"Rojunaco \u2013 robotics and digital twins enhance construction - CESI LINEACT","og_description":"ROJUNACO develops automated inspections in Construction 4.0 using digital twins, BIM, robotics, and augmented reality for greater efficiency.","og_url":"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/","og_site_name":"CESI LINEACT","article_modified_time":"2025-12-15T08:48:55+00:00","og_image":[{"width":1024,"height":1024,"url":"https:\/\/lineact.cesi.fr\/wp-content\/uploads\/2025\/11\/Gemini_Generated_Image_aeu76eaeu76eaeu7.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/","url":"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/","name":"Rojunaco \u2013 robotics and digital twins enhance construction - CESI LINEACT","isPartOf":{"@id":"https:\/\/lineact.cesi.fr\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/#primaryimage"},"image":{"@id":"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/#primaryimage"},"thumbnailUrl":"https:\/\/lineact.cesi.fr\/wp-content\/uploads\/2025\/11\/Gemini_Generated_Image_aeu76eaeu76eaeu7.png","datePublished":"2025-11-26T08:26:34+00:00","dateModified":"2025-12-15T08:48:55+00:00","description":"ROJUNACO develops automated inspections in Construction 4.0 using digital twins, BIM, robotics, and augmented reality for greater efficiency.","breadcrumb":{"@id":"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/#primaryimage","url":"https:\/\/lineact.cesi.fr\/wp-content\/uploads\/2025\/11\/Gemini_Generated_Image_aeu76eaeu76eaeu7.png","contentUrl":"https:\/\/lineact.cesi.fr\/wp-content\/uploads\/2025\/11\/Gemini_Generated_Image_aeu76eaeu76eaeu7.png","width":1024,"height":1024},{"@type":"BreadcrumbList","@id":"https:\/\/lineact.cesi.fr\/en\/projets\/rojunaco-robotics-and-augmented-digital-twin-for-construction\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/lineact.cesi.fr\/en\/"},{"@type":"ListItem","position":2,"name":"Projets","item":"https:\/\/lineact.cesi.fr\/en\/projets\/"},{"@type":"ListItem","position":3,"name":"Rojunaco \u2013 robotics and augmented digital twin for construction"}]},{"@type":"WebSite","@id":"https:\/\/lineact.cesi.fr\/en\/#website","url":"https:\/\/lineact.cesi.fr\/en\/","name":"CESI LINEACT","description":"Laboratoire de recherche et d'innovation","publisher":{"@id":"https:\/\/lineact.cesi.fr\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/lineact.cesi.fr\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/lineact.cesi.fr\/en\/#organization","name":"CESI LINEACT","url":"https:\/\/lineact.cesi.fr\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lineact.cesi.fr\/en\/#\/schema\/logo\/image\/","url":"https:\/\/lineact.cesi.fr\/wp-content\/uploads\/2022\/11\/cropped-LOGOTYPE_CESI_QUADRI_RVB_2.png","contentUrl":"https:\/\/lineact.cesi.fr\/wp-content\/uploads\/2022\/11\/cropped-LOGOTYPE_CESI_QUADRI_RVB_2.png","width":862,"height":112,"caption":"CESI LINEACT"},"image":{"@id":"https:\/\/lineact.cesi.fr\/en\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/lineact.cesi.fr\/en\/wp-json\/wp\/v2\/projets\/191250","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lineact.cesi.fr\/en\/wp-json\/wp\/v2\/projets"}],"about":[{"href":"https:\/\/lineact.cesi.fr\/en\/wp-json\/wp\/v2\/types\/projets"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/lineact.cesi.fr\/en\/wp-json\/wp\/v2\/media\/193908"}],"wp:attachment":[{"href":"https:\/\/lineact.cesi.fr\/en\/wp-json\/wp\/v2\/media?parent=191250"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lineact.cesi.fr\/en\/wp-json\/wp\/v2\/categories?post=191250"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lineact.cesi.fr\/en\/wp-json\/wp\/v2\/tags?post=191250"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}