{"id":4984,"date":"2024-12-06T13:45:34","date_gmt":"2024-12-06T12:45:34","guid":{"rendered":"https:\/\/mecatron.rma.ac.be\/?page_id=4984"},"modified":"2026-01-05T11:33:43","modified_gmt":"2026-01-05T10:33:43","slug":"guided","status":"publish","type":"page","link":"https:\/\/mecatron.rma.ac.be\/index.php\/projects\/guided\/","title":{"rendered":"GUIDED"},"content":{"rendered":"

<\/div><\/div><\/div><\/div><\/div><\/section>
\n\t\t<\/i>\n\t<\/div>\n
<\/p>\n

Defence-related research action (DEFRA)<\/a><\/p>\n

2024 – 2027<\/span><\/p>\n

1.8 M\u20ac<\/p>\n

\n<\/div>

\n\n \"\" <\/div>\n
<\/div>
\n\t\t<\/i>\n\t<\/div>\n
<\/p>\n

Ken Hasselmann<\/a><\/p>\n

Charles Hamesse<\/p>\n

Marnix Enting<\/a><\/p>\n

\n<\/div>

<\/div>\n
\n\n\t

Partners<\/h1>\n<\/div>\n
\n\n \"\" <\/div>\n
<\/div>
\n\n \n \"\" <\/a>\n <\/div>\n
<\/div>
\n\n \"\" <\/div>\n
<\/div>
\n\n \"\" <\/div>\n<\/div><\/div>
<\/p>\n

Revolutionizing the User Experience of Explosive Ordnance Disposal Robotics Operators <\/strong>with Augmented 3D Awareness<\/h2>\n

In the high-stakes field of Explosive Ordnance Disposal (EOD), ensuring safety and efficiency is paramount. Current EOD robots rely on a 2D video feed for navigation and operation, a setup that limits situational awareness and places significant cognitive strain on operators. The GUIDED project aims to overcome these limitations by developing cutting-edge technology that enhances operator experience and performance.<\/p>\n

Enhancing EOD Operations with 3D Reconstruction<\/h3>\n

The GUIDED project focuses on creating an advanced augmented reality system for EOD robots. By integrating a suite of multi-spectral sensors and real-time image processing software, the project will provide operators with a comprehensive 3D reconstruction of their surroundings. This enhanced situational awareness enables operators to navigate and manipulate robots more intuitively, reducing the dependency on continuous training.<\/p>\n

Key Innovations<\/h3>\n
    \n
  1. \n

    Multi-Sensor 3D Reconstruction<\/strong>: By combining data from multispectral cameras, GUIDED generates a real-time 3D overview of the operational environment. Operators can utilize a third-person or bird\u2019s-eye-view (BEV) perspective to gain critical spatial awareness.<\/p>\n<\/li>\n

  2. \n

    AI-Driven Salient Region Detection<\/strong>: To reduce cognitive load, the system uses artificial intelligence to highlight regions of interest in various spectral bands. These regions, invisible in the standard visible spectrum, are crucial for identifying potential threats.<\/p>\n<\/li>\n

  3. \n

    Immersive VR Interface<\/strong>: Operators will interact with the augmented 3D environment through head-mounted displays (VR goggles). This immersive interface consolidates critical information, improving decision-making efficiency and operational safety.<\/p>\n<\/li>\n<\/ol>\n

    Project Objectives<\/h3>\n

    The GUIDED project will develop a TRL5 demonstrator that:<\/p>\n

      \n
    • \n

      Improves situational awareness through real-time multi-sensor 3D scene reconstruction.<\/p>\n<\/li>\n

    • \n

      Enhances threat detection by leveraging AI to identify hidden threats in non-visible spectra.<\/p>\n<\/li>\n

    • \n

      Reduces cognitive load with intelligent visualisation tools and an intuitive user interface.<\/p>\n<\/li>\n<\/ul>\n

      Agile, User-Centric Development Approach<\/h3>\n

      GUIDED employs an end-user-driven methodology, with the DOVO EOD operators at the heart of the development process. Regular feedback and iterative testing will ensure the system meets operational needs. Starting with off-the-shelf hardware, the project will integrate advanced software tools, including:<\/p>\n

        \n
      • \n

        Multimodal Simultaneous Localization and Mapping (SLAM) for precise positioning in complex environments.<\/p>\n<\/li>\n

      • \n

        State-of-the-art Neural Radiance Fields (NeRFs) for photorealistic scene visualizations.<\/p>\n<\/li>\n

      • \n

        Salient region prediction algorithms to prioritize critical information.<\/p>\n<\/li>\n<\/ul>\n

        Realistic Testing and Validation<\/h3>\n

        The prototype system will undergo rigorous testing and refinement, culminating in a realistic demonstration scenario. This approach ensures the technology is robust, effective, and ready for deployment in operational contexts. By working closely with Belgian Defence, the project aims to maximize the impact and usability of its innovations.<\/p>\n

        Transforming EOD Robotics<\/h3>\n

        GUIDED\u2019s groundbreaking technology promises to revolutionize the way EOD operations are conducted. By enhancing the interaction between robots and operators, the project will not only improve operational safety and efficiency but also set new standards for user-centric design in defence robotics.<\/p>\n

        \n<\/div><\/div><\/div>