Month: June 2023

Celebrating the achievements of HumanTech's first year

It's been a year since the start of HumanTech! And we are getting a feeling of great momentum building up in our project. Having invested a good amount of time in clearly defining tasks, dependencies and architectures during this period, we will focus even more on our technical developments in the coming year.

Since HumanTech began, we have already seen some promising first results — from scanning and semantic reconstruction to wearables integration and robotics & perception — while initiating our first round of user evaluations. Meanwhile, the scientific excellence of our consortium is already evident with three publications and technical challenge awards.

We have also been very active in communication, dissemination and community building for artificial intelligence (AI) in construction by organising two technical workshops with impressive attendance and having a very active online presence.

Below, discover our progress in this first part of the project and our plans for the period ahead.

https://youtu.be/KUC21zRo4yE

Overall framework definitions

Our partners at the German Research Centre for Artificial Intelligence (DFKI) have led the implementation of the HumanTech cooperation, defining our overall vision and creating the first version of the project's system architecture.

After many fruitful team discussions and collaboration with partners involved in the project's technical development and pilots, they have defined a detailed architecture at the modular level — clearly paving a path from technical developments to integrated proof-of-concept implementations for our pilots.

Furthermore, they have been able to define a comprehensive collection of end-user requirements for our HumanTech technologies, which will be the basis for further human-centred technology evaluation activities and, above that, have guiding character for our technology developing partners.

Our team working on the project's overall framework definitions will now closely follow the progress of the rest of the team to make the necessary updates towards the final version of the HumanTech system architecture.

BIMxD formats and standardisation

Our team focused on BIMxD (multidimensional building information modelling) formats and standardisation, led by the University of Padova, has worked on implementing standardised and openBIM methods in designing a BIMxD platform, in terms of technology implementation and processes.

Their main activities during our first project year could be summarised in these:

• Analysis of the existing standards and openBIM implementation in semantic BIM modelling, use of BIM models and robotics in construction activities
• Definition of the exchange requirements of the BIMxD platform
• Design of the BIMxD platform for collaboration
• Implementation of the BCF (BIM Collaboration Format) for the task
• Initial work on open-source BIM software and framework for modelling and updating services of BIMxD representations

Regarding their main results achieved, they have advanced on the implementation of the IDM for the BIMxD platform and executed the first successful workflow in the BIMxD platform using an open-source framework.

Next, they will focus on implementing the BIMxD platform, the BSDD domain for the BMxD platform and required implementation, and the framework and software modules for the opensource BIM tool.

Dynamic semantic digital twin generation

The main activities of our team focused on dynamic semantic digital twin generation, led by Naska.AI, have been:

• The development of hardware and software pipelines for unmanned ground vehicles (UGV) and unmanned aerial vehicles (UAV) data capture platforms
• The development and testing of prototype RGB-D sensor
• The development of an industrial 360° RGB (red, green, and blue) camera
• The capture of several RGBD (red, green, blue depth) datasets, development of annotation workflow and tools for semantic segmentation
• Initial work on synthetic data generation from BIM models
• The definition of scan-to-BIM pipeline and algorithm development
• The study of the state-of-the-art for the use of spectral sensors for building material classification and identification of suitable sensors

In this regard, we have achieved the following:

• An initial hardware and software pipeline for UGV data capture
• Promising initial results of RGB-D camera prototype
• Multimodal data capture at a test site in Weingarten, Germany
• Promising initial results on semantic segmentation from RGB-D data

Our work during the next phase of the project will be focused on:

• The integration of the RICOH industrial 360° camera on UGV and UAV platforms
• The development of path planning algorithm for autonomous UGV inspection
• The testing of a multispectral sensor for building material classification and its integration on a UGV platform
• Continuing the development of semantic segmentation algorithms using RGB-D data
• Synthetic data generation from BIM models and domain adaptation
• Multimodal data capture with final configurations of UGV and UAV platforms
• The development of a scan-to-BIM pipeline

Wearable technologies for construction

Our partners working on wearable technologies, also led by the German Research Centre for Artificial Intelligence (DFKI), have been involved in discussions and workshops with other partners to help define a detailed architecture and specify the pilot use cases to which the components they are developing will contribute.

They have detailed specifications on visual body sensor network components and their interfaces, and designed and constructed a novel miniaturised 360° camera that is being integrated into the visual body sensor network.

In parallel, they have built test equipment with IMUs (inertial measurement units) and physical sensors to reproduce the laboratory's pilot use case of the exoskeleton.

Based on a new 360° camera, they are developing a first setup of a visual-inertial tracking system. The concept of this visual body sensor network will be documented in a public report. Also, they will collect sensor data with the exoskeleton to develop an intention recognition algorithm for activating it.

In this next phase, the partners involved in these tasks will also work on localising the wearable camera in the digital twin and the BIMxD visualisation in extended reality (XR) glasses. They have already started to conceive and discuss concepts and have initiated workshops with other partners to define interfaces and benefit from existing BIM standards.

Their next step is to define suitable laboratory spaces, equip them accordingly, and generate BIM models from them as a basis for our research on the target functionalities.

Construction robotics and human-robot collaboration

Our main achievements in our work on construction robotics and human-robot collaboration, led by SINTEF, have been:

• Establishing a common understanding for our pilots
• Defining the robotic tasks for demolition, handling and mastic application
• Doing a site visit to get a hands-on experience with construction processes
• Initial research and development for the teleoperation of a robotic system
• System design for robotic manipulation platform to be used in pilots
• Design and prototyping of robotic grippers for pilots
• Training of vision algorithms for the detection of bricks and humans
• Initial testing and studies with human-robot communication interfaces (e.g., voice or gesture control)

Our first results in this field have been:

• To develop the first draft of robotic construction ontology
• To document and publish vision algorithms for brick/human detection
• To test teaching algorithms for programming robots
• To establish a common data repository for exchanging designs and plans
• To design a robotic task execution framework

Next, a robotic platform will be ready to be tested on construction sites.

Human factors - Training and usability assessment

Our work on human factors and training and usability assessment, led by the Technological University of the Shannon (TUS), has focused on the following:

• Preparing material for the subjective assessment of worker's technology acceptance related to collaborative and interactive robots, exoskeletons and XR technologies
• Organising three focus groups in Spain (2) and Ireland (1) with the main stakeholders of the construction sector (apprentices, workers and supervisors), where we have presented technology features and benefits
• Making questionnaires about the technology acceptance, features required and ways of interaction with technology developments to participants

Currently, we are processing the answers from participants and analysing the data we have gathered. We will soon deliver our results and conclusions.

Continuing with the subjective assessment, we will organise more focus groups in Central Europe. Once our technologies are ready to test, we will proceed with the objective assessment, which we will carry out by evaluating physiological sensor data collected in dedicated training sessions.

Pilots, evaluation and validation

Our work on pilots, evaluation and validation, led by the University of Kaiserslautern-Landau (RPTU), has been dedicated to defining the use cases and interfaces to other partners.

In several on and off-site workshops, we have managed to define interesting use cases for human-robot collaborative bricklaying, robotic mastic application, including learning from demonstration, and robotic demolition.

We have held fruitful discussions that have led to good ideas about possible use cases for our digital twin pilots, including health and safety monitoring, construction progress tracking, dynamic semantic digital twin generation and BIMxD update.

Outreach and collaboration

We have focused our work on communication and dissemination, as well as on community building, led by Australo, on:

• Establishing our visual identity and our internal and external communication channels
• Sharing what our project is about, what the technologies we are developing consist of, how they will positively contribute to the construction industry and its workers, and the work and stories of the organisations and professionals involved in HumanTech
• Giving visibility to our main achievements, including publishing our first scientific paper, receiving several technical challenge awards (BOP Challenge, ECCV 2022, EC³, CVPR 2023), and organising two technical workshops
• Collaborating with our sister projects, BEEYONDERS and RoBétArmé, with which we have created the #Tech4EUconstruction cluster, and StandICT.eu

During the project's next phase, we will continue strengthening our online and offline presence, engaging our stakeholders in our progress and raising awareness of our work through more events, publications and communication campaigns.

We look forward to the second year of our project to continue working towards a safer, greener and more efficient construction industry with our outstanding team of diverse skills and an impressive openness to collaboration.

Subscribe to our newsletter and follow us on LinkedIn and Twitter to learn more about our work at HumanTech, and stay updated on our advances!

by andrea@australo.org

Tech4EUconstruction cluster: revolutionizing the construction sector together

We are excited to announce that at HumanTech, we have joined forces with our sister projects, BEEYONDERS and RoBétArmé, to create the collaborative cluster "Tech4EUconstruction". Together, our three EU-funded projects are boarding on an exciting journey to address key challenges of the European construction sector.

Funded by the European Commission, our three projects aim to develop and demonstrate new technologies to further digitalise and automatise the European building sector, increasing its safety and attractivity for workers. Furthermore, our cluster seeks to stimulate the EU’s sovereignty in the industry, decreasing the need for technological imports.

The members of the Tech4EUconstruction cluster

HumanTech

At HumanTech, we aim to overcome major challenges in the European construction sector by achieving significant advances in cutting-edge technologies. Our objective is to establish a safe, rewarding, and digitally-enabled work environment that caters to highly skilled construction workers' and engineers' requirements while enhancing workforce well-being, productivity, and resource efficiency.

BEEYONDERS

BEEYONDERS’ core ambition is to address the challenges hampering the EU’s competitiveness in the construction sector by producing, commercializing and integrating beyond state-of-the-art solutions into real construction scenarios. The project will extensively use AI, automation, and digitisation to do so.

RoBétArmé

RoBétArmé seeks to revolutionize Construction 4.0 by automating labour-intensive tasks in shotcrete application, targeting improved safety, productivity, and sustainability in the construction industry. To this end, the project will deliver a human-robot collaborative construction system for shotcrete digitalization and automation through advanced perception, cognition, mobility and additive manufacturing skills.

We have created a joint visual identity to facilitate our recognition by our key stakeholders. It represents our shared vision and commitment towards creating breakthrough technologies supporting technological sovereignty in construction.

Stay tuned and follow our hashtag #Tech4EUconstruction for updates on our joint activities as we work together to shape the construction landscape in the EU.

by andrea@australo.org

Unlocking the future of research: Chiara Zarna, research scientist at SINTEF

Our series 'Unlocking the future of research' is coming to its first release! In this editorial, we will hear from the PhDs, PostDocs, junior researchers, staff, master students and interns working on HumanTech. They will tell us about their experience in our project, how it fits with their research and how working on a European-funded initiative can influence their careers.

Meet our first guest, Chiara Zarna, a brilliant research scientist at SINTEF, Norway:

Just one month ago, I started my position as a researcher at SINTEF Manufacturing AS. This was right after graduating with a PhD from the Norwegian University of Science and Technology (NTNU). In fact, my Norwegian journey started after my master’s graduation from the Technical University Dresden in my home country, Germany.

During my master’s, I specialised in textile and processing machinery, where I became especially interested in polymer composite material characterisation, design and manufacturing. Slightly off-topic, I chose to write my master’s thesis during an industrial internship on the anti-squeak behaviour of artificial leather for the application of automotive seats. I consider this one of my most valuable experiences, as I gained insights into how daily business is handled in large companies and how to interact with many fundamentally different people.

"I consider this internship as one of my most valuable experiences, as I gained insights into how daily business is handled in large companies and how to interact with many different people."

Just a few days after defending my master’s thesis, I was lucky to receive a call notifying me about the opportunity to start a PhD position at NTNU in the field of wood fibre-reinforced thermoplastics, also referred to as biocomposites. I happily took this chance and moved to Norway with full excitement, as it was my first educational stay abroad and my first in Norway ever.

During my PhD and besides subject-related knowledge, I gained skills in scientific working, writing and communicating, as well as handling complex tasks and not losing myself in a swirl of uncertainties (or at least how to escape it before drowning). It was a partially challenging but mostly exciting time, which sparked my desire to become a researcher. Besides that, I got to know the Norwegian culture, language and environment, making me fall in love with a major part of that. Thus, the decision to stay became evident relatively early on.

"During my PhD, I gained skills in scientific working, writing and communicating, as well as handling complex tasks and not losing myself in a swirl of uncertainties."

After that, another exciting opportunity arose, which I gratefully seized out of curiosity for new challenges. For the first time, I got the chance to participate in an EU-funded project. The HumanTech project deals with human-centred intelligent automation of the European construction industry, supported by omnipresent data and knowledge. The aim is to increase the productivity, safety and well-being of its workforce and importantly contribute to the shift towards a more resource-efficient and sustainable industry.

Ten countries are involved in the project, which significantly widens the horizon of my work and brings new challenges in terms of collaboration across borders and taking into account perhaps yet unnoticed viewpoints. On the other hand, the opportunity to build or expand my network with industrial and academic partners on a European level is of the highest value. It accommodates the potential to gain international visibility and identify future research trends and needs from a broader perspective.

"The opportunity to build or expand my network with industrial and academic partners on a European level is of the highest value."

Besides that, I am more than excited to be part of a project with high international relevance and to dive deeper into great collaborative work. Work that is again slightly different from what I did before. For me, however, it is motivating and keeps my curiosity alive to get involved in different research fields and deal with new perspectives, especially when a project’s objectives are as ambitious and trendsetting as they are in HumanTech.

Stay tuned for the next editions of our "Unlocking the future of research" editorial series and subscribe to our newsletter and follow us on LinkedIn and Twitter to learn more about our advances!

by andrea@australo.org