2026
Journal article
Open Access
A 3D-based web platform for multi-source diagnostic data fusion and visualization
Belfiore Cristina Maria, Callieri Marco, D'Agostino Graziana, Menta Salvatore, Potenziani Marco, Santagati Cettina, Scopigno Roberto
Cultural Heritage conservation increasingly relies on the integration of diverse diagnostic data acquired through multiple techniques. However, managing together these data, often heterogeneous in format and origin, remains a significant challenge. Starting from this premise, we introduce a web-based platform designed to support data fusion and visualization of multi-source diagnostic analysis. Designed by a multidisciplinary research team and developed exploiting open-source technologies, the platform enables interactive access to diagnostic results through annotated 3D models, allowing users to interrogate specific areas of interest, retrieve the associated analytical data, and share them in several ways. A key feature of the platform is its JSON-driven data management system, which associates each diagnostic analysis with a specific template composed of atomic fields easily adaptable to the requirements of various analytical methods. The platform was validated through a case study on the historic mortars of a prominent 18th-century building in Catania (Italy), a context characterized by visible degradation and partial loss of plaster, ideal for sampling and analysis. Diagnostic data were acquired using a range of techniques (including XRPD, FTIR-ATR, WD-XRF, and POM) and complemented with 3D surveying methods, resulting in a rich dataset comprising both metric and analytical information. The study confirmed that fusing heterogeneous datasets within a unified system can exemplify a data-driven approach to heritage diagnostics, while the ability to annotate models and link them to specific diagnostic entries can add a layer of semantic richness crucial for interdisciplinary interpretation.Source: INTERNATIONAL ARCHIVES OF THE PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCES, vol. XLVIII-2/W12-2026, pp. 41-48
DOI: 10.5194/isprs-archives-xlviii-2-w12-2026-41-2026
Project(s): Cultural Heritage Innovation for Next-Gen Sustainable Society
Metrics:
Belfiore Cristina Maria, Callieri Marco, D'Agostino Graziana, Menta Salvatore, Potenziani Marco, Santagati Cettina, Scopigno Roberto
Cultural Heritage conservation increasingly relies on the integration of diverse diagnostic data acquired through multiple techniques. However, managing together these data, often heterogeneous in format and origin, remains a significant challenge. Starting from this premise, we introduce a web-based platform designed to support data fusion and visualization of multi-source diagnostic analysis. Designed by a multidisciplinary research team and developed exploiting open-source technologies, the platform enables interactive access to diagnostic results through annotated 3D models, allowing users to interrogate specific areas of interest, retrieve the associated analytical data, and share them in several ways. A key feature of the platform is its JSON-driven data management system, which associates each diagnostic analysis with a specific template composed of atomic fields easily adaptable to the requirements of various analytical methods. The platform was validated through a case study on the historic mortars of a prominent 18th-century building in Catania (Italy), a context characterized by visible degradation and partial loss of plaster, ideal for sampling and analysis. Diagnostic data were acquired using a range of techniques (including XRPD, FTIR-ATR, WD-XRF, and POM) and complemented with 3D surveying methods, resulting in a rich dataset comprising both metric and analytical information. The study confirmed that fusing heterogeneous datasets within a unified system can exemplify a data-driven approach to heritage diagnostics, while the ability to annotate models and link them to specific diagnostic entries can add a layer of semantic richness crucial for interdisciplinary interpretation.Source: INTERNATIONAL ARCHIVES OF THE PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCES, vol. XLVIII-2/W12-2026, pp. 41-48
DOI: 10.5194/isprs-archives-xlviii-2-w12-2026-41-2026
Project(s): Cultural Heritage Innovation for Next-Gen Sustainable Society
Metrics:
See at:
CNR IRIS 
| isprs-archives.copernicus.org | CNR IRIS 
2026
Contribution to book
Open Access
Tecnologie per la conservazione e il restauro
Scopigno Roberto, Potenziani Marco, Callieri Marco
Le tecnologie diagnostiche forniscono un contributo fondamentale alla conoscenza dell’opera, alla verifica del suo stato di conservazione e a una corretta pianificazione delle possibili azioni di restauro. Questi strumenti hanno superato di gran lunga le potenzialità della semplice analisi visiva dell’esperto. In questo contributo viene presentata una succinta review delle principali tecnologie diagnostiche, illustrandone il contributo all’acquisizione di informazioni sui materiali e la loro composizione chimica, sulla struttura e l’analisi degli strati pittorici, sulle tecniche costruttive e sul grado di conservazione. Una serie di lavori citati permetterà di approfondire questo tema molto complesso e differenziato.Project(s): Cultural Heritage Innovation for Next-Gen Sustainable Society
Scopigno Roberto, Potenziani Marco, Callieri Marco
Le tecnologie diagnostiche forniscono un contributo fondamentale alla conoscenza dell’opera, alla verifica del suo stato di conservazione e a una corretta pianificazione delle possibili azioni di restauro. Questi strumenti hanno superato di gran lunga le potenzialità della semplice analisi visiva dell’esperto. In questo contributo viene presentata una succinta review delle principali tecnologie diagnostiche, illustrandone il contributo all’acquisizione di informazioni sui materiali e la loro composizione chimica, sulla struttura e l’analisi degli strati pittorici, sulle tecniche costruttive e sul grado di conservazione. Una serie di lavori citati permetterà di approfondire questo tema molto complesso e differenziato.Project(s): Cultural Heritage Innovation for Next-Gen Sustainable Society
See at:
CNR IRIS | www.store.rubbettinoeditore.it | CNR IRIS | CNR IRIS
2025
Other
Open Access
ISTI-day 2025 Proceedings
Del Corso G., Pedrotti A., Federico G., Gennaro C., Carrara F., Amato G., Di Benedetto M., Gabrielli E., Belli D., Matrullo Zoe, Miori V., Tolomei Gabriele, Waheed T., Marchetti E., Calabrò Antonello., Rossetti G., Stella Massimo, Cazabet Rémy, Abramski K., Cau E., Citraro S., Failla A., Mesina V., Morini V., Pansanella V., Colantonio S., Germanese D., Pascali M. A., Bianchi L., Messina N., Falchi F., Barsellotti L., Pacini G., Cassese M., Puccetti G., Esuli A., Volpi L., Moreo Alejandro, Sebastiani F., Sperduti G., Nguyen Dong, Broccia G., Ter Beek M. H., Ferrari A., Massink M., Belmonte Gina, Ciancia V., Papini O., Canapa G., Catricalà B., Manca M., Paternò F., Santoro C., Zedda E., Gallo S., Maenza S., Mattioli A., Simeoli L., Rucci D., Carlini E., Dazzi P., Kavalionak H., Mordacchini M., Rulli C., Muntean Cristina Ioana, Nardini F. M., Perego R., Rocchietti G., Lettich F., Renso C., Pugliese C., Casini G., Haldimann Jonas, Meyer Thomas, Assante M., Candela L., Dell'Amico A., Frosini L., Mangiacrapa F., Oliviero A., Pagano P., Panichi G., Peccerillo B., Procaccini M., Mannocci A., Manghi P., Lonetti F., Kang Dongjae, Di Giandomenico F., Jee Eunkyoung, Lazzini G., Conti F., Scopigno R., D'Acunto M., Moroni D., Cafiso M., Paradisi P., Callieri M., Pavoni G., Corsini M., De Falco A., Sala F., Saraceni Q., Gattiglia Gabriele
ISTI-Day is an annual information and networking event organized by the Institute of Information Science and Technologies "A. Faedo" (ISTI) of the Italian National Research Council (CNR). This event features an opening talk of the Director of the Dept. DIITET (Emilio F. Campana) as well as an overview of the Institute's activities presented by the ISTI Director (Roberto Scopigno). Those institutional segments are complemented by dedicated presentations and round tables featuring former staff members, as well as internal and external collaborators. To foster a network of knowledge and collaboration among newcomers, the 2025 ISTI Day edition also includes a large poster session that provides a comprehensive overview of current research activities. Each of the 13 laboratories contributes 1–3 posters, highlighting the most innovative work and offering early-career researchers a platform for discussion. Thus these proceedings include the posters selected for ISTI-Day 2025, reflecting the diverse and innovative nature of the Institute's research.
Del Corso G., Pedrotti A., Federico G., Gennaro C., Carrara F., Amato G., Di Benedetto M., Gabrielli E., Belli D., Matrullo Zoe, Miori V., Tolomei Gabriele, Waheed T., Marchetti E., Calabrò Antonello., Rossetti G., Stella Massimo, Cazabet Rémy, Abramski K., Cau E., Citraro S., Failla A., Mesina V., Morini V., Pansanella V., Colantonio S., Germanese D., Pascali M. A., Bianchi L., Messina N., Falchi F., Barsellotti L., Pacini G., Cassese M., Puccetti G., Esuli A., Volpi L., Moreo Alejandro, Sebastiani F., Sperduti G., Nguyen Dong, Broccia G., Ter Beek M. H., Ferrari A., Massink M., Belmonte Gina, Ciancia V., Papini O., Canapa G., Catricalà B., Manca M., Paternò F., Santoro C., Zedda E., Gallo S., Maenza S., Mattioli A., Simeoli L., Rucci D., Carlini E., Dazzi P., Kavalionak H., Mordacchini M., Rulli C., Muntean Cristina Ioana, Nardini F. M., Perego R., Rocchietti G., Lettich F., Renso C., Pugliese C., Casini G., Haldimann Jonas, Meyer Thomas, Assante M., Candela L., Dell'Amico A., Frosini L., Mangiacrapa F., Oliviero A., Pagano P., Panichi G., Peccerillo B., Procaccini M., Mannocci A., Manghi P., Lonetti F., Kang Dongjae, Di Giandomenico F., Jee Eunkyoung, Lazzini G., Conti F., Scopigno R., D'Acunto M., Moroni D., Cafiso M., Paradisi P., Callieri M., Pavoni G., Corsini M., De Falco A., Sala F., Saraceni Q., Gattiglia Gabriele
ISTI-Day is an annual information and networking event organized by the Institute of Information Science and Technologies "A. Faedo" (ISTI) of the Italian National Research Council (CNR). This event features an opening talk of the Director of the Dept. DIITET (Emilio F. Campana) as well as an overview of the Institute's activities presented by the ISTI Director (Roberto Scopigno). Those institutional segments are complemented by dedicated presentations and round tables featuring former staff members, as well as internal and external collaborators. To foster a network of knowledge and collaboration among newcomers, the 2025 ISTI Day edition also includes a large poster session that provides a comprehensive overview of current research activities. Each of the 13 laboratories contributes 1–3 posters, highlighting the most innovative work and offering early-career researchers a platform for discussion. Thus these proceedings include the posters selected for ISTI-Day 2025, reflecting the diverse and innovative nature of the Institute's research.
See at:
CNR IRIS | www.isti.cnr.it | CNR IRIS
2025
Other
Open Access
CHANGES - D5.2 Report on digital tools for data sharing and processing, designed to support CH stakeholders in the management and analysis of diagnostic results
Potenziani M., Scopigno R., Romano F. P., Preisler Z., Romandini M., Falciano S., De Panfilis E., Santagati C., D’agostino G.
This report introduces part of the work performed in the “CHANGES” project, and specifically in Spoke 5 “Science and Technologies for Sustainable Diagnostics for Cultural Heritage” WP5 “Digital technologies, AI/ML solutions, chemometric methods supporting data-driven Heritage”. It presents and discusses the results obtained in the WP by the research partners involved. The deliverable addresses various aspects of the digital support required for scientific investigation and the presentation of Cultural Heritage assets. It focuses on the following activities: implementing services for data analysis; designing interactive and collaborative visualization tools, including features for sample data integration and interactive inspection; and developing digital methodologies for the restoration of missing parts. The reported experiences contribute to the broader objective of supporting the knowledge consolidation process through digital tools, ultimately aiming to enhance the understanding and assessment of the conservation status of heritage assets.DOI: 10.5281/zenodo.17052994
DOI: 10.5281/zenodo.17052993
Project(s): Cultural Heritage Innovation for Next-Gen Sustainable Society
Metrics:
Potenziani M., Scopigno R., Romano F. P., Preisler Z., Romandini M., Falciano S., De Panfilis E., Santagati C., D’agostino G.
This report introduces part of the work performed in the “CHANGES” project, and specifically in Spoke 5 “Science and Technologies for Sustainable Diagnostics for Cultural Heritage” WP5 “Digital technologies, AI/ML solutions, chemometric methods supporting data-driven Heritage”. It presents and discusses the results obtained in the WP by the research partners involved. The deliverable addresses various aspects of the digital support required for scientific investigation and the presentation of Cultural Heritage assets. It focuses on the following activities: implementing services for data analysis; designing interactive and collaborative visualization tools, including features for sample data integration and interactive inspection; and developing digital methodologies for the restoration of missing parts. The reported experiences contribute to the broader objective of supporting the knowledge consolidation process through digital tools, ultimately aiming to enhance the understanding and assessment of the conservation status of heritage assets.DOI: 10.5281/zenodo.17052994
DOI: 10.5281/zenodo.17052993
Project(s): Cultural Heritage Innovation for Next-Gen Sustainable Society
Metrics:
2024
Other
Open Access
CHANGES - D5.1 Report on data encoding-integration-processing needs of CH stakeholders
Scopigno R., Potenziani M.
This report is part of the work planned in the project PNRR PE 5 “CHANGES”, and specifically in Spoke 5 “Science and Technologies for Sustainable Diagnostics for Cultural Heritage”, WP5 “Digital technologies, AI/ML solutions, chemometric methods supporting data-driven Heritage”. It implements one of the results planned in the project: R5.1 – Study of CH stakeholders' needs concerning data encoding/integration/processing – M12 and constitutes one of the Deliverables: D5.1–Report on data encoding/integration/processing needs of CH stakeholders. The scope of this report is to collect, discuss, and organize the needs of our stakeholders (museum curators, conservators, restorers, art historians, ...), to highlight how they need support in terms of enabling digital data types, digitization processes, and digital platforms/tools. The results of this preliminary study will steer the design of the tools and technologies developed in Spoke5-WP5. The Cultural Heritage (CH) context is very broad, both in terms of preservation goals and subjects (ranging from a small artifact to an entire building, up to an archaeological site or an entire city) and in terms of research/conservation questions (which, in turn, often require different representation approaches, media, scales, and accuracies). For this reason, we have first to introduce some concepts and distinctions between the different digital approaches to CH management, and then we will present the results of a questionnaire aimed at collecting information and needs from potential stakeholders. The final goal is to use this knowledge to guide the process of designing new digital tools aimed at supporting our community.Project(s): Cultural Heritage Innovation for Next-Gen Sustainable Society
Scopigno R., Potenziani M.
This report is part of the work planned in the project PNRR PE 5 “CHANGES”, and specifically in Spoke 5 “Science and Technologies for Sustainable Diagnostics for Cultural Heritage”, WP5 “Digital technologies, AI/ML solutions, chemometric methods supporting data-driven Heritage”. It implements one of the results planned in the project: R5.1 – Study of CH stakeholders' needs concerning data encoding/integration/processing – M12 and constitutes one of the Deliverables: D5.1–Report on data encoding/integration/processing needs of CH stakeholders. The scope of this report is to collect, discuss, and organize the needs of our stakeholders (museum curators, conservators, restorers, art historians, ...), to highlight how they need support in terms of enabling digital data types, digitization processes, and digital platforms/tools. The results of this preliminary study will steer the design of the tools and technologies developed in Spoke5-WP5. The Cultural Heritage (CH) context is very broad, both in terms of preservation goals and subjects (ranging from a small artifact to an entire building, up to an archaeological site or an entire city) and in terms of research/conservation questions (which, in turn, often require different representation approaches, media, scales, and accuracies). For this reason, we have first to introduce some concepts and distinctions between the different digital approaches to CH management, and then we will present the results of a questionnaire aimed at collecting information and needs from potential stakeholders. The final goal is to use this knowledge to guide the process of designing new digital tools aimed at supporting our community.Project(s): Cultural Heritage Innovation for Next-Gen Sustainable Society
2023
Other
Restricted
Repository PNRR ISTI
Pierangela Cempini, Enrico Fantini, Barbara Furletti, Giuseppe Lipari, Alessandra Pierotti, Roberto Scopigno, Federico Volpini
Il documento descrive la piattaforma progettata e implementata per la gestione della documentazione da fornire in rendicontazione PNRRDOI: 10.32079/isti-tr-2023/013
DOI: https://doi.org/10.32079/isti-tr-2023/013
Metrics:
Pierangela Cempini, Enrico Fantini, Barbara Furletti, Giuseppe Lipari, Alessandra Pierotti, Roberto Scopigno, Federico Volpini
Il documento descrive la piattaforma progettata e implementata per la gestione della documentazione da fornire in rendicontazione PNRRDOI: 10.32079/isti-tr-2023/013
DOI: https://doi.org/10.32079/isti-tr-2023/013
Metrics:
2022
Conference article
Open Access
Cultural Heritage 3D data on the Web: issues and perspectives
Potenziani M, Ponchio F, Callieri M, Cignoni P, Scopigno R
Les modèles numériques 3D sont unanimement considérés comme un atout inestimable pour l'étude, la gestion et la promotion du patrimoine culturel. L'urgence de COVID-19 a accéléré la tendance commune à travailler à distance et, pour le patrimoine culturel, la présentation, le partage et l'accès aux données 3D en ligne sont désormais perçus comme une nécessité. Malheureusement, l'absence de méthodologies, d'outils et d'infrastructures standard rend difficile le passage du stockage local à la gestion en ligne de données 3D complexes. Dans cette contribution, nous souhaitons évaluer l'état de l'art de l'utilisation avancée de la 3D sur le web, en soulignant les besoins actuels, en présentant quelques études de cas et en explorant les perspectives futures.
Potenziani M, Ponchio F, Callieri M, Cignoni P, Scopigno R
Les modèles numériques 3D sont unanimement considérés comme un atout inestimable pour l'étude, la gestion et la promotion du patrimoine culturel. L'urgence de COVID-19 a accéléré la tendance commune à travailler à distance et, pour le patrimoine culturel, la présentation, le partage et l'accès aux données 3D en ligne sont désormais perçus comme une nécessité. Malheureusement, l'absence de méthodologies, d'outils et d'infrastructures standard rend difficile le passage du stockage local à la gestion en ligne de données 3D complexes. Dans cette contribution, nous souhaitons évaluer l'état de l'art de l'utilisation avancée de la 3D sur le web, en soulignant les besoins actuels, en présentant quelques études de cas et en explorant les perspectives futures.
See at:
CNR IRIS | ISTI Repository | www.heritageresearch-hub.eu | CNR IRIS
2022
Conference article
Restricted
Leafing through the painting "Ecce Homo" by Antonello da Messina: multimodal imaging techniques and data-fusion
Cucci C., Potenziani M., Albertin F., Ruberto C., Picollo M., Stefani L., Callieri M., Siotto E., Pingi P., Scopigno R., Castelli L., Taccetti F., Bettuzzi M., Brancaccio R., Morigi M. P., De Vita F.
European Research Infrastructures for Heritage Science enable access to cutting-edge technologies and top-level expertise to solve specific queries on high value artworks and heritage assets. A successful example of this approach was the ECCEHOMO Project, carried out within E-RIHS program [1-3] and dedicated to non-invasive multimodal analysis of the painting “Ecce Homo” by Antonello da Messina (ca. 1430–1479). This masterpiece of the Early Italian Renaissance is carefully preserved at the Collegio Alberoni in Piacenza (Italy). Being extremely fragile, this painting needs continuous monitoring and the implementation of careful preventive conservation strategy, which should be based on sound knowledge of materials and conservation status of the painting. The interdisciplinary research undertaken in the project combined cutting-edge 3D and 2D techniques to perform a systematic, rigorously non-invasive, analysis of the artwork. By exploiting the complementarity of imaging spectroscopic techniques operating in different regions of the electromagnetic spectrum (from X-rays to the Ultraviolet, Visible and Infrared ranges) the painting was fully investigated, virtually ‘leafing through' its levels and structures the from the surface to the wooden support. Structured-light 3D metrological survey was used to digitize the external surface of the artwork. The surface irregularities and the support were analyzed with a structured-light 3D scanner and X-ray tomography. UV fluorescence was used to visualize the aged layers of varnishes. X-ray fluorescence scanning (MA-XRF) and reflectance hyperspectral imaging (HSI) were combined to study pictorial materials and their distributions, and the artist technique. Hidden details were brought to the light, like a fingerprints traces. Data-fusion from the 2D and 3D techniques provided new insights on the artwork and updated documentation of the conservation status. The obtained digital documentation was exploited to compile web-based interactive platforms targeted at the visualization and dissemination of the results, for both professional users and large public.
Cucci C., Potenziani M., Albertin F., Ruberto C., Picollo M., Stefani L., Callieri M., Siotto E., Pingi P., Scopigno R., Castelli L., Taccetti F., Bettuzzi M., Brancaccio R., Morigi M. P., De Vita F.
European Research Infrastructures for Heritage Science enable access to cutting-edge technologies and top-level expertise to solve specific queries on high value artworks and heritage assets. A successful example of this approach was the ECCEHOMO Project, carried out within E-RIHS program [1-3] and dedicated to non-invasive multimodal analysis of the painting “Ecce Homo” by Antonello da Messina (ca. 1430–1479). This masterpiece of the Early Italian Renaissance is carefully preserved at the Collegio Alberoni in Piacenza (Italy). Being extremely fragile, this painting needs continuous monitoring and the implementation of careful preventive conservation strategy, which should be based on sound knowledge of materials and conservation status of the painting. The interdisciplinary research undertaken in the project combined cutting-edge 3D and 2D techniques to perform a systematic, rigorously non-invasive, analysis of the artwork. By exploiting the complementarity of imaging spectroscopic techniques operating in different regions of the electromagnetic spectrum (from X-rays to the Ultraviolet, Visible and Infrared ranges) the painting was fully investigated, virtually ‘leafing through' its levels and structures the from the surface to the wooden support. Structured-light 3D metrological survey was used to digitize the external surface of the artwork. The surface irregularities and the support were analyzed with a structured-light 3D scanner and X-ray tomography. UV fluorescence was used to visualize the aged layers of varnishes. X-ray fluorescence scanning (MA-XRF) and reflectance hyperspectral imaging (HSI) were combined to study pictorial materials and their distributions, and the artist technique. Hidden details were brought to the light, like a fingerprints traces. Data-fusion from the 2D and 3D techniques provided new insights on the artwork and updated documentation of the conservation status. The obtained digital documentation was exploited to compile web-based interactive platforms targeted at the visualization and dissemination of the results, for both professional users and large public.
2021
Journal article
Open Access
Smart Working at CNR-ISTI in the COVID-19 Era
Scopigno R, Giorgi D
The CNR Institute for Information Science and Technologies describes its experience in adapting to smart working, which has dramatically changed the institute's modus operandi for most of the year 2020.Source: ERCIM NEWS, pp. 6-7
Scopigno R, Giorgi D
The CNR Institute for Information Science and Technologies describes its experience in adapting to smart working, which has dramatically changed the institute's modus operandi for most of the year 2020.Source: ERCIM NEWS, pp. 6-7
See at:
ercim-news.ercim.eu | CNR IRIS | ISTI Repository | CNR IRIS
2021
Contribution to book
Restricted
Virtual clones for cultural heritage applications
Potenziani M, Banterle F, Callieri M, Dellepiane M, Ponchio F, Scopigno R
Digital technologies are now mature for producing high quality digital replicas of Cultural Heritage (CH) artifacts. The research results produced in the last decade have shown an impressive evolution and consolidation of the technologies for acquiring high-quality digital 3D models, encompassing both geometry and color (or, better, surface reflectance properties). Some recent technologies for constructing 3D models enriched by a high-quality encoding of the color attribute will be presented. The focus of this paper is to show and discuss practical solutions, which could be deployed without requiring the installation of a specific or sophisticated acquisition lab setup. In the second part of this paper, we focus on new solutions for the interactive visualization of complex models, adequate for modern communication channels such as the web and the mobile platforms. Together with the algorithms and approaches, we show also some practical examples where high-quality 3D models have been used in CH research, restoration and conservation.
Potenziani M, Banterle F, Callieri M, Dellepiane M, Ponchio F, Scopigno R
Digital technologies are now mature for producing high quality digital replicas of Cultural Heritage (CH) artifacts. The research results produced in the last decade have shown an impressive evolution and consolidation of the technologies for acquiring high-quality digital 3D models, encompassing both geometry and color (or, better, surface reflectance properties). Some recent technologies for constructing 3D models enriched by a high-quality encoding of the color attribute will be presented. The focus of this paper is to show and discuss practical solutions, which could be deployed without requiring the installation of a specific or sophisticated acquisition lab setup. In the second part of this paper, we focus on new solutions for the interactive visualization of complex models, adequate for modern communication channels such as the web and the mobile platforms. Together with the algorithms and approaches, we show also some practical examples where high-quality 3D models have been used in CH research, restoration and conservation.
See at:
CNR IRIS | CNR IRIS | www.lerma.it
2021
Conference article
Open Access
Mixing visual media for cultural heritage
Scopigno R.
The Cultural Heritage (CH) domain is a field where many different visual media are constituent elements of the main activities: study, conservation, dissemination, and presentation to the public (museum visitors, tourists, practitioners). Those media are usually used in isolation, adopting specific visualization tools. This paper aims to present several experiences where multiple visual media have been used in a coordinated manner by fusing or presenting them in the same visualization context. These approaches experimented with new interaction and visualization methodologies to use different media in a synergic way. CH domain is an ideal field of experimentation of the potential of media integration/fusion/ cross-analysis. According to our understanding, using multiple media can improve insight capability. We guide the reader in the analysis of some pioneering experiences and approaches and try to deduce, for each of them, the potential improvement granted in terms of data communication or analysis. A final discussion tries to highlight the work needed for a wider acceptance and increased impact of those approaches.Source: COMMUNICATIONS IN COMPUTER AND INFORMATION SCIENCE (PRINT), pp. 297-315. Nicosia, Cyprus, June 2-4, 2021
DOI: 10.1007/978-3-030-83647-4_20
Project(s): EVOCATION
Metrics:
Scopigno R.
The Cultural Heritage (CH) domain is a field where many different visual media are constituent elements of the main activities: study, conservation, dissemination, and presentation to the public (museum visitors, tourists, practitioners). Those media are usually used in isolation, adopting specific visualization tools. This paper aims to present several experiences where multiple visual media have been used in a coordinated manner by fusing or presenting them in the same visualization context. These approaches experimented with new interaction and visualization methodologies to use different media in a synergic way. CH domain is an ideal field of experimentation of the potential of media integration/fusion/ cross-analysis. According to our understanding, using multiple media can improve insight capability. We guide the reader in the analysis of some pioneering experiences and approaches and try to deduce, for each of them, the potential improvement granted in terms of data communication or analysis. A final discussion tries to highlight the work needed for a wider acceptance and increased impact of those approaches.Source: COMMUNICATIONS IN COMPUTER AND INFORMATION SCIENCE (PRINT), pp. 297-315. Nicosia, Cyprus, June 2-4, 2021
DOI: 10.1007/978-3-030-83647-4_20
Project(s): EVOCATION
Metrics:
See at:
CNR IRIS | link.springer.com | ISTI Repository | CNR IRIS | CNR IRIS
2021
Journal article
Open Access
"Ecce Homo" by Antonello da Messina, from non-invasive investigations to data fusion and dissemination
Albertin F., Ruberto C., Cucci C., Callieri M., Potenziani M., Siotto E., Pingi P., Scopigno R., Bettuzzi M., Brancaccio R., Morigi M. P., Castelli L., Taccetti F., Picollo M., Stefani L., De Vita F.
Scientific investigations of artworks are crucial in terms of preservation since they provide a measurable evaluation of the materials and the state of conservation. This is the case of Antonello da Messina's painting "Ecce Homo": its delicate state of conservation, with the need for constant monitoring, required a broad and in-depth diagnostic campaign to support the restorers. The project was carried out entirely in situ using non-invasive cutting-edge techniques and proposes a multimodal and data-centric approach, integrating 3D and 2D methodologies. The surface irregularities and the support were analysed with a structured-light 3D scanner and X-ray tomography. The painting materials were investigated with X-ray fluorescence scanning (MA-XRF) and reflectance hyperspectral imaging (HSI). Primarily, the data were jointly used for a scientific scope and provided new knowledge of the painting in terms of materials and painting techniques. In addition, two web-based interactive platforms were developed: one to provide restorers and experts with a new perspective of the hidden geometries of the painting, and the other targeted at the general public for dissemination purposes. The results of the Ecce Homo scientific analysis were exhibited, using a touch-screen interface, and developed for different user levels, from adults to kids.Source: SCIENTIFIC REPORTS, vol. 11 (issue 1), pp. 15868-15885
DOI: 10.1038/s41598-021-95212-2
DOI: https://doi.org/10.1038/s41598-021-95212-2
Project(s): E-RIHS PP
Metrics:
Albertin F., Ruberto C., Cucci C., Callieri M., Potenziani M., Siotto E., Pingi P., Scopigno R., Bettuzzi M., Brancaccio R., Morigi M. P., Castelli L., Taccetti F., Picollo M., Stefani L., De Vita F.
Scientific investigations of artworks are crucial in terms of preservation since they provide a measurable evaluation of the materials and the state of conservation. This is the case of Antonello da Messina's painting "Ecce Homo": its delicate state of conservation, with the need for constant monitoring, required a broad and in-depth diagnostic campaign to support the restorers. The project was carried out entirely in situ using non-invasive cutting-edge techniques and proposes a multimodal and data-centric approach, integrating 3D and 2D methodologies. The surface irregularities and the support were analysed with a structured-light 3D scanner and X-ray tomography. The painting materials were investigated with X-ray fluorescence scanning (MA-XRF) and reflectance hyperspectral imaging (HSI). Primarily, the data were jointly used for a scientific scope and provided new knowledge of the painting in terms of materials and painting techniques. In addition, two web-based interactive platforms were developed: one to provide restorers and experts with a new perspective of the hidden geometries of the painting, and the other targeted at the general public for dissemination purposes. The results of the Ecce Homo scientific analysis were exhibited, using a touch-screen interface, and developed for different user levels, from adults to kids.Source: SCIENTIFIC REPORTS, vol. 11 (issue 1), pp. 15868-15885
DOI: 10.1038/s41598-021-95212-2
DOI: https://doi.org/10.1038/s41598-021-95212-2
Project(s): E-RIHS PP
Metrics:
See at:
Scientific Reports | Scientific Reports | CNR IRIS | ISTI Repository | Scientific Reports | Scientific Reports | Archivio istituzionale della ricerca - Alma Mater Studiorum Università di Bologna | CNR IRIS
2021
Contribution to book
Restricted
Documentation and analysis of the deformations of the panel and painted surface with 3D scanner
Pingi P, Siotto E, Palma G, Scopigno R
Despite what might be assumed, the surface of a painting on a canvas or a wooden panel is not perfectly flat, but rather is characterized by a complex three-dimensionality. The paint the artist lays down on the support possesses its own body and thickness, that, even on a millimeter or sub-millimeter scale, may be detected using instruments and three-dimensional measurement applications. At the same time, a wooden panel may be affected by deformations from historical or restoration changes, which may be readily revealed and documented. When analyzing a work of art subjected to an important restoration treatment, as was the case of the Adoration of the Magi by Leonardo da Vinci, a precise 3D documentation of the painted surface is thus strictly linked to the state of its wooden support. As is well-known, a panel painting is a layered structure (usually a protective varnish coating, paint layers, usually preparatory or ground layers, and the wooden panel), each with different physical and chemical compositions. Therefore, an accurate geometric 3D acquisition of the board structure and its connecting components (butterfly joins or dowel inserts) and the auxiliary support system (crossbars) may supply information to not only improve understanding of how the painting was made and its condition, but also permit it to be monitored over time or during restoration. Furthermore, the application of modern 3D computer graphics technologies is not only a valid diagnostic aid to acquiring knowledge about the work, but also a way to map information and share it (for example art historical information, technical data, and the results of chemical and physical analyses), making them easily accessible online both to experts in the sector and a wider public, thanks to specifically developed multimedia systems.1 In the case of the unfinished masterpiece by Leonardo, a complete high resolution 3D acquisition was performed in order to show and measure--at the moment during conservation treatment--a map of deviations from planarity caused by the curvature and warp of the wooden boards, permitting the documenting of the spatial deformation of the painted surface and the monitoring of its state of preservation.Source: PROBLEMI DI CONSERVAZIONE E RESTAURO, pp. 281-286
Pingi P, Siotto E, Palma G, Scopigno R
Despite what might be assumed, the surface of a painting on a canvas or a wooden panel is not perfectly flat, but rather is characterized by a complex three-dimensionality. The paint the artist lays down on the support possesses its own body and thickness, that, even on a millimeter or sub-millimeter scale, may be detected using instruments and three-dimensional measurement applications. At the same time, a wooden panel may be affected by deformations from historical or restoration changes, which may be readily revealed and documented. When analyzing a work of art subjected to an important restoration treatment, as was the case of the Adoration of the Magi by Leonardo da Vinci, a precise 3D documentation of the painted surface is thus strictly linked to the state of its wooden support. As is well-known, a panel painting is a layered structure (usually a protective varnish coating, paint layers, usually preparatory or ground layers, and the wooden panel), each with different physical and chemical compositions. Therefore, an accurate geometric 3D acquisition of the board structure and its connecting components (butterfly joins or dowel inserts) and the auxiliary support system (crossbars) may supply information to not only improve understanding of how the painting was made and its condition, but also permit it to be monitored over time or during restoration. Furthermore, the application of modern 3D computer graphics technologies is not only a valid diagnostic aid to acquiring knowledge about the work, but also a way to map information and share it (for example art historical information, technical data, and the results of chemical and physical analyses), making them easily accessible online both to experts in the sector and a wider public, thanks to specifically developed multimedia systems.1 In the case of the unfinished masterpiece by Leonardo, a complete high resolution 3D acquisition was performed in order to show and measure--at the moment during conservation treatment--a map of deviations from planarity caused by the curvature and warp of the wooden boards, permitting the documenting of the spatial deformation of the painted surface and the monitoring of its state of preservation.Source: PROBLEMI DI CONSERVAZIONE E RESTAURO, pp. 281-286
2020
Journal article
Open Access
Effective annotations over 3D models
Ponchio F, Callieri M, Dellepiane M, Scopigno R
Annotation support in interactive systems is often considered a simple task by the CG community, since it entails the apparently easy selection of a region and its connection with some information. The reality appears more complex. The scope of this paper is twofold: first, to review the status of this domain, discussing and characterizing several approaches proposed in literature to manage annotations over geometric models; second, to present in detail an innovative solution proposed and assessed in the framework of Cultural Heritage (CH) applications, called ClippingVolumes. At the annotation definition stage ClippingVolumes uses 3D data to characterize the annotation region; subsequently, annotations are visualized by adopting a two-pass rendering solution which uses stencil buffers, thus without introducing new geometric elements, changing the topology or duplicating geometry elements. It solves most of the issues that afflict the current state of the art, such as fragmentation, annotation transfer to multiple representations, and multi-resolution data encoding. The latter is a mandatory requirement to produce efficient web-based systems. We implemented and we fully tested this approach in the framework of a complex system that supports the documentation of CH restoration projects.Source: COMPUTER GRAPHICS FORUM (ONLINE), vol. 39 (issue 1), pp. 89-105
DOI: 10.1111/cgf.13664
Metrics:
Ponchio F, Callieri M, Dellepiane M, Scopigno R
Annotation support in interactive systems is often considered a simple task by the CG community, since it entails the apparently easy selection of a region and its connection with some information. The reality appears more complex. The scope of this paper is twofold: first, to review the status of this domain, discussing and characterizing several approaches proposed in literature to manage annotations over geometric models; second, to present in detail an innovative solution proposed and assessed in the framework of Cultural Heritage (CH) applications, called ClippingVolumes. At the annotation definition stage ClippingVolumes uses 3D data to characterize the annotation region; subsequently, annotations are visualized by adopting a two-pass rendering solution which uses stencil buffers, thus without introducing new geometric elements, changing the topology or duplicating geometry elements. It solves most of the issues that afflict the current state of the art, such as fragmentation, annotation transfer to multiple representations, and multi-resolution data encoding. The latter is a mandatory requirement to produce efficient web-based systems. We implemented and we fully tested this approach in the framework of a complex system that supports the documentation of CH restoration projects.Source: COMPUTER GRAPHICS FORUM (ONLINE), vol. 39 (issue 1), pp. 89-105
DOI: 10.1111/cgf.13664
Metrics:
See at:
CNR IRIS | onlinelibrary.wiley.com | ISTI Repository | Computer Graphics Forum | CNR IRIS | CNR IRIS
2019
Conference article
Restricted
Analisi dei frammenti di Sectilia vitrei dalla Villa romana di Aiano-Torraccia di Chiusi (si) e studio della tecnica d'esecuzione
Cavalieri M, Landi S, Manna D, Giamello M, Fornacelli C, Bracci S, Palma G, Siotto E, Scopigno R
The consistent amount of sectilia fragments from the late Roman Villa of Aiano (4th-5th century AD)provides important insights on the study of the diffusion of opus sectile during the Late Roman period. The extent of the corpus of glass slabs, in particular, immediately suggests interesting perspectives on both the archaeological and technological issues. Thanks to cooperation between archaeologist, conservators, IT and scientists, an in-depth study of the repertory is in progress to provide important information about the technologies and the raw materials used to produce a number of selected samples. High-resolution images have been obtained via Reflectance Transformation Imaging (RTI) to better understand all the different phases characterizing the manufacture of the more complex slabs. Due to their flexibility and low analytical costs, portable and non-invasive analytical techniques provided a fast and quite accurate definition of the chemical and mineralogical properties of each sample and the first classification of a large number of slabs in compositional clusters. Portable X-Ray Fluorescence (p-XRF) and Fiber Optics Reflectance Spectroscopy (FORS) allowed a first definition of the chemical variability within the repertory and provided indications about both manufacturing and coloring techniques.
Cavalieri M, Landi S, Manna D, Giamello M, Fornacelli C, Bracci S, Palma G, Siotto E, Scopigno R
The consistent amount of sectilia fragments from the late Roman Villa of Aiano (4th-5th century AD)provides important insights on the study of the diffusion of opus sectile during the Late Roman period. The extent of the corpus of glass slabs, in particular, immediately suggests interesting perspectives on both the archaeological and technological issues. Thanks to cooperation between archaeologist, conservators, IT and scientists, an in-depth study of the repertory is in progress to provide important information about the technologies and the raw materials used to produce a number of selected samples. High-resolution images have been obtained via Reflectance Transformation Imaging (RTI) to better understand all the different phases characterizing the manufacture of the more complex slabs. Due to their flexibility and low analytical costs, portable and non-invasive analytical techniques provided a fast and quite accurate definition of the chemical and mineralogical properties of each sample and the first classification of a large number of slabs in compositional clusters. Portable X-Ray Fluorescence (p-XRF) and Fiber Optics Reflectance Spectroscopy (FORS) allowed a first definition of the chemical variability within the repertory and provided indications about both manufacturing and coloring techniques.
See at:
CNR IRIS | CNR IRIS | www.aiscom.it
2019
Other
Open Access
Share -- Publish -- Store -- Preserve. Methodologies, Tools and Challenges for 3D Use in Social Sciences and Humanities (White Paper)
Alaoui M'darhri A, Baillet V, Bourineau B, Calantropio A, Carpentiero G, Chayani Cnrs M, De Luca L, Dudek I, Dutailly Cnrs B, Gautier H, Grilli E, Grimaud V, Hoffmann C, Joffres A, Joni N, Jordan M, Kimball J, Manuel A, Mcinerny P, Muñoz I, Neroulidis A, Nocerino E, Pamart A, Papadopoulos C, Potenziani M, Saubestre E, Scopigno R, Seillier D, Tournonvaliente S, Trognitz M, Vallet Jm, Zuanni C
Through this White Paper, which gathers contributions from experts of 3D data as well as professionals concerned with the interoperability and sustainability of 3D research data, the PARTHENOS project aims at highlighting some of the current issues they have to face, with possible specific points according to the discipline, and potential practices and methodologies to deal with these issues. During the workshop, several tools to deal with these issues have been introduced and confronted with the participants' experiences, this White Paper now intends to go further by also integrating participants feedbacks and suggestions of potential improvements. Therefore, even if the focus is put on specific tools, the main goal is to contribute to the development of standardized good practices related to the sharing, publication, storage and long-term preservation of 3D data.Project(s): PARTHENOS
Alaoui M'darhri A, Baillet V, Bourineau B, Calantropio A, Carpentiero G, Chayani Cnrs M, De Luca L, Dudek I, Dutailly Cnrs B, Gautier H, Grilli E, Grimaud V, Hoffmann C, Joffres A, Joni N, Jordan M, Kimball J, Manuel A, Mcinerny P, Muñoz I, Neroulidis A, Nocerino E, Pamart A, Papadopoulos C, Potenziani M, Saubestre E, Scopigno R, Seillier D, Tournonvaliente S, Trognitz M, Vallet Jm, Zuanni C
Through this White Paper, which gathers contributions from experts of 3D data as well as professionals concerned with the interoperability and sustainability of 3D research data, the PARTHENOS project aims at highlighting some of the current issues they have to face, with possible specific points according to the discipline, and potential practices and methodologies to deal with these issues. During the workshop, several tools to deal with these issues have been introduced and confronted with the participants' experiences, this White Paper now intends to go further by also integrating participants feedbacks and suggestions of potential improvements. Therefore, even if the focus is put on specific tools, the main goal is to contribute to the development of standardized good practices related to the sharing, publication, storage and long-term preservation of 3D data.Project(s): PARTHENOS
See at:
hal.archives-ouvertes.fr | CNR IRIS | ISTI Repository | CNR IRIS
2019
Other
Open Access
SOROS: Sciadro online reconstruction by odometry and stereo-matching
Ganovelli F, Malomo L, Scopigno R
In this report we show how to interactively create 3D models for scenes seen by a common off-the-shelf smartphone. Our approach combines Visual Odometry with IMU sensors in order to achieve interactive 3D reconstruction of the scene as seen from the camera.
Ganovelli F, Malomo L, Scopigno R
In this report we show how to interactively create 3D models for scenes seen by a common off-the-shelf smartphone. Our approach combines Visual Odometry with IMU sensors in order to achieve interactive 3D reconstruction of the scene as seen from the camera.
See at:
CNR IRIS | ISTI Repository | CNR IRIS
2019
Journal article
Open Access
Deformation analysis of Leonardo da Vinci's "Adorazione dei Magi" through temporal unrelated 3D digitization
Palma G, Pingi P, Siotto E, Bellucci R, Guidi G, Scopigno R
3D scanning is an effective technology for dealing at different levels the state of conservation/deformation of a panel painting, from the micro-geometry of the craquelure to the macro-geometry of the supported used. Unfortunately, the current solutions used to analyze multiple 3D scans acquired over time are based on very controlled acquisition procedures, such as the use of target reference points that are stationary over time and fixed to the artwork, or on complex hardware setups to keep the acquisition device fixed to the artwork. These procedures are challenging when a long monitoring period is involved or during restoration when the painting may be moved several times. This paper presents a new and robust approach to observe and quantify the panel deformations of artworks by comparing 3D models acquired with different scanning devices at different times. The procedure is based on a non-rigid registration algorithm that deforms one 3D model over the other in a controlled way, extracting the real deformation field. We apply the method to the 3D scanning data of the unfinished panel painting "Adorazione dei Magi" by Leonardo da Vinci. The data were acquired in 2002 and 2015. First, we analyze the two 3D models with the classical distance from the ideal flat plane of the painting. Then we study the type of deformation of each plank of the support by fitting a quadric surface. Finally, we compare the models before and after the deformation computed by a non-rigid registration algorithm. This last comparison enables the panel deformation to be separated from the structural changes (e.g. the structural restorations on the back and the missing pieces) of the artwork in a more robust way.Source: JOURNAL OF CULTURAL HERITAGE, vol. 38, pp. 174-185
DOI: 10.1016/j.culher.2018.11.001
Metrics:
Palma G, Pingi P, Siotto E, Bellucci R, Guidi G, Scopigno R
3D scanning is an effective technology for dealing at different levels the state of conservation/deformation of a panel painting, from the micro-geometry of the craquelure to the macro-geometry of the supported used. Unfortunately, the current solutions used to analyze multiple 3D scans acquired over time are based on very controlled acquisition procedures, such as the use of target reference points that are stationary over time and fixed to the artwork, or on complex hardware setups to keep the acquisition device fixed to the artwork. These procedures are challenging when a long monitoring period is involved or during restoration when the painting may be moved several times. This paper presents a new and robust approach to observe and quantify the panel deformations of artworks by comparing 3D models acquired with different scanning devices at different times. The procedure is based on a non-rigid registration algorithm that deforms one 3D model over the other in a controlled way, extracting the real deformation field. We apply the method to the 3D scanning data of the unfinished panel painting "Adorazione dei Magi" by Leonardo da Vinci. The data were acquired in 2002 and 2015. First, we analyze the two 3D models with the classical distance from the ideal flat plane of the painting. Then we study the type of deformation of each plank of the support by fitting a quadric surface. Finally, we compare the models before and after the deformation computed by a non-rigid registration algorithm. This last comparison enables the panel deformation to be separated from the structural changes (e.g. the structural restorations on the back and the missing pieces) of the artwork in a more robust way.Source: JOURNAL OF CULTURAL HERITAGE, vol. 38, pp. 174-185
DOI: 10.1016/j.culher.2018.11.001
Metrics:
See at:
CNR IRIS | ISTI Repository | www.sciencedirect.com | Journal of Cultural Heritage | CNR IRIS | CNR IRIS
2019
Journal article
Open Access
DeepFlash: turning a flash selfie into a studio portrait
Capece N, Banterle F, Cignoni P, Ganovelli F, Scopigno R, Erra U
We present a method for turning a flash selfie taken with a smartphone into a photograph as if it was taken in a studio setting with uniform lighting. Our method uses a convolutional neural network trained on a set of pairs of photographs acquired in an ad-hoc acquisition campaign. Each pair consists of one photograph of a subject's face taken with the camera flash enabled and another one of the same subject in the same pose illuminated using a photographic studio-lighting setup. We show how our method can amend defects introduced by a close-up camera flash, such as specular highlights, shadows, skin shine, and flattened images.Source: SIGNAL PROCESSING-IMAGE COMMUNICATION, vol. 77 (issue September), pp. 28-39
DOI: 10.1016/j.image.2019.05.013
DOI: https://doi.org/10.1016/j.image.2019.05.013
DOI: 10.48550/arxiv.1901.04252
Metrics:
Capece N, Banterle F, Cignoni P, Ganovelli F, Scopigno R, Erra U
We present a method for turning a flash selfie taken with a smartphone into a photograph as if it was taken in a studio setting with uniform lighting. Our method uses a convolutional neural network trained on a set of pairs of photographs acquired in an ad-hoc acquisition campaign. Each pair consists of one photograph of a subject's face taken with the camera flash enabled and another one of the same subject in the same pose illuminated using a photographic studio-lighting setup. We show how our method can amend defects introduced by a close-up camera flash, such as specular highlights, shadows, skin shine, and flattened images.Source: SIGNAL PROCESSING-IMAGE COMMUNICATION, vol. 77 (issue September), pp. 28-39
DOI: 10.1016/j.image.2019.05.013
DOI: https://doi.org/10.1016/j.image.2019.05.013
DOI: 10.48550/arxiv.1901.04252
Metrics:
See at:
arXiv.org e-Print Archive | Signal Processing Image Communication | CNR IRIS | ISTI Repository | Signal Processing Image Communication | doi.org | CNR IRIS | CNR IRIS
2019
Journal article
Restricted
Semi-automated cleaning of laser scanning campaigns with machine learning
Marais P, Dellepiane M, Cignoni P, Scopigno R
Terrestrial laser scanning campaigns provide an important means to document the 3D structure of historical sites. Unfortunately, the process of converting the 3D point clouds acquired by the laser scanner into a coherent and accurate 3D model has many stages and is not generally automated. In particular, the initial cleaning stage of the pipeline--in which undesired scene points are deleted--remains largely manual and is usually labour intensive. In this article, we introduce a semi-automated cleaning approach that incrementally trains a random forest (RF) classifier on an initial keep/discard point labelling generated by the user when cleaning the first scan(s). The classifier is then used to predict the labelling of the next scan in the sequence. Before this classification is presented to the user, a denoising post-process, based on the 2D range map representation of the laser scan, is applied. This significantly reduces small isolated point clusters that the user would otherwise have to fix. The user then selects the remaining incorrectly labelled points and these are weighted, based on a confidence estimate, and fed back into the classifier to retrain it for the next scan. Our experiments, across 8 scanning campaigns, show that when the scan campaign is coherent, i.e., it does not contain widely disparate or contradictory data, the classifier yields a keep/discard labelling that typically ranges between 95% and 99%. This is somewhat surprising, given that the data in each class can represent many object types, such as a tree, person, wall, and so on, and that no further effort beyond the point labeling of keep/discard is required of the user. We conducted an informal timing experiment over a 15-scan campaign, which compared the processing time required by our software, without user interaction (point label correction) time, against the time taken by an expert user to completely clean all scans. The expert user required 95mins to complete all cleaning. The average time required by the expert to clean a single scan was 6.3mins. Even with current unoptimized code, our system was able to generate keep/discard labels for all scans, with 98% (average) accuracy, in 75mins. This leaves as much as 20mins for the user input required to relabel the 2% of mispredicted points across the set of scans before the full system time would match the expert's cleaning time.Source: ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE, vol. 12 (issue 3)
DOI: 10.1145/3292027
Metrics:
Marais P, Dellepiane M, Cignoni P, Scopigno R
Terrestrial laser scanning campaigns provide an important means to document the 3D structure of historical sites. Unfortunately, the process of converting the 3D point clouds acquired by the laser scanner into a coherent and accurate 3D model has many stages and is not generally automated. In particular, the initial cleaning stage of the pipeline--in which undesired scene points are deleted--remains largely manual and is usually labour intensive. In this article, we introduce a semi-automated cleaning approach that incrementally trains a random forest (RF) classifier on an initial keep/discard point labelling generated by the user when cleaning the first scan(s). The classifier is then used to predict the labelling of the next scan in the sequence. Before this classification is presented to the user, a denoising post-process, based on the 2D range map representation of the laser scan, is applied. This significantly reduces small isolated point clusters that the user would otherwise have to fix. The user then selects the remaining incorrectly labelled points and these are weighted, based on a confidence estimate, and fed back into the classifier to retrain it for the next scan. Our experiments, across 8 scanning campaigns, show that when the scan campaign is coherent, i.e., it does not contain widely disparate or contradictory data, the classifier yields a keep/discard labelling that typically ranges between 95% and 99%. This is somewhat surprising, given that the data in each class can represent many object types, such as a tree, person, wall, and so on, and that no further effort beyond the point labeling of keep/discard is required of the user. We conducted an informal timing experiment over a 15-scan campaign, which compared the processing time required by our software, without user interaction (point label correction) time, against the time taken by an expert user to completely clean all scans. The expert user required 95mins to complete all cleaning. The average time required by the expert to clean a single scan was 6.3mins. Even with current unoptimized code, our system was able to generate keep/discard labels for all scans, with 98% (average) accuracy, in 75mins. This leaves as much as 20mins for the user input required to relabel the 2% of mispredicted points across the set of scans before the full system time would match the expert's cleaning time.Source: ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE, vol. 12 (issue 3)
DOI: 10.1145/3292027
Metrics:
See at:
dl.acm.org | Journal on Computing and Cultural Heritage | CNR IRIS | CNR IRIS