2016
Journal article  Open Access

Retrieval and classification methods for textured 3D models: a comparative study

Biasotti S. M., Cerri A., Aono M., Hamza A. B., Garro V., Giachetti A., Giorgi D., Godil A. A., Li G. C., Sanada C., Spagnuolo M., Tatsuma A., Velasco Forero S.

Computer Graphics  Shape retrieval  [SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing  Textured 3D models  Computer Vision and Pattern Recognition  Shape classification  Software  Computer Graphics and Computer-Aided Design 

This paper presents a comparative study of six methods for the retrieval and classification of textured 3D models, which have been selected as representative of the state of the art. To better analyse and control how methods deal with specific classes of geometric and texture deformations, we built a collection of 572 synthetic textured mesh models, in which each class includes multiple texture and geometric modifications of a small set of null models. Results show a challenging, yet lively, scenario and also reveal interesting insights into how to deal with texture information according to different approaches, possibly working in the CIELab as well as in modifications of the RGB colour space.

Source: The visual computer 32 (2016): 217–241. doi:10.1007/s00371-015-1146-3

Publisher: Springer., Heidelberg , Germania


1. TurboSquid. http://www.turbosquid.com/
2. Aubry, M., Schlickewei, U., Cremers, D.: The wave kernel signature: A quantum mechanical approach to shape analysis. In: Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, pp. 1626-1633 (2011)
3. Biasotti, S., Cerri, A., Abdelrahman, M., Aono, M., Ben Hamza, A., El-Melegy, M., Farag, A., Garro, V., Giachetti, A., Giorgi, D., Godil, A., Li, C., Liu, Y.J., Martono, H.Y., Sanada, C., Tatsuma, A., Velasco-Forero, S., Xu, C.X.: Retrieval and Classification on Textured 3D Models. In: Eurographics Workshop on 3D Object Retrieval (3DOR), pp. 111-120 (2014)
4. Biasotti, S., Cerri, A., Bronstein, A., Bronstein, M.: Quantifying 3D Shape Similarity Using Maps: Recent Trends, Applications and Perspectives. In: S. Lefebvre, M. Spagnuolo (eds.) EG 2014 - STARs, pp. 135-159 (2014)
5. Biasotti, S., Cerri, A., Giorgi, D., Spagnuolo, M.: PHOG: Photometric and geometric functions for textured shape retrieval. Comput. Graph. Forum 32(5), 13-22 (2013)
6. Biasotti, S., Giorgi, D., Spagnuolo, M., Falcidieno, B.: Reeb graphs for shape analysis and applications. Theor. Comput. Sci. 392(1-3), 5-22 (2008)
7. Biasotti, S., Giorgi, D., Spagnuolo, M., Falcidieno, B.: Size functions for comparing 3D models. Pattern Recogn. 41(9), 2855-2873 (2008)
8. Biasotti, S., Spagnuolo, M., Falcidieno, B.: Grouping real functions defined on 3D surfaces. Comput. Graph. 37(6), 608 - 619 (2013)
9. Cerri, A., Biasotti, S., Abdelrahman, M., Angulo, J., Berger, K., Chevallier, L., El-Melegy, M., Farag, A., Lefebvre, F., Giachetti, A., Guermoud, H., Liu, Y.J., Velasco-Forero, S., Vigouroux, J., Xu, C.X., Zhang, J.B.: SHREC'13 Track: Retrieval on Textured 3D Models. In: Eurographics Workshop on 3D Object Retrieval (3DOR), pp. 73-80 (2013)
10. Cerri, A., Landi, C.: The persistence space in multidimensional persistent homology. In: R. Gonzalez-Diaz, M.J. Jimenez, B. Medrano (eds.) Discrete Geometry for Computer Imagery, Lecture Notes in Computer Science, vol. 7749, pp. 180-191. Springer Berlin Heidelberg (2013)
11. Cohen-Steiner, D., Edelsbrunner, H., Harer, J.: Stability of persistence diagrams. Discr. Comput. Geom. 37(1), 103-120 (2007)
12. Cortelazzo, G., Orio, N.: Retrieval of Colored 3D Models. In: 3D Data Processing, Visualization, and Transmission, Third International Symposium on, pp. 986-993 (2006)
13. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Computer Vision and Pattern Recognition (CVPR), 2005 IEEE Conference on, vol. 1, pp. 886-893 (2005)
14. Desbrun, M., Meyer, M., Schr¨oder, P., Barr, A.H.: Implicit fairing of irregular meshes using diffusion and curvature flow. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '99, pp. 317-324. ACM Press/AddisonWesley Publishing Co., New York, NY, USA (1999)
15. Deza, M.M., Deza, E.: Encyclopedia of Distances. Springer Berlin Heidelberg (2009)
16. Edelsbrunner, H., Harer, J.: Persistent homology-a survey. In: Surveys on discrete and computational geometry, Contemp. Math., vol. 453, pp. 257-282. Amer. Math. Soc., Providence, RI (2008)
17. Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A densitybased algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD, pp. 226-231 (1996)
18. Fairchild, M.D.: Color Appearance Models. John Wiley & Sons Ltd (2005)
19. Fawcett, T.: An introduction to ROC analysis. Pattern Recogn. Lett. 27(8), 861 - 874 (2006)
20. Finlayson, G.: Coefficient Color Constancy. Simon Fraser University (1995)
21. Frosini, P., Landi, C.: Size theory as a topological tool for computer vision. Pattern Recogn. and Image Anal. 9(4), 596-603 (1999)
22. Funkhouser, T., Kazhdan, M., Min, P., Shilane, P.: Shape-based retrieval and analysis of 3D models. Commun. ACM 48(6), 58-64 (2005)
23. Ge¸bal, K., Baerentzen, J.A., Aanaes, H., Larsen, R.: Shape analysis using the auto diffusion function. Comput. Graph. Forum 28(5), 1405-1413 (2009)
24. Gevers, T., Smeulders, A.W.: Pictoseek: combining color and shape invariant features for image retrieval. IEEE T. Image Process. 9(1), 102-119 (2000)
25. Giachetti, A., Lovato, C.: Radial symmetry detection and shape characterization with the multiscale area projection transform. Comput. Graph. Forum 31(5), 1669-1678 (2012)
26. Giorgi, D., Attene, M., Patane, G., Marini, S., Pizzi, C., Biasotti, S., Spagnuolo, M., Falcidieno, B., Corvi, M., Usai, L., Roncarolo, L., Garibotto, G.: A critical assessment of 2d and 3D face recognition algorithms. In: Advanced Video and Signal Based Surveillance (AVSS), 2009 IEEE International Conference on, pp. 79-84 (2009)
27. Johnson, A.E., Hebert, M.: Using spin images for efficient object recognition in cluttered 3D scenes. IEEE T. Pattern Anal. 21(5), 433-449 (1999)
28. Kanezaki, A., Harada, T., Kuniyoshi, Y.: Partial matching of real textured 3D objects using color cubic higherorder local auto-correlation features. Visual Comput. 26(10), 1269-1281 (2010)
29. Kazhdan, M., Funkhouser, T., Rusinkiewicz, S.: Rotation invariant spherical harmonic representation of 3D shape descriptors. In: Proceedings of the First Eurographics/ACM SIGGRAPH Symposium on Geometry Processing, SGP '03, pp. 156-164. Eurographics Association, Aire-la-Ville, Switzerland, Switzerland (2003)
30. Kimmel, R., Malladi, R., Sochen, N.: Images as embedded maps and minimal surfaces: Movies, color, texture, and volumetric medical images. Int. J. Comput. Vision 39(2), 111-129 (2000)
31. Kovnatsky, A., Bronstein, M.M., Bronstein, A.M., Kimmel, R.: Photometric heat kernel signatures. In: Proceedings of the Third International Conference on Scale Space and Variational Methods in Computer Vision, SSVM'11, pp. 616-627. Springer-Verlag, Berlin, Heidelberg (2012)
32. Kovnatsky, A., Bronstein, M.M., Bronstein, A.M., Raviv, D., Kimmel, R.: Affine-Invariant Photometric Heat Kernel Signatures. In: Eurographics Workshop on 3D Object Retrieval (3DOR), pp. 39-46 (2012)
33. Kovnatsky, A., Raviv, D., Bronstein, M., Bronstein, A.M., Kimmel, R.: Geometric and Photometric Data Fusion in Non-Rigid Shape Analysis. Numer. Math. Theor. Meth. Appl. 6(1), 199-222 (2013)
34. Kuhn, H.W.: The hungarian method for the assignment problem. Nav. Res. Logist. Q. 2, 83-97 (1955)
35. Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: Computer Vision and Pattern Recognition (CVPR), 2006 IEEE Conference on, vol. 2, pp. 2169-2178 (2006)
36. Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., Fulk, D.: The digital michelangelo project: 3D scanning of large statues. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '00, pp. 131- 144. ACM Press/Addison-Wesley Publishing Co., New York, NY, USA (2000)
37. Li, C.: Spectral geometric methods for deformable 3D shape retrieval. Master's thesis, Concordia University (2013)
38. Li, C., Ben Hamza, A.: Symmetry discovery and retrieval of nonrigid 3D shapes using geodesic skeleton paths. Multimed. Tools Appl. 72(2), 1027-1047 (2014)
39. Li, C., Ben Hamza, A.: Intrinsic spatial pyramid matching for deformable 3D shape retrieval. Int. J. Multimed. Inf. Retr. 2(4), 261-271 (2013)
40. Li, C., Ben Hamza, A.: A multiresolution descriptor for deformable 3D shape retrieval. Visual Comput. pp. 1-12 (2013)
41. Li, C., Ben Hamza, A.: Spatially aggregating spectral descriptors for nonrigid 3D shape retrieval: a comparative survey. Multimedia Syst. pp. 253-281 (2014)
42. Li, C., Ovsjanikov, M., Chazal, F.: Persistence-based structural recognition. In: Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pp. 1995-2002 (2014)
43. Lian, Z., Godil, A., Bustos, B., Daoudi, M., Hermans, J., Kawamura, S., Kurita, Y., Lavou´e, G., Nguyen, H.V., Ohbuchi, R., Ohkita, Y., Ohishi, Y., Porikli, F., Reuter, M., Sipiran, I., Smeets, D., Suetens, P., Tabia, H., Vandermeulen, D.: SHREC '11 track: Shape retrieval on nonrigid 3D watertight meshes. In: Eurographics Workshop on 3D Object Retrieval (3DOR), pp. 79-88 (2011)
44. Lian, Z., Godil, A., Bustos, B., Daoudi, M., Hermans, J., Kawamura, S., Kurita, Y., Lavou´e, G., Van Nguyen, H., Ohbuchi, R., Ohkita, Y., Ohishi, Y., Porikli, F., Reuter, M., Sipiran, I., Smeets, D., Suetens, P., Tabia, H., Vandermeulen, D.: A comparison of methods for non-rigid 3D shape retrieval. Pattern Recogn. 46(1), 449-461 (2013)
45. Ling, H., Jacobs, D.: Deformation invariant image matching. In: Computer Vision (ICCV), 2005 IEEE International Conference on, vol. 2, pp. 1466-1473 (2005)
46. Liu, Y.J., Zheng, Y.F., Lv, L., Xuan, Y.M., Fu, X.L.: 3D model retrieval based on color + geometry signatures. Visual Comput. 28(1), 75-86 (2012)
47. Lowe, D.G.: Distinctive image features from scaleinvariant keypoints. Int. J. Comput. Vision 60(2), 91-110 (2004)
48. Loy, G., Zelinsky, A.: Fast radial symmetry for detecting points of interest. IEEE T. Pattern Anal. 25(8), 959-973 (2003)
49. Matthews, B.: Comparison of the predicted and observed secondary structure of T4 phage lysozyme. Biochim. Biophys. Acta 405(2), 442 - 451 (1975)
50. Mika, S., Scho¨lkopf, B., Smola, A., Mu¨ller, K.R., Scholz, M., Ra¨tsch, G.: Kernel pca and de-noising in feature spaces. In: Advances in Neural Information Processing Systems II, pp. 536-542. MIT Press (1999)
51. Mitra, N.J., Pauly, M., Wand, M., Ceylan, D.: Symmetry in 3D geometry: Extraction and applications. Comput. Graph. Forum 32(6), 1-23 (2013)
52. Ojala, T., Pietik¨ainen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recogn. 29(1), 51-59 (1996)
53. Osada, R., Funkhouser, T., Chazelle, B., Dobkin, D.: Shape distributions. ACM T. Graphics 21(4), 807-832 (2002)
54. Pasqualotto, G., Zanuttigh, P., Cortelazzo, G.M.: Combining color and shape descriptors for 3D model retrieval. Signal Process-Image 28(6), 608 - 623 (2013)
55. Pavan, M., Pelillo, M.: Dominant sets and pairwise clustering. IEEE T. Pattern Anal. 29(1), 167 -172 (2007)
56. Pele, O., Werman, M.: Fast and robust Earth Mover's Distances. In: Computer Vision (ICCV), 2009 IEEE International Conference on, pp. 460-467 (2009)
57. Phong, B.T.: Illumination for computer generated pictures. Commun. ACM 18(6), 311-317 (1975)
58. Rabin, J., Peyr´e, G., Cohen, L.D.: Geodesic shape retrieval via optimal mass transport. In: Proceedings of the 11th European Conference on Computer Vision: Part V, ECCV'10, pp. 771-784. Springer-Verlag, Berlin, Heidelberg (2010)
59. Raviv, D., Bronstein, A., Bronstein, M., Waisman, D., Sochen, N., Kimmel, R.: Equi-affine invariant geometry for shape analysis. J. Math. Imaging Vis. 50(1-2), 144- 163 (2014)
60. Raviv, D., Bronstein, A.M., Bronstein, M.M., Kimmel, R., Sochen, N.: Affine-invariant geodesic geometry of deformable 3D shapes. Comput. Graph. 35(3), 692 - 697 (2011)
61. Reeb, G.: Sur les points singuliers d'une forme de Pfaff compl`etement int´egrable ou d'une fonction num´erique. Comptes Rendus Hebdomadaires des S´eances de l'Acad´emie des Sciences 222, 847-849 (1946)
62. Reuter, M., Wolter, F.E., Peinecke, N.: Laplace-Beltrami spectra as ”Shape-DNA” of surfaces and solids. Comput. Aided Design 38(4), 342-366 (2006)
63. Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover's distance as a metric for image retrieval. Int. J. Comput. Vision 40(2), 99-121 (2000)
64. Ruiz, C., Cabredo, R., Monteverde, L., Huang, Z.: Combining Shape and Color for Retrieval of 3D Models. In: INC, IMS and IDC (NCM'09). Fifth International Joint Conference on, pp. 1295-1300 (2009)
65. Rustamov, R.M.: Laplace-beltrami eigenfunctions for deformation invariant shape representation. In: Proceedings of the Fifth Eurographics Symposium on Geometry Processing, SGP '07, pp. 225-233. Eurographics Association, Aire-la-Ville, Switzerland, Switzerland (2007)
66. Seitz, S., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: Computer Vision and Pattern Recognition (CVPR), 2006 IEEE Conference on, vol. 1, pp. 519-528 (2006)
67. Shilane, P., Min, P., Kazhdan, M., Funkhouser, T.: The Princeton shape benchmark. In: Proceedings of the Shape Modeling International 2004, SMI '04, pp. 167- 178. IEEE Computer Society, Washington, DC, USA (2004)
68. Smeets, D., Fabry, T., Hermans, J., Vandermeulen, D., Suetens, P.: Isometric deformation modelling for object recognition. In: Computer Analysis of Images and Patterns, Lecture Notes in Computer Science, vol. 5702, pp. 757-765. Springer Berlin Heidelberg (2009)
69. Starck, J., Hilton, A.: Correspondence labelling for widetimeframe free-form surface matching. In: Computer Vision (ICCV), 2007 IEEE International Conference on, pp. 1-8 (2007)
70. Sun, J., Ovsjanikov, M., Guibas, L.: A concise and provably informative multi-scale signature based on heat diffusion. Comput. Graph. Forum 28(5), 1383-1392 (2009)
71. Suzuki, M.: A Web-based retrieval system for 3D polygonal models. In: IFSA World Congress and 20th NAFIPS International Conference. Joint 9th, vol. 4, pp. 2271-2276 (2001)
72. Tanaka, J., Weiskopf, D., Williams, P.: The role of color in high-level vision. Trends Cogn. Sci. 5, 211-215 (2001)
73. Tangelder, J., Veltkamp, R.: A survey of content-based 3D shape retrieval methods. Multimed. Tools Appl. 39(3), 441-471 (2008)
74. Tatsuma, A., Aono, M.: Multi-fourier spectra descriptor and augmentation with spectral clustering for 3D shape retrieval. Visual Comput. 25(8), 785-804 (2008)
75. Tombari, F., Salti, S., Di Stefano, L.: A combined texture-shape descriptor for enhanced 3D feature matching. In: Image Processing (ICIP), 2011 IEEE International Conference on, pp. 809-812 (2011)
76. Veltkamp, R., Ruijsenaars, R., Spagnuolo, M., van Zwol, R., ter Haar, F.: Shrec2006: 3D Shape Retrieval Contest . Tech. Rep. CS-2006-030, UU (2006)
77. Wang, C., Bronstein, M.M., Bronstein, A.M., Paragios, N.: Discrete minimum distortion correspondence problems for non-rigid shape matching. In: Proceedings of the Third International Conference on Scale Space and Variational Methods in Computer Vision, SSVM'11, pp. 580-591. Springer-Verlag, Berlin, Heidelberg (2012)
78. Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., Gong, Y.: Locality-constrained linear coding for image classification. In: Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pp. 3360-3367 (2010)
79. Wu, C., Clipp, B., Li, X., Frahm, J.M., Pollefeys, M.: 3D model matching with Viewpoint-Invariant Patches (VIP). In: Computer Vision and Pattern Recognition (CVPR), 2008 IEEE Conference on, pp. 1-8 (2008)
80. Zaharescu, A., Boyer, E., Horaud, R.: Keypoints and local descriptors of scalar functions on 2D manifolds. Int. J. Comput. Vision 100(1), 78-98 (2012)

Metrics



Back to previous page
BibTeX entry
@article{oai:it.cnr:prodotti:334059,
	title = {Retrieval and classification methods for textured 3D models: a comparative study},
	author = {Biasotti S. M. and Cerri A. and Aono M. and Hamza A. B. and Garro V. and Giachetti A. and Giorgi D. and Godil A. A. and Li G. C. and Sanada C. and Spagnuolo M. and Tatsuma A. and Velasco Forero S.},
	publisher = {Springer., Heidelberg , Germania},
	doi = {10.1007/s00371-015-1146-3},
	journal = {The visual computer},
	volume = {32},
	pages = {217–241},
	year = {2016}
}

IQMULUS
A High-volume Fusion and Analysis Platform for Geospatial Point Clouds, Coverages and Volumetric Data Sets

VISIONAIR
VISION ADVANCED INFRASTRUCTURE FOR RESEARCH


OpenAIRE