A METHOD OF SEMANTIC-BASED IMAGE RETRIEVAL USING GRAPH CUT

Authors

  • Nguyen Minh Hai HCMC University of Education, Ho Chi Minh City, Viet Nam
  • Van Thanh The HCMC University of Education, Ho Chi Minh City, Viet Nam
  • Tran Van Lang HCMC University of Foreign Languages - Information Technology, Ho Chi Minh City, Vietnam https://orcid.org/0000-0002-8925-5549

DOI:

https://doi.org/10.15625/1813-9663/38/2/16786

Keywords:

Image retrieval, Ontology, Clustering, data mining.

Abstract

Semantic extraction for images is a topical problem and is applied in many different semantic search systems. In this paper, a method of semantic image retrieval is proposed based on the set of similar images to the input image; then, the semantics of the images are queried on the ontology through the visual words vector. The objects of each image are extracted and classified by the Mask R-CNN and stored on the cluster graph to extract semantics for the image. The similar images of query image are extracted on the cluster graph; then, the k-NN algorithm is applied to find the visual words vector as the basis for querying the semantic of the query image on the ontology by the SPARQL query. On the basis of the proposed method, an experiment was built and evaluated on two large-volume image datasets MIRFLICKR-25K and MS COCO. Experimental results are compared with recently published works on the same datasets to demonstrate the effectiveness of the proposed method. According to the experimental results, the method of semantic image retrieval in this paper has improved the accuracy to 0.897 for MIRFLICKR-25K, 0.833 for MS COCO.

Metrics

Metrics Loading ...

Author Biography

Tran Van Lang, HCMC University of Foreign Languages - Information Technology, Ho Chi Minh City, Vietnam

Assoc. Professor in Computer Science

Doctor in Mathematics - Physics

Dean of Faculty of Information Technology, Lac Hong University

Deputy Editor-in-Chief: Journal of Computer Science and Cybernetics

Scientific Secretary, Section Editor: Vietnam Journal of Science and Technology

Editor-in-Chief:: HUFLIT Journal of Science 

Downloads

Published

2022-06-23

How to Cite

[1]
H. M. Nguyen, V. Thanh The, and T. V. Lang, “A METHOD OF SEMANTIC-BASED IMAGE RETRIEVAL USING GRAPH CUT”, JCC, vol. 38, no. 2, p. 193–212, Jun. 2022.

Issue

Section

Articles