LEARNING INTERACTION MEASURE WITH RELEVANCE FEEDBACK IN IMAGE RETRIEVAL
Author affiliations
DOI:
https://doi.org/10.15625/1813-9663/32/2/8605Keywords:
Content-based image retrieval, Relevance feedback, linear programming, Fuzzy mea-sures, Choquet integralAbstract
Relevance feedback is an eective approach to bridge the gap between low-level featureextraction and high-level semantic concept in content-based image retrieval (CBIR). In this paper,we further improve the use of users feedback with multi-feature query and the Choquet integral.Taking into account the interaction among feature sets, feedback information are used to adjust thefeature's relevance weights that are considered as the fuzzy density values in the Choquet integralto dene the overall similarity measure between two images. The feature weight adjustment andintegration aims at minimizing the dierence between users desire and outcome of the retrieval system.Experimental results on several benchmark datasets have shown the eectiveness of the proposedmethod in improving the quality of CBIR systems.Metrics
References
S. Aksoy and R. M. Haralick, Feature normalization and likelihood-based similarity measures for image retrieval," Pattern Recognition Letters, vol. 22, no. 5, pp. 563-582, 2001, image/Video Indexing and Retrieval.
M. Arevalillo-Herr_aez, F. J. Ferri, and J. Domingo, “A naive relevance feedback model for content-based image retrieval using multiple similarity measures," Pattern Recogn., vol. 43, no. 3, pp. 619-629, Mar. 2010.
M. Arevalillo-Herrez, J. Domingo, and F. J. Ferri, “Combining similarity measures in contentbased image retrieval," Pattern Recognition Letters, vol. 29, no. 16, pp. 2174-2181, 2008.
M. Arevalillo-Herrez, F. J. Ferri, and J. Domingo, “A naive relevance feedback model for contentbased
image retrieval using multiple similarity measures," Pattern Recognition, vol. 43, no. 3, pp. 619-629, 2010.
H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool, “Speeded-up robust features (surf)," Computer Vision and Image Understanding, vol. 110, no. 3, pp. 346-359, 2008, similarity Matching in Computer Vision and Multimedia.
G. Beliakov, “Fitting fuzzy measures by linear programming. programming library fmtools," in Fuzzy Systems, 2008. FUZZ-IEEE 2008. (IEEE World Congress on Computational Intelligence). IEEE International Conference on, June 2008, pp. 862-867.
W. Budiharto, A. R. Krishnan, M. M. Kasim, and E. M. N. E. A. Bakar, “A short survey on the usage of choquet integral and its associated fuzzy measure in multiple attribute analysis," Procedia Computer Science, vol. 59, pp. 427-434, 2015.
O. M. A. B. Chawki Youness, El Asnaoui Khalid, “New method of content based image retrieval based on 2-d esprit method and the gabor _lters," TELKOMNIKA Indonesian Journal of Electrical Engineering, vol. 15, no. 2, pp. 313-320, August 2015.
Y. Choi, D. Kim, and R. Krishnapuram, “Relevance feedback for content-based image retrieval using the choquet integral," in Multimedia and Expo, 2000. ICME 2000. 2000 IEEE International Conference on, vol. 2, 2000, pp. 1207-1210 vol.2.
R. da S. Torres, A. X. Falc~ao, B. Zhang, W. Fan, E. A. Fox, M. A. Gon_calves, and P. Calado, “A
new framework to combine descriptors for content-based image retrieval," in Proceedings of the 14th ACM International Conference on Information and Knowledge Management, ser. CIKM '05. New York,
NY, USA: ACM, 2005, pp. 335-336.
R. Datta, D. Joshi, J. Li, and J. Z. Wang, “Image retrieval: Ideas, inuences, and trends of the new age," ACM Computing Surveys, vol. 40, no. 2, pp. 1- 60, May 2008.
L. Fei-Fei, R. Fergus, and P. Perona, “Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories," Comput. Vis. Image Underst., vol. 106, no. 1, pp. 59-70, Apr. 2007.
H. Frigui, “Interactive image retrieval using fuzzy sets," Pattern Recognition Letters, vol. 22, no. 9, pp. 1021-1031, 2001.
N. T. Giang, N. Q. Tao, N. D. Dung, and N. T. The, “Skeleton based shape matching using reweighted random walks," in The proceding of the IEEE on 9th International Conference on Information, Communications and Signal Processing (ICICS), December 2013, pp. 1-5.
M. Grabisch, “The application of fuzzy integrals in multicriteria decision making," European Journal of Operational Research, vol. 89, no. 3, pp. 445-456, 1996.
M. Grabisch, I. Kojadinovic, and P. Meyer, “A review of methods for capacity identi_cation in choquet integral based multi-attribute utility theory: Applications of the kappalab r package," European Journal of Operational Research, vol. 186, no. 2, pp. 766-785, 2008.
W. Hu, N. Xie, L. Li, X. Zeng, and S. Maybank, “A survey on visual content-based video indexing and retrieval," IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 41, no. 6, pp. 797-819, Nov 2011.
M. J. Huiskes and M. S. Lew, “Performance evaluation of relevance feedback methods," in Proceedings of the 2008 International Conference on Content-based Image and Video Retrieval, ser. CIVR '08. New York, NY, USA: ACM, 2008, pp. 239-248.
Q. Iqbal and J. K. Aggarwal, “Combining structure, color and texture for image retrieval: A performance evaluation," in Pattern Recognition, 2002. Proceedings. 16th International Conference
on, vol. 2, 2002, pp. 438-443 vol.2.
J. D. Knowles and D. W. Corne, “Approximating the nondominated front using the pareto archived evolution strategy," Evol. Comput., vol. 8, no. 2, pp. 149-172, Jun. 2000.
C.-H. Lee and M.-F. Lin, “Ego-similarity measurement for relevance feedback," Expert Systems
with Applications, vol. 37, no. 1, pp. 871-877, 2010.
Y. Liu, D. Zhang, G. Lu, and W.-Y. Ma, “A survey of content-based image retrieval with highlevel
semantics," Pattern Recogn., vol. 40, no. 1, pp. 262-282, Jan. 2007.
G. Michel, “K-order additive discrete fuzzy measures and their representation," Fuzzy Sets Syst.,
vol. 92, no. 2, pp. 167-189, Dec. 1997.
T. Murofushi and M. Sugeno, “An interpretation of fuzzy measures and the choquet integral as
an integral with respect to a fuzzy measure," Fuzzy Sets and Systems, vol. 29, no. 2, pp. 201 - 227, 1989.
Y. Narukawa and T. Murofushi, Choquet integral and Sugeno integral as aggregation functions.
Berlin, Heidelberg: Springer Berlin Heidelberg, 2003, pp. 27-39.
Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra, “Relevance feedback: a power tool for interactive content-based image retrieval," IEEE Transactions on Circuits and Systems for Video Technology, vol. 8, no. 5, pp. 644-655, Sep 1998.
A. Silvia, G. Salvatore, L. Fabio, and M. Benedetto, “Assessing non-additive utility for multicriteria
decision aid," European Journal of Operational Research, vol. 158, no. 3, pp. 734-744, 2004.
M. S. T. Murofushi, “An interpretation of fuzzy measure and the choquet integral as an integral with respect to a fuzzy measure," Fuzzy Sets and Systems, vol. 29, pp. 201-227, 1989.
D. Tao, X. Tang, X. Li, and Y. Rui, “Direct kernel biased discriminant analysis: a new contentbased
image retrieval relevance feedback algorithm," IEEE Transactions on Multimedia, vol. 8, no. 4, pp. 716-727, Aug 2006.
B. Thomee and M. Lew, “Interactive search in image retrieval: a survey," International Journal
of Multimedia Information Retrieval, vol. 1, no. 2, pp. 71-86, 2012.
J. Wu and J. M. Rehg, “Centrist: A visual descriptor for scene categorization," IEEE Transac-
tions on Pattern Analysis and Machine Intelligence, vol. 33, no. 8, pp. 1489-1501, Aug 2011.
L. Wu and S. C. H. Hoi, “Enhancing bag-of-words models with semantics-preserving metric
learning," IEEE MultiMedia, vol. 18, no. 1, pp. 24-37, Jan 2011.
B. Xu, J. Bu, C. Chen, C.Wang, D. Cai, and X. He, “Emr: A scalable graph-based ranking model for content-based image retrieval," IEEE Transactions on Knowledge and Data Engineering, vol. 27, no. 1, pp. 102-114, Jan 2015.
M. O. Y. Rui, T. S. Huang and S. Mehrotra, “Relevance feedback: A powerful tool for interactive content-based image retrieval," IEEE Transactions on Circuits and Systems for Video Technology, vol. 8, pp. 644- 655, 1998.
Q. Zhang and E. Izquierdo, “Optimizing metrics combining low-level visual descriptors for image annotation and retrieval," in 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings, vol. 2, May 2006, pp. II-II.
J. Zhu, S. C. Hoi, M. R. Lyu, and S. Yan, “Near-duplicate keyframe retrieval by nonrigid image matching," in Proceedings of the 16th ACM International Conference on Multimedia, ser. MM '08. New York, NY, USA: ACM, 2008, pp. 41-50.
Y. K. J. K. Zukuan WEI, Hongyeon KIM, “An e_cient content based image retrieval scheme,"
TELKOMNIKA Indonesian Journal of Electrical Engineering, vol. 11, no. 11, p. 6986 6991, November 2013.
Downloads
Published
How to Cite
Issue
Section
License
1. We hereby assign copyright of our article (the Work) in all forms of media, whether now known or hereafter developed, to the Journal of Computer Science and Cybernetics. We understand that the Journal of Computer Science and Cybernetics will act on my/our behalf to publish, reproduce, distribute and transmit the Work.2. This assignment of copyright to the Journal of Computer Science and Cybernetics is done so on the understanding that permission from the Journal of Computer Science and Cybernetics is not required for me/us to reproduce, republish or distribute copies of the Work in whole or in part. We will ensure that all such copies carry a notice of copyright ownership and reference to the original journal publication.
3. We warrant that the Work is our results and has not been published before in its current or a substantially similar form and is not under consideration for another publication, does not contain any unlawful statements and does not infringe any existing copyright.
4. We also warrant that We have obtained the necessary permission from the copyright holder/s to reproduce in the article any materials including tables, diagrams or photographs not owned by me/us.
