Mining multimedia subjective feedback

Abstract

Personalising web search engines, a crucial issue nowadays,would obviously benefit from the system?sability to capture such an important aspect of a user?s personality as visual impressions and their communication.Unfortunately, such impressions are intrinsically variable and very difficult to make explicit. In this paper, wepropose a methodology to dynamically create personalised models of visual impression words. We suggest thatit can be achieved by exploiting multimedia data mining on the large amount of information contained in animage and in its mapping onto an impression word. The continuous adaptation of each model utilises not onlyrelevance feedback but also externalisation feedback. The externalisation process, triggered by the data miningactivity, is supported by a conceptual space whose tools allow users to transform their mental model into formalspecifications. For experimental validation purposes, a web-based meta search engine has been developed that canretrieve images on the basis of impression words. Personalising web search engines, a crucial issue nowadays,would obviously benefit from the system?sability to capture such an important aspect of a user?s personality as visual impressions and their communication.Unfortunately, such impressions are intrinsically variable and very difficult to make explicit. In this paper, wepropose a methodology to dynamically create personalised models of visual impression words. We suggest thatit can be achieved by exploiting multimedia data mining on the large amount of information contained in animage and in its mapping onto an impression word. The continuous adaptation of each model utilises not onlyrelevance feedback but also externalisation feedback. The externalisation process, triggered by the data miningactivity, is supported by a conceptual space whose tools allow users to transform their mental model into formalspecifications. For experimental validation purposes, a web-based meta search engine has been developed that canretrieve images on the basis of impression words.