Query expansion based on visual content new
Embed Size (px)
Transcript of Query expansion based on visual content new
Query Expansion Based on Visual ContentLazaros T. Tsochatzidis
Athanasios Ch. Kapoutsis
Nikolaos I. Dourvas
Savvas A. Chatzichristofis
Yiannis S. Boutalis Thursday, January 26, 20121Department of Electrical and Computer Engineering Democritus University of Thrace
How the todays web search engines work?Keywords (from the user)Metadata (keywords, tags, any other information)
Thursday, January 26, 20122
compareIs everything working fine?
The ProblemsOrdinary image search is based on metadata, sometimes irrelative or missing
Very difficult to describe(using textual query) the image exactly as it is
Thursday, January 26, 20123
Thursday, January 26, 20124 is to reduce the sematic gap between What the user wants to find and How he describes it.
How does TsoKaDo work?Thursday, January 26, 20125
CEDD(Color and Edge Directivity Descriptor) Thursday, January 26, 20126
What is it?Belongs to the family of Compact Composite Descriptors (CCDs)Describes color and texture of an image.Used for searching and retrieving images from multimedia databases.
WHY?The results are very effective.It is very light and fast as it used only 54 bytes per imageThursday, January 26, 20127
Function of CEDDFor the color:2 fuzzy systems map the color of the image in a 24-color palette.
For the texture:Using a fuzzy version of the five digital filters proposed by MPEG-7 Edge Histogram Descriptor
Thursday, January 26, 20128
ClassificationThursday, January 26, 20129
ClassificationSGONGThe Self Growing and Self Organized Neural Gas Network (SGONG) Innovative neural classifier Dynamically defines the number of classes needed
K-means N observations into k clusters Criterion: Each observation belongs to the cluster with the nearest mean.
Friday, January 27, 201210
The proposed tagsThursday, January 26, 201211
Semantic similaritySemantic similarityThe definition of it relates to computing the conceptual similarity between terms that are not lexicography similar
Why we use it?It reduces the amount of proposed tags and gives more corresponding results.
Thursday, January 26, 201212
WORDNETA lexical database which provides a large repository of English lexical terms.
How it works?Parts Of Speech (POS) noun,verb,adjective, adverb.Establishes connection between POS and groups them into synsets.Sense A group of synset. .Represents different meaning of the same term.Thursday, January 26, 201213
The Path length measurement
Thursday, January 26, 201214Wu and Palmer method
Tsokado in action
Thursday, January 26, 201215
Problems And ObstaclesCEDD is based only in color and texture of the image Noisy tags at Flickr (human imported): Irrelevant tags
Time consuming when using Wordnet.Thursday, January 26, 201216
Solutions and future workUse of Visual Words instead of CEDD for better semantic classification
Fetching of tags from more reliable sources (e.g. Wikipedia)
Use of EuroWordnet, a multilanguage version.Thursday, January 26, 201217
Are there any ?'s
Thursday, January 26, 201218