Query expansion based on visual content new

download Query expansion based on visual content new

If you can't read please download the document

  • date post

  • Category


  • view

  • download


Embed Size (px)

Transcript of Query expansion based on visual content new


Query Expansion Based on Visual ContentLazaros T. Tsochatzidis

Athanasios Ch. Kapoutsis

Nikolaos I. Dourvas

Savvas A. Chatzichristofis

Yiannis S. Boutalis Thursday, January 26, 20121Department of Electrical and Computer Engineering Democritus University of Thrace


How the todays web search engines work?Keywords (from the user)Metadata (keywords, tags, any other information)

Thursday, January 26, 20122

compareIs everything working fine?


The ProblemsOrdinary image search is based on metadata, sometimes irrelative or missing

Very difficult to describe(using textual query) the image exactly as it is

Thursday, January 26, 20123


Our goal

Thursday, January 26, 20124 is to reduce the sematic gap between What the user wants to find and How he describes it.


How does TsoKaDo work?Thursday, January 26, 20125


CEDD(Color and Edge Directivity Descriptor) Thursday, January 26, 20126


What is it?Belongs to the family of Compact Composite Descriptors (CCDs)Describes color and texture of an image.Used for searching and retrieving images from multimedia databases.

WHY?The results are very effective.It is very light and fast as it used only 54 bytes per imageThursday, January 26, 20127


Function of CEDDFor the color:2 fuzzy systems map the color of the image in a 24-color palette.

For the texture:Using a fuzzy version of the five digital filters proposed by MPEG-7 Edge Histogram Descriptor

Thursday, January 26, 20128


ClassificationThursday, January 26, 20129


ClassificationSGONGThe Self Growing and Self Organized Neural Gas Network (SGONG) Innovative neural classifier Dynamically defines the number of classes needed

K-means N observations into k clusters Criterion: Each observation belongs to the cluster with the nearest mean.

Friday, January 27, 201210


The proposed tagsThursday, January 26, 201211


Semantic similaritySemantic similarityThe definition of it relates to computing the conceptual similarity between terms that are not lexicography similar

Why we use it?It reduces the amount of proposed tags and gives more corresponding results.

Thursday, January 26, 201212


WORDNETA lexical database which provides a large repository of English lexical terms.

How it works?Parts Of Speech (POS) noun,verb,adjective, adverb.Establishes connection between POS and groups them into synsets.Sense A group of synset. .Represents different meaning of the same term.Thursday, January 26, 201213


The Path length measurement

Thursday, January 26, 201214Wu and Palmer method


Tsokado in action

Thursday, January 26, 201215


Problems And ObstaclesCEDD is based only in color and texture of the image Noisy tags at Flickr (human imported): Irrelevant tags

Time consuming when using Wordnet.Thursday, January 26, 201216


Solutions and future workUse of Visual Words instead of CEDD for better semantic classification

Fetching of tags from more reliable sources (e.g. Wikipedia)

Use of EuroWordnet, a multilanguage version.Thursday, January 26, 201217


Are there any ?'s

Please visit:http://tsokado.nonrelevant.net

Thursday, January 26, 201218