Query expansion based on visual content new

download Query expansion based on visual content new

If you can't read please download the document

  • date post

    17-Jan-2017
  • Category

    Software

  • view

    525
  • download

    2

Embed Size (px)

Transcript of Query expansion based on visual content new

PowerPoint

Query Expansion Based on Visual ContentLazaros T. Tsochatzidis

Athanasios Ch. Kapoutsis

Nikolaos I. Dourvas

Savvas A. Chatzichristofis

Yiannis S. Boutalis Thursday, January 26, 20121Department of Electrical and Computer Engineering Democritus University of Thrace

1

How the todays web search engines work?Keywords (from the user)Metadata (keywords, tags, any other information)

Thursday, January 26, 20122

compareIs everything working fine?

2

The ProblemsOrdinary image search is based on metadata, sometimes irrelative or missing

Very difficult to describe(using textual query) the image exactly as it is

Thursday, January 26, 20123

3

Our goal

Thursday, January 26, 20124 is to reduce the sematic gap between What the user wants to find and How he describes it.

4

How does TsoKaDo work?Thursday, January 26, 20125

5

CEDD(Color and Edge Directivity Descriptor) Thursday, January 26, 20126

6

What is it?Belongs to the family of Compact Composite Descriptors (CCDs)Describes color and texture of an image.Used for searching and retrieving images from multimedia databases.

WHY?The results are very effective.It is very light and fast as it used only 54 bytes per imageThursday, January 26, 20127

7

Function of CEDDFor the color:2 fuzzy systems map the color of the image in a 24-color palette.

For the texture:Using a fuzzy version of the five digital filters proposed by MPEG-7 Edge Histogram Descriptor

Thursday, January 26, 20128

8

ClassificationThursday, January 26, 20129

9

ClassificationSGONGThe Self Growing and Self Organized Neural Gas Network (SGONG) Innovative neural classifier Dynamically defines the number of classes needed

K-means N observations into k clusters Criterion: Each observation belongs to the cluster with the nearest mean.

Friday, January 27, 201210

10

The proposed tagsThursday, January 26, 201211

11

Semantic similaritySemantic similarityThe definition of it relates to computing the conceptual similarity between terms that are not lexicography similar

Why we use it?It reduces the amount of proposed tags and gives more corresponding results.

Thursday, January 26, 201212

12

WORDNETA lexical database which provides a large repository of English lexical terms.

How it works?Parts Of Speech (POS) noun,verb,adjective, adverb.Establishes connection between POS and groups them into synsets.Sense A group of synset. .Represents different meaning of the same term.Thursday, January 26, 201213

13

The Path length measurement

Thursday, January 26, 201214Wu and Palmer method

14

Tsokado in action

Thursday, January 26, 201215

15

Problems And ObstaclesCEDD is based only in color and texture of the image Noisy tags at Flickr (human imported): Irrelevant tags

Time consuming when using Wordnet.Thursday, January 26, 201216

16

Solutions and future workUse of Visual Words instead of CEDD for better semantic classification

Fetching of tags from more reliable sources (e.g. Wikipedia)

Use of EuroWordnet, a multilanguage version.Thursday, January 26, 201217

17

Are there any ?'s

Please visit:http://tsokado.nonrelevant.net

Thursday, January 26, 201218

18