Evidence from BehaviorLBSC 796/INFM 719RDouglas W. OardSession 7, October 22, 2007
Picture of Relevance FeedbackxxxxoooRevised queryx non-relevant documentso relevant documentsoooxxxxxxxxxxxxxxInitial queryx
Rocchio Formulaqm = modified query vector; q0 = original query vector;,,: weights (hand-chosen or set empirically); Dr = set of known relevant doc vectors; Dnr = set of known irrelevant doc vectors
Rocchio Example040800124001201104-16370-30408002480028044016Original queryPositive FeedbackNegative feedback(+)(-)New queryTypically, <
Using Positive InformationSource: Jon Herlocker, SIGIR 1999
SmallWorld
SpaceMtn
Mad Tea Pty
Dumbo
Speed-way
CntryBear
Joe
D
A
B
D
?
?
Ellen
A
F
D
F
Mickey
A
A
A
A
A
A
Goofy
D
A
C
John
A
C
A
C
A
Ben
F
A
F
Nathan
D
A
A
Using Negative InformationSource: Jon Herlocker, SIGIR 1999
SmallWorld
SpaceMtn
Mad Tea Pty
Dumbo
Speed-way
CntryBear
Joe
D
A
B
D
?
?
Ellen
A
F
D
F
Mickey
A
A
A
A
A
A
Goofy
D
A
C
John
A
C
A
C
A
Ben
F
A
F
Nathan
D
A
A
Rating-Based RecommendationUse ratings as to describe objectsPersonal recommendations, peer review,
Beyond topicality:Accuracy, coherence, depth, novelty, style,
Has been applied to many modalitiesBooks, Usenet news, movies, music, jokes, beer,
Motivations to Provide RatingsSelf-interestUse the ratings to improve systems user model
Economic benefitIf a market for ratings is created
Altruism
Explicit Feedback: AssumptionsA1: User has sufficient knowledge for a reasonable initial query
A2: Selected examples are representative
A3: The user will try giving feedback
A4: The user will keep giving feedback
A1: Good Initial Query?Two problems:User may not have sufficient initial knowledgeFew or no relevant documents may be retrieved
Examples:Misspellings (Brittany Speers)Cross-language information retrievalVocabulary mismatch (e.g., cosmonaut/astronaut)
A2: Representative Examples?There may be several clusters of relevant documents
Examples:Burma/MyanmarContradictory government policiesOpinions
A3: Will People Use It?EfficiencyLonger queries require more processing time
UnderstandabilityHarder to see why subsequent documents retrieved
RiskUsers are reluctant to provide negative feedback
A4: Self-Interest Decreases!Number of RatingsValue of ratingsMarginal value to raterMarginal value to communityFewLotsMarginal cost
Solving the Cost vs. Value ProblemMaximize the valueProvide for continuous user model adaptation
Minimize the costsUse implicit feedback rather than explicit ratingsMinimize privacy concerns through encryptionBuild an efficient scalable architectureLimit the scope to noncompetitive activities
Solution: Reduce the Marginal CostNumber of RatingsMarginal value to raterMarginal value to communityFewLotsMarginal cost
View Listen Select Print Bookmark Save Purchase Delete Subscribe Copy / paste Quote Forward Reply Link Cite Mark up Tag Publish Organize Type Edit
View Listen Select Print Bookmark Save Purchase Delete Subscribe Copy / paste Quote Forward Reply Link Cite Mark up Tag Publish Organize Type Edit
View Listen Select Print Bookmark Save Purchase Delete Subscribe Copy / paste Quote Forward Reply Link Cite Mark up Tag Publish Organize Type Edit
Estimating Authority from LinksAuthorityAuthorityHub
Anchor Text IndexingSometimes yields unexpected results: Google ranked Microsoft #1 for evil empireAdapted from: Manning and Raghavan
Collecting Click StreamsBrowsing histories are easily capturedMake all links initially point to a central siteEncode the desired URL as a parameterBuild a time-annotated transition graph for each userCookies identify users (when they use the same machine)Redirect the browser to the desired page
Reading time is correlated with interestCan be used to build individual profilesUsed to target advertising by doubleclick.com
020406080100120140160180NoInterestLowInterestModerateInterestHighInterestRatingReading Time (seconds)Full Text Articles (Telecommunications)50325843
More Complete ObservationsUser selects an articleInterpretation: Summary was interestingUser quickly prints the articleInterpretation: They want to read itUser selects a second articleInterpretation: another interesting summaryUser scrolls around in the articleInterpretation: Parts with high dwell time and/or repeated revisits are interestingUser stops scrolling for an extended periodInterpretation: User was interrupted
NoInterestNoInterestLowInterestModerateInterestHighInterestAbstracts (Pharmaceuticals)42555251
Chart2
56
30
66
45
67
32
140
27
118
72
67
93
6
7
4
18
53
17
95
52
68
105
11
46
75
64
45
77
30
29
15
4
12
10
6
3
13
4
24
50
40
70
47
175
80
50
56
125
91
25
53
66
76
105
75
108
27
23
137
62
72
21
59
54
25
46
43
41
32
16
176
35
102
58
15
100
39
35
30
21
38
166
23
41
3
5
20
48
77
75
54
38
39
36
22
79
21
15
33
37
8
64
40
35
23
10
22
107
69
72
67
84
88
87
70
106
95
78
60
37
100
96
13
19
38
21
9
10
27
76
24
37
46
55
40
27
27
14
36
23
29
33
16
5
107
73
81
71
79
123
99
17
12
Rating
Reading Time
z_ab_to
zool_3101.0010:34:2256.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab.05464-.55905
zool_3101.0010:36:2030.00CNT2820KCH1623WIZ2760ITP2794.00F1.00ab-.53380-1.30297
zool_3101.0010:37:3766.00CNT2841KCH1623WIZ2760ITP27942.00P2.00ab.28096.18488
zool_3101.0010:39:3445.00CNT3609KCH1623WIZ3548ITP3582.00F1.00ab-.19432-1.30297
zool_3101.0010:41:3667.00CNT4966KCH1623WIZ4905ITP49392.00P2.00ab.30359.18488
zool_3103.0010:29:2132.00CNT1685KCH1623WIZ1624ITP1658.00F1.00ab-.48854-1.30297
zool_385.0010:31:45140.00CNT1685KCH1623WIZ1624ITP16582.00F1.00ab1.95575.18488
zool_385.0010:32:4827.00CNT1685KCH1623WIZ1624ITP1658.00F1.00ab-.60170-1.30297
zool_385.0010:40:42118.00CNT1708KCH1623WIZ1624ITP1668.00F1.00ab1.45784-1.30297
zool_385.0010:45:4572.00CNT3001KCH1623WIZ2760ITP28152.00F1.00ab.41675.18488
zool_388.0010:32:1367.00CNT1685KCH1623WIZ1624ITP1658.00F1.00ab.30359-1.30297
zool_388.0010:39:5193.00CNT2213KCH1623WIZ1624ITP1679.00F1.00ab.89203-1.30297
zool_389.0010:27:596.00CNT1919KCH1623WIZ1813ITP18572.00F1.00ab-1.07697.18488
zool_389.0010:32:367.00CNT3632KCH1623WIZ3548ITP35921.00F1.00ab-1.05434-.55905
zool_391.0010:30:464.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab-1.12224-.55905
zool_391.0010:39:1318.00CNT2213KCH1623WIZ1624ITP1679.00F1.00ab-.80539-1.30297
zool_391.0010:38:0253.00CNT2171KCH1623WIZ1624ITP16793.00P2.00ab-.01326.92881
zool_391.0010:39:5417.00CNT2192KCH1623WIZ1624ITP1679.00F1.00ab-.82802-1.30297
zool_392.0010:30:3695.00CNT1685KCH1623WIZ1624ITP1658.00F1.00ab.93730-1.30297
zool_395.0010:36:4052.00CNT4988KCH1623WIZ4905ITP49602.00F1.00ab-.03589.18488
zool_395.0010:43:3768.00CNT2276KCH1623WIZ1813ITP18682.00F1.00ab.32623.18488
zool_485.0012:34:56105.00CNT5195KCH1623WIZ4905ITP49491.00F1.00ab1.16362-.55905
zool_485.0012:37:3911.00CNT2276KCH1623WIZ1813ITP18681.00P2.00ab-.96381-.55905
zool_485.0012:39:0346.00CNT2255KCH1623WIZ1813ITP18681.00F1.00ab-.17168-.55905
zool_488.0012:24:5475.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab.48465-.55905
zool_488.0012:29:0064.00CNT2213KCH1623WIZ1624ITP16792.00F1.00ab.23570.18488
zool_488.0012:34:3845.00CNT2276KCH1623WIZ1813ITP18682.00F1.00ab-.19432.18488
zool_488.0012:36:4377.00CNT2841KCH1623WIZ2760ITP27941.00F1.00ab.52992-.55905
zool_488.0012:38:4530.00CNT3001KCH1623WIZ2760ITP28152.00F1.00ab-.53380.18488
zool_488.0012:40:0029.00CNT3609KCH1623WIZ3548ITP35821.00F1.00ab-.55643-.55905
zool_488.0012:41:4515.00CNT13542KCH1623WIZ3548ITP3603.00F1.00ab-.87328-1.30297
zool_488.0012:42:214.00CNT4966KCH1623WIZ4905ITP4939.00F1.00ab-1.12224-1.30297
zool_488.0012:43:1412.00CNT5217KCH1623WIZ4905ITP49491.00F1.00ab-.94118-.55905
zool_489.0012:19:1710.00CNT1685KCH1623WIZ1624ITP1658.00F1.00ab-.98644-1.30297
zool_489.0012:25:006.00CNT2234KCH1623WIZ1813ITP1868.00F1.00ab-1.07697-1.30297
zool_489.0012:25:413.00CNT2841KCH1623WIZ2760ITP27942.00F1.00ab-1.14487.18488
zool_489.0012:27:1713.00CNT3001KCH1623WIZ2760ITP28151.00F1.00ab-.91855-.55905
zool_489.0012:28:184.00CNT3609KCH1623WIZ3548ITP35821.00F1.00ab-1.12224-.55905
zool_489.0012:37:1224.00CNT5009KCH1623WIZ4905ITP49603.00F1.00ab-.66959.92881
zool_495.0012:24:3350.00CNT2980KCH1623WIZ2760ITP28151.00F1.00ab-.08115-.55905
zool_497.0012:20:4740.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab-.30748-.55905
zool_5101.0014:35:0970.00CNT2171KCH1623WIZ1624ITP16792.00F1.00ab.37149.18488
zool_5101.0014:47:0647.00CNT4988KCH1623WIZ4905ITP49602.00F1.00ab-.14905.18488
zool_5103.0014:46:18175.00CNT1685KCH1623WIZ1624ITP16583.00F1.00ab2.74788.92881
zool_584.0014:38:2480.00CNT2213KCH1623WIZ1624ITP16792.00F1.00ab.59781.18488
zool_584.0014:39:3650.00CNT2171KCH1623WIZ1624ITP16793.00F1.00ab-.08115.92881
zool_585.0014:22:5256.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab.05464-.55905
zool_585.0014:33:31125.00CNT2213KCH1623WIZ1624ITP16791.00F1.00ab1.61626-.55905
zool_585.0014:35:3091.00CNT2171KCH1623WIZ1624ITP16791.00F1.00ab.84677-.55905
zool_585.0014:36:2725.00CNT2192KCH1623WIZ1624ITP16791.00F1.00ab-.64696-.55905
zool_588.0014:23:2753.00CNT2192KCH1623WIZ1624ITP16791.00F1.00ab-.01326-.55905
zool_588.0014:24:5866.00CNT2213KCH1623WIZ1624ITP1679.00F1.00ab.28096-1.30297
zool_588.0014:35:1676.00CNT2276KCH1623WIZ1813ITP1868.00F1.00ab.50728-1.30297
zool_588.0014:38:33105.00CNT2980KCH1623WIZ2760ITP28152.00F1.00ab1.16362.18488
zool_588.0014:40:0475.00CNT2959KCH1623WIZ2760ITP28151.00F1.00ab.48465-.55905
zool_589.0014:23:09108.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab1.23152-.55905
zool_589.0014:30:1327.00CNT2213KCH1623WIZ1624ITP16791.00F1.00ab-.60170-.55905
zool_589.0014:37:5823.00CNT3609KCH1623WIZ3548ITP3582.00F1.00ab-.69223-1.30297
zool_589.0014:45:40137.00CNT13542KCH1623WIZ3548ITP36031.00F1.00ab1.88785-.55905
zool_591.0014:24:5662.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab.19043-.55905
zool_591.0014:30:3772.00CNT2171KCH1623WIZ1624ITP16793.00F1.00ab.41675.92881
zool_591.0014:31:1721.00CNT2192KCH1623WIZ1624ITP16791.00F1.00ab-.73749-.55905
zool_591.0014:36:3659.00CNT2276KCH1623WIZ1813ITP18682.00F1.00ab.12254.18488
zool_591.0014:39:5154.00CNT2841KCH1623WIZ2760ITP27942.00F1.00ab.00937.18488
zool_591.0014:46:4625.00CNT2959KCH1623WIZ2760ITP2815.00F1.00ab-.64696-1.30297
zool_592.0014:26:4946.00CNT1747KCH1623WIZ1624ITP1668.00F1.00ab-.17168-1.30297
zool_597.0014:34:0343.00CNT2234KCH1623WIZ1813ITP18683.00P2.00ab-.23958.92881
zool_597.0014:35:3641.00CNT2841KCH1623WIZ2760ITP27941.00F1.00ab-.28484-.55905
zool_597.0014:43:2932.00CNT3609KCH1623WIZ3548ITP35822.00P2.00ab-.48854.18488
zool_6101.0014:21:1816.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab-.85065-.55905
zool_6101.0014:34:16176.00CNT5009KCH1623WIZ4905ITP49601.00F1.00ab2.77051-.55905
zool_6101.0014:37:3435.00CNT4988KCH1623WIZ4905ITP49602.00F1.00ab-.42064.18488
zool_6103.0014:21:55102.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab1.09572-.55905
zool_6103.0014:37:5058.00CNT2213KCH1623WIZ1624ITP16793.00P2.00ab.09990.92881
zool_6103.0014:38:4815.00CNT2192KCH1623WIZ1624ITP16791.00F1.00ab-.87328-.55905
zool_6103.0014:46:42100.00CNT2276KCH1623WIZ1813ITP18682.00P2.00ab1.05046.18488
zool_6103.0014:47:5139.00CNT2234KCH1623WIZ1813ITP18683.00F1.00ab-.33011.92881
zool_684.0014:27:5935.00CNT1685KCH1623WIZ1624ITP16582.00P2.00ab-.42064.18488
zool_684.0014:41:0830.00CNT3609KCH1623WIZ3548ITP35822.00F1.00ab-.53380.18488
zool_684.0014:42:2221.00CNT4966KCH1623WIZ4905ITP49392.00F1.00ab-.73749.18488
zool_684.0014:47:0738.00CNT5217KCH1623WIZ4905ITP49492.00F1.00ab-.35274.18488
zool_685.0014:24:28166.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab2.54419-.55905
zool_685.0014:41:0623.00CNT2171KCH1623WIZ1624ITP16791.00F1.00ab-.69223-.55905
zool_685.0014:42:2141.00CNT2213KCH1623WIZ1624ITP1679.00F1.00ab-.28484-1.30297
zool_685.0014:42:493.00CNT2192KCH1623WIZ1624ITP1679.00F1.00ab-1.14487-1.30297
zool_685.0014:44:395.00CNT1919KCH1623WIZ1813ITP1857.00F1.00ab-1.09961-1.30297
zool_685.0014:45:4120.00CNT1919KCH1623WIZ1813ITP1857.00F1.00ab-.76012-1.30297
zool_688.0014:22:0248.00CNT1685KCH1623WIZ1624ITP16582.00P2.00ab-.12642.18488
zool_688.0014:27:3077.00CNT2213KCH1623WIZ1624ITP16791.00F1.00ab.52992-.55905
zool_688.0014:32:0175.00CNT2213KCH1623WIZ1624ITP16791.00F1.00ab.48465-.55905
zool_688.0014:40:4654.00CNT2276KCH1623WIZ1813ITP18682.00F1.00ab.00937.18488
zool_688.0014:42:0638.00CNT2841KCH1623WIZ2760ITP27943.00P2.00ab-.35274.92881
zool_688.0014:46:0139.00CNT2959KCH1623WIZ2760ITP28151.00F1.00ab-.33011-.55905
zool_688.0014:47:1936.00CNT4966KCH1623WIZ4905ITP49392.00P2.00ab-.39801.18488
zool_689.0014:44:2022.00CNT2213KCH1623WIZ1624ITP1679.00F1.00ab-.71486-1.30297
zool_691.0014:21:3279.00CNT1685KCH1623WIZ1624ITP1658.00F1.00ab.57518-1.30297
zool_691.0014:37:5021.00CNT2213KCH1623WIZ1624ITP16792.00F1.00ab-.73749.18488
zool_691.0014:38:1415.00CNT2213KCH1623WIZ1624ITP16793.00F1.00ab-.87328.92881
zool_691.0014:44:3933.00CNT2276KCH1623WIZ1813ITP18682.00F1.00ab-.46590.18488
zool_691.0014:45:3137.00CNT2255KCH1623WIZ1813ITP18681.00F1.00ab-.37537-.55905
zool_691.0014:45:588.00CNT2234KCH1623WIZ1813ITP18682.00P2.00ab-1.03171.18488
zool_691.0014:48:0364.00CNT2820KCH1623WIZ2760ITP2794.00F1.00ab.23570-1.30297
zool_692.0014:46:5240.00CNT3001KCH1623WIZ2760ITP28153.00F1.00ab-.30748.92881
zool_695.0014:20:4535.00CNT1685KCH1623WIZ1624ITP16582.00F1.00ab-.42064.18488
zool_695.0014:37:1823.00CNT2171KCH1623WIZ1624ITP16792.00F1.00ab-.69223.18488
zool_695.0014:37:4010.00CNT2213KCH1623WIZ1624ITP16791.00F1.00ab-.98644-.55905
zool_695.0014:38:3622.00CNT1919KCH1623WIZ1813ITP18571.00F1.00ab-.71486-.55905
zool_697.0014:22:06107.00CNT1685KCH1623WIZ1624ITP16582.00F1.00ab1.20888.18488
zool_697.0014:41:1469.00CNT2171KCH1623WIZ1624ITP16793.00F1.00ab.34886.92881
zool_697.0014:46:0972.00CNT2841KCH1623WIZ2760ITP27941.00F1.00ab.41675-.55905
zool_697.0014:47:5367.00CNT3001KCH1623WIZ2760ITP28153.00F1.00ab.30359.92881
zool_7101.0015:0484.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab.68834-.55905
zool_7101.0032:0688.00CNT2213KCH1623WIZ1624ITP16792.00F1.00ab.77887.18488
zool_7101.0041:0387.00CNT2255KCH1623WIZ1813ITP18683.00F1.00ab.75624.92881
zool_7101.0043:0570.00CNT4966KCH1623WIZ4905ITP49393.00F1.00ab.37149.92881
zool_7103.0014:45106.00CNT1685KCH1623WIZ1624ITP16582.00F1.00ab1.18625.18488
zool_7103.0024:3895.00CNT2213KCH1623WIZ1624ITP1679.00F1.00ab.93730-1.30297
zool_7103.0036:3078.00CNT2255KCH1623WIZ1813ITP18681.00F1.00ab.55255-.55905
zool_7103.0037:5460.00CNT2234KCH1623WIZ1813ITP18683.00F1.00ab.14517.92881
zool_7103.0039:5837.00CNT2820KCH1623WIZ2760ITP27941.00F1.00ab-.37537-.55905
zool_7103.0042:05100.00CNT2841KCH1623WIZ2760ITP27943.00P2.00ab1.05046.92881
zool_784.0015:1396.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab.95993-.55905
zool_784.0019:1113.00CNT1708KCH1623WIZ1624ITP16682.00F1.00ab-.91855.18488
zool_784.0020:0719.00CNT2213KCH1623WIZ1624ITP16792.00F1.00ab-.78275.18488
zool_784.0030:5238.00CNT2841KCH1623WIZ2760ITP27941.00F1.00ab-.35274-.55905
zool_784.0035:4821.00CNT3001KCH1623WIZ2760ITP28153.00F1.00ab-.73749.92881
zool_784.0037:369.00CNT4966KCH1623WIZ4905ITP49393.00F1.00ab-1.00908.92881
zool_784.0038:2510.00CNT5217KCH1623WIZ4905ITP49493.00F1.00ab-.98644.92881
zool_784.0039:5927.00CNT5009KCH1623WIZ4905ITP49603.00F1.00ab-.60170.92881
zool_785.0014:2676.00CNT1685KCH1623WIZ1624ITP16582.00F1.00ab.50728.18488
zool_785.0017:3824.00CNT2213KCH1623WIZ1624ITP16791.00F1.00ab-.66959-.55905
zool_785.0023:5337.00CNT2276KCH1623WIZ1813ITP18683.00F1.00ab-.37537.92881
zool_785.0029:1946.00CNT2841KCH1623WIZ2760ITP27941.00F1.00ab-.17168-.55905
zool_785.0035:0955.00CNT3001KCH1623WIZ2760ITP28153.00F1.00ab.03201.92881
zool_785.0039:0140.00CNT4966KCH1623WIZ4905ITP49393.00F1.00ab-.30748.92881
zool_788.0013:2527.00CNT1685KCH1623WIZ1624ITP16582.00F1.00ab-.60170.18488
zool_788.007:4427.00CNT2213KCH1623WIZ1624ITP16793.00F1.00ab-.60170.92881
zool_788.003:2414.00CNT2841KCH1623WIZ2760ITP27942.00F1.00ab-.89592.18488
zool_788.0028:5536.00CNT2980KCH1623WIZ2760ITP28152.00F1.00ab-.39801.18488
zool_788.0030:3023.00CNT5009KCH1623WIZ4905ITP49601.00F1.00ab-.69223-.55905
zool_789.0016:1529.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab-.55643-.55905
zool_789.0019:3833.00CNT2213KCH1623WIZ1624ITP16792.00F1.00ab-.46590.18488
zool_789.0024:2516.00CNT2234KCH1623WIZ1813ITP18682.00F1.00ab-.85065.18488
zool_789.0030:415.00CNT4988KCH1623WIZ4905ITP4960.00F1.00ab-1.09961-1.30297
zool_792.0015:08107.00CNT1685KCH1623WIZ1624ITP16582.00F1.00ab1.20888.18488
zool_792.0029:0473.00CNT5009KCH1623WIZ4905ITP49603.00F1.00ab.43939.92881
zool_792.0030:4281.00CNT4988KCH1623WIZ4905ITP49601.00F1.00ab.62044-.55905
zool_792.0034:5671.00CNT4966KCH1623WIZ4905ITP49393.00F1.00ab.39412.92881
zool_795.0015:4479.00CNT1685KCH1623WIZ1624ITP16581.00F1.00ab.57518-.55905
zool_795.0025:35123.00CNT2171KCH1623WIZ1624ITP16792.00F1.00ab1.57100.18488
zool_795.0041:2199.00CNT2841KCH1623WIZ2760ITP2794.00F1.00ab1.02783-1.30297
zool_797.0035:1517.00CNT4988KCH1623WIZ4905ITP49601.00P2.00ab-.82802-.55905
zool_797.0039:3512.00CNT2892KCH1623WIZ2760ITP28043.00P2.00ab-.94118.92881
Recommending w/Implicit FeedbackEstimateRatingUserModelRatings ServerUser RatingsCommunityRatingsPredictedRatingsUserObservationsUser RatingsUserModelEstimateRatingsObservations ServerPredictedObservationsCommunityObservationsPredictedRatings
UserObservations
Critical IssuesProtecting privacyWhat absolute assurances can we provide?How can we make remaining risks understood?
Scalable rating serversIs a fully distributed architecture practical?
Non-cooperative usersHow can the effect of spamming be limited?
Gaining Access to ObservationsObserve public behaviorHypertext linking, publication, citing,
Policy protectionEU: Privacy lawsUS: Privacy policies + FTC enforcement
Statistical assurance of privacyDistributed architectureModel and mitigate privacy risks
Search EngineQuery LogsA: Southeast Asia (Dec 27, 2004) B: Indonesia (Mar 29, 2005) C; Pakistan (Oct 10, 2005) D; Hawaii (Oct 16, 2006) E: Indonesia (Aug 8, 2007) F: Peru (Aug 16, 2007)
Search Engine Query Logshttp://hannu.biz/aolsearch/
AOL User 4417749
11627
Top Related