1. Michalis Vafopoulos NTUA & Data in a nutshell Open data workshop,

50
1

Transcript of 1. Michalis Vafopoulos NTUA & Data in a nutshell Open data workshop,

Page 1: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

1

Page 2: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Michalis Vafopoulos

NTUA www.publicspending.net & www.vafopoulos.org

Data in a nutshell

Open data workshop, Lebanon 23/5/2014

Page 3: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Welcome to the data era

Page 4: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,
Page 5: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

5

Page 6: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

6

Page 7: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

The era of Open budgets, spending, registries, contracting…

7

Page 8: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

The Transparency program in Greece (2010-2014)

oA revolution in open governmentoex-ante reporting of every state

decision oparadigm shift for 40K public

servants

8

Page 9: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

The Transparency program in Greece

omanifests the value of procrastination principle (again)

ostrong rival to the Clientelistic state

oThe new version under beta testing (delivery: in 10 days!)

9

Page 10: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

publicspending.net

2011: I believed that the Transparency program is the open data “gold” (& persuaded 7 more people)

10

Page 11: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

publicspending.net

2012: …with some dust and rocks in a deep goldmine

11

Page 12: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

2013: time to chisel some jewelry2014: open data everywhere

12

Page 13: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Indexing, searching, global comparisons

Page 14: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Indexing, searching, global comparisons

Page 15: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Indexing, searching, global comparisons

Page 16: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Indexing, searching, global comparisons

Page 17: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Indexing, searching, global comparisons

Page 18: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Where the money goes in Greece

Page 19: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Data: Open, big, linked

Open: access…everyone to use and republish as she wishes

Big: scalehigh volume, velocity and variety

Linked: usePublish once, use as many times

Page 21: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Examples

Can you find the famous persons born in Beirut before 1900?

In Paris, Athens, … ?

Page 22: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Examples

#anoixtigenia, @vafopoulos

Page 23: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Examples

#anoixtigenia, @vafopoulos

Page 24: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Why Open Dataomore & better information o objective and processable

information for economic/political “dialogue”

• to promote competition• to decrease cost • to judge the efficiency of policy

mixtures• to enable participation

24

Page 25: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

(initial) scope OGD

to provide an objective & intermediate layer of information that will enable citizens, journalists, business people and politicians to re-discover their own “stories” from data.

25

Page 26: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

LOD in Greece: why it is important

• quality of information during economic crisis

• transparency & efficiency in funding development

26

Page 27: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Issues

ohow can we initiate the virtuous cycle of creation?

demonstrate LOD’s added value

ohow to get the most out of data?local & global interconnections

27

Page 28: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

In few words,

Apps, Apps, Apps…..

28

Page 29: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Public Spending in Greece & worldwide publicspending.net

• the first LOD App in Greece• daily updates• open spending linked data,

endpoint & visualizations

29

Page 30: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Insights in Global Public Spending

Page 31: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Open but Effective?

oWho really gets the public money?

oFor what? From whom?oCan we compare them?o Is public spending effective?o<your question goes here>

31

Page 32: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Useful economic open data

1. The full cycle of public money

2. Uniform Company names3. Compatible Payment

categories

32

Page 33: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

1. The full cycle of public money

33

Prices

Page 34: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Follow Public Money all the Way Vocabulary (fpm)

oA compact and minimal way to model the flows of public money

oFrom budget to spending including business information and prices

34

Page 35: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Useful economic open data

1. The full cycle of public money

2. Uniform Company names3. Compatible Payment

categories

35

Page 36: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

2. Not uniform Company names

36

The problem: different

names for the same company

“Oracle” in the Australian public spending

Page 38: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

3. Compatible Payment categories

The problem:

Spending decisions are using different (or not any!) classification schemes (e.g. CPV, UNSSC, NAICS)

38

Page 39: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Compatible Payment categories

Transforming classification schemes or literal descriptions to CPV, expanding:

The MOLDEAS project Methods On Linked Data for E-procurement Applying

Semantics

39

Page 40: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

40

Page 41: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Reconciling Company names:the Forbes Global 2000

companies

Page 42: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Compatible Payment categories

Page 43: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Going global: AUSTRALIA

43

Page 44: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

the 5 stars of open linked data

★make your stuff available on the Web (whatever format)

★★make it available as structured data (e.g. excel instead of image scan of a table)

★★★non-proprietary format (e.g. csv instead of excel)

★★★★use URLs to identify things, so that people can point at your stuff★★★★★link your data to other people’s data to provide context

http://lab.linkeddata.deri.ie/2010/star-scheme-by-example/

Page 45: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Linked data = internet + http +

RDF

Page 46: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Linked Data Principles

1. Use URIs as names for things2. Use URIs so that people can

look up (dereference) those names.

3. When someone looks up a URI, provide useful information.

4. Include links to other URIs so that they can discover more things.

Page 47: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

Web as a database

• Linked Data makes the web exploitable as ONE GIANT HUGE GLOBAL DATABASE!

• Is there any query language like sql?SPARQL…

Page 48: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

What are we planning?

• LOD for the main economic activities (insurance, banking)

• Law for open data by default in ALL public organisations

• Open data education (open generation)

Page 49: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

References

o Vafopoulos, Michalis N., Rodríguez, Jose María Álvarez, Meimaris, Marios, Xidias, Ioannis, Klonaras, Michailis and Vafeiadis, Giorgos, Insights in Global Public Spending (May 12, 2013). Available at SSRN: http://ssrn.com/abstract=2264958 or http://dx.doi.org/10.2139/ssrn.2264958

o Vafopoulos, Michalis N., The Web Economy: Goods, Users, Models, and Policies (July 26, 2012). Michalis Vafopoulos (2012) "The Web Economy: Goods, Users, Models, and Policies", Foundations and Trends® in Web Science: Vol. 3: No 1-2, pp 1-136. http://dx.doi.org/10.1561/1800000015. Available at SSRN: http://ssrn.com/abstract=2117855

o ALVAREZ, J. and LABRA, J. 2012. Towards a pan-european e-procurement platform to aggregate, publish and search public procurement notices powered by Linked Open Data: the MOLDEAS approach. International Journal of Software Engineering and Knowledge Engineering. 22, 3 (2012), 365–383.

49

Page 50: 1. Michalis Vafopoulos NTUA  &   Data in a nutshell Open data workshop,

More info

• Twitter: @vafopoulos• [email protected]• www.Vafopoulos.org • www.publicspending.net • www.Youtube.com/websciencegr