BBN - GENI Project Office

ΔΙΑΧΕΙΡΙΣΗ ΔΙΚΤΥΩΝΕυφυείς Προγραμματιζόμενες Δικτυακές Υποδομές (IΙ)

Περιβάλλοντα Εξομοίωσης Προηγμένων Εικονικών Αρχιτεκτονικών

US GENI

Dr. Niky RigaBBN - GENI Project Office

[email protected]/

14/12/2015

mailto:[email protected]

http://www.netmode.ntua.gr/

U.S. National Science Foundation (NSF) GENI Testbeds

Global Environment for Networking Innovationshttp://www.geni.net/

2

http://www.geni.net/


Sponsored by the National Science Foundation

GENIExploring Networks of the Future

Niky Rigawww.geni.net



Credit: MONET Group at UIUC

Society IssuesWe increasingly rely on the Internet but are unsure we can trust its security, privacy

or resilience

Science IssuesWe cannot currently understand

or predict the behavior of complex,

large-scale networks

Innovation IssuesSubstantial barriers to

at-scale experimentation with new architectures, services, and

technologies

NTUA – Dec 14th 2015Sponsored by the National Science Foundation www.geni.net 4

Global networks creating important challenges




Global Environment for Network Innovations

GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.


Infra

stru

ctur

e fo

rE

xper

imen

tatio

n




Multiple GENI Experiments run Concurrently

Resources can be shared

between slices


Experiments live in isolated “slices”




GENI is “Deeply Programmable”

Install software throughout a network

slice or control switches using

OpenFlow

Experimenters can set up custom topologies, protocols and switching of flows





GENI is a Federation

Backbone #1

Regional

GENI Rack

GENIRack

Commercial Clouds

Corporate GENI suites

Non-US Testbeds

Research Testbed

Campus

My experiment runs across the evolving GENI federation.

My GENI SliceAccess

#1

GENI grows by GENI-enabling heterogeneous infrastructure


Separate administrative

domains

Common APIs for the user and

between domains

Ability to integrate technology not yet developed




“At scale” GENI prototype

Campus photo by Vonbloompasha

Build GENI at sufficient scale

Infeasible to build a testbed as big as the Internet

GENI-enabled campuses, students as early adopters

HP ProCurve 5400 Switch

NEC WiMAX Base Station

GENI-enabled equipment

GENI-enable testbeds, commercial equipment, campuses, regional and


backbone networks




GENI Network Architecture

GENI-enabled hardware

Legend

Layer 3 Control Plane

Layer 2 Data Plane

MetroResearch

Backbones

Internet ISP

Regional Networks

U N I V E R S I T Y

Campus/City

g

g

g

Spans campus/metro, regional, and nationwide networks

GENI relies on participants to contribute compute and network resources


Flexible network / cloud infrastructureIncludes VMs, SDN switches, WiMAX/LTE base stations and clients, L2 network access





Compute Resources

GENI Racks: small cloudsVirtual Machines Bare metal Machines

Android Phones

Wireless nodes

Network ResourcesLayer 2 VLANS and Access to Programmable Switches

Internet2: US Research Backbone

Regionals

Rack switches

WiMAX/LTEbase stations,

4G/3GNetwork

ORBIT

Emulab

Planetlab

Existing Testbeds

NTUA – Dec 14th 2015 www.geni.net 11




GENI racks – small clouds

Rick McGeerFewer resources / rack,

more racks

Rajesh Narayanan DELL

KC Wang Clemson Latest addition

Ilia Baldine RENCIMore resources / rack,fewer racks





GENI

Enabling a Campus

Rack

Campus Resources

GENIWireless

Suman Banerjee, PI

Parmesh Ramanathan, PI

Connectivity through MOXI

Regional

Dale W. Carter, Campus admin

Connection to local

community

Internet 2 PoP

GENI

To other GENI campuses





onsored by the National Science Fo

PNWGP

CENIC

ESNet

UCDOSF

Washington

Stanford

CENIC

CENICUCLA

NPS

UEN

UtahUtahDDC

Utah

Houston

LEARN TAMU

GPN

KanREN

MissouriKansas

UMKC

Colorado

WRN

FRGP

Northwestern

Illinois

StarLight Kettering

CIC

ICCN

ESNet

Chicago

Wisconsin

OARNet

OHMDC

OneCommunity

CASE

WVNET

MERIT WSU

CAAREN GWU

WVNMOXI

BEN

NCSURENCI

MAX

MAX

MAGPI

Rutgers

Princeton

NYSERNet

NoX

GPONYSERNet

Cornell

NYU

SOXPeachNet

CenturyLinkMOXI

EPB

UTC

Clemson

SOX

GATech

FLR

FIUUFL

STANFORDCOLORADO

MICHIGAN UMASS

KyRONKentucky

UKYPKS2

InstaGENI Rack

ExoGENI Rack

IG E GOGCG

OpenGENI Rack

Regional Network

Campus Network

W iMAX/LTEAdvanced Layer2 Service POP

GENI’s footprint

NTUA – Dec 14th 2015Sp CiscoGENI Rack undation www.geni.net 14




GENI Network Map





GENI on Internet2

• Collaboration to implement national-scale infrastructure– sliced and deeply-programmable– incorporating OpenFlow/SDN switches, GENI Racks, etc.– high-speed (10-100 Gbps)

• Internet2 provides dynamic link provisioning to GENI experimenters– Uses AL2S (Advanced Layer 2 Services)

• Experimenters can run OpenFlow controllers in AL2S





GENI Operations

GMOC: GENI Meta-operation Center• Keeps track of outages• Notification system for resource reservation• Monitors most GENI Aggregates• Coordinates LLR Requests

– Legal Law Enforcement & Regulatory

• Handles Emergency StopGENI Monitoring Portal developed by UKY

https://mail1.grnoc.iu.edu/mailman/listinfo/experimenter-ops





GENI Stitching

• Setup point-to-point VLANs– Between hosts on different Ams

• One host/per AM/per stitch– Not a broadcast domain

• Dynamic, real-time setup– Need to coordinate multiple

AMs– Takes time– Can fail

A common concept used in other networks, applied to GENI, e.g. OSCARS, GLIF

GENI RAC K A

GENI RAC K B

Backbone

GENI RAC K B

Regio nal 1

Regio nal 3

Regio nal 2





17NTUA – Dec 14th 2015 www.geni.net

How does GENI Stitching Work?

1. Rack Configuration (network admins)• Long process (~weeks, months)• Done once in advance• Manual

2. Inter-aggregate link reservations (experimenters)• Automated (tools can make them)• Quickish (usually a few minutes)

Sponsored•by theLNiavtioena,l SEcieancse

yFoundation

GENI Stitching: Under the Hood




www.geni.net

18

Finding a workable path, and the right reservation order can be hard.

• Stitching Computation Service (SCS) for path and workflow computation– Tom Lehman and Xi Yang wrote this optional service– Includes many heuristics to optimize path, chance of success– Allows excluding particular connection points, VLANs

• Other tools may use different heuristics– Stitcher uses the SCS

https://wiki.maxgigapop.net/twiki/bin/view/GENI/NetworkStitchingAPI

ION

Stitching Computation Service

NTUA – Dec 14th 2015Sponsored by the National Science Foundation


Tool

7. Manifest Back

Automated by the tool

1. Simple Request

Experimenter: Creating a Circuit

Over 16,000 stitched slivers since November, 2013





GENI’s International Collaborations

nd

Layer 2 Data Plane

GENI-enabled hardware

Layer 3

Lege Control Plane

Metro

Research Backbones

Internet I

S P

Regional NetworksCampus

g

g

g

GENI is working actively with peer efforts on five continents to define and adopt common concepts and APIs.





GENI – FIRE Federation

50 VLANS


50 Vlans between I2 PoP@ NY and iMinds• use stitching with FIRE or GENI account• look for the demo on Tuesday evening





NTUA – Dec 14th 2015www.geni.net 22

Universities

GENI Use By Numbers

4300Users

2600Students trained onGENI by

Countries

45Different

instructors

Experiments instantiated

100,000+

200+publications

PNWGP

CENIC

ESNet

OSF

Washington

StanUfoCDrd

CENIC

ENC IC

UCLA

UEN

NPS Utah

UtahDDC

Utah

Houston

LEARN TAMU

GPN

KanREN

Kansas

Colorado

WRN

StarLight

CIC

KetteringESNet

Wisconsin

OARNetUMKC

OHMDC

ICCN

Chicago Northwestern

CASE OneCommunity

MEWRSU

IT

MOXIWVN

BEN

NCSU

MAX

WVNET

CAAREN GWU MAX

MAGPI Princeton

GPONYSERNet

Cornell

NoX NYU

Rutgers NYSERNet

SOX

CenturyLink

Missouri RENCI

MOXI

EPB

Illinois UTC

Clemson

SOX

GATech

FLR

FIUUFL

STANFORD

FRGPCOLORADO

MICHIGANUMASS

KyRONKentucky

UKYPKS2 PeachNet


FIA Teams have Slices on GENI

Named Data Networking


eXpressive Internet Architecture

ChoiceNet

Mobility First

GENI is a unique testbed that can support these teams.




On-time weather Forecasting using dynamic

CyberInfrastructure

Mike Zink Umass Amherst


Program your network and place computation and storage where it makes a difference

Place computation in the network

Dynamically adjust paths cross domains using SDN to ensure performance




TransGeo Distributed Clouds:Think Globally, Compute Locally

Federation fosters International Collaborations

Yvonne CoadyU. VictoriaCanada

Rob RicciU. Utah

US

Joe Mambertti Northwestern

USJulio Ibarra

FIU, US

Michael Stanton USP, Brazil

Rick McGeer HP, US

Aki NakaoU. TokyoJapan

Paul MuellerU. Kaiserslautern

Germany

Piet Demeester Ughent

Belgium

Compute “green index”

for cities worldwide





Factory of the FutureAdvanced Manufacturing App Marketplace

Enable small companies to innovate and build new business models

Simulation as a Service

Combine clouds with high performance

computing and gigabit network





Parmesh RamanathanU. Wisconsin

KC WangU. Clemson

Users can view and source live streamsNTUA – Dec 14th 2015Sponsored by the National Science Foundation www.geni.net 29

GENI Cinema: Persistent live video streaming




On-time Emergency Response

Local Cloud Computing

Ubiquitous Wireless Access

Advanced network capabilities

Suman Banerjee University of Wisconsin





How to run an experiment

DEMO ANDHANDS-ON





GENI: Terms and Definitions

SliceAbstraction for an experiment

Isolate experiments

Have expiration

Experimenters are responsible for their slices






SliverOne or more resources provided by an aggregateBare machines, virtual machines, VLANs, etc

Backbone #1

Backbone #2

Campus#3 Commercial

Clouds

Corporate GENI suites

Other-Nation Projects

Research Testbed

Campus My GENI SliceAccess

#1

My slice contains slivers from many aggregates.

Resources have expirations, generally different from slice or from each other!





ProjectsOrganize research in GENI

Projects contain both people and their experimentsProject Lead is a single responsible individual

Project

LeadMembers

Slice


To access GENI Resources you need to be a member of a project!





Slice credentials

– Standard credentials shared via custom API or new Common CH API– GENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENI

CH• Aggregate: Provides resources to GENI experimenters

– Typically owned and managed by an organization– Speaks the GENI AM API– Examples: PlanetLab, Emulab, GENI Racks on various campuses

Create & Register Slice

Researcher

Aggregate Manager API

- listResources- createSliver…

• Clearinghouse: Manages users, projects and slicesAggregate Manager

Aggregate Resources

users

slices

clearinghouse

projects

Tool






GENI User Authentication

For many experimenters:• no new passwords• familiar login screens

The GENI Portal leverages InCommon for single sign-on authentication

Experimenters from 304 educational and research institutions have InCommon accounts

GENI Project Office runs a federated IdP toprovide accounts for non-federated organizations.





RSpecs Lingua franca for describing and requesting resources

– “Machine language” for negotiating resources between experiment and aggregate

– Experimenter tools eliminate the need for most experimenters to write or read RSpec

<?xml version="1.0" encoding="UTF-8"?><rspec xmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi

="http://www.w3.org/2001/XMLSchema-instance"xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2

http://www.protogeni.net/resources/rspec/2/request.xsd

"type="request" ><node client_id="my-node” exclusive="true">

<sliver_type name="raw-pc" /></node>


</rspec> RSpec for requesting a single node


http://www.protogeni.net/resources/rspec/2


http://www.w3.org/2001/XMLSchema-instance







Reserving Resources using RSpecs and the AM API

Aggregate Manager

Exp

erim

ente

rTo

ol

ListResources(…)

Advertisement RSpec

CreateSliver(Request RSpec, …)

Manifest RSpec

ListResources(SliceName, …)

Manifest RSpec

Experimenter tools and aggregates talk to each other using resource specifications (RSpecs) and the GENI Aggregate Manager API (GENI AM API)• Advertisement RSpec: What does an aggregate have?• Request RSpec: What does the experimenter want?

• Manifest RSpec: What dWoehsatthdeoexperimenter have?

you have?I have …

I wouldlike …

You have…What do I

have?You have


…




Demo: Putting it all Together

Login to the GENI Portal Create a sliceCreate a sliver at one aggregate

Two computers (VMs), connected by a LAN

Install software on the machines

Generate traffic View results

Delete sliver





BBN - GENI Project Office

Documents

Transcript of BBN - GENI Project Office