Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY...

16
Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Transcript of Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY...

Page 1: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

Analyze User Instructions, adapted from MVT

Bob SchwankeSiemens

WITH FUNDING SUPPORT

PROVIDED BY NATIONAL

INSTITUTE OF STANDARDS AND

TECHNOLOGY

Page 2: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

QI-Bench Overview

2222

Formulate

Statistical Analysis Results (Relation

strength)

Annotation and Image Markup,

Non-imaging Clinical Data

Primary Data: Images and other

Raw Data

Reference Data SetsQIBO

Specify

RDF Triple Store

CT Volumetry CT

obtained_by

Tumor growth

measure_of

TherapeuticEfficacy

used_for

Analyze

Y=β0..n+β1(QIB)+β2T+ eij

Execute

Feedbac k

Feed

bac

k

Page 3: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

BiomarkerDB.SummaryStatistic+ = Analyze ({ReferenceDataSet .CollectedValue});

33

Role Use Case Supported Now Gap vs. Model

Domain expert

Run and modify statistical analyses

Web App (thin) n/a Create the web app

Informaticist

Configure set of analysis scripts in toolbox

Desktop (thick)

Run relevant calculations at technical performance level

Persist statistical calculations results as N-ary relations in knowledge store, across larger data sets and at clinical level too

IT systems expert

Configure data input and output services

Server-sideConnects to (some)caGrid data services

Connect directly to RDSM and knowledge store (and through Formulate, broader set of data services)

Page 4: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

Load Cases and Run MVT (measurement variability tool)

Page 5: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

AIM output for selected case (from Batch Analysis Service)

Page 6: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

Choose Analysis Type (we’ll be adding new Types)

Page 7: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

Ground truth can be direct or indirect

Page 8: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

Deselect RECIST and WHO measurements

Choose Biomarker Measurements to Analyze (we’ll be adding Measurements)

Page 9: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

R Script for summary statistic

Some Methods exist; we will create new ones (e.g., factor analysis)

Page 10: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

Column per measurement

Columns for calculation according to the Methods

Page 11: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

Intra- and Inter-reader comparisons

Output of Analysis Type run (this example intra-reader)

Page 12: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

Inter-reader measurements

Output of Analysis Type run (this example inter-reader)

Page 13: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

… calculated

Additional outputs based on Methods

Page 14: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

Outliers list

Outlier Analysis with Drill-down is Supported (access to raw imagery)

Page 15: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

Configure plots as needed

Resulting plots – we’ll be adding plot types, e.g., box, radar, and K-M

Page 16: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY.

1616