Concern-driven Reporting of Software Performance Analysis ... · Asking "What"?, Automating the...

8
Untersuchung der Prozessgrenzen und Wärmeakkumulation bei der Präzisionsbear-beitung von Metall mit ultrakurz gepulster Laserstrahlung 10th ACM/SPEC Int. Conf. on Performance Engineering (ICPE 2019) Mumbai, India April 10, 2019 Concern-driven Reporting of Software Performance Analysis Results Dušan Okanović, André van Hoorn Christoph Zorn, Fabian Beck, Vincenzo Ferme, Jürgen Walter Work-in-progress/vision @andrevanhoorn

Transcript of Concern-driven Reporting of Software Performance Analysis ... · Asking "What"?, Automating the...

Page 1: Concern-driven Reporting of Software Performance Analysis ... · Asking "What"?, Automating the "How"?: The Vision of Declarative Performance Engineering. ICPE 2016: 91-94 Walter

Untersuchung der Prozessgrenzen und Wärmeakkumulationbei der Präzisionsbear-beitung von Metall mit ultrakurz gepulster Laserstrahlung

10th ACM/SPEC Int. Conf. on Performance Engineering (ICPE 2019)

Mumbai, India – April 10, 2019

Concern-driven Reporting of Software Performance Analysis Results

Dušan Okanović,

André van Hoorn

Christoph Zorn, Fabian Beck, Vincenzo Ferme, Jürgen Walter

Work-in-progress/vision

@andrevanhoorn

Page 2: Concern-driven Reporting of Software Performance Analysis ... · Asking "What"?, Automating the "How"?: The Vision of Declarative Performance Engineering. ICPE 2016: 91-94 Walter

Background: Performance Analysis Workflow

Okanovic, van Hoorn, et al. | Concern-driven Reporting of Software Performance Analysis Results 2

System

Real System

Performance Model

Stakeholder

Established Methods, Techniques, and Toolsfor Software Performance Engineering

What is the average

response time of the

system?

Performance

Concern

Performance

Analysis

Results

Page 3: Concern-driven Reporting of Software Performance Analysis ... · Asking "What"?, Automating the "How"?: The Vision of Declarative Performance Engineering. ICPE 2016: 91-94 Walter

Problem: Reporting Performance Analysis Results

Okanovic, van Hoorn, et al. | Concern-driven Reporting of Software Performance Analysis Results 3

Performance

Analysis

Results

Stakeholder

No

explanations

Mainly

charts and

tables No real

answer

No

explicit

concern

Page 4: Concern-driven Reporting of Software Performance Analysis ... · Asking "What"?, Automating the "How"?: The Vision of Declarative Performance Engineering. ICPE 2016: 91-94 Walter

Approach and Tool (PoC) – Concern-driven Reporting

5

VIZARD tool

Isaac et al., EuroVis 2014

“State of the Art of

Performance Visualization”

Asking “What?”,

automating the “How?”!

Walter et al., ICPE 2016

Page 5: Concern-driven Reporting of Software Performance Analysis ... · Asking "What"?, Automating the "How"?: The Vision of Declarative Performance Engineering. ICPE 2016: 91-94 Walter

Co

ncern

-dri

ven

VIZ

AR

DR

ep

ort

7https://github.com/DECLARE-Project/Vizard

Page 6: Concern-driven Reporting of Software Performance Analysis ... · Asking "What"?, Automating the "How"?: The Vision of Declarative Performance Engineering. ICPE 2016: 91-94 Walter

● Concern specification

● Mappping to other languages

(DQL, behavior-driven, …)

● Support for additional concerns

● Reporting

● Interactive analysis, e.g., chat bots

● Other types of reports, e.g., videos, VR

● Vizard Tool

● Integration with DPE tooling

● Evaluation

● User study

● Expert review

Okanovic, van Hoorn, et al. | Concern-driven Reporting of Software Performance Analysis Results 8

Summary

https://github.com/DECLARE-Project/Vizard

We have conducted a

preliminary pilot study

Does Vizard help

experts and/or (non-experts)?

Future Work

Page 7: Concern-driven Reporting of Software Performance Analysis ... · Asking "What"?, Automating the "How"?: The Vision of Declarative Performance Engineering. ICPE 2016: 91-94 Walter

References

Katherine E. Isaacs, Alfredo Giménez, Ilir Jusufi, Todd Gamblin, Abhinav Bhatele,

Martin Schulz, Bernd Hamann, Peer-Timo Bremer: State of the Art of Performance

Visualization. EuroVis (STARs) 2014

Jürgen Walter, André van Hoorn, Heiko Koziolek, Dusan Okanovic, Samuel Kounev:

Asking "What"?, Automating the "How"?: The Vision of Declarative Performance

Engineering. ICPE 2016: 91-94

Walter et al., ICPE 2016

Isaac et al., EuroVis 2014

Page 8: Concern-driven Reporting of Software Performance Analysis ... · Asking "What"?, Automating the "How"?: The Vision of Declarative Performance Engineering. ICPE 2016: 91-94 Walter

Untersuchung der Prozessgrenzen und Wärmeakkumulationbei der Präzisionsbear-beitung von Metall mit ultrakurz gepulster Laserstrahlung

10th ACM/SPEC Int. Conf. on Performance Engineering (ICPE 2019)

Mumbai, India – April 10, 2019

Concern-driven Reporting of Software Performance Analysis Results

Dušan Okanović,

André van Hoorn

Christoph Zorn, Fabian Beck, Vincenzo Ferme, Jürgen Walter

Work-in-progress/vision

@andrevanhoorn