Skip to content

Latest commit

 

History

History
25 lines (14 loc) · 1.25 KB

File metadata and controls

25 lines (14 loc) · 1.25 KB

Mastering Uncertainty in Performance Estimations of Configurable Software Systems

RQ1 & RQ2: MAPE Comparison

We compare our approach vs. SPL Conquerer, a state-of-the-art approach, in terms of point-estimate accuracy (soli lines). We also consider the accuracy when we use confidence intervals as predictions (dotted lines)

MAPE Comparison Only Relative Errors [PDF] [PNG]

This plot compares our approach when using a model with relative error with SPL Conquerer. For our approach, the plot illustrates the MAPE for the point estimate and for 95%-confidence and 50%-confidence intervals.

MAPE comparison

MAPE Comparison With Absolute Error Models [PDF] [PNG] [PDF-LARGE]

mape-abs-rel-enlarged For comparison, we provide a plot that, in addition to the plot above, also includes approach when absolute errors are modeled (orange).

MAPE comparison