BENCHMARKS.md

Algorithm Benchmarks

Last updated: Mon, 16 Sep 2024 00:58:39 GMT

Solver	Ranking	Avg Correctness	Avg Time/Sample
multilayer-ijump	1	80.00%	4.09ms
infgrid-ijump-astar-multimargin	2	66.50%	1.51ms
infgrid-ijump-astar	3	59.00%	0.24ms
jump-point-grid	4	54.00%	17.46ms
simple-grid	5	52.50%	37.68ms
gridless-poi	6	26.50%	2.45ms
infgrid-astar	7	26.25%	40.51ms

simple-grid

Problem Type	Samples Run	Completion	Average Time
single-trace	100	93.00%	2.19ms
traces	100	27.00%	4.45ms
distant-single-trace	100	89.00%	143.63ms
keyboards	100	1.00%	0.47ms

gridless-poi

Problem Type	Samples Run	Completion	Average Time
single-trace	100	49.00%	3.59ms
traces	100	3.00%	1.70ms
distant-single-trace	100	53.00%	3.55ms
keyboards	100	1.00%	0.95ms

infgrid-astar

Problem Type	Samples Run	Completion	Average Time
single-trace	100	58.00%	4.90ms
traces	100	2.00%	13.19ms
distant-single-trace	100	44.00%	143.90ms
keyboards	100	1.00%	0.04ms

infgrid-ijump-astar

Problem Type	Samples Run	Completion	Average Time
single-trace	100	98.00%	0.28ms
traces	100	38.00%	0.38ms
distant-single-trace	100	97.00%	0.17ms
keyboards	100	3.00%	0.14ms

infgrid-ijump-astar-multimargin

Problem Type	Samples Run	Completion	Average Time
single-trace	100	100.00%	0.89ms
traces	100	61.00%	2.05ms
distant-single-trace	100	100.00%	0.60ms
keyboards	100	5.00%	2.51ms

jump-point-grid

Problem Type	Samples Run	Completion	Average Time
single-trace	100	95.00%	1.92ms
traces	100	25.00%	3.35ms
distant-single-trace	100	95.00%	64.09ms
keyboards	100	1.00%	0.47ms

multilayer-ijump

Problem Type	Samples Run	Completion	Average Time
single-trace	100	100.00%	1.48ms
traces	100	77.00%	2.68ms
distant-single-trace	100	100.00%	0.89ms
keyboards	100	43.00%	11.30ms