admb-project / benchmarks

Benchmark of ADMB 12.3 vs 13.0-beta

Benchmark: ADMB 12.3 vs 13.0-beta

10 Jul 2022

Revisiting the benchmark from May, building ADMB from the admb-13.0 branch (commit f6721274), updated in July.

The analysis of the July results indicates that for these examples, ADMB 13.0-beta still has a performance problem in Windows. See plot.

---

16 May 2022

Two modern laptops, Lenovo P15 Gen 1 (i7-10875H) and Dell Precision 3560 (i7-1165G7), each with a number of VMs. ADMB built from the 12.3 source and from the current admb-13.0 branch (commit 8820af06) with make -j8. The example models (catage and vol) are built using admb -f and then run as catage -mcmc 1e6 -mcsave 1e3 and nm2vol.

The analysis of the results indicates that for these examples, ADMB 13.0-beta is consistently and considerably slower than ADMB 12.3, around 20% slower in Linux and around 60% slower in Windows. See plot.

One would hope that ADMB 13.0 will be equally fast as previous versions - or at least not much slower.

This seems worth looking into before releasing 13.0.

Related: Link to recent SS3 benchmarks.