xiamingwudi / go-plugin-benchmark

Benchmark comparing the go plugin package to other plugin implementations

Golang Plugin Benchmark

A comparison of the go plugin package and other plugin implementations for golang. The reason for this is to evaluate plugin options for Beubo which is a CMS written in go. As shown in a previous benchmark there is basically no difference in performance of using go plugins to running a function directly in code.

The following packages have been benchmarked.

• go plugin package
• hashicorp/go-plugin
• natefinch/pie
• dullgiulio/pingo
• elliotmr/plug
• traefik/yaegi

Several of the other packages use RPC or similar methods instead of the go plugin package which gets around issues such as, but not limited to, not being compatible with Windows and package paths and GOPATH needing to be the same between apps and plugins.

With the addition of Yaegi, I am also benchmarking interpreters.

Do you know any other plugin packages? Please open an issue or pull request.

Found an issue with a benchmark? Please open an issue or pull request.

Results

Most plugins tested are using RPC which adds about 30 - 50 microseconds to plugin calls (or 0.03 - 0.05 milliseconds) over the golang plugin package.

Benchmarks

Name	Operations	ns/op
go plugin package	87296470	13.50 ns/op
hashicorp/go-plugin	26695	44913 ns/op
natefinch/pie	32142	37148 ns/op
dullgiulio/pingo over tcp	21369	56459 ns/op
dullgiulio/pingo over unix	30313	38929 ns/op
elliotmr/plug	100197	12196 ns/op
traefik/yaegi	1447602	898.2 ns/op

Last run on January 15th, 2022 with Go version 1.17.6. Benchmark performed on a MacBook Pro (15-inch, 2018) with a 2,9 GHz 6-Core Intel Core i9 processor and 32 GB 2400 MHz DDR4 ram.

% bash ./run.sh
goos: darwin
goarch: amd64
pkg: github.com/uberswe/go-plugin-benchmark
cpu: Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
BenchmarkPluginRandInt/golang-plugin-12         87296470                13.50 ns/op
BenchmarkHashicorpGoPluginRandInt/hashicorp-go-plugin-12                   26695             44913 ns/op
BenchmarkPieRandInt/pie-12                                                 32142             37148 ns/op
BenchmarkPingoTcpRandInt/pingo-tcp-12                                      21369             56459 ns/op
BenchmarkPingoTcpRandInt/pingo-unix-12                                     30313             38929 ns/op
BenchmarkPlugRandInt/plug-12                                              100197             12196 ns/op
BenchmarkYaegiRandInt/yaegi-12                                           1447602               898.2 ns/op
PASS
ok      github.com/uberswe/go-plugin-benchmark  12.279s

Contributing

If you have a plugin or interpreter written in go which you would like to benchmark feel free to open an issue.

Would you like to add more benchmarks? Please feel free to fork this repository and open a pull request with the updated changes. Please make sure to add any needed code and also update the Readme. Your code belongs to you but it must fall under the same LICENSE as this repository to be included.