mneumann / argparse-benchmarks-rs

Collected benchmarks for arg parsing crates written in Rust

Rust Arg Parsing Benchmarks

This repo tries to assess Rust arg parsing performance.

We currently compare:

Name	Style	Notes
No-op	N/A	N/A
argh	derive
bpaf	Combinator
clap_lex	Imperative	No help generation
clap	Builder or derive	Color, suggested fixes, completions
gumdrop	derive
lexopt	Imperative	No help generation
pico-args	Imperative	No help generation
xflags	proc-macro

Note: any non-performanve comparison is meant to provide context for what you gain/lose with each crate's overhead. For a full comparison, see each parser docs

Results

Name	Overhead (release)	Build (debug)	Parse (release)	Invalid UTF-8	Downloads	Version
null	0 KiB	670ms	2ms	Y		-
argh	41 KiB	5s	3ms	N		v0.1.7
bpaf	162 KiB	1s	3ms	Y		v0.3.2
clap	572 KiB	6s	2ms	Y		v3.1.9
clap-minimal	537 KiB	5s	3ms	Y		v3.1.9
clap_derive	577 KiB	12s	2ms	Y		v3.1.9
clap_lex	39 KiB	1s	2ms	Y		v0.1.1
gumdrop	36 KiB	5s	2ms	N		v0.8.1
lexopt	39 KiB	898ms	2ms	Y		v0.2.0
pico-args	23 KiB	901ms	2ms	Y		v0.4.2
xflags	22 KiB	1s	2ms	Y		v0.2.4

Notes:

• Overhead will be lower if your application shares dependencies with your argument parsing library.

Running the Benchmarks

$ ./bench.py
$ ./format.py

To be included, the crate needs meet one of the following criteria:

• 10k+ recent downloads
• Unique API design

Special Thanks

• RazrFalcon for creating the initial benchmarks
• djc for inspiration with template-benchmarks-rs
• sharkdp for hyperfine