the-benchmarker / website Goto Github PK

The page will displays all benchmark data from wrk.

Also possibly add other non-benchmark information like:

• GitHub star count
• Last commit
• Issues count
• etc.

(Maybe will integrate in compare page instead of creating new page?)

Please add https://foalts.org/ to Benchmark. Thank you.

Hi,

In json their is many ..._errors keys (http or socket based).

It could be accurate to add this information on UI.

The main question is how.

Regards,

PS : The errors are already remove from req/s in https://github.com/the-benchmarker/web-frameworks/blob/53cbf2e70a773ff82bae600e218192a012e01eab/.tasks/db.rake#L22

I'm planning to rewrite this application, with more refined UI and more features. For the rewrite, I will use React, Tailwind, and (possibly) ApexCharts.

Few things to do on the next version:

• Rewrite the app with Solid and Tailwind
• Create own data table component on React
• Remade the charts with ApexCharts.js
• Add CI/CD for deployment (GH Pages)

Some feature ideas that can be implemented:

• #19, we can use free service like Deta.sh for the backend, or rent a cheap $30 / year VPS for more control, requires the-benchmarker/web-frameworks#4236 to be resolved

If you have any suggestion about UI or features, feel free to leave them here.

When you look at the results, you don't immediately notice that the version number is in parentheses next to the name of the framework. This is confusing. It is clearer to write ditsmod v2.49 instead of ditsmod (2.49).

Hi,

Om homepage dropdown, we have date for historical points

but not from latest

I think we should display it.

Regards,

Please add support: https://trpc.io

The table here:
https://web-frameworks-benchmark.netlify.app/result?asc=1&metric=minimumLatency&order_by=level64
has negative results for some entries, which seems impossible to me, and is probably due to an overflow somewhere in the measurement program.

Just curious to see benchmark results of some javascript frameworks due to the supposed increase in performance when using bun.

Hi, please add max memory usage for all framework.

Hi @waghanza, I had an idea of showing old benchmark data.

How it works:

1. Get file history of data.min.json from https://api.github.com/repos/the-benchmarker/web-frameworks/commits?path=data.min.json
2. Get distinct commit date from the history, and show it as dropdown select on the website linked to the commit's sha
3. Fetch data based on the selected date using the commit's sha (e.g. https://raw.githubusercontent.com/the-benchmarker/web-frameworks/${sha}/data.min.json (You can use full SHA or first 7 characters of SHA for ${sha})

What do you think?

Include minimum / maximum / average latency and 50th / 75th / 90th / 99th / 99.999th percentile

For some reasons, nothing show up on the website when I selected "Spring":

Waiting for the-benchmarker/web-frameworks#4179 to be resolved

as current has no constrain what should response in http header, I suggest at least show throughput in results.

It would be helpful if your readme would contain a section about the benchmark scope.
In it's current state the scope is very minimal (it seems like the benchmark only benches a simple get request with no database connection or other meaningful backend work).
So I propose to either disclaim that no real world scenario is used, or explicitly state which scenarios you are benchmarking.

Thank you.

Hello. I didn't see Bitrix in the list

Hi @SuspiciousLookingOwl,

I think something like https://files.gitter.im/socketry/falcon/2qlu/image.png (only the blue line), will be accurate to add on UI.

I mean, it add a quick view to : what is the concurrency level for framework X where req/s is acceptable ?

The idea is to add resources consumption (when available).

Regards,

PS ; I also think https://rawgraphs.io/ could be a source of inspiration

https://web-frameworks-benchmark.netlify.app/compare?f=axum

Minor version bumps can also include performance improvements so it would be nice to see the full version number reflected in the test results.

Hi,

I can see that total requests are displayed on https://web-frameworks-benchmark.netlify.app/result by default.

I think req/s has more meaning.

Regards,

Hi there,

first of all, thank you so much for this detailed list of benchmarks.

Just curious to see benchmark results with laravel-octane using openswoole.

Thanks again.

The Iris is a Golang Framework with repository at here: https://github.com/kataras/iris
Please add it. Thank you so much

Below 2 pages shows the fastest list of the framework but both of them have extremely different results:

• https://web-frameworks-benchmark.netlify.app/result
• https://www.techempower.com/benchmarks/#section=data-r21&l=gctczi-64d ( Best fortunes responses per second, Dell R440 Xeon Gold + 10 GbE(216 tests) )

AdonisJS is a Rails-like JS/Typescript framework. I would be interested to see how it performs. Would you consider adding it to your list?

json send, database read.. etc

When in visit https://web-frameworks-benchmark.netlify.app/result. It's occur an error. And gives a white screen. I gave a screenshot for that-

Hi @SuspiciousLookingOwl,

Perhaps it is a good idea to sort result (by default). It could be a good idea to keep the same sorting as actual README, by req/s on 64 concurrency level.

Regards,

Is it possible to add node/deno/bun frameworks to the benchmark?

Here are some of the frameworks:

1. https://github.com/denosaurs/bench
2. https://github.com/SaltyAom/bun-http-framework-benchmark

hi
How can I use your data for myself and on my site? I need your database on my host.

thank you very much

Looking at the results of the web framework benchmark, I was very suspicious regarding the latencies.

The website states these are milliseconds (ms), but they looked more like microseconds (us or µs).

Looking at the wrk homepage confirmed it is microseconds, not milliseconds:
https://github.com/wg/wrk/blob/4.2.0/SCRIPTING#L96

So either the latency unit should be changed to us or µs or the value should by divided by 1000.

Hello, can you add ntex for Rust? Thanks!
https://github.com/ntex-rs/ntex

Hi,

I think it could be a very cool feature if we can create URLs with filter params.

For example, the URL https://web-frameworks-benchmark.netlify.app/result?language=crystal,ruby to filter results on crystal and ruby

Regards,

Add home page similar to the-benchmarker/web-frameworks readme

(As requested in the-benchmarker/web-frameworks#4194)